-- Logs begin at Wed 2022-10-19 05:56:19 UTC, end at Wed 2022-10-19 08:10:43 UTC. -- Oct 19 06:38:43.880851 n-d-861333-10 systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 06:38:43.888171 n-d-861333-10 devstack@n-api.service[111669]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 06:38:43 2022] *** Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: nodename: n-d-861333-10 Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: machine: x86_64 Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: clock source: unix Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: pcre jit disabled Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: detected number of CPU cores: 4 Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: current working directory: / Oct 19 06:38:43.890855 n-d-861333-10 devstack@n-api.service[111669]: detected binary path: /usr/bin/uwsgi-core Oct 19 06:38:43.891563 n-d-861333-10 devstack@n-api.service[111669]: your processes number limit is 47680 Oct 19 06:38:43.891563 n-d-861333-10 devstack@n-api.service[111669]: your memory page size is 4096 bytes Oct 19 06:38:43.891563 n-d-861333-10 devstack@n-api.service[111669]: detected max file descriptor number: 2048 Oct 19 06:38:43.891563 n-d-861333-10 devstack@n-api.service[111669]: lock engine: pthread robust mutexes Oct 19 06:38:43.891563 n-d-861333-10 devstack@n-api.service[111669]: thunder lock: enabled Oct 19 06:38:43.891563 n-d-861333-10 devstack@n-api.service[111669]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 06:38:43.891563 n-d-861333-10 devstack@n-api.service[111669]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 06:38:43.930852 n-d-861333-10 devstack@n-api.service[111669]: Python main interpreter initialized at 0x55c97ac6f9c0 Oct 19 06:38:43.930852 n-d-861333-10 devstack@n-api.service[111669]: python threads support enabled Oct 19 06:38:43.930852 n-d-861333-10 devstack@n-api.service[111669]: your server socket listen backlog is limited to 100 connections Oct 19 06:38:43.930852 n-d-861333-10 devstack@n-api.service[111669]: your mercy for graceful operations on workers is 90 seconds Oct 19 06:38:43.931256 n-d-861333-10 devstack@n-api.service[111669]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 06:38:43.931332 n-d-861333-10 devstack@n-api.service[111669]: *** Operational MODE: preforking *** Oct 19 06:38:43.931558 n-d-861333-10 devstack@n-api.service[111669]: *** uWSGI is running in multiple interpreter mode *** Oct 19 06:38:43.931558 n-d-861333-10 devstack@n-api.service[111669]: spawned uWSGI master process (pid: 111669) Oct 19 06:38:43.931765 n-d-861333-10 systemd[1]: Started Devstack devstack@n-api.service. Oct 19 06:38:43.936634 n-d-861333-10 devstack@n-api.service[111669]: spawned uWSGI worker 1 (pid: 111670, cores: 1) Oct 19 06:38:43.936634 n-d-861333-10 devstack@n-api.service[111669]: spawned uWSGI worker 2 (pid: 111671, cores: 1) Oct 19 06:38:43.936634 n-d-861333-10 devstack@n-api.service[111669]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 06:38:44.584592 n-d-861333-10 devstack@n-api.service[111671]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 06:38:44.586265 n-d-861333-10 devstack@n-api.service[111670]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 06:38:45.654646 n-d-861333-10 devstack@n-api.service[111671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 06:38:45.654646 n-d-861333-10 devstack@n-api.service[111671]: from cryptography.utils import int_from_bytes Oct 19 06:38:45.655823 n-d-861333-10 devstack@n-api.service[111671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 06:38:45.655823 n-d-861333-10 devstack@n-api.service[111671]: from cryptography.utils import int_from_bytes Oct 19 06:38:45.659176 n-d-861333-10 devstack@n-api.service[111670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 06:38:45.659176 n-d-861333-10 devstack@n-api.service[111670]: from cryptography.utils import int_from_bytes Oct 19 06:38:45.659602 n-d-861333-10 devstack@n-api.service[111670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 06:38:45.659602 n-d-861333-10 devstack@n-api.service[111670]: from cryptography.utils import int_from_bytes Oct 19 06:38:48.096678 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 06:38:48.097276 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 06:38:48.097455 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 06:38:48.097809 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 06:38:48.098055 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 06:38:48.098432 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.098751 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.098834 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 06:38:48.099194 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.099281 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 06:38:48.099354 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.099614 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 06:38:48.099740 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.099966 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.100061 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 06:38:48.100228 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 06:38:48.106407 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.106407 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.106561 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.106634 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.106706 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.106772 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.106842 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.106907 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.106979 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107057 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861333-10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107135 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107201 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107271 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107345 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107420 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107486 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107556 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107621 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107685 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107757 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107822 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107886 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.107949 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.108018 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.108092 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861333-10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.108092 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.108602 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.108700 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.108778 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.108904 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.108996 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.109082 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.109167 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.109300 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.109430 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.109568 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.109657 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.109735 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.109866 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.109949 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110036 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110123 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110203 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110334 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110417 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110494 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110617 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110709 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110795 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861333-10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110880 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.110958 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111049 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111142 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111275 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111357 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111434 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111434 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111589 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111668 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111745 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111745 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111899 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861333-10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.111978 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112068 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112178 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112260 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112343 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112422 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112498 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112576 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112676 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112823 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112905 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.112982 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113058 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113136 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113223 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113301 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113426 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113514 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113639 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113731 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113820 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113888 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.113964 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114046 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114130 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114221 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114307 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114392 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114471 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114555 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114633 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114758 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.114875 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.115076 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.115192 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.115379 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.115477 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.115674 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.115808 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.115897 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.115978 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.116231 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.116347 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.116552 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.116640 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.116871 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.116966 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.117176 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.117263 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.117497 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.117658 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.117791 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.117929 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.118089 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.118233 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.118368 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.118505 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.118648 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.118870 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.119009 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.119144 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.119278 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.119366 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.119537 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.119633 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.119804 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.119891 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.120152 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.120241 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.120439 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.120539 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.120748 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.120842 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.121049 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.121141 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.121359 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.121453 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.121677 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.121763 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.121979 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.122066 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.122290 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.122385 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.122606 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.122692 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.122909 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.123003 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.123209 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.123296 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.124029 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.124149 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.124368 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.124459 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.124684 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.124771 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.124977 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.125071 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.125223 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.125309 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.125563 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.125650 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.125872 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.125970 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.126182 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.126269 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.126485 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.126573 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.126788 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.126875 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.127092 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.127186 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.127345 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.127430 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.127646 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.127737 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.127953 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.128049 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.128291 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.128378 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.128593 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.128688 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.128894 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.128994 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.129195 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.129280 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.129491 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.129617 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.129792 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.129886 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.130089 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.130174 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.130385 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.130478 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.130688 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.130789 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.130996 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.131090 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.131294 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.131385 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.131594 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.131683 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.131891 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.131985 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.132212 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.132301 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.132515 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.132603 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.132811 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.132903 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.133113 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.133201 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.133423 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.133509 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.133719 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.133807 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.134016 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.134104 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.134317 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.134403 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.134615 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.134710 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.134916 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.135002 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.135218 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.135304 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.135509 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.135594 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.135809 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.135910 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.136130 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.136228 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.136430 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.136516 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.136729 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.136814 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.137025 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.137112 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.137320 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.137406 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.137615 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.137715 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.137916 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.138014 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.138210 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.138295 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.138506 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.138602 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.138800 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.138886 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.139140 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.139748 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.139955 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.140055 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.140282 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.140369 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.140587 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.140676 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.140888 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.140983 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.141188 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.141274 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.141485 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.141620 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.141800 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.141896 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.142119 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.142206 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.142423 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.142516 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.142729 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.142823 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.143030 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.143160 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.143345 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:38:48.143431 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.143676 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.143764 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.143993 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.144085 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.144340 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.144427 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.144649 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.144738 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.144955 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.145042 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.145261 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.145355 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.145576 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.145670 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.145889 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.145973 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.146206 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.146381 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.146510 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.146599 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.146819 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.146921 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.147126 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.147225 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.147429 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.147514 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.147745 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.147833 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.148063 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.148216 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.148401 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.148485 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.148708 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.148794 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.149018 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.149115 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.149337 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.149422 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.149647 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.149732 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.149966 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.150060 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.150278 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.150362 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.150584 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.150677 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.150889 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.150977 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.151194 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.151278 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.151527 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.151621 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.151837 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.151927 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.152173 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.152274 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.152489 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.152585 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.152797 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.152882 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.153105 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.153229 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.153413 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.153498 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.153717 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.153805 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.154026 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.154113 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.154334 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.154429 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.154637 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.154724 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.154972 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.155056 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.155281 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.155378 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.155592 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.155676 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.155898 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.155989 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.156236 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.156372 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.156547 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.156648 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.156853 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.156969 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.157164 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.157262 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.157473 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.157570 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.157775 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.157861 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.158083 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.158179 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.158388 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.158482 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.158694 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.158793 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.158995 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.159082 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.159304 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.159388 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.159619 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.159704 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.159919 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.160005 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.160249 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.160392 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.160552 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.160695 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.160844 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.160985 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.161149 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.161286 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.161454 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.161588 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.161756 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.161894 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.162066 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.162198 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.162373 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.162514 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.162674 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.162806 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.162981 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.163111 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.163283 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.163424 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.163584 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.163715 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.163885 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.164016 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.164213 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.164356 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.164521 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.164661 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.164825 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.164955 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.165129 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.165274 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.165437 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.165575 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.165740 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.165879 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.166024 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.166159 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.166348 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.166458 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.166652 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.166753 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.166957 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.167045 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.167263 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.167363 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.167576 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.167673 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.167881 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.167978 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.168211 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.168299 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.168537 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.168623 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.168849 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.168946 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.169146 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.169241 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.169450 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.169546 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.169751 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.169839 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.170049 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.170153 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.170369 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.170477 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.170672 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.170760 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.170970 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.171065 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.171268 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.171365 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.171566 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.171653 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.171870 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.172029 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.172189 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.172331 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.172468 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.172604 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.172777 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.172910 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.173059 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.173193 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.173359 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.173492 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.173659 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.173791 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.173962 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.174102 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.174246 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.174382 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.174568 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.174700 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.174874 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.175014 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.175174 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.175313 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.175475 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.175620 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.175765 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.175912 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.176098 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.176250 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.176440 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.176602 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.176735 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.176878 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.177020 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.177158 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.177310 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.177405 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.177618 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.177705 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.177925 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.178020 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.178245 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.178340 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.178550 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.178636 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.178868 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.178954 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.179174 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.179273 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.179482 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.179567 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.179780 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.179875 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.180090 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.180217 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.180431 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.180528 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.180738 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.180824 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.181057 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.181143 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.181362 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.181449 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.181672 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.181757 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.181977 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.182062 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.182280 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.182366 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.182590 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.182675 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.182898 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.182986 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.183206 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.183292 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.183520 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.183605 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.183828 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.183963 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.184158 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.184246 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.184464 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.184564 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.184773 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.184858 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.185075 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.185159 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.185383 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.185477 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.185683 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.185768 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.186513 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.186644 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.186832 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.186927 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.187143 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.187229 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.187451 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.187535 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.187760 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.187853 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.188072 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.188187 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.188399 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.188483 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.188707 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.188794 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.189013 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.189106 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.189314 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.189400 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.189614 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.189702 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.189918 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.190011 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.190228 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.190314 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.190534 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.190633 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.190837 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.190923 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.191136 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.191221 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.191438 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.191535 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.191740 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.191826 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.192040 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.192276 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.192362 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.192440 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.192665 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.192753 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.192981 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.193076 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.193289 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.193375 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.193607 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.193694 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.193913 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.194053 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.194211 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.194296 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.194510 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.194602 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.194824 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.194924 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.195124 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.195216 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.195426 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.195523 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.195727 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.195822 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.196027 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.196133 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.196387 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.196485 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.196689 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.196770 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.196988 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.197072 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.197299 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.197385 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.197600 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.197687 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.197902 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.197986 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.198202 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.198286 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.198508 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.198594 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.198810 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.198895 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.199127 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.199221 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.199437 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.199524 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.199743 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.199878 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.200047 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.200178 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.200379 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.200467 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.200686 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.200774 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.200991 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.201085 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.201308 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.201418 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.201669 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.201829 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.202016 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.202168 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.202303 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.202422 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.202570 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.202657 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.202876 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.202980 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.203183 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.203269 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.203758 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.203994 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.204218 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.204352 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.204448 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.204667 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.204754 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.204974 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.205066 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.205285 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.205380 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.205601 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.205701 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.205925 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.206163 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.206258 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.206506 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.206608 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.206825 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.206949 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.207128 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.207400 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.207491 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.207717 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.207826 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.208028 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.208233 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.208399 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.208554 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.208695 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.208832 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.208968 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.209104 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.209248 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.209396 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.209535 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.209674 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.209812 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.209949 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.210086 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.210241 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.210381 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.210518 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.210674 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.210884 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.211037 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.211185 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.211322 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.211459 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.211596 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.211734 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.211880 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.212020 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.212188 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.212329 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.212465 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.212602 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.212751 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.212890 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.213027 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.213165 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.213325 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.213460 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.213628 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.213761 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.213962 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.214094 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.214286 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.214382 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.214626 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.214714 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.214928 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.215014 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.215229 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.215323 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.215536 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.215623 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.215837 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.215923 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.216167 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.216270 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.216472 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.216558 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.216778 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.216889 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.217085 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.217176 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.217904 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.217992 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.218214 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.218301 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.218525 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.218613 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.218831 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.218917 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.219141 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.219227 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.219442 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.219528 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.219748 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.219832 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.220048 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.220181 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.220378 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.220464 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.220685 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.220770 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.220986 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.221099 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.221285 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.221371 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.221590 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.221682 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.221891 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.222055 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.222193 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.222286 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.222494 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.222578 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.222791 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.222885 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.223102 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.223187 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.223399 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.223487 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.223700 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.223795 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.224000 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.224093 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.224333 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.224429 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.224638 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.224738 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.224938 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.225024 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.225255 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.225342 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.225564 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.225652 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.225866 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.225951 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.226166 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.226253 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.226466 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.226590 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.226765 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.226885 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.227065 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.227180 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.227366 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.227481 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.227682 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.227802 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.227992 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.228127 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.228316 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.228437 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.228617 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.228731 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.228918 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.229044 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.229218 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.229330 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.229514 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.229627 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.229820 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.229940 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.230117 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.230229 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.230415 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.230531 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.230740 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.230872 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.231506 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.231595 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.231675 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.231753 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.231753 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.231897 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.231964 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.232027 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.232200 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.232312 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.232500 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.232601 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.232798 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.233491 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.233655 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.233754 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.233960 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.234047 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.234266 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.234363 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.234587 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.234683 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.234895 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.234991 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.235199 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.235287 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.235504 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.235600 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.235808 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.235904 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.236160 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.236262 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.236437 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.236525 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.236747 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.236833 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.237055 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.237141 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.237363 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.237452 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.237664 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.237758 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.237963 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.238050 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.238279 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.238375 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.238589 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.238673 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.238892 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.238978 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.239206 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.239295 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.239521 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.239605 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.239829 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.239923 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.240146 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.240234 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.240449 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.240533 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.240755 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.240862 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.241060 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.241147 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.241368 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.241453 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.241672 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.241771 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.241981 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.242068 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.242295 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.242418 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.242596 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.242710 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.242901 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.242999 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.243209 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.243306 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.243506 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.243626 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.243812 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.243922 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.244161 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.244257 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.244436 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.244531 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.244750 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.244838 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.245051 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.245138 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.245352 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.245441 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.245655 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.245742 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.245956 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.246042 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.246263 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.246350 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.246561 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.246645 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.246862 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.246985 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.247185 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.247295 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.247492 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.247605 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.247797 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.247898 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.248122 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.248212 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.248430 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.248558 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.248765 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.248861 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.249069 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.249156 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.249428 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.249513 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.249798 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.249896 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.250111 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.250205 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.250417 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.250504 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.250723 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.250890 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.251024 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.251111 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.251323 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.251409 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.251631 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.251719 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.251932 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.252018 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.252262 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.252364 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.252567 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.252676 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.252863 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.252973 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.253179 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.253287 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.253478 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.253593 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.253792 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.253924 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.254196 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.254317 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.254499 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.254592 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.254801 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.254889 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.255102 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.255195 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.255407 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.255493 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.255728 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.255816 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.256033 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.256150 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.256380 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.256473 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.256724 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.256861 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.257028 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.257141 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.257337 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.257439 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.257640 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.257784 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.257957 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.258095 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.258275 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.258404 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.258583 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.258727 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.258895 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.259050 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.259195 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.259379 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.259512 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.259684 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.259827 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.259997 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.260153 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.260329 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.260472 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.260653 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.260879 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.260975 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.261197 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.261287 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.261504 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.261589 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.261819 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.261904 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.262137 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.262262 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.262437 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.262524 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.262739 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.262837 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.263041 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.263130 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.263341 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.263476 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.263639 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.263801 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.263955 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.264176 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.264299 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.264501 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.264603 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.264827 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.264915 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.265134 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.265222 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.265440 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.265526 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.265748 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.265837 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.266054 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.266147 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.266349 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.266435 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.266665 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.266760 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.266967 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.267052 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.267279 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.267379 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.267592 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.267677 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.267892 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.267990 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.268216 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.268317 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.268521 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.268608 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.268816 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.268901 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.269120 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.269215 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.269420 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.269507 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.269741 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.269833 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.270040 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.270135 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.270354 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.270451 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.270659 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.270745 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.270981 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.271069 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.271284 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.271376 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.271585 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.271670 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.271889 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.271983 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.272221 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.272362 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.272536 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.272621 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.272849 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.272955 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.273162 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.273248 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.273458 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.273552 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.273755 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.273841 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.274058 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.274145 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.274357 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.274452 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.274657 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.274753 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.274956 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.275042 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.275257 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.275356 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.275555 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.275641 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.275853 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.275939 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.276170 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.276273 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.276489 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.276576 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.276787 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.276886 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.277101 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.277190 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.277401 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.277485 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.277696 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.277790 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.277995 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.278090 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.278292 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.278379 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.278590 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.278674 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.278891 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.278978 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.279211 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.279297 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.279511 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.279596 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.280369 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.280468 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.280676 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.280763 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.280983 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.281078 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.281285 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.281379 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.281587 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.281675 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.281896 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.281995 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.282208 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.282295 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.282518 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.282603 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.282838 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.282986 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.283136 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.283223 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.283446 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.283539 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.283757 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.283852 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.284072 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.284304 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.284395 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.284632 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.284727 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.284941 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.285029 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.285250 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.285337 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.285559 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.285654 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.285869 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.285963 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.286178 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.286265 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.286483 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.286584 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.286789 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.287016 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.287109 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.287347 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.287434 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.287660 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.287748 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.287973 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.288066 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.288309 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.288411 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.288626 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.288722 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.288937 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.289023 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.289259 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.289368 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.289549 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.289637 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.289854 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.289940 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.290160 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.290320 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.290488 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.290577 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.290786 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.290871 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.291094 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.291182 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.291400 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.291487 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.291708 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.291802 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.292014 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.292143 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.292345 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.292433 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.292652 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.292762 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.292957 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.293100 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.293262 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.293350 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.293563 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.293660 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.293871 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.293957 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.294177 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.294270 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.294485 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.294581 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.294797 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.294883 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.295106 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.295191 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.295947 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.296046 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.296287 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.296376 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.296600 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.296689 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.296909 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.297114 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.297221 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.297421 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.297536 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.297748 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.297844 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.298070 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.298157 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.298390 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.298478 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.298700 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.298797 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.299012 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.299098 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.299332 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.299418 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.299636 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.299862 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.300016 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.300196 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.300300 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.300531 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.300631 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.300830 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.300917 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.301149 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.301248 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.301454 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.301543 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.301751 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.301837 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.302067 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.302152 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.302368 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.302455 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.302674 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.302887 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.302974 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.303227 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.303324 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.303540 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.303627 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.303862 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.303948 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.304193 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.304294 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.304501 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.304604 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.304799 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.304934 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.305114 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.305208 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.305417 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.305643 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.305730 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.305987 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.306083 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.306304 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.306392 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.306603 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.306688 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.306905 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.307014 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.307209 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.307296 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.307513 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.307599 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.307813 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.307909 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.308151 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.308242 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.308442 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.308543 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.308756 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.308843 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.309056 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.309142 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.309359 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.309446 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.309657 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.309744 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.309964 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.310050 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.310266 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.310352 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.310565 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.310653 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.310866 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.311261 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.311359 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.311448 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.311526 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.311607 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.311769 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.311858 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.312071 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.312250 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.312395 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.312483 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.312701 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.312848 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.313002 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.313098 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.313309 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.313407 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.313614 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.313702 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.313918 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.314017 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.314216 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.314303 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.314519 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.314616 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.314821 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.314974 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.315123 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.315210 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.315431 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.315524 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.315737 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.315825 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.316045 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.316150 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.316392 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.316478 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.316716 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.316805 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.317019 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.317236 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.317324 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.317861 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.317972 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.318055 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.318142 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.318223 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.318302 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.318514 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.318617 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.318820 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.318908 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.319124 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.319210 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.319434 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.319531 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.319753 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.319981 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.320068 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.320380 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.320480 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.320687 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.320775 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.320991 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.321078 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.321295 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.321392 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.321601 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.321697 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.321906 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.321993 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.322211 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.322308 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.322516 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.322602 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.322820 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.322959 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.323124 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.323214 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.323429 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.323533 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.323731 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.323818 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.324034 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.324142 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.324365 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.324451 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.324675 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.324762 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.325027 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.325127 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.325287 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.325374 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.325595 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.325692 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.325902 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.325989 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.326207 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.326294 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.326512 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.326715 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.326840 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.326926 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.327145 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.327232 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.327457 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.327558 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.327780 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.327868 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.328091 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.328210 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.328658 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.328766 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.328984 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.329294 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.329381 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.329605 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.329701 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.329920 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.330015 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.330230 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.330327 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.330536 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.330631 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.330854 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.330949 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.331165 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.331251 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.331470 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.331568 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.331782 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.332087 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.332194 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.332437 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.332542 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.332764 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.332850 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.333085 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.333170 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.333393 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.333488 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.333696 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.333781 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.333997 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.334086 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.334300 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.334389 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.334606 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.334694 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.334919 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.335014 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.335221 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.335320 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.335521 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.335608 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.335820 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.335907 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.336156 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.336248 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.336445 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.336546 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.336744 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.336831 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.337044 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.337132 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.337342 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.337427 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.337644 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.337741 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.337943 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.338029 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.338240 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.338326 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.338537 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.338634 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.338836 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.338923 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.339135 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.339220 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.339436 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.339531 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.339735 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.339828 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.340032 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.340131 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.340357 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.340464 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.340657 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.340742 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.340950 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.341042 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.341248 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.341335 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.341549 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.341636 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.341851 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.341937 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.342152 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.342769 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.342990 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.343079 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.343294 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.343389 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.343596 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.343684 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.343898 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.343991 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.344226 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.344316 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.344530 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.344619 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.344838 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.344924 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.345199 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.345317 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.345462 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.345557 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.345767 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.345854 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.346074 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.346169 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.346381 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.346473 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.346730 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.346822 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.346986 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.347083 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.347290 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.347377 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.347603 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.347688 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.347910 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.347999 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.348234 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.348323 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.348553 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.348638 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.348865 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.348963 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.349177 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.349273 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.349478 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.349565 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.349783 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.349870 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.350087 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.350172 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.350406 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.350509 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.350713 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.350802 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.351016 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.351103 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.351324 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.351420 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.351631 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.351726 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.351939 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.352025 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.352272 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.352379 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.352581 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.352667 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.352892 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.352977 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.353202 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.353297 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.353510 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.353595 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.353820 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.353917 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.354123 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.354210 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.354429 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.354514 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.354742 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.354836 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.355053 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.355150 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.355365 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.355465 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.355680 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.355767 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.355995 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.356084 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.356329 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.356415 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.356640 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.356740 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.356944 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.357043 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.357183 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 06:38:48.357270 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.357578 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.358467 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.358785 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.359127 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.359455 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.359767 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.360083 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.360419 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:38:48.360662 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 06:38:48.510421 n-d-861333-10 devstack@n-api.service[111671]: INFO dbcounter [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Registered counter for database nova_api Oct 19 06:38:48.518097 n-d-861333-10 devstack@n-api.service[111670]: INFO dbcounter [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Registered counter for database nova_api Oct 19 06:38:48.532027 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_db.sqlalchemy.engines [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:38:48.538554 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writer thread running {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:38:48.539934 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_db.sqlalchemy.engines [None req-943500c6-2f48-4056-860e-585e08e613ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:38:48.546426 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writer thread running {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:38:48.595484 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.context [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) {{(pid=111671) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 06:38:48.599414 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:38:48.599810 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:38:48.601380 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:38:48.602095 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:38:48.602529 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:38:48.603613 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.context [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) {{(pid=111670) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 06:38:48.604504 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:38:48.606467 n-d-861333-10 devstack@n-api.service[111671]: INFO dbcounter [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Registered counter for database nova_cell0 Oct 19 06:38:48.607464 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_concurrency.lockutils [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:38:48.607958 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_concurrency.lockutils [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:38:48.609835 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_concurrency.lockutils [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:38:48.610450 n-d-861333-10 devstack@n-api.service[111671]: INFO dbcounter [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Registered counter for database nova_cell1 Oct 19 06:38:48.613133 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_concurrency.lockutils [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:38:48.613596 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_concurrency.lockutils [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=111670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:38:48.616945 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_concurrency.lockutils [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=111670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:38:48.617575 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_db.sqlalchemy.engines [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:38:48.619031 n-d-861333-10 devstack@n-api.service[111670]: INFO dbcounter [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Registered counter for database nova_cell0 Oct 19 06:38:48.620176 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_db.sqlalchemy.engines [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:38:48.623358 n-d-861333-10 devstack@n-api.service[111670]: INFO dbcounter [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Registered counter for database nova_cell1 Oct 19 06:38:48.624389 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writer thread running {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:38:48.627607 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writer thread running {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:38:48.630588 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_db.sqlalchemy.engines [None req-943500c6-2f48-4056-860e-585e08e613ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:38:48.631833 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_db.sqlalchemy.engines [None req-943500c6-2f48-4056-860e-585e08e613ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:38:48.638200 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writer thread running {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:38:48.641020 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writer thread running {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:38:48.770265 n-d-861333-10 devstack@n-api.service[111671]: INFO dbcounter [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Registered counter for database nova_cell0 Oct 19 06:38:48.778973 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_db.sqlalchemy.engines [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:38:48.784243 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writer thread running {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:38:48.785560 n-d-861333-10 devstack@n-api.service[111670]: INFO dbcounter [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Registered counter for database nova_cell0 Oct 19 06:38:48.794106 n-d-861333-10 devstack@n-api.service[111670]: DEBUG oslo_db.sqlalchemy.engines [None req-943500c6-2f48-4056-860e-585e08e613ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:38:48.798792 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writer thread running {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:38:49.205878 n-d-861333-10 devstack@n-api.service[111671]: WARNING keystonemiddleware.auth_token [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 06:38:49.213065 n-d-861333-10 devstack@n-api.service[111671]: WARNING keystonemiddleware.auth_token [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 06:38:49.310505 n-d-861333-10 devstack@n-api.service[111670]: WARNING keystonemiddleware.auth_token [None req-943500c6-2f48-4056-860e-585e08e613ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 06:38:49.318578 n-d-861333-10 devstack@n-api.service[111670]: WARNING keystonemiddleware.auth_token [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 06:38:49.549050 n-d-861333-10 devstack@n-api.service[111671]: WARNING keystonemiddleware.auth_token [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 06:38:49.555265 n-d-861333-10 devstack@n-api.service[111671]: WARNING keystonemiddleware.auth_token [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 06:38:49.560737 n-d-861333-10 devstack@n-api.service[111671]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c97ac6f9c0 pid: 111671 (default app) Oct 19 06:38:49.562989 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:38:49.564218 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001859 Oct 19 06:38:49.564643 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Wed Oct 19 06:38:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:38:49.659234 n-d-861333-10 devstack@n-api.service[111670]: WARNING keystonemiddleware.auth_token [None req-943500c6-2f48-4056-860e-585e08e613ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 06:38:49.665242 n-d-861333-10 devstack@n-api.service[111670]: WARNING keystonemiddleware.auth_token [None req-943500c6-2f48-4056-860e-585e08e613ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 06:38:49.671093 n-d-861333-10 devstack@n-api.service[111670]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c97ac6f9c0 pid: 111670 (default app) Oct 19 06:40:13.210140 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:13.211864 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Oct 19 06:40:13.217606 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:13 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:13.226061 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writing DB stats nova_api:SELECT=3 {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:13.232079 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writing DB stats nova_cell0:SELECT=3 {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:13.233066 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writing DB stats nova_cell1:SELECT=3 {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:13.235623 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:14.139197 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-e5c2adf5-aaee-4291-b6f0-9294267b54be admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:14.172875 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-e5c2adf5-aaee-4291-b6f0-9294267b54be admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.953086 Oct 19 06:40:14.173815 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 06:40:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:40:16.789580 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:16.790671 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-936da47a-2871-4c24-8345-7b416fd44311 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Oct 19 06:40:16.791238 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:17.240235 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-9c6e3c42-2337-4f1c-92d9-d9569e3af330 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "ram": 256, "swap": 0, "rxtx_factor": 1.0}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:17.336923 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-9c6e3c42-2337-4f1c-92d9-d9569e3af330 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.539111 Oct 19 06:40:17.337404 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:40:17.351870 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writing DB stats nova_api:SELECT=3 {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:17.352748 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writing DB stats nova_cell0:SELECT=3 {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:17.354681 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writing DB stats nova_cell1:SELECT=3 {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:17.355690 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:17.561085 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-ecf3ebdd-550d-438e-8670-1cd95bd39d2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:17.688341 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-ecf3ebdd-550d-438e-8670-1cd95bd39d2f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.341620 Oct 19 06:40:17.689771 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 06:40:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:40:20.308623 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-9c6e3c42-2337-4f1c-92d9-d9569e3af330 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:20.309655 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-9c6e3c42-2337-4f1c-92d9-d9569e3af330 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 19 06:40:20.310035 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:21.082366 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-360d258a-d59c-4e38-a07e-52a00447c66d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:21.202300 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-360d258a-d59c-4e38-a07e-52a00447c66d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.885422 Oct 19 06:40:21.203212 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:40:21.220138 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-6916efd6-0ade-4973-9746-523ce00dd590 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:21.356642 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-6916efd6-0ade-4973-9746-523ce00dd590 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141761 Oct 19 06:40:21.361646 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 06:40:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:40:24.199862 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-360d258a-d59c-4e38-a07e-52a00447c66d admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:24.202773 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-360d258a-d59c-4e38-a07e-52a00447c66d admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002968 Oct 19 06:40:24.223091 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:24.798191 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-9d4ab988-194f-4618-88e3-582e65bfccfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:24.879254 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-9d4ab988-194f-4618-88e3-582e65bfccfb admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.662075 Oct 19 06:40:24.879799 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:40:24.891904 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-5b72e831-4996-4f53-a7b8-6664f11bb2b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:24.993371 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-5b72e831-4996-4f53-a7b8-6664f11bb2b6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105280 Oct 19 06:40:24.994420 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 06:40:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:40:27.619026 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-9d4ab988-194f-4618-88e3-582e65bfccfb admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:27.620255 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-9d4ab988-194f-4618-88e3-582e65bfccfb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Oct 19 06:40:27.620670 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:28.078419 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-8056563e-fcaf-45e9-9079-be8469d2a09d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "disk": 10, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:28.166139 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-8056563e-fcaf-45e9-9079-be8469d2a09d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538589 Oct 19 06:40:28.166874 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:40:28.178784 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-686bb99a-2370-47b9-bddc-57806ca2c833 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:28.289209 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-686bb99a-2370-47b9-bddc-57806ca2c833 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114014 Oct 19 06:40:28.296150 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 06:40:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:40:30.997436 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-8056563e-fcaf-45e9-9079-be8469d2a09d admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:30.999019 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-8056563e-fcaf-45e9-9079-be8469d2a09d admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 Oct 19 06:40:30.999597 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:40:31.490183 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-94aea0ea-6b50-4d79-ba71-535e6eaaf411 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G"}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:31.569331 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-94aea0ea-6b50-4d79-ba71-535e6eaaf411 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.562842 Oct 19 06:40:31.584623 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-c54b1a8d-b309-4bc4-bb73-2024819c2b6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:31.591730 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:40:31.671936 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-c54b1a8d-b309-4bc4-bb73-2024819c2b6a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092098 Oct 19 06:40:31.672557 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 06:40:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:40:34.322772 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-94aea0ea-6b50-4d79-ba71-535e6eaaf411 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:34.323831 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-94aea0ea-6b50-4d79-ba71-535e6eaaf411 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Oct 19 06:40:34.324289 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:34.745748 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-ac410a9c-cb60-4628-b905-3e21fc95e2a9 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:34.771903 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-ac410a9c-cb60-4628-b905-3e21fc95e2a9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.440702 Oct 19 06:40:34.772831 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 06:40:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:40:37.502343 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-94aea0ea-6b50-4d79-ba71-535e6eaaf411 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:37.503397 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-94aea0ea-6b50-4d79-ba71-535e6eaaf411 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Oct 19 06:40:37.503840 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:40:37.912396 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-b40596ad-7ffa-4435-9477-0beb84d4d808 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny"}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:37.974362 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-b40596ad-7ffa-4435-9477-0beb84d4d808 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.464306 Oct 19 06:40:37.974827 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:40:37.987325 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-773b426c-6a17-4241-8234-d9efec68593f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:38.078986 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-773b426c-6a17-4241-8234-d9efec68593f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095391 Oct 19 06:40:38.079510 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 06:40:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:40:40.698002 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-b40596ad-7ffa-4435-9477-0beb84d4d808 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:40.699035 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-b40596ad-7ffa-4435-9477-0beb84d4d808 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 19 06:40:40.699437 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:41.094562 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-f3b17bb8-ef62-4f85-af69-4e1b8d7fdff7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:41.188845 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-f3b17bb8-ef62-4f85-af69-4e1b8d7fdff7 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.482637 Oct 19 06:40:41.189962 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 06:40:41.202298 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-f51bca15-fc23-4376-a076-0c443fd20c77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:41.301578 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-f51bca15-fc23-4376-a076-0c443fd20c77 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103048 Oct 19 06:40:41.302158 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 06:40:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:40:44.045808 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-f3b17bb8-ef62-4f85-af69-4e1b8d7fdff7 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:44.047080 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-f3b17bb8-ef62-4f85-af69-4e1b8d7fdff7 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 19 06:40:44.047717 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:44.449414 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-0eb0d590-8355-457f-8a2f-b1a9c66dd3e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:44.509738 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-0eb0d590-8355-457f-8a2f-b1a9c66dd3e2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.455842 Oct 19 06:40:44.510297 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:40:44.522624 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-452c56e0-8438-48f1-9279-3ca730c3fb50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:44.528987 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:44.635214 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-452c56e0-8438-48f1-9279-3ca730c3fb50 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116108 Oct 19 06:40:44.636372 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 06:40:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:40:47.265633 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-0eb0d590-8355-457f-8a2f-b1a9c66dd3e2 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:47.266802 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-0eb0d590-8355-457f-8a2f-b1a9c66dd3e2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Oct 19 06:40:47.267915 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:47.729043 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-3cfaaa40-5d7b-4786-8ee9-b1f0fce63c05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:47.809278 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-3cfaaa40-5d7b-4786-8ee9-b1f0fce63c05 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.533006 Oct 19 06:40:47.810155 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:40:47.822794 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-37d5860f-de84-479b-a43d-3f523de90d50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:47.827608 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:40:47.924461 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-37d5860f-de84-479b-a43d-3f523de90d50 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105275 Oct 19 06:40:47.925564 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 06:40:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:40:50.549597 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-3cfaaa40-5d7b-4786-8ee9-b1f0fce63c05 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:40:50.550608 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-3cfaaa40-5d7b-4786-8ee9-b1f0fce63c05 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 19 06:40:50.551009 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:40:50.978626 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-a95f534c-6d87-4898-8682-e11d9b6bcda4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge"}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:51.070229 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-a95f534c-6d87-4898-8682-e11d9b6bcda4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.512907 Oct 19 06:40:51.070824 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 06:40:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:40:51.083969 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-7287a90b-a79b-49e3-bbbd-8e998130c9b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:40:51.198465 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-7287a90b-a79b-49e3-bbbd-8e998130c9b6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118962 Oct 19 06:40:51.198965 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 06:40:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:41:11.800391 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-a95f534c-6d87-4898-8682-e11d9b6bcda4 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:11.801407 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-a95f534c-6d87-4898-8682-e11d9b6bcda4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 19 06:41:11.801809 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:41:11.812299 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:41:12.187902 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-9e73fd21-83f3-4019-b1e2-1d8e68eff9d6 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:12.206680 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-9e73fd21-83f3-4019-b1e2-1d8e68eff9d6 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398849 Oct 19 06:41:12.207212 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 06:41:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:41:13.510560 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-a95f534c-6d87-4898-8682-e11d9b6bcda4 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:13.511557 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-a95f534c-6d87-4898-8682-e11d9b6bcda4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 19 06:41:13.511950 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:41:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:41:14.056075 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-32fddbd3-6100-40a1-ad6d-bf7c3504e577 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:14.061530 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.wsgi [None req-32fddbd3-6100-40a1-ad6d-bf7c3504e577 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-32fddbd3-6100-40a1-ad6d-bf7c3504e577 admin admin] Request method failure captured: Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: Accept: application/json Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: Accept-Encoding: gzip, deflate Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: Connection: keep-alive Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: Content-Length: 0 Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: Host: 10.222.0.39 Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: Openstack-Api-Version: compute 2.92 Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: Openstack-System-Scope: None Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: User-Agent: python-novaclient Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Auth-Token: gAAAAABjT5wJu5HJsGzaRm6C9kGFhKURdgj93DDLTy5oZfH31tGntYbl6lSICNC_hQXmdjsNJ2En0Tc2hU8YH85Aso_BWJJUcUKKtE9o2c84jQE7fpD05bY2KKYPbvdDGzOCOIBweMet81Iw0PQlvnyokc4eFz4v0ByTy35pjrpXEqBN2KulR14 Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Domain-Id: None Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Domain-Name: None Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Identity-Status: Confirmed Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Is-Admin-Project: True Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Domain-Id: default Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Domain-Name: Default Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Name: admin Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Role: reader,member,admin Oct 19 06:41:14.064794 n-d-861333-10 devstack@n-api.service[111670]: X-Roles: reader,member,admin Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cafcdad80e764c8d9a8808fcd60d838b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: X-Tenant: admin Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: X-Tenant-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: X-Tenant-Name: admin Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: X-User: admin Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: X-User-Domain-Id: default Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: X-User-Domain-Name: Default Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: X-User-Id: 304b8da33fa74a75adb676a88c52eef5 Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: X-User-Name: admin Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: method: > Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: exception: Flavor 42 could not be found. Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: action_args: {'id': '42'} Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:41:14.066500 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:14.067546 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.069020 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-32fddbd3-6100-40a1-ad6d-bf7c3504e577 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:41:14.070670 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-32fddbd3-6100-40a1-ad6d-bf7c3504e577 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396379 Oct 19 06:41:14.070670 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 06:41:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:41:14.076024 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-37f2869f-9a48-46e7-9c52-5a34a062accd admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:14.080142 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:41:14.099062 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-37f2869f-9a48-46e7-9c52-5a34a062accd admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026661 Oct 19 06:41:14.099610 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 06:41:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:41:14.120993 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-624052ee-71f8-4aa0-9daf-37fe6c173dff admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:14.143230 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-624052ee-71f8-4aa0-9daf-37fe6c173dff admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026835 Oct 19 06:41:14.143785 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 06:41:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:41:14.153275 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-b75a2237-6747-4cac-8fcd-f3835fde189b admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:14.159649 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.wsgi [None req-b75a2237-6747-4cac-8fcd-f3835fde189b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-b75a2237-6747-4cac-8fcd-f3835fde189b admin admin] Request method failure captured: Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: Accept: application/json Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: Accept-Encoding: gzip, deflate Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: Connection: keep-alive Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: Content-Length: 0 Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: Host: 10.222.0.39 Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: Openstack-Api-Version: compute 2.92 Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: Openstack-System-Scope: None Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: User-Agent: python-novaclient Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Auth-Token: gAAAAABjT5wJu5HJsGzaRm6C9kGFhKURdgj93DDLTy5oZfH31tGntYbl6lSICNC_hQXmdjsNJ2En0Tc2hU8YH85Aso_BWJJUcUKKtE9o2c84jQE7fpD05bY2KKYPbvdDGzOCOIBweMet81Iw0PQlvnyokc4eFz4v0ByTy35pjrpXEqBN2KulR14 Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Domain-Id: None Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Domain-Name: None Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Identity-Status: Confirmed Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Is-Admin-Project: True Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Domain-Id: default Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Domain-Name: Default Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Name: admin Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Role: reader,member,admin Oct 19 06:41:14.162939 n-d-861333-10 devstack@n-api.service[111671]: X-Roles: reader,member,admin Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cafcdad80e764c8d9a8808fcd60d838b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: X-Tenant: admin Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: X-Tenant-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: X-Tenant-Name: admin Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: X-User: admin Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: X-User-Domain-Id: default Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: X-User-Domain-Name: Default Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: X-User-Id: 304b8da33fa74a75adb676a88c52eef5 Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: X-User-Name: admin Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: method: > Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: exception: Flavor 42 could not be found. Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: action_args: {'id': '42'} Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:41:14.164552 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:14.165530 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:14.166674 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-b75a2237-6747-4cac-8fcd-f3835fde189b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:41:14.167641 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-b75a2237-6747-4cac-8fcd-f3835fde189b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014817 Oct 19 06:41:14.167641 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 06:41:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:41:15.381480 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-624052ee-71f8-4aa0-9daf-37fe6c173dff admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:15.382525 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-624052ee-71f8-4aa0-9daf-37fe6c173dff admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 19 06:41:15.382955 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:41:15.895806 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-7b484fbb-bb18-4703-89ba-8b0fcb0ab85e admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:15.900831 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.wsgi [None req-7b484fbb-bb18-4703-89ba-8b0fcb0ab85e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-7b484fbb-bb18-4703-89ba-8b0fcb0ab85e admin admin] Request method failure captured: Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: Accept: application/json Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: Accept-Encoding: gzip, deflate Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: Connection: keep-alive Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: Content-Length: 0 Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: Host: 10.222.0.39 Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: Openstack-Api-Version: compute 2.92 Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: Openstack-System-Scope: None Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: User-Agent: python-novaclient Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Auth-Token: gAAAAABjT5wLjZwSry-jWGjViAVLlhkoj1uDNq1RC9aOnZCyDmhb2qFJ9lmQEA_TnVa62mVb4kg_FGw_L1vX3W9EF47vOizI_d-OuiJ6M6sqQSmtBfph8soo6qGT8plAV-eWXzFTmq9B1ZrMm_LTms8u6LTW-y8YBksjiPibbO_uMABhHRZKUvI Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Domain-Id: None Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Domain-Name: None Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Identity-Status: Confirmed Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Is-Admin-Project: True Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Domain-Id: default Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Domain-Name: Default Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Name: admin Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Role: reader,member,admin Oct 19 06:41:15.902345 n-d-861333-10 devstack@n-api.service[111671]: X-Roles: reader,member,admin Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cafcdad80e764c8d9a8808fcd60d838b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: X-Tenant: admin Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: X-Tenant-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: X-Tenant-Name: admin Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: X-User: admin Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: X-User-Domain-Id: default Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: X-User-Domain-Name: Default Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: X-User-Id: 304b8da33fa74a75adb676a88c52eef5 Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: X-User-Name: admin Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: method: > Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: exception: Flavor 84 could not be found. Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: action_args: {'id': '84'} Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:41:15.903803 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:15.904692 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.905823 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-7b484fbb-bb18-4703-89ba-8b0fcb0ab85e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:41:15.906815 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-7b484fbb-bb18-4703-89ba-8b0fcb0ab85e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.384452 Oct 19 06:41:15.906815 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 06:41:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 06:41:15.914181 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-ccc9e289-ec64-45a8-a147-1afa33c3c590 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:15.928840 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-ccc9e289-ec64-45a8-a147-1afa33c3c590 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018172 Oct 19 06:41:15.929340 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 06:41:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:41:15.938345 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-81d060b1-d007-4702-9bc4-1916c888a092 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:15.953301 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-81d060b1-d007-4702-9bc4-1916c888a092 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018407 Oct 19 06:41:15.953817 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 06:41:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:41:15.963435 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-73cffcd6-d012-4908-9417-a1703f65b9a7 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:15.968278 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.wsgi [None req-73cffcd6-d012-4908-9417-a1703f65b9a7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-73cffcd6-d012-4908-9417-a1703f65b9a7 admin admin] Request method failure captured: Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: Accept: application/json Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: Accept-Encoding: gzip, deflate Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: Connection: keep-alive Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: Content-Length: 0 Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: Host: 10.222.0.39 Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: Openstack-Api-Version: compute 2.92 Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: Openstack-System-Scope: None Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: User-Agent: python-novaclient Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Auth-Token: gAAAAABjT5wLjZwSry-jWGjViAVLlhkoj1uDNq1RC9aOnZCyDmhb2qFJ9lmQEA_TnVa62mVb4kg_FGw_L1vX3W9EF47vOizI_d-OuiJ6M6sqQSmtBfph8soo6qGT8plAV-eWXzFTmq9B1ZrMm_LTms8u6LTW-y8YBksjiPibbO_uMABhHRZKUvI Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Domain-Id: None Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Domain-Name: None Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Identity-Status: Confirmed Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Is-Admin-Project: True Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Domain-Id: default Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Domain-Name: Default Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Name: admin Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Role: reader,member,admin Oct 19 06:41:15.969783 n-d-861333-10 devstack@n-api.service[111670]: X-Roles: reader,member,admin Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cafcdad80e764c8d9a8808fcd60d838b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: X-Tenant: admin Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: X-Tenant-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: X-Tenant-Name: admin Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: X-User: admin Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: X-User-Domain-Id: default Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: X-User-Domain-Name: Default Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: X-User-Id: 304b8da33fa74a75adb676a88c52eef5 Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: X-User-Name: admin Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: method: > Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: exception: Flavor 84 could not be found. Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: action_args: {'id': '84'} Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:41:15.971858 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:15.972842 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:15.974304 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-73cffcd6-d012-4908-9417-a1703f65b9a7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:41:15.975532 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-73cffcd6-d012-4908-9417-a1703f65b9a7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011106 Oct 19 06:41:15.975824 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 06:41:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:41:17.173282 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-81d060b1-d007-4702-9bc4-1916c888a092 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:17.174321 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-81d060b1-d007-4702-9bc4-1916c888a092 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 19 06:41:17.174718 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:41:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:41:17.686954 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-a42378ba-b010-4981-935a-b6b8a9952b8a admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:17.692795 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.wsgi [None req-a42378ba-b010-4981-935a-b6b8a9952b8a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-a42378ba-b010-4981-935a-b6b8a9952b8a admin admin] Request method failure captured: Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: Accept: application/json Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: Accept-Encoding: gzip, deflate Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: Connection: keep-alive Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: Content-Length: 0 Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: Host: 10.222.0.39 Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: Openstack-Api-Version: compute 2.92 Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: Openstack-System-Scope: None Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: User-Agent: python-novaclient Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Auth-Token: gAAAAABjT5wNPFEG12fazJgpJGrNtwvRYWBd6NBQnUcSVvqWDAcGP7otGm66kWk0r0Ws53ZjZnS8dVzQ8xeBE5wt5mVuPDb2NdydaWIrD-O4EhjbBipk9prShnhB0eNZ5rzYOmbObJvKbkprkoEoVLJiyIzMlCbeeRLxbT1atvEtQcemquUGBTs Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Domain-Id: None Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Domain-Name: None Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Identity-Status: Confirmed Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Is-Admin-Project: True Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Domain-Id: default Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Domain-Name: Default Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Project-Name: admin Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Role: reader,member,admin Oct 19 06:41:17.694313 n-d-861333-10 devstack@n-api.service[111670]: X-Roles: reader,member,admin Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cafcdad80e764c8d9a8808fcd60d838b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: X-Tenant: admin Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: X-Tenant-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: X-Tenant-Name: admin Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: X-User: admin Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: X-User-Domain-Id: default Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: X-User-Domain-Name: Default Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: X-User-Id: 304b8da33fa74a75adb676a88c52eef5 Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: X-User-Name: admin Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: method: > Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: exception: Flavor 451 could not be found. Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: action_args: {'id': '451'} Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:41:17.695789 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:17.696751 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.697797 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-a42378ba-b010-4981-935a-b6b8a9952b8a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:41:17.698765 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-a42378ba-b010-4981-935a-b6b8a9952b8a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.384186 Oct 19 06:41:17.698765 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 06:41:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:41:17.705516 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-518480df-a5b6-4663-a9a0-a8c737206d0c admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:17.720303 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-518480df-a5b6-4663-a9a0-a8c737206d0c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018431 Oct 19 06:41:17.721348 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 06:41:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:41:17.730469 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:17.745603 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018650 Oct 19 06:41:17.746116 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 06:41:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:41:17.755094 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-a86cb0f0-d5bc-4818-aad6-bb39077ab2e4 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:17.759882 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.wsgi [None req-a86cb0f0-d5bc-4818-aad6-bb39077ab2e4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-a86cb0f0-d5bc-4818-aad6-bb39077ab2e4 admin admin] Request method failure captured: Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: Accept: application/json Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: Accept-Encoding: gzip, deflate Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: Connection: keep-alive Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: Content-Length: 0 Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: Host: 10.222.0.39 Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: Openstack-Api-Version: compute 2.92 Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: Openstack-System-Scope: None Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: User-Agent: python-novaclient Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Auth-Token: gAAAAABjT5wNPFEG12fazJgpJGrNtwvRYWBd6NBQnUcSVvqWDAcGP7otGm66kWk0r0Ws53ZjZnS8dVzQ8xeBE5wt5mVuPDb2NdydaWIrD-O4EhjbBipk9prShnhB0eNZ5rzYOmbObJvKbkprkoEoVLJiyIzMlCbeeRLxbT1atvEtQcemquUGBTs Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Domain-Id: None Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Domain-Name: None Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Identity-Status: Confirmed Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Is-Admin-Project: True Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Domain-Id: default Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Domain-Name: Default Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Project-Name: admin Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Role: reader,member,admin Oct 19 06:41:17.761404 n-d-861333-10 devstack@n-api.service[111671]: X-Roles: reader,member,admin Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cafcdad80e764c8d9a8808fcd60d838b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cafcdad80e764c8d9a8808fcd60d838b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: X-Tenant: admin Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: X-Tenant-Id: cafcdad80e764c8d9a8808fcd60d838b Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: X-Tenant-Name: admin Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: X-User: admin Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: X-User-Domain-Id: default Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: X-User-Domain-Name: Default Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: X-User-Id: 304b8da33fa74a75adb676a88c52eef5 Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: X-User-Name: admin Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: method: > Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: exception: Flavor 451 could not be found. Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: action_args: {'id': '451'} Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:41:17.762914 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:17.763815 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: ERROR nova.api.openstack.wsgi Oct 19 06:41:17.764912 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-a86cb0f0-d5bc-4818-aad6-bb39077ab2e4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:41:17.765923 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-a86cb0f0-d5bc-4818-aad6-bb39077ab2e4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011074 Oct 19 06:41:17.765923 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 06:41:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:41:18.959615 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:18.960647 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 19 06:41:18.961033 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:41:19.479080 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-10643d9d-c3c4-4938-8ef9-f550eb7c269a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:41:19.564110 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-10643d9d-c3c4-4938-8ef9-f550eb7c269a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.469395 Oct 19 06:41:19.565319 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Oct 19 06:41:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:41:20.763415 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:20.764449 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 19 06:41:20.764874 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:41:21.282368 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-1d8de93b-ab4c-45b6-ae14-fd80dd38775b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:41:21.337546 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-1d8de93b-ab4c-45b6-ae14-fd80dd38775b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.438419 Oct 19 06:41:21.338098 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Oct 19 06:41:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:41:22.545197 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:22.546321 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Oct 19 06:41:22.546719 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:41:23.060188 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-2f4dfcde-b03b-40ba-964e-26bf160d52bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:41:23.183076 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-2f4dfcde-b03b-40ba-964e-26bf160d52bf admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.498433 Oct 19 06:41:23.183549 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Oct 19 06:41:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 06:41:24.393620 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:24.394633 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 19 06:41:24.395036 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:41:24.909438 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-dda0c81e-b442-4cb9-bf35-37e810aa5d42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:41:24.986863 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-dda0c81e-b442-4cb9-bf35-37e810aa5d42 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.454008 Oct 19 06:41:24.987410 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Oct 19 06:41:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:41:26.197837 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:26.198839 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 19 06:41:26.199239 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:41:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:41:26.711436 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-897a90ad-7d5c-4741-a716-edbdbf47891c admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:41:26.731465 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-897a90ad-7d5c-4741-a716-edbdbf47891c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397038 Oct 19 06:41:26.732003 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Wed Oct 19 06:41:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:42:22.864974 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:42:22.865992 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-11dd0d2d-6391-48bc-bf0e-f1ffe3ed299f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 19 06:42:22.866393 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 06:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:42:22.876902 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:42:23.258041 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-35ee1ab9-f5f8-43d7-9df4-e3c98c112d57 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:42:23.278394 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-35ee1ab9-f5f8-43d7-9df4-e3c98c112d57 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405926 Oct 19 06:42:23.278951 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 06:42:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:42:23.300906 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writing DB stats nova_api:SELECT=14 {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:42:23.304737 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-6e07146f-4e41-4888-a6a6-d611eae5abd4 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:42:23.311813 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-6e07146f-4e41-4888-a6a6-d611eae5abd4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013043 Oct 19 06:42:23.313445 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1283 bytes} [Wed Oct 19 06:42:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:42:23.324442 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-45b07484-e69c-4ff6-9edd-81b8d7f16e92 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:42:23.331580 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-45b07484-e69c-4ff6-9edd-81b8d7f16e92 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010743 Oct 19 06:42:23.336483 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1286 bytes} [Wed Oct 19 06:42:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:42:23.343405 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-d2e437d8-f4f2-489c-9b2d-01da7d3dd0a7 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:42:23.350874 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-d2e437d8-f4f2-489c-9b2d-01da7d3dd0a7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010971 Oct 19 06:42:23.351392 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1286 bytes} [Wed Oct 19 06:42:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:42:23.362982 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-45c87d6a-376a-4948-8ed9-1cacc60b9937 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:42:23.370066 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-45c87d6a-376a-4948-8ed9-1cacc60b9937 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011069 Oct 19 06:42:23.370578 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1283 bytes} [Wed Oct 19 06:42:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:48:03.321369 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-d2e437d8-f4f2-489c-9b2d-01da7d3dd0a7 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:48:03.322395 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-d2e437d8-f4f2-489c-9b2d-01da7d3dd0a7 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 19 06:48:03.322796 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:48:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:48:03.462553 n-d-861333-10 devstack@n-api.service[111671]: DEBUG dbcounter [-] [111671] Writing DB stats nova_api:SELECT=6 {{(pid=111671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:48:03.602549 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-8ecc4bed-0608-4c3e-a95b-e5e472187512 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:48:03.607403 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-8ecc4bed-0608-4c3e-a95b-e5e472187512 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:48:03.607869 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-8ecc4bed-0608-4c3e-a95b-e5e472187512 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:48:03.608318 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-8ecc4bed-0608-4c3e-a95b-e5e472187512 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:48:03.609043 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-8ecc4bed-0608-4c3e-a95b-e5e472187512 admin admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:48:03.609482 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-8ecc4bed-0608-4c3e-a95b-e5e472187512 admin admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:48:03.609897 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-8ecc4bed-0608-4c3e-a95b-e5e472187512 admin admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:48:03.648057 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-8ecc4bed-0608-4c3e-a95b-e5e472187512 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.186605 Oct 19 06:48:03.648703 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 06:48:03 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:48:04.724395 n-d-861333-10 devstack@n-api.service[111670]: DEBUG nova.api.openstack.wsgi [None req-d2e437d8-f4f2-489c-9b2d-01da7d3dd0a7 admin admin] Calling method '>' {{(pid=111670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:48:04.725407 n-d-861333-10 devstack@n-api.service[111670]: INFO nova.api.openstack.requestlog [None req-d2e437d8-f4f2-489c-9b2d-01da7d3dd0a7 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 19 06:48:04.725804 n-d-861333-10 devstack@n-api.service[111670]: [pid: 111670|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 06:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:48:04.916600 n-d-861333-10 devstack@n-api.service[111671]: DEBUG nova.api.openstack.wsgi [None req-5341ede1-a3ad-4688-8209-683b04ba0577 admin admin] Calling method '>' {{(pid=111671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:48:04.920059 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-5341ede1-a3ad-4688-8209-683b04ba0577 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:48:04.920604 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-5341ede1-a3ad-4688-8209-683b04ba0577 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:48:04.921054 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-5341ede1-a3ad-4688-8209-683b04ba0577 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:48:04.921758 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-5341ede1-a3ad-4688-8209-683b04ba0577 admin admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:48:04.922197 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-5341ede1-a3ad-4688-8209-683b04ba0577 admin admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:48:04.922602 n-d-861333-10 devstack@n-api.service[111671]: DEBUG oslo_concurrency.lockutils [None req-5341ede1-a3ad-4688-8209-683b04ba0577 admin admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:48:04.944670 n-d-861333-10 devstack@n-api.service[111671]: INFO nova.api.openstack.requestlog [None req-5341ede1-a3ad-4688-8209-683b04ba0577 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.080602 Oct 19 06:48:04.945155 n-d-861333-10 devstack@n-api.service[111671]: [pid: 111671|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 06:48:04 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:48:50.410656 n-d-861333-10 devstack@n-api.service[111669]: Wed Oct 19 06:48:50 2022 - graceful shutdown triggered... Oct 19 06:48:50.410645 n-d-861333-10 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 19 06:48:50.411620 n-d-861333-10 devstack@n-api.service[111671]: Gracefully killing worker 2 (pid: 111671)... Oct 19 06:48:50.412210 n-d-861333-10 devstack@n-api.service[111670]: Gracefully killing worker 1 (pid: 111670)... Oct 19 06:48:50.537829 n-d-861333-10 devstack@n-api.service[111670]: DEBUG dbcounter [-] [111670] Writing DB stats nova_api:SELECT=4 {{(pid=111670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:48:51.410797 n-d-861333-10 devstack@n-api.service[111669]: worker 1 buried after 1 seconds Oct 19 06:48:51.410797 n-d-861333-10 devstack@n-api.service[111669]: worker 2 buried after 1 seconds Oct 19 06:48:51.411351 n-d-861333-10 devstack@n-api.service[111669]: goodbye to uWSGI. Oct 19 06:48:51.412399 n-d-861333-10 systemd[1]: devstack@n-api.service: Succeeded. Oct 19 06:48:51.412967 n-d-861333-10 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 19 06:48:51.415975 n-d-861333-10 systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 06:48:51.432860 n-d-861333-10 devstack@n-api.service[127557]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 06:48:51 2022] *** Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: nodename: n-d-861333-10 Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: machine: x86_64 Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: clock source: unix Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: pcre jit disabled Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: detected number of CPU cores: 4 Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: current working directory: / Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: detected binary path: /usr/bin/uwsgi-core Oct 19 06:48:51.449731 n-d-861333-10 devstack@n-api.service[127557]: your processes number limit is 47680 Oct 19 06:48:51.450598 n-d-861333-10 devstack@n-api.service[127557]: your memory page size is 4096 bytes Oct 19 06:48:51.450598 n-d-861333-10 devstack@n-api.service[127557]: detected max file descriptor number: 2048 Oct 19 06:48:51.450598 n-d-861333-10 devstack@n-api.service[127557]: lock engine: pthread robust mutexes Oct 19 06:48:51.450598 n-d-861333-10 devstack@n-api.service[127557]: thunder lock: enabled Oct 19 06:48:51.450598 n-d-861333-10 devstack@n-api.service[127557]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 06:48:51.450598 n-d-861333-10 devstack@n-api.service[127557]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 06:48:51.492625 n-d-861333-10 devstack@n-api.service[127557]: Python main interpreter initialized at 0x561a71f329c0 Oct 19 06:48:51.492625 n-d-861333-10 devstack@n-api.service[127557]: python threads support enabled Oct 19 06:48:51.492625 n-d-861333-10 devstack@n-api.service[127557]: your server socket listen backlog is limited to 100 connections Oct 19 06:48:51.492625 n-d-861333-10 devstack@n-api.service[127557]: your mercy for graceful operations on workers is 90 seconds Oct 19 06:48:51.493037 n-d-861333-10 devstack@n-api.service[127557]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 06:48:51.493037 n-d-861333-10 devstack@n-api.service[127557]: *** Operational MODE: preforking *** Oct 19 06:48:51.493271 n-d-861333-10 devstack@n-api.service[127557]: *** uWSGI is running in multiple interpreter mode *** Oct 19 06:48:51.493271 n-d-861333-10 devstack@n-api.service[127557]: spawned uWSGI master process (pid: 127557) Oct 19 06:48:51.493480 n-d-861333-10 systemd[1]: Started Devstack devstack@n-api.service. Oct 19 06:48:51.494635 n-d-861333-10 devstack@n-api.service[127557]: spawned uWSGI worker 1 (pid: 127567, cores: 1) Oct 19 06:48:51.494635 n-d-861333-10 devstack@n-api.service[127557]: spawned uWSGI worker 2 (pid: 127568, cores: 1) Oct 19 06:48:51.494635 n-d-861333-10 devstack@n-api.service[127557]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 06:48:52.152849 n-d-861333-10 devstack@n-api.service[127567]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 06:48:52.156374 n-d-861333-10 devstack@n-api.service[127568]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 06:48:53.315966 n-d-861333-10 devstack@n-api.service[127567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 06:48:53.315966 n-d-861333-10 devstack@n-api.service[127567]: from cryptography.utils import int_from_bytes Oct 19 06:48:53.316540 n-d-861333-10 devstack@n-api.service[127567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 06:48:53.316540 n-d-861333-10 devstack@n-api.service[127567]: from cryptography.utils import int_from_bytes Oct 19 06:48:53.321682 n-d-861333-10 devstack@n-api.service[127568]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 06:48:53.321682 n-d-861333-10 devstack@n-api.service[127568]: from cryptography.utils import int_from_bytes Oct 19 06:48:53.322206 n-d-861333-10 devstack@n-api.service[127568]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 06:48:53.322206 n-d-861333-10 devstack@n-api.service[127568]: from cryptography.utils import int_from_bytes Oct 19 06:48:55.761404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 06:48:55.761964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 06:48:55.762178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 06:48:55.762275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 06:48:55.762655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 06:48:55.762745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 06:48:55.762839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 06:48:55.762962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 06:48:55.763161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.763334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 06:48:55.763489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.763592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 06:48:55.763813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.763972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.764292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.764400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.764631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.764744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.765477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.765645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.765802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.765987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.766123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.766308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.766451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.766637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.766798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.766993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.767140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.767282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.767386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861333-10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.767549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.767652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.767870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.767969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.768225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861333-10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.768340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.768554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.768702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.768864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.768980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.769169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.769271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.769478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.769597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.769792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.769970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.770121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.770419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.770557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.770726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.770928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.771069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.771244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.771381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.771555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.771662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.771871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.771968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.772235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.772354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.772557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.772651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.772874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.772975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.773197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.773306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.773505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.773597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861333-10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.773836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.773929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.774152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.774254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.774488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.774590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861333-10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.774857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.775003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.775174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.775267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.775491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.775594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.775810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.775914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.776153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.776367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.776480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.776690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.776853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.777031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.777179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.777324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.777468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.777633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.777805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.777983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.778133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.778287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.778432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.778576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.778911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.779064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.779208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.779363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.779523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.779686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.779855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.780000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.780177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.780315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.781090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.781261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.781415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.781575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.781716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.781861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.782024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.782178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.782330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.782477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.782621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.782768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.782928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.783075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.783223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.783377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.783517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.783668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.783835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.783998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.784163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.784302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.784444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.784601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.784759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.784854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.784940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.785031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.785127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.785227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.785321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.785407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.785492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.785584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.785720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.785896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.786032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.786205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.786345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.786524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.786672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.786919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.787023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.787171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.787306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.787479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.787621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.787815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.787948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.788156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.788375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.788469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.788631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.788780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.789048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.789163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.789288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.789383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.789611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.789762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.789925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.790030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.790249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.790345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.790576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.790677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.790876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.790978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.791128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.791236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.791428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.791531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.791732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.791839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.792049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.792191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.792382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.792486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.792679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.792779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.792983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.793134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.793267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.793399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.793574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.793676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.793877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.793983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.794181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.794282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.794488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.794588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.794790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.794890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.795093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.795192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.795396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.795496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.795702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.795795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.796017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.796631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.796859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.797005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.797171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.797312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.797484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.797620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.797790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.797922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.798099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.798233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.798404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.798546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.798716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.798852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.799107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.799329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.799470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.799612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.799751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.799890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.800022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.800192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.800326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.800455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.800592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.800729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.800874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.801013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.801144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.801273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.801450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.801600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.801769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.801914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.802060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.802196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.802364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.802511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.802679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.802814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.802986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.803126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.803290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.803434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.803590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.803733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.803893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.804029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.804219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.804330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.804524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.804625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.804826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.804920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.805129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.805234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.805423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.805521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.805744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.805861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.806063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.806162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.806368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.806465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.806673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.806790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.806976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.807080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.807294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.807401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.807612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.807709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.807927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.808025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.808275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.808393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.808586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.808700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.808910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 06:48:55.809051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.809243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.809353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.809563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.809672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.809878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.809978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.810196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.810305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.810524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.810630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.810836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.810933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.811147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.811252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.811475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.811573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.811871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.812556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.812709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.812852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.813009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.813215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.813377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.813603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.813749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.813893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.814073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.814230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.814395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.814539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.814681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.814830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.814982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.815134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.815297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.815609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.815774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.815919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.816061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.816250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.816971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.817140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.817285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.817531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.817687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.817842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.817998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.818172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.818323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.818473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.818627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.818627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.819022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.819275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.819506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.819655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.819813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.820028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.820212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.820431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.820578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.820734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.820891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.821042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.821184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.821326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.821479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.821622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.821777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.821929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.822072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.822221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.822364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.822521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.822665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.822816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.822960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.823102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.823244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.823406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.823550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.823700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.823844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.823993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.824155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.824325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.824477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.824627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.824777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.824929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.825079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.825232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.825387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.825553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.825709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.825861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.826013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.826168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.826312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.826479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.826696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.826843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.826996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.827148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.827291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.827443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.827624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.827778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.827939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.828087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.828293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.828438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.828580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.828722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.828891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.829102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.829276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.829526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.829683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.829835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.829989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.830134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.830282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.830444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.830661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.830827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.830978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.831124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.831274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.831426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.831587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.831740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.831884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.832026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.832190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.832347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.832504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.832663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.832814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.832977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.833120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.833263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.833405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.833566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.833716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.833867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.834020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.834162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.834317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.834460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.834609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.834759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.834902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.835044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.835199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.835352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.835502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.835645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.835794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.835944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.836096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.836275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.836420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.836561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.836727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.836942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.837101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.837258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.837413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.837567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.837711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.837862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.838029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.838180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.838331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.838331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.838612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.838764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.838913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.839056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.839288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.839522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.839681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.839835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.839979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.840157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.840358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.840516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.840683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.840911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.841060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.841060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.841347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.841491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.841658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.841809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.841959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.842102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.842244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.842393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.842550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.842702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.842844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.842994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.843136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.843292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.843523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.843691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.843842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.843993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.844155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.844315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.844472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.844615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.844765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.844913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.845063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.845219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.845362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.845513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.845513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.845788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.845945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.846506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.846657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.846807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.846978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.847203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.847356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.847510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.847652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.847804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.847967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.848148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.848298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.848453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.848597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.848746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.848898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.849050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.849201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.849686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.849840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.849986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.850128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.850293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.850446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.850599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.850788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.851027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.851175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.851325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.851482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.851640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.851783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.851925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.851925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.852261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.852426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.852570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.852711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.852860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.853002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.853143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.853293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.853435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.853435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.853712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.853860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.854012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.854163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.854329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.854480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.854622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.854771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.854922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.855065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.855206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.855349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.855490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.855631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.855783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.855932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.856074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.856291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.856445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.856595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.856751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.856894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.857042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.857203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.857420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.857576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.857727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.857727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.858017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.858179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.858321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.858478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.859136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.859286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.859438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.859581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.859810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.859969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.860137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.860297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.860442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.860583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.860734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.860895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.861055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.861264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.861417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.861561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.861712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.861855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.862005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.862155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.862297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.862439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.862591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.862744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.862897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.863039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.863187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.863337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.863493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.863646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.863796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.863939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.864080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.864273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.864432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.864575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.864727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.864880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.865030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.865179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.865339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.865489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.865631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.865774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.865914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.866064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.866207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.866356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.866515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.866664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.866808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.866963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.867113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.867263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.867424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.867649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.867798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.867961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.868122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.868282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.868434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.868593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.868736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.868888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.869030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.869172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.869312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.869454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.869604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.869755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.869990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.870136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.870278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.870419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.870580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.870723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.870872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.871023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.871165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.871396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.871559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.871710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.871853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.872003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.872183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.872333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.872486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.872640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.872788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.872931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.873084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.873305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.873450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.873450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.873729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.873878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.874038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.874038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.874931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.875087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.875239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.875391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.875534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.875676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.875817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.875958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.876163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.876322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.876479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.876630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.876630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.876923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.877090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.877235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.877384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.877536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.877766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.877929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.878078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.878220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.878412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.878582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.878734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.878877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.879026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.879219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.879369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.879522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.879666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.879808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.879979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.880259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.880445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.880674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.880831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.880974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.881116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.881266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.881266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.881655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.881799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.881941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.882094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.882238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.882398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.882549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.882699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.882850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.882993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.883136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.883306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.883456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.883607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.883758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.883909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.884059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.884236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.884389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.884541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.884684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.884960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.885135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.885283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.885443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.885594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.885745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.885896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.886053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.886196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.886346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.886529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.886679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.886829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.886982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.887132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.887313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.887472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.887615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.887784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.887955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.888180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.888342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.888493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.888644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.888797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.888939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.889088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.889238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.889390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.889539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.889691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.889872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.890024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.890193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.890484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.890484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.890850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.891054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.891207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.891358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.891520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.891744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.891943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.892095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.892261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.892462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.892615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.892775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.892920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.893063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.893205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.893347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.893496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.893648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.893810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.893953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.894096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.894245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.894388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.894543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.894543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.894814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.895017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.895168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.895318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.895510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.895663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.895816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.895959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.896143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.896349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.896496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.896690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.896842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.897030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.897195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.897393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.897558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.897708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.897856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.898027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.898185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.898350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.898541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.898737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.898737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.899021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.899214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.899381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.899532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.899681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.899884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.900061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.900248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.900420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.900646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.900803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.900954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.900954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.901260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.901418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.901575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.901746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.901991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.902147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.902317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.902475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.902633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.902790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.902790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.903090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.903253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.903404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.903561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.903711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.903859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.904126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.904285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.904446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.904595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.904755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.904905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.905069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.905226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.905404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.905404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.905737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.905888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.906047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.906206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.906356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.906515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.906666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.906816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.906974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.907125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.907281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.907432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.907581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.907741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.907905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.908067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.908288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.908448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.908608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.908608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.908608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.908608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.909197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.909354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.909504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.909661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.909820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.909970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.910118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.910266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.910426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.910589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.910835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.910999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.911150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.911298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.911455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.911683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.911844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.912077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.912263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.912415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.912654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.912896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.913050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.913207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.913359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.913518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.913675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.913825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.913974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.914123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.914285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.914450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.914600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.914756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.914925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.915083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.915241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.915399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.915557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.915708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.915863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.916020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.916205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.916372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.916538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.916688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.916845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.917014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.917174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.917325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.917474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.917622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.917771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.917926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.918088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.918248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.918493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.918658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.918825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.918986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.919145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.919296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.919451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.919609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.919790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.919949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.920219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.920380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.920559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.920757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.920994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.921721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.921886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.922062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.922284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.922448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.922599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.922769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.922920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.923077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.923227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.923378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.923536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.923697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.923848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.924007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.924175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.924331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.924493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.924654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.924804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.924954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.925111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.925261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.925424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.925582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.925740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.925889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.926053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.926210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.926374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.926526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.926682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.926832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.926988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.927147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.927310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.927468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.927627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.927778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.927964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.928154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.928395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.928557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.928715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.928871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.929021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.929236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.929402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.929553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.929702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.929859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.930018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.930187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.930346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.930501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.930657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.930822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.930992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.931213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.931382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.931534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.931690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.931854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.932004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.932182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.932429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.932586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.932744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.932909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.933060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.933207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.933363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.933522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.933680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.933841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.933992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.934140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.934306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.934456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.934614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.934771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.934932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.935082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.935231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.935379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.935541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.935691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.935691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.935984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.936199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.936367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.936534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.936733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.936733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.937536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.937687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.937835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.938007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.938160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.938317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.938483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.938640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.938800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.938961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.939111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.939269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.939420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.939577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.939741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.939892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.940040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.940215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.940366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.940516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.940678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.940829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.940987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.941136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.941377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.941533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.941697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.941856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.942007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.942164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.942315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.942556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.942713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.942863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.943034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.943185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.943335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.943497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.943647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.943805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.943962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.944146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.944315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.944477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.944627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.944776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.944931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.945100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.945250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.945409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.945572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.945730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.945886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.946035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.946199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.946348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.946497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.946653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.946803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.946959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.947132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.947282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.947430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.947579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.947735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.947891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.948059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.948242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.948400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.948559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.948715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.948865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.949036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.949187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.949338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.949494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.949687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.949860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.950020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.950223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.950374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.950522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.950672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.950946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.951110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.951280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.951515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.951679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.951831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.951991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.952171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.952365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.952537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.952758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.952913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.953073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.953223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.953375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.953534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.953684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.953843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.953993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.954143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.954292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.954450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.954600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.954762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.954913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.955062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.955219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.955376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.955543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.955707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.955857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.956008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.956185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.956349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.956499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.956661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.956818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.956978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.957127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.957283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.957452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.957603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.957603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.957914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.958069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.958219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.958382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.958533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.958681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.958839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.958990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.959141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.959298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.959465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.959623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.959780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.959930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.960080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.960299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.960452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.960608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.960758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.960907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.961069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.961219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.961378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.961553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.961782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.961945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.962108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.962259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.962410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.962566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.962740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.962972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.963135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.963286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.963436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.963607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.963758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.963922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.964080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.964265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.964421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.964570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.964718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.964877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.965028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.965176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.965345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.965495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.965654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.965806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.965962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.966119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.966270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.966420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.966578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.966735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.966892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.967051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.967211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.967368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.967520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.967668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.967826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.968621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.968783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.968943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.969100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.969258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.969409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.969569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.969734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.969899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.970050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.970200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.970356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.970507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.970667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.970825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.970976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.970976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.971259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.971409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.971567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.971730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.971966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.972139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.972305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.972305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.972600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.972752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.972910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.973145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.973298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.973298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.973592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.973743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.973903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.974060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.974218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.974633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.974795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.974795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.975089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.975239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.975388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.975551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.975702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.975851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.976010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.976188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.976355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.976515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.976665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.976823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.976980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.976980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.977265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.977423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.977574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.977723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.977880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.978048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.978212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.978378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.978533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.978682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.978839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.978997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.979157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.979314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.979471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.979471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.979762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.979912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.980082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.980257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.980408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.980556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.980717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.980866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.981092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.981254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.981404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.981560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.981718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.981876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.982121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.982286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.982446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.982446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.982739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.982903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.983054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.983296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.983451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.984165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.984343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.984517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.984669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.984829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.985103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.985276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.985438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.985598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.985757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.985907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.986057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.986214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.986379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.986529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.986685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.986843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.987011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.987161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.987321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.987473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.987622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.987771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.987928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.988078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.988269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.988430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.988591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.988742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.988891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.989058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.989218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.989369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.989519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.989676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.989835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.989995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.990159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.990317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.990469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.990618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.990820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.991002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.991174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.991336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.991494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.991652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.991802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.991965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.992156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.992378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.992542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.992696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.992696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.993056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.993217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.993451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.993606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.993757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.993757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.994062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.994214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.994363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.994512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.994670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.994835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.994994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.995144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.995304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.995452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.995611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.995771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.995929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.996078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.996255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.996406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.996572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.996733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.996887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.997044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.997194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.997358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.997517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.997676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.997833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.997990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.998148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.998305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.998477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.998636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.998793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.998950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.999101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.999304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.999457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.999606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.999765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:55.999926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.000077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.000311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.000472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.000623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.000780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.000938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.001098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.001268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.001418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.001567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.001725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.001883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.002048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.002212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.002380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.002608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.002771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.002924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.003089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.003240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.003401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.003644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.003806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.003957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.004153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.004312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.004472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.004623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.004773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.004773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.005072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.005224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.005392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.005543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.005700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.005865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.006016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.006166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.006316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.006466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.006624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.006784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.006935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.007085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.007259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.007420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.007571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.007734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.007893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.008080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.008255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.008449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.008619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.008778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.008929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.009079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.009236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.009407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.009937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.010275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.010449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.010602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.010762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.010913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.011080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.011232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.011391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.011594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.011762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.012010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.012187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.012356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.012510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.012758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.012923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.013086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.013238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.013395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.013556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.013799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.013964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.014125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.014287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.014446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.014604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.014784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.014943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.015103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.015255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.015404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.015553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.015704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.015863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.015863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.016220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.016389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.016539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.016690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.016857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.017015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.017167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.017324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.017474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.017624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.017788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.017939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.018097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.018255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.018424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.018424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.018722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.018889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.019040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.019189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.019346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.019575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.019740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.019900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.020050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.020235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.020408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.020569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.020720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.020877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.021036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.021186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.021335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.021499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.021649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.021798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.021956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.022106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.022255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.022432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.022584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.022760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.022982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.023137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.023316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.023582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.023776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.024005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.024225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.024408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.024579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.024731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.024899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.025050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.025200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.025350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.025509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.025659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.025808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.025957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.026114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.026290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.026441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.026590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.026756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.026907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.027057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.027221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.027372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.027529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.027680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.027836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.027993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.028266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.028456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.028612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.028773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.028930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.029096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.029253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.029404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.029553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.029710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.029859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.030017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.030168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.030327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.031042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.031203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.031375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.031536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.031687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.031849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.032008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.032177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.032345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.032498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.032656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.032814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.032985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.033220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.033397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.033558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.033715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.033873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.034120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.034283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.034447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.034599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.034757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.034915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.035073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.035222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.035383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.035544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 06:48:56.035696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.035696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 06:48:56.035696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 06:48:56.088305 n-d-861333-10 devstack@n-api.service[127568]: INFO dbcounter [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Registered counter for database nova_api Oct 19 06:48:56.088634 n-d-861333-10 devstack@n-api.service[127567]: INFO dbcounter [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Registered counter for database nova_api Oct 19 06:48:56.110484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_db.sqlalchemy.engines [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:48:56.112039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_db.sqlalchemy.engines [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:48:56.117890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writer thread running {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:48:56.118894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writer thread running {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:48:56.175056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.context [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) {{(pid=127568) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 06:48:56.175270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.context [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) {{(pid=127567) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 06:48:56.179153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:48:56.179304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:48:56.179640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:48:56.179750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:48:56.181247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:48:56.181359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:48:56.181984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:48:56.182082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:48:56.182435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:48:56.182554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:48:56.184470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:48:56.184597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:48:56.186462 n-d-861333-10 devstack@n-api.service[127567]: INFO dbcounter [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Registered counter for database nova_cell0 Oct 19 06:48:56.186566 n-d-861333-10 devstack@n-api.service[127568]: INFO dbcounter [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Registered counter for database nova_cell0 Oct 19 06:48:56.190574 n-d-861333-10 devstack@n-api.service[127568]: INFO dbcounter [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Registered counter for database nova_cell1 Oct 19 06:48:56.190693 n-d-861333-10 devstack@n-api.service[127567]: INFO dbcounter [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Registered counter for database nova_cell1 Oct 19 06:48:56.197896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_db.sqlalchemy.engines [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:48:56.200144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_db.sqlalchemy.engines [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:48:56.201610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_db.sqlalchemy.engines [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:48:56.203380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_db.sqlalchemy.engines [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:48:56.205550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writer thread running {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:48:56.206678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writer thread running {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:48:56.211990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writer thread running {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:48:56.352322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writer thread running {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:48:56.361700 n-d-861333-10 devstack@n-api.service[127567]: INFO dbcounter [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Registered counter for database nova_cell0 Oct 19 06:48:56.361850 n-d-861333-10 devstack@n-api.service[127568]: INFO dbcounter [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Registered counter for database nova_cell0 Oct 19 06:48:56.369924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_db.sqlalchemy.engines [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:48:56.372333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_db.sqlalchemy.engines [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 06:48:56.376797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writer thread running {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:48:56.377010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writer thread running {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 06:48:56.694824 n-d-861333-10 devstack@n-api.service[127568]: WARNING keystonemiddleware.auth_token [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 06:48:56.695756 n-d-861333-10 devstack@n-api.service[127567]: WARNING keystonemiddleware.auth_token [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 06:48:56.702066 n-d-861333-10 devstack@n-api.service[127568]: WARNING keystonemiddleware.auth_token [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 06:48:56.703570 n-d-861333-10 devstack@n-api.service[127567]: WARNING keystonemiddleware.auth_token [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 06:48:57.045323 n-d-861333-10 devstack@n-api.service[127567]: WARNING keystonemiddleware.auth_token [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 06:48:57.048449 n-d-861333-10 devstack@n-api.service[127568]: WARNING keystonemiddleware.auth_token [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 06:48:57.051884 n-d-861333-10 devstack@n-api.service[127567]: WARNING keystonemiddleware.auth_token [None req-18eca131-fe17-4b69-a40a-e186fb48c3cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 06:48:57.054442 n-d-861333-10 devstack@n-api.service[127568]: WARNING keystonemiddleware.auth_token [None req-e28f6d4a-b4ab-4289-9ed1-34026d8bcf77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 06:48:57.057276 n-d-861333-10 devstack@n-api.service[127567]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a71f329c0 pid: 127567 (default app) Oct 19 06:48:57.059744 n-d-861333-10 devstack@n-api.service[127568]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a71f329c0 pid: 127568 (default app) Oct 19 06:49:38.474429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:38.475260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:38.476598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:38.477653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:39.775923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:39.775923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:39.775923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:39.775923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:39.822102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a6ed774-92f3-40e1-a579-1cc845b71fa0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:39.822102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6ed774-92f3-40e1-a579-1cc845b71fa0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:39.823447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6ed774-92f3-40e1-a579-1cc845b71fa0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:39.823447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6ed774-92f3-40e1-a579-1cc845b71fa0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:39.823447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6ed774-92f3-40e1-a579-1cc845b71fa0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:39.823928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6ed774-92f3-40e1-a579-1cc845b71fa0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:39.824325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6ed774-92f3-40e1-a579-1cc845b71fa0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:39.870399 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a6ed774-92f3-40e1-a579-1cc845b71fa0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.401157 Oct 19 06:49:39.873655 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1/1] 10.222.0.39 () {58 vars in 1176 bytes} [Wed Oct 19 06:49:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:39.887214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-564f0349-8d80-405b-8ef4-403513ea96f0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-713854065"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:39.907267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-564f0349-8d80-405b-8ef4-403513ea96f0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Generated uuid ba5ccdb4-7518-4393-8e7c-dcb3e48264f1 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:49:40.010140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-564f0349-8d80-405b-8ef4-403513ea96f0 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.126473 Oct 19 06:49:40.010748 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2/2] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:49:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:49:40.025171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3157ab4-a95a-4f16-9ab0-e77ae69f581c tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:40.049190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3157ab4-a95a-4f16-9ab0-e77ae69f581c tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:40.049686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3157ab4-a95a-4f16-9ab0-e77ae69f581c tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:40.050124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3157ab4-a95a-4f16-9ab0-e77ae69f581c tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:40.789972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Calling method '.version_select at 0x7f6d662dec10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:40.798053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) {{(pid=127568) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 19 06:49:40.798774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:40.799243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:40.799669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:40.825042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:40.825566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:40.826046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:40.838366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:40.838834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:40.839265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:40.848800 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19fbb443-2a28-42b6-b1ac-b230336cae99 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.200574 Oct 19 06:49:40.848800 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1208 bytes} [Wed Oct 19 06:49:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:49:41.010510 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3157ab4-a95a-4f16-9ab0-e77ae69f581c tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.990990 Oct 19 06:49:41.011103 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3/4] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:49:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:49:41.029899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '.version_select at 0x7f6d66397a60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:41.032279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:41.032764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:41.033193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:41.050358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:41.050849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:41.051291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:41.064418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:41.064908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:41.065348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:41.071649 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce54f2bc-9aec-4392-8ea7-2c963427b564 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.224501 Oct 19 06:49:41.072411 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2/5] 10.222.0.39 () {58 vars in 1167 bytes} [Wed Oct 19 06:49:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:41.128668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4ecc650-8105-4ac2-b270-bcc3d92eb7ec tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1343420561", "id": 704090978, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:41.216663 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4ecc650-8105-4ac2-b270-bcc3d92eb7ec tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.204309 Oct 19 06:49:41.217422 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4/6] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:41 2022] POST /compute/v2.1/flavors => generated 427 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:41.288874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-098cf2cd-36af-428f-ad44-5367b84a06e6 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:41.290442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-098cf2cd-36af-428f-ad44-5367b84a06e6 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:41.290923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-098cf2cd-36af-428f-ad44-5367b84a06e6 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:41.291360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-098cf2cd-36af-428f-ad44-5367b84a06e6 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:41.292080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-098cf2cd-36af-428f-ad44-5367b84a06e6 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:41.292555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-098cf2cd-36af-428f-ad44-5367b84a06e6 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:41.292981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-098cf2cd-36af-428f-ad44-5367b84a06e6 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:41.333669 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-098cf2cd-36af-428f-ad44-5367b84a06e6 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.260277 Oct 19 06:49:41.334246 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1164 bytes} [Wed Oct 19 06:49:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:41.337723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-714295dd-a2e8-429a-826a-07437461ffc0 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2132158854", "id": 896549186, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:41.432334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f91c2d2c-0625-46a1-a495-309e2d66a78c tempest-AZAdminNegativeTestJSON-2011464236 tempest-AZAdminNegativeTestJSON-2011464236-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:41.433876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f91c2d2c-0625-46a1-a495-309e2d66a78c tempest-AZAdminNegativeTestJSON-2011464236 tempest-AZAdminNegativeTestJSON-2011464236-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '9b7e238f87b846faac97c3c2544aa8b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6601449606464b8818afee9a901984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f91c2d2c-0625-46a1-a495-309e2d66a78c tempest-AZAdminNegativeTestJSON-2011464236 tempest-AZAdminNegativeTestJSON-2011464236-project] Request method failure captured: Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54B1kUAkQ0rgYOe8Z6h_u1BeQ2hTrMZkqyeTUlIcwEnn_dVKd6FVbHUBlM_4MKBsdslOpiCMqWUt7J4L-yCKfp2D3UWdVmjXER9jJ_lWGh_j8mgjjauLMxZCmHJN-A9wpU04h21akY2xy0lWMpSxvGFUfLu72Wh73cEhNJYXz94jTU Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 1f6601449606464b8818afee9a901984 Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2011464236 Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:49:41.437396 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1f6601449606464b8818afee9a901984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1f6601449606464b8818afee9a901984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1f6601449606464b8818afee9a901984"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1f6601449606464b8818afee9a901984", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AZAdminNegativeTestJSON-2011464236 Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 1f6601449606464b8818afee9a901984 Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2011464236 Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AZAdminNegativeTestJSON-2011464236-project Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 9b7e238f87b846faac97c3c2544aa8b2 Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AZAdminNegativeTestJSON-2011464236-project Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 19 06:49:41.438659 n-d-861333-10 devstack@n-api.service[127568]: action_args: {} Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:41.439349 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.440539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f91c2d2c-0625-46a1-a495-309e2d66a78c tempest-AZAdminNegativeTestJSON-2011464236 tempest-AZAdminNegativeTestJSON-2011464236-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:41.441610 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f91c2d2c-0625-46a1-a495-309e2d66a78c tempest-AZAdminNegativeTestJSON-2011464236 tempest-AZAdminNegativeTestJSON-2011464236-project] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.103620 Oct 19 06:49:41.441610 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1185 bytes} [Wed Oct 19 06:49:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 104 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:41.443797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03c7cc7a-eb90-4d0f-ac56-0eb9e728de71 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:41.447103 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-714295dd-a2e8-429a-826a-07437461ffc0 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.228437 Oct 19 06:49:41.456742 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 5/9] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:41 2022] POST /compute/v2.1/flavors => generated 428 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:41.476981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03c7cc7a-eb90-4d0f-ac56-0eb9e728de71 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:41.477476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03c7cc7a-eb90-4d0f-ac56-0eb9e728de71 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:41.478119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03c7cc7a-eb90-4d0f-ac56-0eb9e728de71 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:41.549047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-03c7cc7a-eb90-4d0f-ac56-0eb9e728de71 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-861333-10. Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03c7cc7a-eb90-4d0f-ac56-0eb9e728de71 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Request method failure captured: Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 40 Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54CHyXnxcY_BZ7RcOeMhveEDVsBqhyQpMx83MmBuO3cDwWyTU-XZwhGnBD-JtLDkKri3l1Ipivj7pvs3dUe_u6jQEOOZvhUloAwUxT6uPv3mAcJktOLBtBeN2xmmulQh9wMzDflATScGwOUbXlx15mnZ1UgHDKl5poaDzjLyP0OdTE Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:41.563059 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0cff4856e6284bd1884c414f89d14493", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8ab63b69ed624e6c888ca1babe8ef28b Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: {"add_host": {"host": "n-h1-861333-10"}} Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:41.564435 n-d-861333-10 devstack@n-api.service[127568]: exception: Aggregate 1 already has host n-h1-861333-10. Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-861333-10'}}} Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 06:49:41.565255 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-861333-10-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi session.flush() Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 06:49:41.566365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 06:49:41.567317 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 06:49:41.570901 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-861333-10-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 19, 6, 49, 41, 509480), 'updated_at': None, 'host': 'n-h1-861333-10', 'aggregate_id': 1}] Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:41.572141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-861333-10. Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.573131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-861333-10. Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:41.574389 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:41.575741 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-861333-10. Oct 19 06:49:41.575741 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:41.575741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03c7cc7a-eb90-4d0f-ac56-0eb9e728de71 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-861333-10. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:41.575741 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03c7cc7a-eb90-4d0f-ac56-0eb9e728de71 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.124425 Oct 19 06:49:41.575741 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 5/10] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:49:41 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 19 06:49:41.575741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-666f6184-d242-419e-a017-c0d5df0f8a31 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:41.576146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd254188-9608-4de1-83d5-0b3045a9b716 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1518407124", "id": 1732769177, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:41.638228 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd254188-9608-4de1-83d5-0b3045a9b716 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.180298 Oct 19 06:49:41.638810 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 6/11] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:41 2022] POST /compute/v2.1/flavors => generated 439 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:41.643718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aca1ff7a-da07-448f-a5d8-2b421cc87aa3 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:41.645441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aca1ff7a-da07-448f-a5d8-2b421cc87aa3 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:41.645928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aca1ff7a-da07-448f-a5d8-2b421cc87aa3 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:41.646365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aca1ff7a-da07-448f-a5d8-2b421cc87aa3 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:41.652675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aca1ff7a-da07-448f-a5d8-2b421cc87aa3 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:41.653499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aca1ff7a-da07-448f-a5d8-2b421cc87aa3 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:41.653985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aca1ff7a-da07-448f-a5d8-2b421cc87aa3 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:41.677470 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aca1ff7a-da07-448f-a5d8-2b421cc87aa3 tempest-AZAdminV2TestJSON-107193344 tempest-AZAdminV2TestJSON-107193344-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.037617 Oct 19 06:49:41.677987 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 7/12] 10.222.0.39 () {58 vars in 1185 bytes} [Wed Oct 19 06:49:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:41.682246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11f23730-f830-4a5f-833a-6bdcad1502a9 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d95bd99192dc4324ba3b386b906a55a4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:41.686494 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-666f6184-d242-419e-a017-c0d5df0f8a31 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/704090978" status: 202 len: 0 microversion: 2.1 time: 0.118933 Oct 19 06:49:41.686494 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 6/13] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 06:49:41 2022] DELETE /compute/v2.1/flavors/704090978 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:41.692241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4d6189f-aa74-43d1-8e5e-f1255660b289 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:41.703124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d6189f-aa74-43d1-8e5e-f1255660b289 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:41.703696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d6189f-aa74-43d1-8e5e-f1255660b289 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:41.704220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d6189f-aa74-43d1-8e5e-f1255660b289 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:42.271712 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11f23730-f830-4a5f-833a-6bdcad1502a9 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/896549186/action" status: 200 len: 96 microversion: 2.1 time: 0.592622 Oct 19 06:49:42.277217 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 8/14] 10.222.0.39 () {60 vars in 1197 bytes} [Wed Oct 19 06:49:41 2022] POST /compute/v2.1/flavors/896549186/action => generated 96 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:42.281274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db19b001-b071-4337-b0cc-92cf04fba77d tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:42.547416 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4d6189f-aa74-43d1-8e5e-f1255660b289 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.858704 Oct 19 06:49:42.548002 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 7/15] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:49:41 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:42.552951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b747d6f8-50f0-4ea8-976e-30c7947178a1 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:42.583798 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b747d6f8-50f0-4ea8-976e-30c7947178a1 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034569 Oct 19 06:49:42.584405 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:42.626349 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db19b001-b071-4337-b0cc-92cf04fba77d tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1732769177/action" status: 200 len: 97 microversion: 2.1 time: 0.345368 Oct 19 06:49:42.626349 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 9/17] 10.222.0.39 () {60 vars in 1200 bytes} [Wed Oct 19 06:49:42 2022] POST /compute/v2.1/flavors/1732769177/action => generated 97 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:42.630163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d0aa898-98ed-48c4-b982-f95057109a48 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:42.722860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e68fcd4-7415-4f71-813e-faa291adc224 tempest-FlavorsAccessTestJSON-303078835 tempest-FlavorsAccessTestJSON-303078835-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:42.733637 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d0aa898-98ed-48c4-b982-f95057109a48 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.112164 Oct 19 06:49:42.735436 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 10/18] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:49:42 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:49:42.748245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23cd1745-b217-4a78-9d57-495bdaf15a27 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1700349133", "id": 11797518, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:42.759573 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e68fcd4-7415-4f71-813e-faa291adc224 tempest-FlavorsAccessTestJSON-303078835 tempest-FlavorsAccessTestJSON-303078835-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.174081 Oct 19 06:49:42.760315 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 9/19] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:42 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:42.765477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6a56f42-2d57-416d-9b63-1009b0f187dc tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:42.829967 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23cd1745-b217-4a78-9d57-495bdaf15a27 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.086715 Oct 19 06:49:42.830874 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:42 2022] POST /compute/v2.1/flavors => generated 411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:42.835305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78988d69-ae85-4f19-9b56-5c6f41fb68e9 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1250594354"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:42.839059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-78988d69-ae85-4f19-9b56-5c6f41fb68e9 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Generated uuid d64a07a6-754a-4d26-bbe4-6a615760a9ec for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:49:42.878450 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-d6a56f42-2d57-416d-9b63-1009b0f187dc tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 3295d3c2ec724c01a07d60e8c5446193 combination. Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6a56f42-2d57-416d-9b63-1009b0f187dc tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Request method failure captured: Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/flavors/1732769177/action HTTP/1.1 Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 67 Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54Esh1XRB1nVo1rlEONt7FKponSf7kJyDQXrCp3wMiaUOQGblEbn0Fe6irrGEu-3Uc-_wRbIogEmF3wNrHk5elIGHPZEpfeVkAtYJy-bsoTBsJack8-DxqianalNORFmz4_pRkkuHgvaND0E9uNd-e5V1So3aVW31ZYzYd4I5NpcV8 Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 199b8700df5c48f5a987d64d3f408a45 Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1276732089 Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:42.882586 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/199b8700df5c48f5a987d64d3f408a45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/199b8700df5c48f5a987d64d3f408a45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/199b8700df5c48f5a987d64d3f408a45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_199b8700df5c48f5a987d64d3f408a45", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1276732089 Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 199b8700df5c48f5a987d64d3f408a45 Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1276732089 Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8e05a66f2f0e4ff68c9d34455aa1ba3c Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: {"addTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} Oct 19 06:49:42.883669 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: exception: Flavor access already exists for flavor 17 and project 3295d3c2ec724c01a07d60e8c5446193 combination. Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1732769177', 'body': {'addTenantAccess': {'tenant': '3295d3c2ec724c01a07d60e8c5446193'}}} Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 06:49:42.884296 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-3295d3c2ec724c01a07d60e8c5446193' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi session.flush() Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 06:49:42.885470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 06:49:42.886593 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 06:49:42.887842 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-3295d3c2ec724c01a07d60e8c5446193' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 19, 6, 49, 42, 839919), 'updated_at': None, 'flavor_id': 17, 'project_id': '3295d3c2ec724c01a07d60e8c5446193'}] Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:42.891397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project 3295d3c2ec724c01a07d60e8c5446193 combination. Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:42.892493 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project 3295d3c2ec724c01a07d60e8c5446193 combination. Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:42.893686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:42.894853 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project 3295d3c2ec724c01a07d60e8c5446193 combination. Oct 19 06:49:42.894853 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:42.894853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6a56f42-2d57-416d-9b63-1009b0f187dc tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 3295d3c2ec724c01a07d60e8c5446193 combination. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:42.894853 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6a56f42-2d57-416d-9b63-1009b0f187dc tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1732769177/action" status: 409 len: 152 microversion: 2.1 time: 0.122613 Oct 19 06:49:42.894853 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 10/21] 10.222.0.39 () {60 vars in 1200 bytes} [Wed Oct 19 06:49:42 2022] POST /compute/v2.1/flavors/1732769177/action => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:49:42.894853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fffa3826-67ec-4f08-acf6-025ea4f3b921 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1898100931", "name": "tempest-test_aggregate-1062698032"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:42.918793 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78988d69-ae85-4f19-9b56-5c6f41fb68e9 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.086637 Oct 19 06:49:42.920119 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 12/22] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:49:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:42.936612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cc0157f-f518-4189-a0c3-0411d3f95b78 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d95bd99192dc4324ba3b386b906a55a4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:42.946493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-fffa3826-67ec-4f08-acf6-025ea4f3b921 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Generated uuid adc30eb7-3092-4e59-890e-a93b67186902 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:49:43.026486 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fffa3826-67ec-4f08-acf6-025ea4f3b921 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.137502 Oct 19 06:49:43.027082 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 11/23] 10.222.0.39 () {60 vars in 1165 bytes} [Wed Oct 19 06:49:42 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:43.032214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26735fba-c8a2-4634-8c3d-9693d67aa359 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:43.052086 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26735fba-c8a2-4634-8c3d-9693d67aa359 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.023826 Oct 19 06:49:43.052681 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:43 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:43.063430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cff80fec-035d-43b6-a340-f3d2a4225616 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:43.512702 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cff80fec-035d-43b6-a340-f3d2a4225616 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1732769177/action" status: 200 len: 21 microversion: 2.1 time: 0.454421 Oct 19 06:49:43.513293 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 13/25] 10.222.0.39 () {60 vars in 1200 bytes} [Wed Oct 19 06:49:43 2022] POST /compute/v2.1/flavors/1732769177/action => generated 21 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:43.587691 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5cc0157f-f518-4189-a0c3-0411d3f95b78 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/896549186/action" status: 200 len: 21 microversion: 2.1 time: 0.665675 Oct 19 06:49:43.588495 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 13/26] 10.222.0.39 () {60 vars in 1197 bytes} [Wed Oct 19 06:49:42 2022] POST /compute/v2.1/flavors/896549186/action => generated 21 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:43.596357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac773d46-1eb4-410e-bfd2-94603f7fe398 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:43.610520 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac773d46-1eb4-410e-bfd2-94603f7fe398 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.020936 Oct 19 06:49:43.611296 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:49:43 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:43.615721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ced957e-049d-46ea-811a-2b81e1ebb4a0 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:43.708610 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ced957e-049d-46ea-811a-2b81e1ebb4a0 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/11797518" status: 202 len: 0 microversion: 2.1 time: 0.096081 Oct 19 06:49:43.712920 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 15/28] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:49:43 2022] DELETE /compute/v2.1/flavors/11797518 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:43.718319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a503565e-f75f-4c28-9326-0918bdd3ec3f tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:43.731575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0924448-683a-40df-93a2-cc4bc7233972 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:43.737353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0924448-683a-40df-93a2-cc4bc7233972 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '72ca823747e34494a2117e9fb885b6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117b129cac5f421eb3c00e935c695d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0924448-683a-40df-93a2-cc4bc7233972 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Request method failure captured: Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 40 Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT53_juCqGmIhkAqdJ10Q5RYU7OyWpFIMh2ee7VXb0es9zqs03useyl5hsFD607cAvefhSfqzsu3-u6OxHX9Urdt_mPnsyqniZzB1RDeMZTtUlWcWottLq-fU4uwkLlWYFHzZYmBqps8fQXWWtBIqy6M6PA9PButCWjp3QnYZqlDUE5k Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:49:43.738149 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_117b129cac5f421eb3c00e935c695d28", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 72ca823747e34494a2117e9fb885b6b2 Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: {"add_host": {"host": "n-h1-861333-10"}} Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:43.739447 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-861333-10'}}} Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:43.740198 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 19 06:49:43.741097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:43.741987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0924448-683a-40df-93a2-cc4bc7233972 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:43.741987 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0924448-683a-40df-93a2-cc4bc7233972 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.225282 Oct 19 06:49:43.743988 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 14/29] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:49:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 230 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:43.753481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1e1160a-b5f1-42bb-8d0e-1960e3051280 tempest-FlavorsAccessTestJSON-303078835 tempest-FlavorsAccessTestJSON-303078835-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:43.772977 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1e1160a-b5f1-42bb-8d0e-1960e3051280 tempest-FlavorsAccessTestJSON-303078835 tempest-FlavorsAccessTestJSON-303078835-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026479 Oct 19 06:49:43.773530 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 15/30] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:43.777826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72b125ad-99c2-4896-8b8a-0a548717cd9c tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:43.788698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72b125ad-99c2-4896-8b8a-0a548717cd9c tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:43.789191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72b125ad-99c2-4896-8b8a-0a548717cd9c tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:43.789633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72b125ad-99c2-4896-8b8a-0a548717cd9c tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:43.845904 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a503565e-f75f-4c28-9326-0918bdd3ec3f tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1732769177" status: 202 len: 0 microversion: 2.1 time: 0.131072 Oct 19 06:49:43.848136 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 16/31] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:43 2022] DELETE /compute/v2.1/flavors/1732769177 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:43.853957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5905813-0516-4363-8dc1-2523b8c2ebde tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:43.884476 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5905813-0516-4363-8dc1-2523b8c2ebde tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035150 Oct 19 06:49:43.885328 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 17/32] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:43.889739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f792e92-924e-4f09-984c-9418ff1b48c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:43.969132 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f792e92-924e-4f09-984c-9418ff1b48c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.082135 Oct 19 06:49:43.973933 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 18/33] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:49:43 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:49:43.975380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86ada319-c35e-4174-9a65-eab30bf61bfa tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.057091 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86ada319-c35e-4174-9a65-eab30bf61bfa tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/896549186" status: 202 len: 0 microversion: 2.1 time: 0.085530 Oct 19 06:49:44.057692 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 19/34] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 06:49:43 2022] DELETE /compute/v2.1/flavors/896549186 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:44.062479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4a09482-ab7b-440d-873e-b28051ebf997 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.090726 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4a09482-ab7b-440d-873e-b28051ebf997 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031903 Oct 19 06:49:44.091519 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 20/35] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:44.110039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-966abcd1-c729-4f83-a482-6dc2826cc558 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1888120102", "id": 1437865310, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:44.116506 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72b125ad-99c2-4896-8b8a-0a548717cd9c tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 316 microversion: 2.1 time: 0.341903 Oct 19 06:49:44.117665 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 16/36] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:49:43 2022] POST /compute/v2.1/os-aggregates/3/action => generated 316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:44.124896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3248e01-8cb9-4009-873a-9a30906a6ef4 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1077989571"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:44.129398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-f3248e01-8cb9-4009-873a-9a30906a6ef4 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Generated uuid 503f284f-cb74-4991-8813-ecd596ad933d for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:49:44.179391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=10,nova_api:DELETE=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:44.184891 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-966abcd1-c729-4f83-a482-6dc2826cc558 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.083713 Oct 19 06:49:44.190328 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 21/37] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:44 2022] POST /compute/v2.1/flavors => generated 429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:44.195208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2361d3b9-6d24-4124-b706-d4701093ec27 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.217865 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2361d3b9-6d24-4124-b706-d4701093ec27 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5410 microversion: 2.1 time: 0.030825 Oct 19 06:49:44.219003 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 22/38] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:44 2022] GET /compute/v2.1/flavors/detail => generated 5410 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:44.224553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b66e659-266f-4fda-a52d-f1223a9e506b tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1758272938", "id": 1075387617, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:44.247680 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3248e01-8cb9-4009-873a-9a30906a6ef4 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.125419 Oct 19 06:49:44.247680 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 17/39] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:49:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:44.253569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69fa0159-f6bb-454f-8d1f-bdc72bd281a1 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.304151 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b66e659-266f-4fda-a52d-f1223a9e506b tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.082863 Oct 19 06:49:44.305588 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 23/40] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:44 2022] POST /compute/v2.1/flavors => generated 438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:44.322974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-045338e5-29a0-45d0-bfa4-c440b094ee88 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1341957233", "id": 1806440619, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:44.348571 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69fa0159-f6bb-454f-8d1f-bdc72bd281a1 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1437865310" status: 202 len: 0 microversion: 2.1 time: 0.101076 Oct 19 06:49:44.349228 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 18/41] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:44 2022] DELETE /compute/v2.1/flavors/1437865310 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:44.356988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-896079712"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:44.370900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:44.371385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:44.371823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:44.379815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:44.380335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:44.380766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:44.388336 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-896079712 could not be found. Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Request method failure captured: Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 57 Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54CHyXnxcY_BZ7RcOeMhveEDVsBqhyQpMx83MmBuO3cDwWyTU-XZwhGnBD-JtLDkKri3l1Ipivj7pvs3dUe_u6jQEOOZvhUloAwUxT6uPv3mAcJktOLBtBeN2xmmulQh9wMzDflATScGwOUbXlx15mnZ1UgHDKl5poaDzjLyP0OdTE Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:44.391288 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0cff4856e6284bd1884c414f89d14493", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8ab63b69ed624e6c888ca1babe8ef28b Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: {"add_host": {"host": "tempest-nonexist_host-896079712"}} Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:44.392589 n-d-861333-10 devstack@n-api.service[127568]: exception: Compute host tempest-nonexist_host-896079712 could not be found. Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-896079712'}}} Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-896079712' is not mapped to any cell Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.393441 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 19 06:49:44.394350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-896079712 could not be found. Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-896079712 could not be found. Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:44.395366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-896079712 could not be found. Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-896079712 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01c2a2eb-4185-4992-9fad-f9b92631ecf3 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.042217 Oct 19 06:49:44.396418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 19/42] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:49:44 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:44.397703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1a8296c-9bb3-4be9-8b28-0edfc9ff2fa4 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.404424 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f1a8296c-9bb3-4be9-8b28-0edfc9ff2fa4 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1a8296c-9bb3-4be9-8b28-0edfc9ff2fa4 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Request method failure captured: Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/flavors/1075387617/os-flavor-access HTTP/1.1 Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54Esh1XRB1nVo1rlEONt7FKponSf7kJyDQXrCp3wMiaUOQGblEbn0Fe6irrGEu-3Uc-_wRbIogEmF3wNrHk5elIGHPZEpfeVkAtYJy-bsoTBsJack8-DxqianalNORFmz4_pRkkuHgvaND0E9uNd-e5V1So3aVW31ZYzYd4I5NpcV8 Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 199b8700df5c48f5a987d64d3f408a45 Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1276732089 Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:44.406328 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/199b8700df5c48f5a987d64d3f408a45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/199b8700df5c48f5a987d64d3f408a45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/199b8700df5c48f5a987d64d3f408a45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_199b8700df5c48f5a987d64d3f408a45", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1276732089 Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 199b8700df5c48f5a987d64d3f408a45 Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1276732089 Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8e05a66f2f0e4ff68c9d34455aa1ba3c Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: exception: Access list not available for public flavors. Oct 19 06:49:44.410636 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'flavor_id': '1075387617'} Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 19 06:49:44.411439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.412724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1a8296c-9bb3-4be9-8b28-0edfc9ff2fa4 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:44.412724 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1a8296c-9bb3-4be9-8b28-0edfc9ff2fa4 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/1075387617/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.013528 Oct 19 06:49:44.412724 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 20/43] 10.222.0.39 () {58 vars in 1209 bytes} [Wed Oct 19 06:49:44 2022] GET /compute/v2.1/flavors/1075387617/os-flavor-access => generated 91 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:49:44.415793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1559df6-d432-4515-8e22-8df44da06df9 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.434648 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-045338e5-29a0-45d0-bfa4-c440b094ee88 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.127757 Oct 19 06:49:44.435355 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 24/44] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:44 2022] POST /compute/v2.1/flavors => generated 431 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:44.436340 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1559df6-d432-4515-8e22-8df44da06df9 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5419 microversion: 2.1 time: 0.026873 Oct 19 06:49:44.448124 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 21/45] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:44 2022] GET /compute/v2.1/flavors/detail => generated 5419 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:44.448124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14aa35a3-a7e2-44b9-a38c-a9e9b5b4462e tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.546941 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14aa35a3-a7e2-44b9-a38c-a9e9b5b4462e tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.103648 Oct 19 06:49:44.546941 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 22/46] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:49:44 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:49:44.546941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf505bff-ff92-4a3f-a602-be1a2b461c33 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.557082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:44.616778 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf505bff-ff92-4a3f-a602-be1a2b461c33 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1075387617" status: 202 len: 0 microversion: 2.1 time: 0.073151 Oct 19 06:49:44.617941 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 23/47] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:44 2022] DELETE /compute/v2.1/flavors/1075387617 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:44.623027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-928c5b9d-4cf6-4ccf-8593-fdcbcc1322a6 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.635137 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-928c5b9d-4cf6-4ccf-8593-fdcbcc1322a6 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/1806440619/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.015990 Oct 19 06:49:44.636262 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 24/48] 10.222.0.39 () {58 vars in 1209 bytes} [Wed Oct 19 06:49:44 2022] GET /compute/v2.1/flavors/1806440619/os-flavor-access => generated 21 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:44.641276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43d51301-ec2e-49fc-bd79-1faf499e0a63 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-827822128", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:44.710643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1370773463", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "availability_zone": "tempest-test_az-1898100931"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:44.738034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:44.738034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:44.738034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:44.738034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:44.738334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:44.738334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:44.789087 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43d51301-ec2e-49fc-bd79-1faf499e0a63 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.151645 Oct 19 06:49:44.789736 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 25/49] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:44 2022] POST /compute/v2.1/flavors => generated 506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:44.794564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-661863c1-b4f4-4328-a2c2-8696967b2d41 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-661863c1-b4f4-4328-a2c2-8696967b2d41 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Request method failure captured: Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 283 Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54CHyXnxcY_BZ7RcOeMhveEDVsBqhyQpMx83MmBuO3cDwWyTU-XZwhGnBD-JtLDkKri3l1Ipivj7pvs3dUe_u6jQEOOZvhUloAwUxT6uPv3mAcJktOLBtBeN2xmmulQh9wMzDflATScGwOUbXlx15mnZ1UgHDKl5poaDzjLyP0OdTE Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:44.799157 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0cff4856e6284bd1884c414f89d14493", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8ab63b69ed624e6c888ca1babe8ef28b Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:44.800488 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:49:44.801095 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:44.801723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:44.802894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:44.803791 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:49:44.803791 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:49:44.803791 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 06:49:44.803791 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:44.803791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-661863c1-b4f4-4328-a2c2-8696967b2d41 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:44.804321 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-661863c1-b4f4-4328-a2c2-8696967b2d41 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.009743 Oct 19 06:49:44.804321 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1165 bytes} [Wed Oct 19 06:49:44 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:49:44.808454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52f8c897-7d3b-42b8-97f0-259e7d8aa73a tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.830659 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52f8c897-7d3b-42b8-97f0-259e7d8aa73a tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5487 microversion: 2.1 time: 0.028581 Oct 19 06:49:44.836356 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 27/51] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:44 2022] GET /compute/v2.1/flavors/detail => generated 5487 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:44.836356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65abc0a4-9e69-4abc-82ab-229a28b6fd4b tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:44.897102 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65abc0a4-9e69-4abc-82ab-229a28b6fd4b tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1806440619" status: 202 len: 0 microversion: 2.1 time: 0.064810 Oct 19 06:49:44.900688 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 28/52] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:44 2022] DELETE /compute/v2.1/flavors/1806440619 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:44.904415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89355c08-e08a-4c3d-b70e-1b165b00acfd tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:45.022358 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89355c08-e08a-4c3d-b70e-1b165b00acfd tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/021a1de4-a1a9-4ad7-b299-847006f2c4e0" status: 202 len: 0 microversion: 2.1 time: 0.123523 Oct 19 06:49:45.022907 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 29/53] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:49:44 2022] DELETE /compute/v2.1/flavors/021a1de4-a1a9-4ad7-b299-847006f2c4e0 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:45.027769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c22374a-2dbf-4ac3-a848-b0e7343024b1 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c22374a-2dbf-4ac3-a848-b0e7343024b1 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Request method failure captured: Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 27 Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54CHyXnxcY_BZ7RcOeMhveEDVsBqhyQpMx83MmBuO3cDwWyTU-XZwhGnBD-JtLDkKri3l1Ipivj7pvs3dUe_u6jQEOOZvhUloAwUxT6uPv3mAcJktOLBtBeN2xmmulQh9wMzDflATScGwOUbXlx15mnZ1UgHDKl5poaDzjLyP0OdTE Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:45.031997 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0cff4856e6284bd1884c414f89d14493", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8ab63b69ed624e6c888ca1babe8ef28b Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: {"aggregate": {"name": ""}} Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:45.033280 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '' Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:45.034044 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 06:49:45.035415 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.040613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c22374a-2dbf-4ac3-a848-b0e7343024b1 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:45.040613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c22374a-2dbf-4ac3-a848-b0e7343024b1 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009525 Oct 19 06:49:45.040613 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 30/54] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:49:45 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:49:45.045350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5b8c599-49bb-4548-a4ef-f7f3c01c34a2 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-880422151", "id": 1659994255, "os-flavor-access:is_public": "False"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:45.108039 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5b8c599-49bb-4548-a4ef-f7f3c01c34a2 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.068420 Oct 19 06:49:45.108658 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 31/55] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:45 2022] POST /compute/v2.1/flavors => generated 438 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:45.113668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c3c7a90-785b-43b5-a8ad-4026e6826662 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:45.134668 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c3c7a90-785b-43b5-a8ad-4026e6826662 tempest-FlavorsAccessTestJSON-402712064 tempest-FlavorsAccessTestJSON-402712064-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024394 Oct 19 06:49:45.149175 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 32/56] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:45.154052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-860e4ee2-fd74-4db3-a62e-78016a713ec2 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:45.174775 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-860e4ee2-fd74-4db3-a62e-78016a713ec2 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024454 Oct 19 06:49:45.175472 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 33/57] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:45.185142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fdec79f-919b-4d6e-bec4-0ed7c9903fe9 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2061133750"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:45.189926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6fdec79f-919b-4d6e-bec4-0ed7c9903fe9 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '72ca823747e34494a2117e9fb885b6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117b129cac5f421eb3c00e935c695d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fdec79f-919b-4d6e-bec4-0ed7c9903fe9 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Request method failure captured: Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 60 Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT53_juCqGmIhkAqdJ10Q5RYU7OyWpFIMh2ee7VXb0es9zqs03useyl5hsFD607cAvefhSfqzsu3-u6OxHX9Urdt_mPnsyqniZzB1RDeMZTtUlWcWottLq-fU4uwkLlWYFHzZYmBqps8fQXWWtBIqy6M6PA9PButCWjp3QnYZqlDUE5k Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:49:45.190717 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_117b129cac5f421eb3c00e935c695d28", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 72ca823747e34494a2117e9fb885b6b2 Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: {"aggregate": {"name": "tempest-test_aggregate-2061133750"}} Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:45.192156 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2061133750'}}} Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:45.192973 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:45.194112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 19 06:49:45.195273 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.195273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fdec79f-919b-4d6e-bec4-0ed7c9903fe9 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:45.195273 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6fdec79f-919b-4d6e-bec4-0ed7c9903fe9 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011009 Oct 19 06:49:45.195273 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 34/58] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:49:45 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:45.295228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:49:45.415118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce444464-2671-4a86-8191-c5143d201570 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:45.418541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce444464-2671-4a86-8191-c5143d201570 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '7eec20287ace4e6dbefd702016bdbd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3295d3c2ec724c01a07d60e8c5446193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce444464-2671-4a86-8191-c5143d201570 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] Request method failure captured: Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/flavors/1659994255/action HTTP/1.1 Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 67 Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54BwuIxZQbNhSiMgQL1NlxIhUMLozI-7B2R_R3R-Ad-b0VDr_8wUgsKhFTULSCQBSmcOtbkQFqb0YmuxP7Yi5SdyKloo8NTEYxU_BWFInRvV6oYYKm7rN1qgr4k0ssfaWER0IEhaAwgr045FO9ZxtlIx0DX02zUWhMFhipCUyqhkPE Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 3295d3c2ec724c01a07d60e8c5446193 Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-198147661 Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:49:45.420279 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3295d3c2ec724c01a07d60e8c5446193"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3295d3c2ec724c01a07d60e8c5446193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3295d3c2ec724c01a07d60e8c5446193"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3295d3c2ec724c01a07d60e8c5446193", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-198147661 Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 3295d3c2ec724c01a07d60e8c5446193 Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-198147661 Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FlavorsAccessNegativeTestJSON-198147661-project Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 7eec20287ace4e6dbefd702016bdbd82 Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-198147661-project Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: {"addTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} Oct 19 06:49:45.422123 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1659994255', 'body': {'addTenantAccess': {'tenant': '3295d3c2ec724c01a07d60e8c5446193'}}} Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:45.422922 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 19 06:49:45.423944 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.425799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce444464-2671-4a86-8191-c5143d201570 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:45.426775 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce444464-2671-4a86-8191-c5143d201570 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] 10.222.0.39 "POST /compute/v2.1/flavors/1659994255/action" status: 403 len: 130 microversion: 2.1 time: 0.233321 Oct 19 06:49:45.427314 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 35/59] 10.222.0.39 () {60 vars in 1200 bytes} [Wed Oct 19 06:49:45 2022] POST /compute/v2.1/flavors/1659994255/action => generated 130 bytes in 234 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:45.435516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e75f580f-3c4a-44a5-b03e-298cb8197e38 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-265853673", "id": "4ce6b070-a113-4cca-a246-f0c50d5bbffa", "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:45.537389 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e75f580f-3c4a-44a5-b03e-298cb8197e38 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.106483 Oct 19 06:49:45.538149 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 36/60] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:45 2022] POST /compute/v2.1/flavors => generated 506 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:45.542899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fa3d9f2-fe0c-4491-b984-749db63c24c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-292075923"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:45.547315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-0fa3d9f2-fe0c-4491-b984-749db63c24c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Generated uuid 053110f2-4cdc-464e-9e27-9391e66c6a95 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:49:45.628911 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0fa3d9f2-fe0c-4491-b984-749db63c24c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.089598 Oct 19 06:49:45.630127 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 37/61] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:49:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:45.644630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a744c1e6-d2fc-4d00-9a8b-e11be8cf45c5 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:45.706425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:49:45.706872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:49:45.707348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:49:45.707762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:49:45.708233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:49:45.722543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:45.723173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:45.723474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:45.724218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:45.724670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:45.725091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:45.731118 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a744c1e6-d2fc-4d00-9a8b-e11be8cf45c5 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1659994255" status: 202 len: 0 microversion: 2.1 time: 0.099475 Oct 19 06:49:45.731960 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 38/62] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:45 2022] DELETE /compute/v2.1/flavors/1659994255 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:45.738582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-909bbdf0-6784-47d6-a7b6-a7f2eaba2ab2 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:45.761491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Getting quotas for project f2631c6f28d74660b55bdbe16c0cea3b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:49:45.765072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Getting quotas for user fa92d335e7cd4168b7aa7e5daa3bd518 and project f2631c6f28d74660b55bdbe16c0cea3b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:49:45.776780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:49:45.779545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:49:45.873923 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-909bbdf0-6784-47d6-a7b6-a7f2eaba2ab2 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/4ce6b070-a113-4cca-a246-f0c50d5bbffa" status: 202 len: 0 microversion: 2.1 time: 0.140524 Oct 19 06:49:45.874681 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 39/63] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:49:45 2022] DELETE /compute/v2.1/flavors/4ce6b070-a113-4cca-a246-f0c50d5bbffa => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:45.879502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fc173c1-3cc9-4040-b593-1ac97aa57dad tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-292075923"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:45.882869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-0fc173c1-3cc9-4040-b593-1ac97aa57dad tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Generated uuid a747ce15-cb0b-4b94-a882-ddba7301005c for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:49:45.891762 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0fc173c1-3cc9-4040-b593-1ac97aa57dad tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-292075923 already exists. Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fc173c1-3cc9-4040-b593-1ac97aa57dad tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Request method failure captured: Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 59 Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54CHyXnxcY_BZ7RcOeMhveEDVsBqhyQpMx83MmBuO3cDwWyTU-XZwhGnBD-JtLDkKri3l1Ipivj7pvs3dUe_u6jQEOOZvhUloAwUxT6uPv3mAcJktOLBtBeN2xmmulQh9wMzDflATScGwOUbXlx15mnZ1UgHDKl5poaDzjLyP0OdTE Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:45.893468 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0cff4856e6284bd1884c414f89d14493", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8ab63b69ed624e6c888ca1babe8ef28b Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: {"aggregate": {"name": "tempest-test_aggregate-292075923"}} Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:45.894667 n-d-861333-10 devstack@n-api.service[127568]: exception: Aggregate tempest-test_aggregate-292075923 already exists. Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-292075923'}}} Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 19 06:49:45.895455 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-292075923 already exists. Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:45.896525 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-292075923 already exists. Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-292075923 already exists. Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fc173c1-3cc9-4040-b593-1ac97aa57dad tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-292075923 already exists. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:45.897723 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0fc173c1-3cc9-4040-b593-1ac97aa57dad tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.019346 Oct 19 06:49:45.898849 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 40/64] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:49:45 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 23 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:49:45.904772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1050d963-930d-4fd1-88a8-630a9f0e5124 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:45.920968 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2c9e87b-5a12-4fca-870a-2486f5c83f73 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484128 Oct 19 06:49:45.921613 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 25/65] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:49:45.926779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d9c4f45-1533-47b2-98e9-92be02b31c28 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:45.939420 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1050d963-930d-4fd1-88a8-630a9f0e5124 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039356 Oct 19 06:49:45.941206 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 41/66] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:45.947095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d44cec0b-95ac-43ff-abee-37f0630b4975 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:45.972234 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d9c4f45-1533-47b2-98e9-92be02b31c28 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049092 Oct 19 06:49:45.973588 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 26/67] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:45.980228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c109ea8e-f128-458c-b8e8-a3ccc9f77fdf tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:45.981219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c109ea8e-f128-458c-b8e8-a3ccc9f77fdf tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:46.040509 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d44cec0b-95ac-43ff-abee-37f0630b4975 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.097292 Oct 19 06:49:46.042242 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 42/68] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:49:45 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:49:46.052697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ab83650-8ac9-4559-a690-d6a53cb5e68c tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2138075479", "id": 1503497539, "os-flavor-access:is_public": "False"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:46.088031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c109ea8e-f128-458c-b8e8-a3ccc9f77fdf tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:46.105957 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c109ea8e-f128-458c-b8e8-a3ccc9f77fdf tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1243 microversion: 2.1 time: 0.131092 Oct 19 06:49:46.107032 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 27/69] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:45 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1243 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:46.111985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e31ab602-8bc9-42d7-aa16-27be07f4e5e0 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-94193249", "id": 347725953, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:46.171486 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ab83650-8ac9-4559-a690-d6a53cb5e68c tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.128103 Oct 19 06:49:46.172068 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 43/70] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:46 2022] POST /compute/v2.1/flavors => generated 439 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:46.179388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37ca88a2-f4be-4c78-953d-3733154f81e4 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1885883153"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:46.180047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-37ca88a2-f4be-4c78-953d-3733154f81e4 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Generated uuid 9f4f3597-0db7-43e8-afdb-74f9590a8451 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:49:46.199801 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e31ab602-8bc9-42d7-aa16-27be07f4e5e0 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.091581 Oct 19 06:49:46.200433 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 28/71] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:46.205819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5aedb721-62cd-4724-9efd-f7b0cb2cf0ff tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:46.290594 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37ca88a2-f4be-4c78-953d-3733154f81e4 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.117243 Oct 19 06:49:46.294100 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 44/72] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:49:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:46.299014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3fe1a68-ead9-4eb1-8acc-5ae34f077e3b tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:46.307285 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3fe1a68-ead9-4eb1-8acc-5ae34f077e3b tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/347725953" status: 200 len: 409 microversion: 2.1 time: 0.012101 Oct 19 06:49:46.315376 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 45/73] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:49:46 2022] GET /compute/v2.1/flavors/347725953 => generated 409 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:46.319750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-422b6d98-61af-49a9-8c53-418fd151316c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:46.321425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-422b6d98-61af-49a9-8c53-418fd151316c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '72ca823747e34494a2117e9fb885b6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117b129cac5f421eb3c00e935c695d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-422b6d98-61af-49a9-8c53-418fd151316c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Request method failure captured: Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT53_juCqGmIhkAqdJ10Q5RYU7OyWpFIMh2ee7VXb0es9zqs03useyl5hsFD607cAvefhSfqzsu3-u6OxHX9Urdt_mPnsyqniZzB1RDeMZTtUlWcWottLq-fU4uwkLlWYFHzZYmBqps8fQXWWtBIqy6M6PA9PButCWjp3QnYZqlDUE5k Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:49:46.323197 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_117b129cac5f421eb3c00e935c695d28", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 72ca823747e34494a2117e9fb885b6b2 Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 19 06:49:46.324270 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '6'} Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:46.324870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.325767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-422b6d98-61af-49a9-8c53-418fd151316c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:46.326645 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-422b6d98-61af-49a9-8c53-418fd151316c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.015763 Oct 19 06:49:46.327269 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 46/74] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:49:46 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:46.644225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22219747-9bba-4fe6-a2ea-b5e033246aeb tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:46.666389 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22219747-9bba-4fe6-a2ea-b5e033246aeb tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5390 microversion: 2.1 time: 0.338622 Oct 19 06:49:46.667438 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 47/75] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:46 2022] GET /compute/v2.1/flavors/detail => generated 5390 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:46.674152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14782064-5fa4-4a73-8d35-f145b97357de tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:46.675314 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5aedb721-62cd-4724-9efd-f7b0cb2cf0ff tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1503497539/action" status: 200 len: 97 microversion: 2.1 time: 0.473817 Oct 19 06:49:46.681601 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 29/76] 10.222.0.39 () {60 vars in 1200 bytes} [Wed Oct 19 06:49:46 2022] POST /compute/v2.1/flavors/1503497539/action => generated 97 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:46.697028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cab2ef2-7ba6-4435-926f-08351c097b77 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:46.788634 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0cab2ef2-7ba6-4435-926f-08351c097b77 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/347725953" status: 202 len: 0 microversion: 2.1 time: 0.095966 Oct 19 06:49:46.790172 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 30/77] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 06:49:46 2022] DELETE /compute/v2.1/flavors/347725953 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:46.794845 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14782064-5fa4-4a73-8d35-f145b97357de tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.125899 Oct 19 06:49:46.795604 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 48/78] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:49:46 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:49:46.800668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4618c54-a336-4a2a-b322-65fb9d372c84 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:46.804845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4618c54-a336-4a2a-b322-65fb9d372c84 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '7eec20287ace4e6dbefd702016bdbd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3295d3c2ec724c01a07d60e8c5446193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:46.810183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6df93327-94f1-483f-b810-7f634faec5c2 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4618c54-a336-4a2a-b322-65fb9d372c84 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] Request method failure captured: Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/flavors/1503497539/action HTTP/1.1 Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 70 Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54BwuIxZQbNhSiMgQL1NlxIhUMLozI-7B2R_R3R-Ad-b0VDr_8wUgsKhFTULSCQBSmcOtbkQFqb0YmuxP7Yi5SdyKloo8NTEYxU_BWFInRvV6oYYKm7rN1qgr4k0ssfaWER0IEhaAwgr045FO9ZxtlIx0DX02zUWhMFhipCUyqhkPE Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 3295d3c2ec724c01a07d60e8c5446193 Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-198147661 Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:49:46.810316 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3295d3c2ec724c01a07d60e8c5446193"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3295d3c2ec724c01a07d60e8c5446193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3295d3c2ec724c01a07d60e8c5446193"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3295d3c2ec724c01a07d60e8c5446193", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-198147661 Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 3295d3c2ec724c01a07d60e8c5446193 Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-198147661 Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FlavorsAccessNegativeTestJSON-198147661-project Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 7eec20287ace4e6dbefd702016bdbd82 Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-198147661-project Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: {"removeTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} Oct 19 06:49:46.811360 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '1503497539', 'body': {'removeTenantAccess': {'tenant': '3295d3c2ec724c01a07d60e8c5446193'}}} Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can( Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:46.812669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 19 06:49:46.813802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.814832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4618c54-a336-4a2a-b322-65fb9d372c84 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:46.814832 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4618c54-a336-4a2a-b322-65fb9d372c84 tempest-FlavorsAccessNegativeTestJSON-198147661 tempest-FlavorsAccessNegativeTestJSON-198147661-project] 10.222.0.39 "POST /compute/v2.1/flavors/1503497539/action" status: 403 len: 133 microversion: 2.1 time: 0.015931 Oct 19 06:49:46.816409 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 31/79] 10.222.0.39 () {60 vars in 1200 bytes} [Wed Oct 19 06:49:46 2022] POST /compute/v2.1/flavors/1503497539/action => generated 133 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:46.820889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97de9ac1-2c6f-4860-829d-f372fafeb253 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:46.842866 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-97de9ac1-2c6f-4860-829d-f372fafeb253 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 19 06:49:46.846607 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6df93327-94f1-483f-b810-7f634faec5c2 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044486 Oct 19 06:49:46.847188 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 49/80] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97de9ac1-2c6f-4860-829d-f372fafeb253 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Request method failure captured: Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54CHyXnxcY_BZ7RcOeMhveEDVsBqhyQpMx83MmBuO3cDwWyTU-XZwhGnBD-JtLDkKri3l1Ipivj7pvs3dUe_u6jQEOOZvhUloAwUxT6uPv3mAcJktOLBtBeN2xmmulQh9wMzDflATScGwOUbXlx15mnZ1UgHDKl5poaDzjLyP0OdTE Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:49:46.849882 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0cff4856e6284bd1884c414f89d14493", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 8ab63b69ed624e6c888ca1babe8ef28b Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: exception: Aggregate -1 could not be found. Oct 19 06:49:46.856622 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '-1'} Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 06:49:46.857235 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.858613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:46.861370 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:46.861370 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:46.861370 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:46.861370 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:46.861370 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 19 06:49:46.861370 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:46.861370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97de9ac1-2c6f-4860-829d-f372fafeb253 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:46.861370 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97de9ac1-2c6f-4860-829d-f372fafeb253 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.033931 Oct 19 06:49:46.862041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca08e526-c3fe-449b-93da-99825aa7a7e7 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3295d3c2ec724c01a07d60e8c5446193"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:46.862141 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 32/81] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:49:46 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:49:46.862740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6aa0251c-cf8f-4e83-a478-6e0295be61c2 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1156428546"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:46.867012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-6aa0251c-cf8f-4e83-a478-6e0295be61c2 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Generated uuid 9309aa76-9524-4680-88a5-56a382964951 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:49:46.952615 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6aa0251c-cf8f-4e83-a478-6e0295be61c2 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.094625 Oct 19 06:49:46.953855 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 33/82] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:49:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:46.959302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc38a2b7-c6f8-4cec-b60d-4334487ca03f tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-466584049", "id": 2094819599, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:47.045763 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc38a2b7-c6f8-4cec-b60d-4334487ca03f tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.090492 Oct 19 06:49:47.046908 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 34/83] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:46 2022] POST /compute/v2.1/flavors => generated 429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:47.051366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70df38ea-2bf9-4345-88e8-a65589c2c3f7 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.052898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70df38ea-2bf9-4345-88e8-a65589c2c3f7 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '72ca823747e34494a2117e9fb885b6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117b129cac5f421eb3c00e935c695d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70df38ea-2bf9-4345-88e8-a65589c2c3f7 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Request method failure captured: Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT53_juCqGmIhkAqdJ10Q5RYU7OyWpFIMh2ee7VXb0es9zqs03useyl5hsFD607cAvefhSfqzsu3-u6OxHX9Urdt_mPnsyqniZzB1RDeMZTtUlWcWottLq-fU4uwkLlWYFHzZYmBqps8fQXWWtBIqy6M6PA9PButCWjp3QnYZqlDUE5k Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:49:47.054700 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_117b129cac5f421eb3c00e935c695d28", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 72ca823747e34494a2117e9fb885b6b2 Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 19 06:49:47.055899 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '7'} Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:47.056538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.057464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70df38ea-2bf9-4345-88e8-a65589c2c3f7 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:47.058344 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70df38ea-2bf9-4345-88e8-a65589c2c3f7 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] 10.222.0.39 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.008214 Oct 19 06:49:47.058344 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 35/84] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:47.062019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfd7450b-bbe1-4125-9de6-d4be60468cf2 tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "2094819599"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:47.073150 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-dfd7450b-bbe1-4125-9de6-d4be60468cf2 tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] HTTP exception thrown: Flavor 2094819599 could not be found. Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfd7450b-bbe1-4125-9de6-d4be60468cf2 tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] Request method failure captured: Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 107 Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54ATiM0Uy3yBas14hmTYJvn_YHHrT29YD1NA5BcS-6dS_HRWrN_jyNXQ0341mQgLeCHgu_TRh8db_2GYzMKfz2zSncjNefcPZLA7S9EnMfVnKjzksfvsBwziagROlFs8hWuZDaDpU9j8yn2SAM1jLWJZB1aCvMoPYG0aIANdnfrFXc Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 7653adc266bc477098c3f65f599a5a94 Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsAdminTestJSON-396446343 Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:49:47.076044 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7653adc266bc477098c3f65f599a5a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7653adc266bc477098c3f65f599a5a94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7653adc266bc477098c3f65f599a5a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7653adc266bc477098c3f65f599a5a94", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsAdminTestJSON-396446343 Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 7653adc266bc477098c3f65f599a5a94 Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-396446343 Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FlavorsAdminTestJSON-396446343-project Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f59b37d72f24442d87a277dfad9b5fac Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsAdminTestJSON-396446343-project Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "test", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "2094819599"}} Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:49:47.077326 n-d-861333-10 devstack@n-api.service[127567]: exception: Flavor 2094819599 could not be found. Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '2094819599'}}} Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2094819599 could not be found. Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.081489 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2094819599 could not be found. Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.082814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:47.083869 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:47.083869 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:47.083869 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:47.083869 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2094819599 could not be found. Oct 19 06:49:47.083869 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.083869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfd7450b-bbe1-4125-9de6-d4be60468cf2 tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] Returning 400 to user: Flavor 2094819599 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:47.083869 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dfd7450b-bbe1-4125-9de6-d4be60468cf2 tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.020069 Oct 19 06:49:47.083869 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 36/85] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:47 2022] POST /compute/v2.1/servers => generated 81 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:49:47.083869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-967e045c-3c6c-4a08-8c23-c45bfb82141a tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.237395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-967e045c-3c6c-4a08-8c23-c45bfb82141a tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.158056 Oct 19 06:49:47.238615 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 37/86] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:49:47 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:49:47.243369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b310c4e-9a68-457a-aea3-4570a99185c2 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.331135 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b310c4e-9a68-457a-aea3-4570a99185c2 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2094819599" status: 202 len: 0 microversion: 2.1 time: 0.091375 Oct 19 06:49:47.331706 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 38/87] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:47 2022] DELETE /compute/v2.1/flavors/2094819599 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:47.336652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5122067-277a-4b6b-9fbd-72c078ae3da3 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.337266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5122067-277a-4b6b-9fbd-72c078ae3da3 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:47.407727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5122067-277a-4b6b-9fbd-72c078ae3da3 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:47.416672 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5122067-277a-4b6b-9fbd-72c078ae3da3 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1243 microversion: 2.1 time: 0.083427 Oct 19 06:49:47.418041 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 39/88] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1243 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:47.425777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-281c25c6-675a-47b5-a77d-405b74a9d1de tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.434265 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-281c25c6-675a-47b5-a77d-405b74a9d1de tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-281c25c6-675a-47b5-a77d-405b74a9d1de tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Request method failure captured: Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54CHyXnxcY_BZ7RcOeMhveEDVsBqhyQpMx83MmBuO3cDwWyTU-XZwhGnBD-JtLDkKri3l1Ipivj7pvs3dUe_u6jQEOOZvhUloAwUxT6uPv3mAcJktOLBtBeN2xmmulQh9wMzDflATScGwOUbXlx15mnZ1UgHDKl5poaDzjLyP0OdTE Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:49:47.435980 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0cff4856e6284bd1884c414f89d14493", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 8ab63b69ed624e6c888ca1babe8ef28b Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: exception: Aggregate -1 could not be found. Oct 19 06:49:47.441819 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '-1'} Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.444931 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 19 06:49:47.446136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.447631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-281c25c6-675a-47b5-a77d-405b74a9d1de tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:47.447631 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-281c25c6-675a-47b5-a77d-405b74a9d1de tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.018375 Oct 19 06:49:47.448823 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 40/89] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:49:47.455582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64340bec-1d52-46d5-885e-b0220d963a11 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.488986 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64340bec-1d52-46d5-885e-b0220d963a11 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038478 Oct 19 06:49:47.490117 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 41/90] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:47.495908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04ed9052-52ba-483e-97ce-b1375d4d489c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.497959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04ed9052-52ba-483e-97ce-b1375d4d489c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '72ca823747e34494a2117e9fb885b6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117b129cac5f421eb3c00e935c695d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04ed9052-52ba-483e-97ce-b1375d4d489c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Request method failure captured: Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT53_juCqGmIhkAqdJ10Q5RYU7OyWpFIMh2ee7VXb0es9zqs03useyl5hsFD607cAvefhSfqzsu3-u6OxHX9Urdt_mPnsyqniZzB1RDeMZTtUlWcWottLq-fU4uwkLlWYFHzZYmBqps8fQXWWtBIqy6M6PA9PButCWjp3QnYZqlDUE5k Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:49:47.499864 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_117b129cac5f421eb3c00e935c695d28", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 72ca823747e34494a2117e9fb885b6b2 Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 19 06:49:47.501182 n-d-861333-10 devstack@n-api.service[127567]: action_args: {} Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:47.501889 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 19 06:49:47.502832 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:47.504163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04ed9052-52ba-483e-97ce-b1375d4d489c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:47.505168 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04ed9052-52ba-483e-97ce-b1375d4d489c tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.014009 Oct 19 06:49:47.505821 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 42/91] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:47.510440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-157da360-48f4-4a74-a794-14fc63c15f48 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1677624265", "id": 973526290, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:47.595382 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-157da360-48f4-4a74-a794-14fc63c15f48 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.088380 Oct 19 06:49:47.596649 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 43/92] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:47 2022] POST /compute/v2.1/flavors => generated 412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:47.610656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0ddac9e-e7f5-43b9-bcde-bafe9673ece7 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1282213222", "id": 2009099286, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:47.650228 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca08e526-c3fe-449b-93da-99825aa7a7e7 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1503497539/action" status: 200 len: 21 microversion: 2.1 time: 0.799359 Oct 19 06:49:47.656775 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 50/93] 10.222.0.39 () {60 vars in 1200 bytes} [Wed Oct 19 06:49:46 2022] POST /compute/v2.1/flavors/1503497539/action => generated 21 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:47.663963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8781370-0354-463d-a8b4-08bd41a2f34f tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.742411 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0ddac9e-e7f5-43b9-bcde-bafe9673ece7 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.137234 Oct 19 06:49:47.743427 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 44/94] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:47 2022] POST /compute/v2.1/flavors => generated 414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:49:47.753921 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8781370-0354-463d-a8b4-08bd41a2f34f tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1503497539" status: 202 len: 0 microversion: 2.1 time: 0.096004 Oct 19 06:49:47.754796 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 51/95] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:47 2022] DELETE /compute/v2.1/flavors/1503497539 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:47.761036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc8d4bd8-9db5-46dd-924a-df387dc13a81 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.764405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4fb627fe-7223-406e-bc82-59f710877d0a tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.770238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=21,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:47.791739 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4fb627fe-7223-406e-bc82-59f710877d0a tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.032347 Oct 19 06:49:47.792541 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 52/96] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:49:47.793460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4fb627fe-7223-406e-bc82-59f710877d0a tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.794707 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4fb627fe-7223-406e-bc82-59f710877d0a tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001297 Oct 19 06:49:47.795441 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 53/97] 10.222.0.39 () {56 vars in 886 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 06:49:47.796419 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc8d4bd8-9db5-46dd-924a-df387dc13a81 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.040405 Oct 19 06:49:47.797571 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 45/98] 10.222.0.39 () {58 vars in 1169 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:47.823808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b47b608e-4120-4030-b729-4a897951b950 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1351376411", "id": 1521941496, "os-flavor-access:is_public": "False"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:47.824281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-977f9a0e-10d3-4c61-aff3-faf87510da31 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.835444 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-977f9a0e-10d3-4c61-aff3-faf87510da31 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.023227 Oct 19 06:49:47.835905 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 46/99] 10.222.0.39 () {58 vars in 1177 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:47.863938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cbadf95-2589-414a-98ea-79ee6d79fd8b tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.869592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:DELETE=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:47.876415 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cbadf95-2589-414a-98ea-79ee6d79fd8b tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.028021 Oct 19 06:49:47.888778 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 47/100] 10.222.0.39 () {58 vars in 1171 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:47.893393 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b47b608e-4120-4030-b729-4a897951b950 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.081476 Oct 19 06:49:47.915895 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 54/101] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:47 2022] POST /compute/v2.1/flavors => generated 439 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:47.916763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e085a16-5b7c-4fdf-b256-7ae7c5e2192a tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.916763 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e085a16-5b7c-4fdf-b256-7ae7c5e2192a tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 844 microversion: 2.1 time: 0.013602 Oct 19 06:49:47.916763 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 48/102] 10.222.0.39 () {58 vars in 1169 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 844 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:47.923220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09354d48-d06f-4902-badc-6143dcb7ebe2 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c9636c753c3446deb3ce03ac55421ab6"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:47.937551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41b3ae0c-238c-4fed-a1a4-445769dc43ee tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.958803 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41b3ae0c-238c-4fed-a1a4-445769dc43ee tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.026931 Oct 19 06:49:47.959383 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 49/103] 10.222.0.39 () {58 vars in 1169 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:47.977791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36905284-7684-4f3a-b815-5ced752bc2e6 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:47.997577 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36905284-7684-4f3a-b815-5ced752bc2e6 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.023513 Oct 19 06:49:47.998134 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 50/104] 10.222.0.39 () {58 vars in 1175 bytes} [Wed Oct 19 06:49:47 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:49:48.017026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-531b5de9-d3a6-401d-ac8e-3833806f007f tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.038464 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-531b5de9-d3a6-401d-ac8e-3833806f007f tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.025344 Oct 19 06:49:48.044179 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 51/105] 10.222.0.39 () {58 vars in 1173 bytes} [Wed Oct 19 06:49:48 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:49:48.057658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dde40218-a76c-4811-b9a2-379c2a97be0a tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.078245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dde40218-a76c-4811-b9a2-379c2a97be0a tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.024407 Oct 19 06:49:48.078808 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 52/106] 10.222.0.39 () {58 vars in 1169 bytes} [Wed Oct 19 06:49:48 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:49:48.096482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1439f7c1-182c-415f-bd37-d1258b96641c tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.165923 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1439f7c1-182c-415f-bd37-d1258b96641c tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2009099286" status: 202 len: 0 microversion: 2.1 time: 0.072723 Oct 19 06:49:48.166775 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 53/107] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:48 2022] DELETE /compute/v2.1/flavors/2009099286 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 06:49:48.177847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f17257f-bf75-462a-a2c2-fa354e448507 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.199302 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f17257f-bf75-462a-a2c2-fa354e448507 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028090 Oct 19 06:49:48.200204 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 54/108] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:48.224625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30b5bb88-36ed-445f-a1a6-d7f4ba8cad83 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.328506 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-30b5bb88-36ed-445f-a1a6-d7f4ba8cad83 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/973526290" status: 202 len: 0 microversion: 2.1 time: 0.113411 Oct 19 06:49:48.331109 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 55/109] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 06:49:48 2022] DELETE /compute/v2.1/flavors/973526290 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:48.340257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad3ce806-f335-40b1-b15a-984427547b4f tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.361468 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad3ce806-f335-40b1-b15a-984427547b4f tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025187 Oct 19 06:49:48.362727 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 56/110] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:49:48.382551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d617122-2fb5-412e-8a46-1c49671a6df1 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1476847843", "id": 1632075731, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:48.450706 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d617122-2fb5-412e-8a46-1c49671a6df1 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.071831 Oct 19 06:49:48.451459 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 57/111] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:48 2022] POST /compute/v2.1/flavors => generated 415 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:49:48.457553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.460647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:48.466989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:48.467477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:48.467912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:48.469191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:48.469803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:48.470386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:48.607472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:48.620323 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00171642-b09e-440f-af71-fa9a704b28a5 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1235 microversion: 2.1 time: 0.167976 Oct 19 06:49:48.621315 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 58/112] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:48 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1235 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:48.635588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5be76b14-db60-42b8-a93e-8a12557558c9 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.658256 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5be76b14-db60-42b8-a93e-8a12557558c9 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035799 Oct 19 06:49:48.658983 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 59/113] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:48.680470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81788aa7-6b5f-4322-bc18-30e750436e2c tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.709674 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81788aa7-6b5f-4322-bc18-30e750436e2c tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032869 Oct 19 06:49:48.710415 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 60/114] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:48.782611 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-09354d48-d06f-4902-badc-6143dcb7ebe2 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] HTTP exception thrown: Flavor access not found for 30 / c9636c753c3446deb3ce03ac55421ab6 combination. Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09354d48-d06f-4902-badc-6143dcb7ebe2 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Request method failure captured: Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/flavors/1521941496/action HTTP/1.1 Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 70 Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54Esh1XRB1nVo1rlEONt7FKponSf7kJyDQXrCp3wMiaUOQGblEbn0Fe6irrGEu-3Uc-_wRbIogEmF3wNrHk5elIGHPZEpfeVkAtYJy-bsoTBsJack8-DxqianalNORFmz4_pRkkuHgvaND0E9uNd-e5V1So3aVW31ZYzYd4I5NpcV8 Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 199b8700df5c48f5a987d64d3f408a45 Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1276732089 Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:48.785485 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/199b8700df5c48f5a987d64d3f408a45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/199b8700df5c48f5a987d64d3f408a45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/199b8700df5c48f5a987d64d3f408a45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_199b8700df5c48f5a987d64d3f408a45", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1276732089 Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 199b8700df5c48f5a987d64d3f408a45 Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1276732089 Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8e05a66f2f0e4ff68c9d34455aa1ba3c Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: {"removeTenantAccess": {"tenant": "c9636c753c3446deb3ce03ac55421ab6"}} Oct 19 06:49:48.786826 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: exception: Flavor access not found for 30 / c9636c753c3446deb3ce03ac55421ab6 combination. Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1521941496', 'body': {'removeTenantAccess': {'tenant': 'c9636c753c3446deb3ce03ac55421ab6'}}} Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 19 06:49:48.787616 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 30 / c9636c753c3446deb3ce03ac55421ab6 combination. Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 30 / c9636c753c3446deb3ce03ac55421ab6 combination. Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:48.788738 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:48.790035 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:48.790035 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:48.790035 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:48.790035 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:48.790035 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 30 / c9636c753c3446deb3ce03ac55421ab6 combination. Oct 19 06:49:48.790035 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:48.792093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09354d48-d06f-4902-badc-6143dcb7ebe2 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Returning 404 to user: Flavor access not found for 30 / c9636c753c3446deb3ce03ac55421ab6 combination. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:48.794717 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-09354d48-d06f-4902-badc-6143dcb7ebe2 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1521941496/action" status: 404 len: 124 microversion: 2.1 time: 0.874510 Oct 19 06:49:48.794717 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 55/115] 10.222.0.39 () {60 vars in 1200 bytes} [Wed Oct 19 06:49:47 2022] POST /compute/v2.1/flavors/1521941496/action => generated 124 bytes in 876 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:48.803059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4db8ded-0d34-4738-979f-c145717e9126 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.926173 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4db8ded-0d34-4738-979f-c145717e9126 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1632075731" status: 202 len: 0 microversion: 2.1 time: 0.129794 Oct 19 06:49:48.929925 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 56/116] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:48 2022] DELETE /compute/v2.1/flavors/1632075731 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:48.934947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d8d7478-faed-49cc-b025-07082647b535 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.938761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77637737-d335-44ea-9916-502cd4aaabaa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Calling method '.version_select at 0x7f6d655e51f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:48.942905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77637737-d335-44ea-9916-502cd4aaabaa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:48.943508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77637737-d335-44ea-9916-502cd4aaabaa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:48.944172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77637737-d335-44ea-9916-502cd4aaabaa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:48.945101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77637737-d335-44ea-9916-502cd4aaabaa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:48.945764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77637737-d335-44ea-9916-502cd4aaabaa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:48.946377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77637737-d335-44ea-9916-502cd4aaabaa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:48.981840 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77637737-d335-44ea-9916-502cd4aaabaa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.270551 Oct 19 06:49:48.982438 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 61/117] 10.222.0.39 () {58 vars in 1128 bytes} [Wed Oct 19 06:49:48 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:48.986869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32291c15-521e-4a8a-80c6-67a68188d013 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.006613 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32291c15-521e-4a8a-80c6-67a68188d013 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022995 Oct 19 06:49:49.007420 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 62/118] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:49.022759 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d8d7478-faed-49cc-b025-07082647b535 tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1521941496" status: 202 len: 0 microversion: 2.1 time: 0.091579 Oct 19 06:49:49.023338 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 57/119] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:49:48 2022] DELETE /compute/v2.1/flavors/1521941496 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:49.031617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e617e7e8-ab07-489e-bd6b-f4d56c458a24 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-321589962", "id": 621043344, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:49.139258 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e617e7e8-ab07-489e-bd6b-f4d56c458a24 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.111696 Oct 19 06:49:49.141378 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 58/120] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:49 2022] POST /compute/v2.1/flavors => generated 410 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:49:49.147432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2619d195-d967-416f-acaf-e7331d860d1a tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.184344 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2619d195-d967-416f-acaf-e7331d860d1a tempest-FlavorsAccessNegativeTestJSON-1276732089 tempest-FlavorsAccessNegativeTestJSON-1276732089-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.041467 Oct 19 06:49:49.185139 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 59/121] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:49.191242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3aa7f2a-777e-4a7e-aeca-f63d929a4558 tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.222938 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3aa7f2a-777e-4a7e-aeca-f63d929a4558 tempest-FlavorsAdminTestJSON-396446343 tempest-FlavorsAdminTestJSON-396446343-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.036413 Oct 19 06:49:49.224759 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 60/122] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:49.250223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5145adc2-430b-4919-aaed-444ec45fff47 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.279921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd33f8eb-fc75-47b1-93e9-8a47234af045 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Calling method '.version_select at 0x7f6d6556cdc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.283566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd33f8eb-fc75-47b1-93e9-8a47234af045 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '16ccdda87a23434586264489f3727d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b578b9ec9fd434cb1f98a986838d6b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd33f8eb-fc75-47b1-93e9-8a47234af045 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Request method failure captured: Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54KAF4JOmxX9BPnDfy6LI5_1XUWHuZ5qyoc0G6Pf4rur9sC7hT2D2V0QLkn6s48askNlmeq2uumcMIwbHIoMe2JeHbCN4HeR6AfMiRYWlTJOIUG6AbK3R6VqpMtVvcnHhCnqseM9mrdjrXBqFHqNOzsrf-HZ4DBQn7kcDeUUIWsREw Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:49:49.285437 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2b578b9ec9fd434cb1f98a986838d6b2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 16ccdda87a23434586264489f3727d40 Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: action_args: {} Oct 19 06:49:49.286779 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.287622 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 19 06:49:49.288812 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.290876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd33f8eb-fc75-47b1-93e9-8a47234af045 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.290876 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd33f8eb-fc75-47b1-93e9-8a47234af045 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.260142 Oct 19 06:49:49.290876 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 63/123] 10.222.0.39 () {58 vars in 1128 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 279 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:49.300437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a76288ea-44d5-46da-9dec-cdbc3f37f0b4 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Calling method '.version_select at 0x7f6d65485c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.302182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a76288ea-44d5-46da-9dec-cdbc3f37f0b4 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '16ccdda87a23434586264489f3727d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b578b9ec9fd434cb1f98a986838d6b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a76288ea-44d5-46da-9dec-cdbc3f37f0b4 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Request method failure captured: Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/n-d-861333-10/reboot HTTP/1.1 Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54KAF4JOmxX9BPnDfy6LI5_1XUWHuZ5qyoc0G6Pf4rur9sC7hT2D2V0QLkn6s48askNlmeq2uumcMIwbHIoMe2JeHbCN4HeR6AfMiRYWlTJOIUG6AbK3R6VqpMtVvcnHhCnqseM9mrdjrXBqFHqNOzsrf-HZ4DBQn7kcDeUUIWsREw Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:49:49.303709 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2b578b9ec9fd434cb1f98a986838d6b2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 16ccdda87a23434586264489f3727d40 Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'n-d-861333-10'} Oct 19 06:49:49.305808 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.306598 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 19 06:49:49.307690 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.311781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a76288ea-44d5-46da-9dec-cdbc3f37f0b4 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.313052 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a76288ea-44d5-46da-9dec-cdbc3f37f0b4 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-861333-10/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016314 Oct 19 06:49:49.313916 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 64/124] 10.222.0.39 () {58 vars in 1191 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/os-hosts/n-d-861333-10/reboot => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:49.325293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc4a04cc-7600-435c-bbcf-b23a553d5967 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Calling method '.version_select at 0x7f6d654855e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.335726 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-dc4a04cc-7600-435c-bbcf-b23a553d5967 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc4a04cc-7600-435c-bbcf-b23a553d5967 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Request method failure captured: Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54MxwPVYWsQR19PDSIZNBURXL-uo-mQq7tMfh1WL8PC66uv7MoDDmVvnrDgQ_ISjWQ0ccX97ygP-1gylsRLNMqPJINvRFRM8DdPY-afILwQBqJyAoI-5JmZHlV54k9evVatDvf6jeh4_yiXfrvbC_IvsGcoiLKCbwg46Ya7-3sBv8Y Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:49:49.337962 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/512883f6b0a5428499ad798301798d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_512883f6b0a5428499ad798301798d8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 99cddd3ce8804815928f090a2235a7d1 Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'nonexistent_hostname'} Oct 19 06:49:49.341100 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:49.341945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 19 06:49:49.342982 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc4a04cc-7600-435c-bbcf-b23a553d5967 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc4a04cc-7600-435c-bbcf-b23a553d5967 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.018857 Oct 19 06:49:49.343956 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 65/125] 10.222.0.39 () {58 vars in 1212 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:49:49.350298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aaf8814e-f733-497b-99a9-1bf7ca66f706 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Calling method '.version_select at 0x7f6d654850d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.352708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aaf8814e-f733-497b-99a9-1bf7ca66f706 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '16ccdda87a23434586264489f3727d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b578b9ec9fd434cb1f98a986838d6b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aaf8814e-f733-497b-99a9-1bf7ca66f706 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Request method failure captured: Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/n-d-861333-10 HTTP/1.1 Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54KAF4JOmxX9BPnDfy6LI5_1XUWHuZ5qyoc0G6Pf4rur9sC7hT2D2V0QLkn6s48askNlmeq2uumcMIwbHIoMe2JeHbCN4HeR6AfMiRYWlTJOIUG6AbK3R6VqpMtVvcnHhCnqseM9mrdjrXBqFHqNOzsrf-HZ4DBQn7kcDeUUIWsREw Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:49:49.354223 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2b578b9ec9fd434cb1f98a986838d6b2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 16ccdda87a23434586264489f3727d40 Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'n-d-861333-10'} Oct 19 06:49:49.355378 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.356012 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 19 06:49:49.357019 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.360956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aaf8814e-f733-497b-99a9-1bf7ca66f706 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.360956 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aaf8814e-f733-497b-99a9-1bf7ca66f706 tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-861333-10" status: 403 len: 109 microversion: 2.1 time: 0.009794 Oct 19 06:49:49.360956 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 66/126] 10.222.0.39 () {58 vars in 1170 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/os-hosts/n-d-861333-10 => generated 109 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:49.369727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cce80419-4052-4a22-8e57-03a25220fbcf tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Calling method '.version_select at 0x7f6d655e5f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.377958 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cce80419-4052-4a22-8e57-03a25220fbcf tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cce80419-4052-4a22-8e57-03a25220fbcf tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Request method failure captured: Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54MxwPVYWsQR19PDSIZNBURXL-uo-mQq7tMfh1WL8PC66uv7MoDDmVvnrDgQ_ISjWQ0ccX97ygP-1gylsRLNMqPJINvRFRM8DdPY-afILwQBqJyAoI-5JmZHlV54k9evVatDvf6jeh4_yiXfrvbC_IvsGcoiLKCbwg46Ya7-3sBv8Y Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:49:49.380144 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/512883f6b0a5428499ad798301798d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_512883f6b0a5428499ad798301798d8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 99cddd3ce8804815928f090a2235a7d1 Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'nonexistent_hostname'} Oct 19 06:49:49.381402 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.382258 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.383391 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.385244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cce80419-4052-4a22-8e57-03a25220fbcf tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.386448 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cce80419-4052-4a22-8e57-03a25220fbcf tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023682 Oct 19 06:49:49.387882 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 67/127] 10.222.0.39 () {58 vars in 1191 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:49:49.392254 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5145adc2-430b-4919-aaed-444ec45fff47 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/621043344" status: 202 len: 0 microversion: 2.1 time: 0.150244 Oct 19 06:49:49.393017 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 61/128] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 06:49:49 2022] DELETE /compute/v2.1/flavors/621043344 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 06:49:49.404396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d1f3543-8bd9-4759-8e85-8e3ad3d1c21a tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Calling method '.version_select at 0x7f6d65485e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.406861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d1f3543-8bd9-4759-8e85-8e3ad3d1c21a tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '16ccdda87a23434586264489f3727d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b578b9ec9fd434cb1f98a986838d6b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:49.409030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c394411-2a0f-4b36-9b9e-6379a4787390 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d1f3543-8bd9-4759-8e85-8e3ad3d1c21a tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Request method failure captured: Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/n-d-861333-10/shutdown HTTP/1.1 Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54KAF4JOmxX9BPnDfy6LI5_1XUWHuZ5qyoc0G6Pf4rur9sC7hT2D2V0QLkn6s48askNlmeq2uumcMIwbHIoMe2JeHbCN4HeR6AfMiRYWlTJOIUG6AbK3R6VqpMtVvcnHhCnqseM9mrdjrXBqFHqNOzsrf-HZ4DBQn7kcDeUUIWsREw Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:49:49.409167 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2b578b9ec9fd434cb1f98a986838d6b2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 16ccdda87a23434586264489f3727d40 Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'n-d-861333-10'} Oct 19 06:49:49.411213 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.412004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 19 06:49:49.413166 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.414026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d1f3543-8bd9-4759-8e85-8e3ad3d1c21a tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.414026 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d1f3543-8bd9-4759-8e85-8e3ad3d1c21a tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-861333-10/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.012299 Oct 19 06:49:49.414026 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 68/129] 10.222.0.39 () {58 vars in 1197 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/os-hosts/n-d-861333-10/shutdown => generated 113 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:49.423663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f6dd009-d7af-42fe-9f07-c2bce5b5e73f tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Calling method '.version_select at 0x7f6d65485ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.434657 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0f6dd009-d7af-42fe-9f07-c2bce5b5e73f tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f6dd009-d7af-42fe-9f07-c2bce5b5e73f tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Request method failure captured: Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54MxwPVYWsQR19PDSIZNBURXL-uo-mQq7tMfh1WL8PC66uv7MoDDmVvnrDgQ_ISjWQ0ccX97ygP-1gylsRLNMqPJINvRFRM8DdPY-afILwQBqJyAoI-5JmZHlV54k9evVatDvf6jeh4_yiXfrvbC_IvsGcoiLKCbwg46Ya7-3sBv8Y Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:49:49.437546 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/512883f6b0a5428499ad798301798d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_512883f6b0a5428499ad798301798d8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 99cddd3ce8804815928f090a2235a7d1 Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'nonexistent_hostname'} Oct 19 06:49:49.438803 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:49.439434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 19 06:49:49.440425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.441320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f6dd009-d7af-42fe-9f07-c2bce5b5e73f tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.442001 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f6dd009-d7af-42fe-9f07-c2bce5b5e73f tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.023276 Oct 19 06:49:49.443919 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 69/130] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 06:49:49.468119 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c394411-2a0f-4b36-9b9e-6379a4787390 tempest-FlavorsAdminTestJSON-311189463 tempest-FlavorsAdminTestJSON-311189463-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068899 Oct 19 06:49:49.470215 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 62/131] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32eec14b-48c8-4584-8700-9deb7917485e tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Calling method '.version_select at 0x7f6d65485040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32eec14b-48c8-4584-8700-9deb7917485e tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '16ccdda87a23434586264489f3727d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b578b9ec9fd434cb1f98a986838d6b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32eec14b-48c8-4584-8700-9deb7917485e tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Request method failure captured: Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/n-d-861333-10/startup HTTP/1.1 Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54KAF4JOmxX9BPnDfy6LI5_1XUWHuZ5qyoc0G6Pf4rur9sC7hT2D2V0QLkn6s48askNlmeq2uumcMIwbHIoMe2JeHbCN4HeR6AfMiRYWlTJOIUG6AbK3R6VqpMtVvcnHhCnqseM9mrdjrXBqFHqNOzsrf-HZ4DBQn7kcDeUUIWsREw Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.480298 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2b578b9ec9fd434cb1f98a986838d6b2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 16ccdda87a23434586264489f3727d40 Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.481396 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'n-d-861333-10'} Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.482636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 19 06:49:49.483776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.484706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32eec14b-48c8-4584-8700-9deb7917485e tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.484706 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32eec14b-48c8-4584-8700-9deb7917485e tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-861333-10/startup" status: 403 len: 110 microversion: 2.1 time: 0.020697 Oct 19 06:49:49.484706 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 70/132] 10.222.0.39 () {58 vars in 1194 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/os-hosts/n-d-861333-10/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:49.501181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a01f66ef-0661-445e-9f21-ce822ebc2d55 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Calling method '.version_select at 0x7f6d6556ce50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.511318 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a01f66ef-0661-445e-9f21-ce822ebc2d55 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a01f66ef-0661-445e-9f21-ce822ebc2d55 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Request method failure captured: Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54MxwPVYWsQR19PDSIZNBURXL-uo-mQq7tMfh1WL8PC66uv7MoDDmVvnrDgQ_ISjWQ0ccX97ygP-1gylsRLNMqPJINvRFRM8DdPY-afILwQBqJyAoI-5JmZHlV54k9evVatDvf6jeh4_yiXfrvbC_IvsGcoiLKCbwg46Ya7-3sBv8Y Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:49:49.513123 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/512883f6b0a5428499ad798301798d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_512883f6b0a5428499ad798301798d8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 99cddd3ce8804815928f090a2235a7d1 Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'nonexistent_hostname'} Oct 19 06:49:49.514181 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:49.514833 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 19 06:49:49.518500 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a01f66ef-0661-445e-9f21-ce822ebc2d55 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a01f66ef-0661-445e-9f21-ce822ebc2d55 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.017618 Oct 19 06:49:49.524075 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 71/133] 10.222.0.39 () {58 vars in 1215 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:49:49.526655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da1e3898-55e5-4241-b72b-44b0e1348daa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Action: 'update', calling method: .version_select at 0x7f6d6553f280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da1e3898-55e5-4241-b72b-44b0e1348daa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Request method failure captured: Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-hosts/n-d-861333-10 HTTP/1.1 Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 51 Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54MxwPVYWsQR19PDSIZNBURXL-uo-mQq7tMfh1WL8PC66uv7MoDDmVvnrDgQ_ISjWQ0ccX97ygP-1gylsRLNMqPJINvRFRM8DdPY-afILwQBqJyAoI-5JmZHlV54k9evVatDvf6jeh4_yiXfrvbC_IvsGcoiLKCbwg46Ya7-3sBv8Y Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:49.528615 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/512883f6b0a5428499ad798301798d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_512883f6b0a5428499ad798301798d8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 99cddd3ce8804815928f090a2235a7d1 Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: {"status": "enable", "maintenance_mode": "invalid"} Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:49:49.534867 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'n-d-861333-10', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'disable', Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'Enable', Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'Disable', Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance: Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.535521 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.537126 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.538219 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.538219 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:49:49.538219 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:49:49.538219 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 06:49:49.538219 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.538219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da1e3898-55e5-4241-b72b-44b0e1348daa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.538219 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da1e3898-55e5-4241-b72b-44b0e1348daa tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-861333-10" status: 400 len: 199 microversion: 2.1 time: 0.008888 Oct 19 06:49:49.538219 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 63/134] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 06:49:49 2022] PUT /compute/v2.1/os-hosts/n-d-861333-10 => generated 199 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 06:49:49.541796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a6e9cb7-137d-40fd-aa02-81c5127352c2 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Action: 'update', calling method: .version_select at 0x7f6d654858b0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a6e9cb7-137d-40fd-aa02-81c5127352c2 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Request method failure captured: Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/os-hosts/n-d-861333-10 HTTP/1.1 Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 51 Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54MxwPVYWsQR19PDSIZNBURXL-uo-mQq7tMfh1WL8PC66uv7MoDDmVvnrDgQ_ISjWQ0ccX97ygP-1gylsRLNMqPJINvRFRM8DdPY-afILwQBqJyAoI-5JmZHlV54k9evVatDvf6jeh4_yiXfrvbC_IvsGcoiLKCbwg46Ya7-3sBv8Y Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:49:49.547436 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/512883f6b0a5428499ad798301798d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_512883f6b0a5428499ad798301798d8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 99cddd3ce8804815928f090a2235a7d1 Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: {"status": "invalid", "maintenance_mode": "enable"} Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.548671 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'n-d-861333-10', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'disable', Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'Enable', Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'Disable', Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance: Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.549328 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.551371 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.552355 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.552355 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:49:49.552355 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:49:49.552355 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 06:49:49.552355 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.552355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a6e9cb7-137d-40fd-aa02-81c5127352c2 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.552355 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a6e9cb7-137d-40fd-aa02-81c5127352c2 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-861333-10" status: 400 len: 189 microversion: 2.1 time: 0.011364 Oct 19 06:49:49.552355 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 72/135] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 06:49:49 2022] PUT /compute/v2.1/os-hosts/n-d-861333-10 => generated 189 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:49:49.560068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b240e87b-a9a1-4690-b823-d7675c497c2b tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Action: 'update', calling method: .version_select at 0x7f6d65df9c10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b240e87b-a9a1-4690-b823-d7675c497c2b tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '16ccdda87a23434586264489f3727d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b578b9ec9fd434cb1f98a986838d6b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b240e87b-a9a1-4690-b823-d7675c497c2b tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Request method failure captured: Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-hosts/n-d-861333-10 HTTP/1.1 Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 50 Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54KAF4JOmxX9BPnDfy6LI5_1XUWHuZ5qyoc0G6Pf4rur9sC7hT2D2V0QLkn6s48askNlmeq2uumcMIwbHIoMe2JeHbCN4HeR6AfMiRYWlTJOIUG6AbK3R6VqpMtVvcnHhCnqseM9mrdjrXBqFHqNOzsrf-HZ4DBQn7kcDeUUIWsREw Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:49:49.568331 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2b578b9ec9fd434cb1f98a986838d6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2b578b9ec9fd434cb1f98a986838d6b2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 2b578b9ec9fd434cb1f98a986838d6b2 Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1242980661 Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 16ccdda87a23434586264489f3727d40 Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1242980661-project Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: {"status": "enable", "maintenance_mode": "enable"} Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 19 06:49:49.569751 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'n-d-861333-10', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.570457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 19 06:49:49.571603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.572579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b240e87b-a9a1-4690-b823-d7675c497c2b tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.572579 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b240e87b-a9a1-4690-b823-d7675c497c2b tempest-HostsAdminNegativeTestJSON-1242980661 tempest-HostsAdminNegativeTestJSON-1242980661-project] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-861333-10" status: 403 len: 111 microversion: 2.1 time: 0.011106 Oct 19 06:49:49.572579 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 64/136] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 06:49:49 2022] PUT /compute/v2.1/os-hosts/n-d-861333-10 => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:49:49.578495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51794e1d-516a-4442-8073-f148ec60390f tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Action: 'update', calling method: .version_select at 0x7f6d654be160>, body: {"status": null, "maintenance_mode": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51794e1d-516a-4442-8073-f148ec60390f tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Request method failure captured: Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/os-hosts/n-d-861333-10 HTTP/1.1 Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 42 Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54MxwPVYWsQR19PDSIZNBURXL-uo-mQq7tMfh1WL8PC66uv7MoDDmVvnrDgQ_ISjWQ0ccX97ygP-1gylsRLNMqPJINvRFRM8DdPY-afILwQBqJyAoI-5JmZHlV54k9evVatDvf6jeh4_yiXfrvbC_IvsGcoiLKCbwg46Ya7-3sBv8Y Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:49:49.583387 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/512883f6b0a5428499ad798301798d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_512883f6b0a5428499ad798301798d8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 99cddd3ce8804815928f090a2235a7d1 Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: {"status": null, "maintenance_mode": null} Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 19 06:49:49.584585 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'n-d-861333-10', 'body': {'status': None, 'maintenance_mode': None}} Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'disable', Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'Enable', Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'Disable', Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance: Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi None Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.585347 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.586604 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.587777 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:49:49.587777 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:49:49.587777 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 19 06:49:49.587777 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.587777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51794e1d-516a-4442-8073-f148ec60390f tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.587777 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51794e1d-516a-4442-8073-f148ec60390f tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-861333-10" status: 400 len: 127 microversion: 2.1 time: 0.010746 Oct 19 06:49:49.587777 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 73/137] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 06:49:49 2022] PUT /compute/v2.1/os-hosts/n-d-861333-10 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:49:49.600405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c60f2b6-2838-40a1-b9bc-4379ac87e061 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Action: 'update', calling method: .version_select at 0x7f6d6552df70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:49.604019 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.hosts [None req-7c60f2b6-2838-40a1-b9bc-4379ac87e061 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Enabling host nonexistent_hostname. Oct 19 06:49:49.612248 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-7c60f2b6-2838-40a1-b9bc-4379ac87e061 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c60f2b6-2838-40a1-b9bc-4379ac87e061 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Request method failure captured: Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 50 Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54MxwPVYWsQR19PDSIZNBURXL-uo-mQq7tMfh1WL8PC66uv7MoDDmVvnrDgQ_ISjWQ0ccX97ygP-1gylsRLNMqPJINvRFRM8DdPY-afILwQBqJyAoI-5JmZHlV54k9evVatDvf6jeh4_yiXfrvbC_IvsGcoiLKCbwg46Ya7-3sBv8Y Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:49:49.613976 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/512883f6b0a5428499ad798301798d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/512883f6b0a5428499ad798301798d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_512883f6b0a5428499ad798301798d8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 512883f6b0a5428499ad798301798d8f Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-170853612 Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 99cddd3ce8804815928f090a2235a7d1 Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-170853612-project-admin Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: {"status": "enable", "maintenance_mode": "enable"} Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.615183 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 06:49:49.615907 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:49:49.616991 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:49:49.618036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c60f2b6-2838-40a1-b9bc-4379ac87e061 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:49:49.619358 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c60f2b6-2838-40a1-b9bc-4379ac87e061 tempest-HostsAdminNegativeTestJSON-170853612 tempest-HostsAdminNegativeTestJSON-170853612-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018755 Oct 19 06:49:49.619358 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 65/138] 10.222.0.39 () {60 vars in 1211 bytes} [Wed Oct 19 06:49:49 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:49:49.644964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:49.646043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:49.653064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:49.653555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:49.654401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:49.655039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:49.655492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:49.655979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:49.729814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:49.750464 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-422589c2-8748-46fb-be5a-e466ee81dc43 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1309 microversion: 2.1 time: 0.110405 Oct 19 06:49:49.752052 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 74/139] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:49 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:50.779495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:50.781398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:50.797388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:50.798104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:50.799043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:50.800029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:50.800652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:50.801227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:52.740391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:52.740391 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-558d99d6-e6c8-481b-89e9-7668dda1995b tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 1.797515 Oct 19 06:49:52.740391 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 66/140] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:50 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:53.615329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:53.617027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:53.623711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:53.624473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:53.625166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:53.626021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:53.626501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:53.627064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:53.851061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:53.859790 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e02d474e-cdf2-4fab-8ad3-c2b7a8b93b44 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.250919 Oct 19 06:49:53.860676 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 75/141] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:53 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:49:54.699877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:55.416575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97bf3064-ec66-4db8-8139-339e6f9c4e79 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1505933810", "ram": 512, "vcpus": 1, "disk": 10, "id": 772316223, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:55.476993 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97bf3064-ec66-4db8-8139-339e6f9c4e79 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.782061 Oct 19 06:49:55.485685 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 67/142] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:49:54 2022] POST /compute/v2.1/flavors => generated 413 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:55.500623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:55.518880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:55.525705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:55.526408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:55.527052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:55.527971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:55.528588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:55.529353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:55.593558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-68131167-69be-4560-8518-a8b3eaf8034c req-c8f1527a-483e-4efd-9912-83b638028725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7970343e-02b4-4dcc-a64f-4f014af41ba3", "tag": "0fe08c14-1ac3-42c0-a16e-b0ace4360b66"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:55.629742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68131167-69be-4560-8518-a8b3eaf8034c req-c8f1527a-483e-4efd-9912-83b638028725 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:55.630632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68131167-69be-4560-8518-a8b3eaf8034c req-c8f1527a-483e-4efd-9912-83b638028725 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:55.631479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68131167-69be-4560-8518-a8b3eaf8034c req-c8f1527a-483e-4efd-9912-83b638028725 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:55.663347 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-68131167-69be-4560-8518-a8b3eaf8034c req-c8f1527a-483e-4efd-9912-83b638028725 service nova] Creating event network-changed:0fe08c14-1ac3-42c0-a16e-b0ace4360b66 for instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 on n-h1-861333-10 Oct 19 06:49:55.663618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68131167-69be-4560-8518-a8b3eaf8034c req-c8f1527a-483e-4efd-9912-83b638028725 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:49:55.664263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68131167-69be-4560-8518-a8b3eaf8034c req-c8f1527a-483e-4efd-9912-83b638028725 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:49:55.666006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f8bdc5-6cec-45d6-b957-533a27ff3505 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:55.666934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f8bdc5-6cec-45d6-b957-533a27ff3505 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:55.667693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f8bdc5-6cec-45d6-b957-533a27ff3505 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:55.668677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f8bdc5-6cec-45d6-b957-533a27ff3505 None None] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:55.669356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f8bdc5-6cec-45d6-b957-533a27ff3505 None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:55.670154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f8bdc5-6cec-45d6-b957-533a27ff3505 None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:55.722586 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.compute.rpcapi [None req-d5f8bdc5-6cec-45d6-b957-533a27ff3505 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 06:49:55.723646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f8bdc5-6cec-45d6-b957-533a27ff3505 None None] Releasing lock "compute-rpcapi-router" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:49:55.758394 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5f8bdc5-6cec-45d6-b957-533a27ff3505 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.891128 Oct 19 06:49:55.759201 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 76/143] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:49:55.764122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:55.774173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f459bdf7-06c8-4c59-a108-05e808a22170 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:55.775427 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f1e68f3-be70-4146-a0cc-d69e4e4a1c2a tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.286286 Oct 19 06:49:55.776474 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 68/144] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:55 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:55.939293 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f459bdf7-06c8-4c59-a108-05e808a22170 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/772316223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.178557 Oct 19 06:49:55.940038 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 77/145] 10.222.0.39 () {60 vars in 1221 bytes} [Wed Oct 19 06:49:55 2022] POST /compute/v2.1/flavors/772316223/os-extra_specs => generated 66 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:56.754182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a2ce9f2-105e-4d2d-bc58-9de8d8776f0c tempest-FlavorsExtraSpecsTestJSON-208072961 tempest-FlavorsExtraSpecsTestJSON-208072961-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:56.788796 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a2ce9f2-105e-4d2d-bc58-9de8d8776f0c tempest-FlavorsExtraSpecsTestJSON-208072961 tempest-FlavorsExtraSpecsTestJSON-208072961-project] 10.222.0.39 "GET /compute/v2.1/flavors/772316223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.842090 Oct 19 06:49:56.794627 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 69/146] 10.222.0.39 () {58 vars in 1200 bytes} [Wed Oct 19 06:49:55 2022] GET /compute/v2.1/flavors/772316223/os-extra_specs => generated 66 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:56.801681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:56.802497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:56.805324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1526406b-eff0-4022-ac39-f0b01044ef9c tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:56.816542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:56.817036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:56.817477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:56.821670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:56.821670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:56.821670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:56.856208 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1526406b-eff0-4022-ac39-f0b01044ef9c tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/772316223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059777 Oct 19 06:49:56.862150 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 78/147] 10.222.0.39 () {60 vars in 1221 bytes} [Wed Oct 19 06:49:56 2022] POST /compute/v2.1/flavors/772316223/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:56.875066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fdcc6a72-94a8-42ee-985f-7c1ec0fe16c6 tempest-FlavorsExtraSpecsTestJSON-208072961 tempest-FlavorsExtraSpecsTestJSON-208072961-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:56.893568 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fdcc6a72-94a8-42ee-985f-7c1ec0fe16c6 tempest-FlavorsExtraSpecsTestJSON-208072961 tempest-FlavorsExtraSpecsTestJSON-208072961-project] 10.222.0.39 "GET /compute/v2.1/flavors/772316223/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.029706 Oct 19 06:49:56.895615 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 79/148] 10.222.0.39 () {58 vars in 1242 bytes} [Wed Oct 19 06:49:56 2022] GET /compute/v2.1/flavors/772316223/os-extra_specs/hw:numa_nodes => generated 22 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:56.907533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cfcca2c8-5fdb-499e-a94a-4e676f503620 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:56.967026 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cfcca2c8-5fdb-499e-a94a-4e676f503620 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/772316223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066247 Oct 19 06:49:56.970575 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 80/149] 10.222.0.39 () {60 vars in 1221 bytes} [Wed Oct 19 06:49:56 2022] POST /compute/v2.1/flavors/772316223/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 06:49:56.981444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9db66cd-ece0-460a-99dc-92535280ed07 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:57.007742 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9db66cd-ece0-460a-99dc-92535280ed07 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/772316223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023932 Oct 19 06:49:57.008756 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 81/150] 10.222.0.39 () {58 vars in 1200 bytes} [Wed Oct 19 06:49:56 2022] GET /compute/v2.1/flavors/772316223/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:57.021725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84c094ce-bb19-4b45-8b31-c85894d7aa37 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:49:57.076876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:SAVEPOINT=7,nova_api:RELEASE=7 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:57.137535 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84c094ce-bb19-4b45-8b31-c85894d7aa37 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/772316223/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.122606 Oct 19 06:49:57.141504 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 82/151] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:49:57 2022] PUT /compute/v2.1/flavors/772316223/os-extra_specs/hw:numa_nodes => generated 22 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 06:49:57.142596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:57.150299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b8844be-df5c-48d3-b9f2-97aa8db4da82 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:57.164520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-318618e5-561c-4a22-98ec-3b308c4b3baa tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.362525 Oct 19 06:49:57.164520 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 70/152] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:56 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:49:57.186004 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b8844be-df5c-48d3-b9f2-97aa8db4da82 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/772316223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035064 Oct 19 06:49:57.187732 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 83/153] 10.222.0.39 () {58 vars in 1200 bytes} [Wed Oct 19 06:49:57 2022] GET /compute/v2.1/flavors/772316223/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:57.197255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c736c4cf-880a-42a1-b2d9-7b00af3c814c tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:57.322258 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c736c4cf-880a-42a1-b2d9-7b00af3c814c tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/772316223/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.128160 Oct 19 06:49:57.325291 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 71/154] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 06:49:57 2022] DELETE /compute/v2.1/flavors/772316223/os-extra_specs/hw:numa_nodes => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:49:57.334502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b09b2553-7e57-4ad2-be81-eb68047b431d tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:57.412486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:49:57.434123 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b09b2553-7e57-4ad2-be81-eb68047b431d tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/772316223/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.106426 Oct 19 06:49:57.438672 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 84/155] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 06:49:57 2022] DELETE /compute/v2.1/flavors/772316223/os-extra_specs/hw:cpu_policy => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:49:57.444588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4952ef0e-efb2-4265-8299-b1000944b24b tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:57.454363 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4952ef0e-efb2-4265-8299-b1000944b24b tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/772316223/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014207 Oct 19 06:49:57.455545 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 72/156] 10.222.0.39 () {58 vars in 1200 bytes} [Wed Oct 19 06:49:57 2022] GET /compute/v2.1/flavors/772316223/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:49:57.471094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7d311be-c676-478f-8661-7746d6f78f42 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:57.588762 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7d311be-c676-478f-8661-7746d6f78f42 tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/772316223" status: 202 len: 0 microversion: 2.1 time: 0.122023 Oct 19 06:49:57.589870 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 85/157] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 06:49:57 2022] DELETE /compute/v2.1/flavors/772316223 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:49:57.598953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe6faa50-4006-464b-ba97-5e3dc648e8de tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:57.629580 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe6faa50-4006-464b-ba97-5e3dc648e8de tempest-FlavorsExtraSpecsTestJSON-1745431475 tempest-FlavorsExtraSpecsTestJSON-1745431475-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035112 Oct 19 06:49:57.637631 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 73/158] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:49:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:49:58.189055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:58.196190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:58.205267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:58.206017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:58.206626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:58.207495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:58.213907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:58.216535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:58.389888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:58.413827 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8487a4f2-ffd0-4d4f-ae05-3f587357503e tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.230442 Oct 19 06:49:58.417306 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 86/159] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:58 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:49:59.444830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:49:59.445987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:49:59.456401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:59.457345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:59.457961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:59.458808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:49:59.459399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:49:59.459965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:49:59.672673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:49:59.711681 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e742da4-a8db-4109-b034-8fdf7c91c9ed tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.270311 Oct 19 06:49:59.714758 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 74/160] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:49:59 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:00.116074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92094da6-7eb6-414c-89a6-ed8ba082e8f5 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:00.119965 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-92094da6-7eb6-414c-89a6-ed8ba082e8f5 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92094da6-7eb6-414c-89a6-ed8ba082e8f5 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346-project-admin] Request method failure captured: Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54XNj6Zg8v9CdtweafD5nyJSGXz238JqUuvSVfoqShXucBZryRAkMB00iDt8X7sUR2xym2Al_uFr5uUEEqqbRZoTb9wCD58wW2vxIlE9HG38qGQBL5nhQ5Qg1dkO9Ht5PtRIBKUrm7YK95THSXX4CQxKGJNRHrxVKDnsSaZZg6XzGs Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: f082315d0f404cbe929a21c8b79dc5ac Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-549880346 Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:50:00.125362 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f082315d0f404cbe929a21c8b79dc5ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f082315d0f404cbe929a21c8b79dc5ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f082315d0f404cbe929a21c8b79dc5ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f082315d0f404cbe929a21c8b79dc5ac", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-549880346 Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: f082315d0f404cbe929a21c8b79dc5ac Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-549880346 Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-549880346-project-admin Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 3872c31c93a94430b65cc3a28bb1ddac Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-549880346-project-admin Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:00.126764 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid timestamp for date invalid_time Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'invalid_time'} Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:00.127460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 19 06:50:00.128784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.130240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92094da6-7eb6-414c-89a6-ed8ba082e8f5 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:00.131237 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92094da6-7eb6-414c-89a6-ed8ba082e8f5 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346 tempest-InstanceUsageAuditLogNegativeTestJSON-549880346-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.623941 Oct 19 06:50:00.138398 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 87/161] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Oct 19 06:49:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 632 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:50:00.658068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39d6ab9c-8352-44e4-bf31-c4471993ead0 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:00.659843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-39d6ab9c-8352-44e4-bf31-c4471993ead0 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a6be44fbc18645078900af6a4bc352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53a5be78aa7e491c8bd071f43d0013f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39d6ab9c-8352-44e4-bf31-c4471993ead0 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] Request method failure captured: Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54UQ-RTpG-b36NYiigekvuzgXs5zDt02_YlyeVyLlBGH55_P_E4cuOw-3mA5MLk1O3AJXaux_HY0kTi-pw_7dxBUh7plp8cdPrT3z1937b5E7w8Ymwk5YR8ZlhULUwoOhT2ocWoq8NVOuihKAgyNrfSDOXTtzQGEiZjJQ5UVBshzwA Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 53a5be78aa7e491c8bd071f43d0013f7 Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:00.661907 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/53a5be78aa7e491c8bd071f43d0013f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53a5be78aa7e491c8bd071f43d0013f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53a5be78aa7e491c8bd071f43d0013f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_53a5be78aa7e491c8bd071f43d0013f7", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 53a5be78aa7e491c8bd071f43d0013f7 Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: a6be44fbc18645078900af6a4bc352c3 Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project Oct 19 06:50:00.663217 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: action_args: {} Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:00.663843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 19 06:50:00.664976 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.665966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39d6ab9c-8352-44e4-bf31-c4471993ead0 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:00.665966 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39d6ab9c-8352-44e4-bf31-c4471993ead0 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.517557 Oct 19 06:50:00.665966 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 75/162] 10.222.0.39 () {58 vars in 1185 bytes} [Wed Oct 19 06:50:00 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 519 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:00.672061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-457220e5-e8b9-44f5-9d88-d8a20bf04445 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:00.673898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-457220e5-e8b9-44f5-9d88-d8a20bf04445 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a6be44fbc18645078900af6a4bc352c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53a5be78aa7e491c8bd071f43d0013f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-457220e5-e8b9-44f5-9d88-d8a20bf04445 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] Request method failure captured: Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19%2006:50:00 HTTP/1.1 Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54UQ-RTpG-b36NYiigekvuzgXs5zDt02_YlyeVyLlBGH55_P_E4cuOw-3mA5MLk1O3AJXaux_HY0kTi-pw_7dxBUh7plp8cdPrT3z1937b5E7w8Ymwk5YR8ZlhULUwoOhT2ocWoq8NVOuihKAgyNrfSDOXTtzQGEiZjJQ5UVBshzwA Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 53a5be78aa7e491c8bd071f43d0013f7 Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:50:00.675444 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/53a5be78aa7e491c8bd071f43d0013f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53a5be78aa7e491c8bd071f43d0013f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53a5be78aa7e491c8bd071f43d0013f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_53a5be78aa7e491c8bd071f43d0013f7", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 53a5be78aa7e491c8bd071f43d0013f7 Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: a6be44fbc18645078900af6a4bc352c3 Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project Oct 19 06:50:00.676723 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '2022-10-19 06:50:00'} Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:00.677251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 19 06:50:00.681861 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:00.682716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-457220e5-e8b9-44f5-9d88-d8a20bf04445 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:00.682716 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-457220e5-e8b9-44f5-9d88-d8a20bf04445 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562 tempest-InstanceUsageAuditLogNegativeTestJSON-393173562-project] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19 06:50:00" status: 403 len: 128 microversion: 2.1 time: 0.008631 Oct 19 06:50:00.682716 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 88/163] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 06:50:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19%2006%3A50%3A00 => generated 128 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:00.739486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:00.739486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:00.745938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:00.746452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:00.747490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:00.748215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:00.748673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:00.749091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:00.886108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:00.891336 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8311a913-68b7-4db9-b614-0a064d2bac15 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.156578 Oct 19 06:50:00.891897 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 76/164] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:00 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:01.915112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:01.916342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:01.923798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:01.924314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:01.924920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:01.925617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:01.926066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:01.926489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.110958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:02.121481 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18c661f3-153f-417f-9351-1086b7475057 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.211043 Oct 19 06:50:02.122062 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 89/165] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:01 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:02.275870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-645561227", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:02.315546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Calling method '.version_select at 0x7f6d654be0d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:02.322752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) {{(pid=127567) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 19 06:50:02.323495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.323983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.324461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.345212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.345711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.346150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.360261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.360396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:50:02.363239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.363693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.371162 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-82f60f76-bd31-4d18-8bf7-bc7fbe415734 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.247834 Oct 19 06:50:02.371862 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 90/166] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:50:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:02.387880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Calling method '.version_select at 0x7f6d65799ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:02.391121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.391121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.391121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.409264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.409981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.414006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.423534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.423940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.424400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.434756 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35ecae75-ff82-4373-8752-fe8a62236c32 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.050421 Oct 19 06:50:02.435373 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 91/167] 10.222.0.39 () {58 vars in 1167 bytes} [Wed Oct 19 06:50:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:50:02.452689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Calling method '.version_select at 0x7f6d654be3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:02.454566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.455092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.455530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.472259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.473059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.473495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.486154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.486629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.487398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.495346 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4136c1d8-3e0b-4035-89d1-d182b5982c50 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.046342 Oct 19 06:50:02.502689 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 92/168] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:50:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:02.507698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf67580e-c596-4662-a637-18c568913cb2 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Calling method '.version_select at 0x7f6d65510d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:02.509615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf67580e-c596-4662-a637-18c568913cb2 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.510089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf67580e-c596-4662-a637-18c568913cb2 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.510708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf67580e-c596-4662-a637-18c568913cb2 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.530215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf67580e-c596-4662-a637-18c568913cb2 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.530743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf67580e-c596-4662-a637-18c568913cb2 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.531179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf67580e-c596-4662-a637-18c568913cb2 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.540391 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf67580e-c596-4662-a637-18c568913cb2 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.036396 Oct 19 06:50:02.541311 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 93/169] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:02.784536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:50:02.784965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:50:02.785438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:50:02.785851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:50:02.786263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:50:02.800736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.801224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.801727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.802382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.802897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:02.803399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:02.834546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Getting quotas for project c294e39032fd4538817ebdb2d62ac1b7. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:02.841878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Getting quotas for user c250b5dd666c4df89fcf483b04391a50 and project c294e39032fd4538817ebdb2d62ac1b7. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:02.858051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:50:02.864222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:50:02.948652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c4e9e21-5e82-400e-bf7b-5fc18ffe79b4 tempest-FlavorsV255TestJSON-1959331805 tempest-FlavorsV255TestJSON-1959331805-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-259075949", "id": 612490474, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:02.992227 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5ff8524-e8ab-402f-ad01-14c404777f62 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.068210 Oct 19 06:50:02.999121 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 77/170] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:50:02.999121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a12c7f5b-d928-486c-833a-5d6155371427 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Calling method '.version_select at 0x7f6d653dc8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:02.999390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a12c7f5b-d928-486c-833a-5d6155371427 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:02.999815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a12c7f5b-d928-486c-833a-5d6155371427 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.000289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a12c7f5b-d928-486c-833a-5d6155371427 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.018027 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a12c7f5b-d928-486c-833a-5d6155371427 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.023744 Oct 19 06:50:03.018627 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 78/171] 10.222.0.39 () {58 vars in 1179 bytes} [Wed Oct 19 06:50:02 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:03.028364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff75e716-35e9-4819-84c8-5a53744e9604 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.028364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff75e716-35e9-4819-84c8-5a53744e9604 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:03.037998 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c4e9e21-5e82-400e-bf7b-5fc18ffe79b4 tempest-FlavorsV255TestJSON-1959331805 tempest-FlavorsV255TestJSON-1959331805-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.495602 Oct 19 06:50:03.047187 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 94/172] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:50:02 2022] POST /compute/v2.1/flavors => generated 445 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:03.047187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Calling method '.version_select at 0x7f6d6545ba60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.048869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.048869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.049296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.074309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.074309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.074309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.079795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.080378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.080812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.088025 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-895434cc-ac68-4f68-b99b-bd44e0e05f11 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.047731 Oct 19 06:50:03.089188 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 95/173] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:03.105036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff75e716-35e9-4819-84c8-5a53744e9604 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:03.117076 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff75e716-35e9-4819-84c8-5a53744e9604 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1221 microversion: 2.1 time: 0.097329 Oct 19 06:50:03.122311 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 79/174] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:03.123045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4aff23d6-61b9-4497-8db7-80c3ac445320 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Calling method '.version_select at 0x7f6d652909d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.124948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4aff23d6-61b9-4497-8db7-80c3ac445320 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.125411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4aff23d6-61b9-4497-8db7-80c3ac445320 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.125842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4aff23d6-61b9-4497-8db7-80c3ac445320 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.142823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4aff23d6-61b9-4497-8db7-80c3ac445320 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.143234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4aff23d6-61b9-4497-8db7-80c3ac445320 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.143760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4aff23d6-61b9-4497-8db7-80c3ac445320 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.157237 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4aff23d6-61b9-4497-8db7-80c3ac445320 tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.036932 Oct 19 06:50:03.168556 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 80/175] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:03.168556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.168556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:03.185018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.186279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.186738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.187491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.187974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.188436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.426803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:03.436303 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-279c00c9-d324-4593-afce-a5d2acda3156 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.273951 Oct 19 06:50:03.437771 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 81/176] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:03.458078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70ccd25e-0e46-4ede-bab1-909d61dfaced tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Calling method '.version_select at 0x7f6d652965e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.460585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ccd25e-0e46-4ede-bab1-909d61dfaced tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.461881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ccd25e-0e46-4ede-bab1-909d61dfaced tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.462513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ccd25e-0e46-4ede-bab1-909d61dfaced tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.478802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ccd25e-0e46-4ede-bab1-909d61dfaced tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.479564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ccd25e-0e46-4ede-bab1-909d61dfaced tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.480235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ccd25e-0e46-4ede-bab1-909d61dfaced tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.481166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a92a3305-66cc-49db-874f-c3adeaf665c6 tempest-FlavorsV255TestJSON-1610338003 tempest-FlavorsV255TestJSON-1610338003-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.490070 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a92a3305-66cc-49db-874f-c3adeaf665c6 tempest-FlavorsV255TestJSON-1610338003 tempest-FlavorsV255TestJSON-1610338003-project] 10.222.0.39 "GET /compute/v2.1/flavors/612490474" status: 200 len: 445 microversion: 2.55 time: 0.399633 Oct 19 06:50:03.490658 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 96/177] 10.222.0.39 () {60 vars in 1196 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/flavors/612490474 => generated 445 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:03.491679 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70ccd25e-0e46-4ede-bab1-909d61dfaced tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.037552 Oct 19 06:50:03.492607 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 82/178] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:03.505148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5e4a44e-c5d3-4590-9c56-adc304df90c6 tempest-FlavorsV255TestJSON-1959331805 tempest-FlavorsV255TestJSON-1959331805-project-admin] Action: 'update', calling method: .version_select at 0x7f6d666a1c10>, body: {"flavor": {"description": "new"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:03.516125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Calling method '.version_select at 0x7f6d65296f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.525293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.525865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.526306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.536135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:03.539873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.540189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.540623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.550443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.550919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.552034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.556823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:50:03.557218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac8cfab-713b-411f-ba26-66f5b3b1604c tempest-HypervisorAdminTestJSON-101848830 tempest-HypervisorAdminTestJSON-101848830-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:50:03.558311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9714ec-ebb1-4c7d-9138-d2f6ed5d9444 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.558766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9714ec-ebb1-4c7d-9138-d2f6ed5d9444 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.559181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9714ec-ebb1-4c7d-9138-d2f6ed5d9444 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.559910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9714ec-ebb1-4c7d-9138-d2f6ed5d9444 None None] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:03.560374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9714ec-ebb1-4c7d-9138-d2f6ed5d9444 None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:03.560844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9714ec-ebb1-4c7d-9138-d2f6ed5d9444 None None] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:03.570069 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.compute.rpcapi [None req-6e9714ec-ebb1-4c7d-9138-d2f6ed5d9444 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 06:50:03.571031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9714ec-ebb1-4c7d-9138-d2f6ed5d9444 None None] Releasing lock "compute-rpcapi-router" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:50:03.609118 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e9714ec-ebb1-4c7d-9138-d2f6ed5d9444 None None] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.098425 Oct 19 06:50:03.609820 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 83/179] 10.222.0.39 () {58 vars in 1173 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:03.652528 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5e4a44e-c5d3-4590-9c56-adc304df90c6 tempest-FlavorsV255TestJSON-1959331805 tempest-FlavorsV255TestJSON-1959331805-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/612490474" status: 200 len: 446 microversion: 2.55 time: 0.151848 Oct 19 06:50:03.653583 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 97/180] 10.222.0.39 () {62 vars in 1216 bytes} [Wed Oct 19 06:50:03 2022] PUT /compute/v2.1/flavors/612490474 => generated 446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:03.667173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed8bf5a8-58b4-4e9f-80f9-b45c26e21f54 tempest-FlavorsV255TestJSON-1610338003 tempest-FlavorsV255TestJSON-1610338003-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.697817 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed8bf5a8-58b4-4e9f-80f9-b45c26e21f54 tempest-FlavorsV255TestJSON-1610338003 tempest-FlavorsV255TestJSON-1610338003-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.034943 Oct 19 06:50:03.700472 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 84/181] 10.222.0.39 () {60 vars in 1187 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:03.720529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08ec3f42-7fc3-401a-84f1-b2e2ee0415b7 tempest-FlavorsV255TestJSON-1610338003 tempest-FlavorsV255TestJSON-1610338003-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.746794 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08ec3f42-7fc3-401a-84f1-b2e2ee0415b7 tempest-FlavorsV255TestJSON-1610338003 tempest-FlavorsV255TestJSON-1610338003-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.031780 Oct 19 06:50:03.747314 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 98/182] 10.222.0.39 () {60 vars in 1166 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:03.764254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29ec677d-d657-434f-9e86-caf373a8f957 tempest-FlavorsV255TestJSON-1959331805 tempest-FlavorsV255TestJSON-1959331805-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.834803 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29ec677d-d657-434f-9e86-caf373a8f957 tempest-FlavorsV255TestJSON-1959331805 tempest-FlavorsV255TestJSON-1959331805-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/612490474" status: 202 len: 0 microversion: 2.55 time: 0.074411 Oct 19 06:50:03.835382 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 85/183] 10.222.0.39 () {60 vars in 1199 bytes} [Wed Oct 19 06:50:03 2022] DELETE /compute/v2.1/flavors/612490474 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:50:03.843852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3ed0e23-68a9-4709-9c85-1442e9d2eb51 tempest-FlavorsV255TestJSON-1959331805 tempest-FlavorsV255TestJSON-1959331805-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:03.865151 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3ed0e23-68a9-4709-9c85-1442e9d2eb51 tempest-FlavorsV255TestJSON-1959331805 tempest-FlavorsV255TestJSON-1959331805-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.025399 Oct 19 06:50:03.865744 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 99/184] 10.222.0.39 () {60 vars in 1187 bytes} [Wed Oct 19 06:50:03 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:50:04.138823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48c5cd4f-624e-40c9-99e5-daa89fd0db6c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:04.141221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48c5cd4f-624e-40c9-99e5-daa89fd0db6c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:04.194815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48c5cd4f-624e-40c9-99e5-daa89fd0db6c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:04.201783 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48c5cd4f-624e-40c9-99e5-daa89fd0db6c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1221 microversion: 2.1 time: 0.066892 Oct 19 06:50:04.202338 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 86/185] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:04 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:04.471609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:04.472709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:04.492720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:04.493341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:04.495241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:04.497020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:04.500588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:04.501238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:04.713264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:04.722295 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91532223-d587-4a98-abab-0892aea3dba6 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.265879 Oct 19 06:50:04.734223 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 100/186] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:04 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:05.224293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:05.225496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:05.232794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.234658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.234658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.236059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.236862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.237530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.282956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Calling method '.version_select at 0x7f6d65296e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:05.287745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.288411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.288947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.306407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.307047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.307704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.325623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:05.336767 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-24884545-5b63-4ba6-a144-6fdf07d92c38 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1273 microversion: 2.1 time: 0.116353 Oct 19 06:50:05.345040 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 101/187] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:05 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:05.383685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.384543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.385136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.397528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.398249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.399274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.424159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.424974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.428819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.432170 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f01330a-b5b1-48f7-bebe-da0f39516030 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.516409 Oct 19 06:50:05.436546 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 87/188] 10.222.0.39 () {60 vars in 1243 bytes} [Wed Oct 19 06:50:04 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:05.449947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Calling method '.version_select at 0x7f6d655e5160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:05.454501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.454989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.455425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.473925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.474476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.474819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.506698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.507174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.507605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.518043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.518508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.518938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.528854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:05.537704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.538177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.538608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.545245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59865c13-2659-4dfd-a984-c911553db7fb tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.099209 Oct 19 06:50:05.545793 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 102/189] 10.222.0.39 () {60 vars in 1222 bytes} [Wed Oct 19 06:50:05 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:05.557621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f138083-d926-4473-b0c3-615565ececd2 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Calling method '.version_select at 0x7f6d6526d700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:05.561497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f138083-d926-4473-b0c3-615565ececd2 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.562005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f138083-d926-4473-b0c3-615565ececd2 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.562437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f138083-d926-4473-b0c3-615565ececd2 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.581542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f138083-d926-4473-b0c3-615565ececd2 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.582019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f138083-d926-4473-b0c3-615565ececd2 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.582447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f138083-d926-4473-b0c3-615565ececd2 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.585419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:05.589280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f138083-d926-4473-b0c3-615565ececd2 tempest-HypervisorAdminV253TestBase-893225571 tempest-HypervisorAdminV253TestBase-893225571-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/02342500-c9fa-4a36-a749-e30ad9340cb5" status: 200 len: 794 microversion: 2.53 time: 0.035362 Oct 19 06:50:05.589869 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 88/190] 10.222.0.39 () {60 vars in 1298 bytes} [Wed Oct 19 06:50:05 2022] GET /compute/v2.1/os-hypervisors/02342500-c9fa-4a36-a749-e30ad9340cb5 => generated 794 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:05.746256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:05.746869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:05.748727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:05.755909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.756955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.757632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.758536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:05.759222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:05.759849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:05.917453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:05.924854 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d15ad6b3-f494-4855-b2c3-285708907025 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.182547 Oct 19 06:50:05.925422 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 103/191] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:05 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:06.362577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:06.363268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:06.369543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:06.370096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:06.370729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:06.371490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:06.372028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:06.372550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:06.458038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:06.469864 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b353ca8-a018-4163-a455-b0195ad40fc8 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1281 microversion: 2.1 time: 0.112602 Oct 19 06:50:06.470436 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 89/192] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:06 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:06.949981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:06.949981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:06.957418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:06.958079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:06.958590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:06.959360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:06.959893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:06.960627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:07.101192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:07.109939 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3514855d-f2a2-4d81-b190-feb71756a0b1 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.166031 Oct 19 06:50:07.110925 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 104/193] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:06 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:07.497732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:07.500768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:07.523864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:07.524632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:07.525381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:07.526780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:07.527496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:07.528969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:07.636721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d42f97e0-bf96-4695-8ac5-e947a8bba810 req-b775c9d3-2f14-4a33-a3fd-9e36a25817f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7970343e-02b4-4dcc-a64f-4f014af41ba3", "name": "network-vif-plugged", "status": "completed", "tag": "0fe08c14-1ac3-42c0-a16e-b0ace4360b66"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:07.663795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d42f97e0-bf96-4695-8ac5-e947a8bba810 req-b775c9d3-2f14-4a33-a3fd-9e36a25817f5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:07.665058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d42f97e0-bf96-4695-8ac5-e947a8bba810 req-b775c9d3-2f14-4a33-a3fd-9e36a25817f5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:07.668286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d42f97e0-bf96-4695-8ac5-e947a8bba810 req-b775c9d3-2f14-4a33-a3fd-9e36a25817f5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:07.712966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:07.727380 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6c60a72-7a2c-49f5-b887-d0a569c4aaa1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1279 microversion: 2.1 time: 0.235857 Oct 19 06:50:07.727963 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 105/194] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:07 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:07.744611 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d42f97e0-bf96-4695-8ac5-e947a8bba810 req-b775c9d3-2f14-4a33-a3fd-9e36a25817f5 service nova] Creating event network-vif-plugged:0fe08c14-1ac3-42c0-a16e-b0ace4360b66 for instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 on n-h1-861333-10 Oct 19 06:50:07.744611 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d42f97e0-bf96-4695-8ac5-e947a8bba810 req-b775c9d3-2f14-4a33-a3fd-9e36a25817f5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298684 Oct 19 06:50:07.744611 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 90/195] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:08.136200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:08.136696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:08.152430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:08.154102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:08.156625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:08.163066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:08.164186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:08.167216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:08.554134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:08.567455 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63232b41-47f4-43e9-ac90-286326be8426 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.436418 Oct 19 06:50:08.569743 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 106/196] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:08 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:08.756542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:08.757434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:08.764907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:08.766950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:08.767496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:08.768620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:08.769271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:08.771359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:08.927625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:08.935305 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75e06ad9-6e09-43d5-815d-5402e067d259 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.183445 Oct 19 06:50:08.936063 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 91/197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:08 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:09.593421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:09.594550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:09.601689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:09.602833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:09.603698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:09.604509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:09.604974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:09.605408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:09.931365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:09.939565 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50486d7f-87c7-46e7-a1af-06a0c8bc02ef tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1339 microversion: 2.1 time: 0.352556 Oct 19 06:50:09.940054 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 107/198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:09 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1339 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:09.961281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:09.961906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:09.973362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:09.973878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:09.975366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:09.976323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:09.978909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:09.981849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:10.245022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:10.253147 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1fe4d1e-9d1e-4317-8c5a-063b5070d1be tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.297340 Oct 19 06:50:10.253724 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 92/199] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:09 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:10.962646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:10.963332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:10.969452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:10.969933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:10.970361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:10.971129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:10.971578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:10.972006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:10.996233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Calling method '.version_select at 0x7f6d6542fb80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:11.001179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:11.005736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:11.005736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:11.043546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:11.044486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:11.045155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:11.072789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:11.073526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:11.074109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:11.086155 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91b51b5d-3554-4e9c-8d7f-f4b7db63d3a4 tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.255560 Oct 19 06:50:11.089445 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 108/200] 10.222.0.39 () {60 vars in 1187 bytes} [Wed Oct 19 06:50:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:11.101679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87c2c68c-1347-43af-941b-3f7bef31336e tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Calling method '.version_select at 0x7f6d65510f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:11.103931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87c2c68c-1347-43af-941b-3f7bef31336e tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:11.104437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87c2c68c-1347-43af-941b-3f7bef31336e tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:11.104873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87c2c68c-1347-43af-941b-3f7bef31336e tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:11.125726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87c2c68c-1347-43af-941b-3f7bef31336e tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:11.126566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87c2c68c-1347-43af-941b-3f7bef31336e tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:11.127089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87c2c68c-1347-43af-941b-3f7bef31336e tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:11.143153 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87c2c68c-1347-43af-941b-3f7bef31336e tempest-HypervisorAdminV228Test-481804431 tempest-HypervisorAdminV228Test-481804431-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.045047 Oct 19 06:50:11.144674 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 109/201] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 06:50:11 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:11.226213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:11.236667 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-600a15d9-4a2b-4dfe-9231-9f09162eb060 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1489 microversion: 2.1 time: 0.277421 Oct 19 06:50:11.252830 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 93/202] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:10 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1489 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:11.263758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b9ac1ad-4b36-4d1a-ad38-8b0fc19bc673 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:11.264828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b9ac1ad-4b36-4d1a-ad38-8b0fc19bc673 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:11.275405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1ad-4b36-4d1a-ad38-8b0fc19bc673 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:11.275906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1ad-4b36-4d1a-ad38-8b0fc19bc673 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:11.276518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1ad-4b36-4d1a-ad38-8b0fc19bc673 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:11.277305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1ad-4b36-4d1a-ad38-8b0fc19bc673 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:11.277761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1ad-4b36-4d1a-ad38-8b0fc19bc673 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:11.278529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1ad-4b36-4d1a-ad38-8b0fc19bc673 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:11.278661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:11.279201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:11.288135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:11.289073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:11.290109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:11.290969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:11.291429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:11.291854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:11.523411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:11.542908 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a7ad5813-4735-47da-8927-b7defb5f52ec tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.268234 Oct 19 06:50:11.543897 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 94/203] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:11 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:50:12.151468 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b9ac1ad-4b36-4d1a-ad38-8b0fc19bc673 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1642 microversion: 2.1 time: 0.893174 Oct 19 06:50:12.157677 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 110/204] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:11 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1642 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:12.181232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:12.182363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:12.190464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:12.191179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:12.192266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:12.193148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:12.193749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:12.194307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:12.226940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:50:12.666956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5f04953-5fab-44c2-a318-951cfbd190de tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Calling method '.version_select at 0x7f6d65510d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:12.795384 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1a92e9e-cad4-448d-ae27-05e51e6f8d67 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 204 len: 0 microversion: 2.1 time: 0.619081 Oct 19 06:50:12.797313 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 95/205] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:50:12 2022] DELETE /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:50:12.804752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:12.805731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:12.812827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:12.813930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:12.814812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:12.815904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:12.817242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:12.817842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:13.176725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:13.189628 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8520d38-f2a4-4c14-8023-04c0b2626f03 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.390831 Oct 19 06:50:13.190920 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 96/206] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:12 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:13.201019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:13.201942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:13.216800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:13.220855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:13.221574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:13.223617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:13.225841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:13.226981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:13.386251 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5f04953-5fab-44c2-a318-951cfbd190de tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/8f84da65622b4ee781989bfac78cd11b" status: 200 len: 371 microversion: 2.1 time: 1.155192 Oct 19 06:50:13.389206 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 111/207] 10.222.0.39 () {58 vars in 1242 bytes} [Wed Oct 19 06:50:12 2022] GET /compute/v2.1/os-quota-sets/8f84da65622b4ee781989bfac78cd11b => generated 371 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:13.402481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a98fd949-8f5c-483f-8ac3-8d76f46e587e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Action: 'update', calling method: .version_select at 0x7f6d6540adc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:13.421213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:13.431281 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-56c98d3c-0de6-4412-a941-9bebcb83fcda tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1495 microversion: 2.1 time: 0.239137 Oct 19 06:50:13.444856 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 97/208] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:13 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1495 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:13.875588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a98fd949-8f5c-483f-8ac3-8d76f46e587e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:13.875588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a98fd949-8f5c-483f-8ac3-8d76f46e587e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:13.875588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a98fd949-8f5c-483f-8ac3-8d76f46e587e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:13.880450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4f8c69ef-dd6b-4f31-8644-f009066e8b8b req-afe75b9e-5aca-4c8a-ae99-4db4de64ddff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8494338-c7cd-45d0-a10c-44f411189512", "tag": "67919d54-1f84-4a84-b595-a64f27391900"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:13.885842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a98fd949-8f5c-483f-8ac3-8d76f46e587e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:13.888402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a98fd949-8f5c-483f-8ac3-8d76f46e587e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:13.889150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a98fd949-8f5c-483f-8ac3-8d76f46e587e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:13.889858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:13.904576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f8c69ef-dd6b-4f31-8644-f009066e8b8b req-afe75b9e-5aca-4c8a-ae99-4db4de64ddff service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:13.907215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f8c69ef-dd6b-4f31-8644-f009066e8b8b req-afe75b9e-5aca-4c8a-ae99-4db4de64ddff service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:13.907916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f8c69ef-dd6b-4f31-8644-f009066e8b8b req-afe75b9e-5aca-4c8a-ae99-4db4de64ddff service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:13.938787 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4f8c69ef-dd6b-4f31-8644-f009066e8b8b req-afe75b9e-5aca-4c8a-ae99-4db4de64ddff service nova] Creating event network-changed:67919d54-1f84-4a84-b595-a64f27391900 for instance a8494338-c7cd-45d0-a10c-44f411189512 on n-h2-861333-10 Oct 19 06:50:13.952925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SAVEPOINT=1,nova_api:UPDATE=2,nova_api:RELEASE=1,nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:13.956452 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4f8c69ef-dd6b-4f31-8644-f009066e8b8b req-afe75b9e-5aca-4c8a-ae99-4db4de64ddff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079763 Oct 19 06:50:13.958592 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 98/209] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:14.142714 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a98fd949-8f5c-483f-8ac3-8d76f46e587e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/8f84da65622b4ee781989bfac78cd11b" status: 200 len: 328 microversion: 2.1 time: 0.742121 Oct 19 06:50:14.150690 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 112/210] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:13 2022] PUT /compute/v2.1/os-quota-sets/8f84da65622b4ee781989bfac78cd11b => generated 328 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:14.163374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01f7ea16-b99a-4cf4-b38e-5ce86707606c tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:14.199616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:14.283193 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01f7ea16-b99a-4cf4-b38e-5ce86707606c tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-quota-sets/8f84da65622b4ee781989bfac78cd11b" status: 202 len: 0 microversion: 2.1 time: 0.131191 Oct 19 06:50:14.283867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 113/211] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 06:50:14 2022] DELETE /compute/v2.1/os-quota-sets/8f84da65622b4ee781989bfac78cd11b => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:50:14.304473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:14.307650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:14.322155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:14.326978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:14.328355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:14.330247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:14.330870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:14.331551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:14.393231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-338ccb1d-bc59-43da-a56f-f91daf2ac0f9 tempest-NetworksTest-946848953 tempest-NetworksTest-946848953-project-admin] Calling method '.version_select at 0x7f6d652721f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:14.666956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:14.677111 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d75e0ba9-b9e4-4142-8b1b-f8954ed337aa tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.388049 Oct 19 06:50:14.678394 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 114/212] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:14 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:14.683343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64b92344-866f-4248-a02b-54fd89bbe6f3 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Calling method '.version_select at 0x7f6d6542f5e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:14.815125 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64b92344-866f-4248-a02b-54fd89bbe6f3 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/8f84da65622b4ee781989bfac78cd11b" status: 200 len: 371 microversion: 2.1 time: 0.135288 Oct 19 06:50:14.816022 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 115/213] 10.222.0.39 () {58 vars in 1242 bytes} [Wed Oct 19 06:50:14 2022] GET /compute/v2.1/os-quota-sets/8f84da65622b4ee781989bfac78cd11b => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:14.831095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:14.831900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:14.844680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:14.845445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:14.846041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:14.846899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:14.849533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:14.850171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:15.119265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:15.130418 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55688fae-d114-4a7a-89c3-ccfa61a37278 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1495 microversion: 2.1 time: 0.312602 Oct 19 06:50:15.131232 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 116/214] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:14 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1495 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:15.149532 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-338ccb1d-bc59-43da-a56f-f91daf2ac0f9 tempest-NetworksTest-946848953 tempest-NetworksTest-946848953-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks" status: 200 len: 2616 microversion: 2.1 time: 1.089389 Oct 19 06:50:15.150297 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 99/215] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:50:14 2022] GET /compute/v2.1/os-networks => generated 2616 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:15.173772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32300ae6-2428-40ed-9f07-dfa455c07ab2 tempest-NetworksTest-946848953 tempest-NetworksTest-946848953-project-admin] Calling method '.version_select at 0x7f6d654beca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:15.201249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96e8e221-db82-43ef-95c7-f5eda918f202 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Calling method '.version_select at 0x7f6d65256550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:15.435990 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32300ae6-2428-40ed-9f07-dfa455c07ab2 tempest-NetworksTest-946848953 tempest-NetworksTest-946848953-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks/6ca08089-6704-47df-a013-49691731b317" status: 200 len: 652 microversion: 2.1 time: 0.270243 Oct 19 06:50:15.437599 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 117/216] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 06:50:15 2022] GET /compute/v2.1/os-networks/6ca08089-6704-47df-a013-49691731b317 => generated 652 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:15.447490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d87ebbf9-b3f7-474b-b755-8a13b5c41100 tempest-NetworksTest-946848953 tempest-NetworksTest-946848953-project-admin] Calling method '.version_select at 0x7f6d6542f5e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:15.493723 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96e8e221-db82-43ef-95c7-f5eda918f202 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/ab03561c13b7404191bfe5117efc206d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.295964 Oct 19 06:50:15.495098 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 100/217] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 06:50:15 2022] GET /compute/v2.1/os-quota-sets/ab03561c13b7404191bfe5117efc206d/defaults => generated 371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:15.703658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:15.704377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:15.724705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:15.725217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:15.725659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:15.726413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:15.727644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:15.727804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:15.838291 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d87ebbf9-b3f7-474b-b755-8a13b5c41100 tempest-NetworksTest-946848953 tempest-NetworksTest-946848953-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks" status: 200 len: 2616 microversion: 2.1 time: 0.395111 Oct 19 06:50:15.843069 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 118/218] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:50:15 2022] GET /compute/v2.1/os-networks => generated 2616 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:16.064639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e25d35e0-ea0e-4ba1-a6bf-46592325d9df tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Action: 'update', calling method: .version_select at 0x7f6d653203a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:16.101078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:16.167605 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a7b357e2-d0cd-4245-b14b-4b620cdc5215 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.413302 Oct 19 06:50:16.167605 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 101/219] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:15 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:50:16.167605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-09f9c90d-99fc-4ded-a543-31e40955ad6d req-85112a12-aae4-4183-b807-f3e7b7594348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7970343e-02b4-4dcc-a64f-4f014af41ba3", "name": "network-vif-deleted", "tag": "0fe08c14-1ac3-42c0-a16e-b0ace4360b66"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:16.167605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-09f9c90d-99fc-4ded-a543-31e40955ad6d req-85112a12-aae4-4183-b807-f3e7b7594348 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:16.167913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-09f9c90d-99fc-4ded-a543-31e40955ad6d req-85112a12-aae4-4183-b807-f3e7b7594348 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:16.167913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-09f9c90d-99fc-4ded-a543-31e40955ad6d req-85112a12-aae4-4183-b807-f3e7b7594348 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:16.200078 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-09f9c90d-99fc-4ded-a543-31e40955ad6d req-85112a12-aae4-4183-b807-f3e7b7594348 service nova] Creating event network-vif-deleted:0fe08c14-1ac3-42c0-a16e-b0ace4360b66 for instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 on n-h1-861333-10 Oct 19 06:50:16.208218 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-09f9c90d-99fc-4ded-a543-31e40955ad6d req-85112a12-aae4-4183-b807-f3e7b7594348 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064772 Oct 19 06:50:16.236553 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 102/220] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:16.259946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:16.260812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:16.267280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:16.269629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:16.269629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:16.269629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:16.269629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:16.269980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:16.549850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92d335e7cd4168b7aa7e5daa3bd518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2631c6f28d74660b55bdbe16c0cea3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:16.565629 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c524a259-a2ba-494a-a689-a8ff1c0dc00f tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 200 len: 1453 microversion: 2.1 time: 0.325731 Oct 19 06:50:16.566212 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 103/221] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:16 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 1453 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:16.659516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25d35e0-ea0e-4ba1-a6bf-46592325d9df tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:16.660723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25d35e0-ea0e-4ba1-a6bf-46592325d9df tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:16.661407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25d35e0-ea0e-4ba1-a6bf-46592325d9df tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:16.662544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25d35e0-ea0e-4ba1-a6bf-46592325d9df tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:16.663648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25d35e0-ea0e-4ba1-a6bf-46592325d9df tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:16.664689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25d35e0-ea0e-4ba1-a6bf-46592325d9df tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:16.796400 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e25d35e0-ea0e-4ba1-a6bf-46592325d9df tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/a49fdc4af3204927ba066b0938a8620b" status: 200 len: 328 microversion: 2.1 time: 0.740895 Oct 19 06:50:16.797063 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 119/222] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:16 2022] PUT /compute/v2.1/os-quota-sets/a49fdc4af3204927ba066b0938a8620b => generated 328 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:16.808957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7281ebd0-92e1-4b62-960b-45836c85a6f0 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Calling method '.version_select at 0x7f6d653ba700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:17.137897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:17.138510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:17.147733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:17.148582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:17.151553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:17.152786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:17.153446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:17.154070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:17.417538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7281ebd0-92e1-4b62-960b-45836c85a6f0 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:17.418265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7281ebd0-92e1-4b62-960b-45836c85a6f0 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:17.418964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7281ebd0-92e1-4b62-960b-45836c85a6f0 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:17.419929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7281ebd0-92e1-4b62-960b-45836c85a6f0 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:17.420420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7281ebd0-92e1-4b62-960b-45836c85a6f0 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:17.420844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7281ebd0-92e1-4b62-960b-45836c85a6f0 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:17.446385 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7281ebd0-92e1-4b62-960b-45836c85a6f0 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/a49fdc4af3204927ba066b0938a8620b/detail" status: 200 len: 916 microversion: 2.1 time: 0.641213 Oct 19 06:50:17.446977 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 104/223] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:50:16 2022] GET /compute/v2.1/os-quota-sets/a49fdc4af3204927ba066b0938a8620b/detail => generated 916 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:17.562654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:17.575681 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5232970-a345-4457-8af9-9ed2e1e2969c tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.441774 Oct 19 06:50:17.576303 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 120/224] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:17 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:50:17.588559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:17.589181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:17.599372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:17.603377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:17.603377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:17.603377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:17.603377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:17.603745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:17.636407 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] HTTP exception thrown: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Request method failure captured: Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 HTTP/1.1 Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54B9UxUTdsq1Can81NyxLtRsCzPNdUUOGKrEJeEMifB-YNgrMDVYqT-j9bjNXuFiKUoo6M1IMgc2k_lvP0Ib7uBX3b21vFQwqOHc_vCYHbl7fEjVIE6hIOrP7sQXZBobJe3ep4pwRhFN_lXR2lQQbS2xJPTpn8SuIAVAbvpby4gnNc Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f2631c6f28d74660b55bdbe16c0cea3b Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-1056340055 Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:17.639018 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f2631c6f28d74660b55bdbe16c0cea3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2631c6f28d74660b55bdbe16c0cea3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2631c6f28d74660b55bdbe16c0cea3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f2631c6f28d74660b55bdbe16c0cea3b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-1056340055 Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f2631c6f28d74660b55bdbe16c0cea3b Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1056340055 Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-1056340055-project Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: fa92d335e7cd4168b7aa7e5daa3bd518 Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-1056340055-project Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:17.640297 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '7970343e-02b4-4dcc-a64f-4f014af41ba3'} Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:17.640936 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:17.641958 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:17.643967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Returning 404 to user: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:17.645137 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9f2ee65-02e8-4151-9e0d-868f9ce766ae tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 404 len: 111 microversion: 2.1 time: 0.060876 Oct 19 06:50:17.645859 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 105/225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:17 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:17.656431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1223f6d9-b77b-4c56-8292-5dc9b3990e31 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861333-10"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:17.668629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1223f6d9-b77b-4c56-8292-5dc9b3990e31 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:17.669246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1223f6d9-b77b-4c56-8292-5dc9b3990e31 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:17.669740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1223f6d9-b77b-4c56-8292-5dc9b3990e31 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:18.015096 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1223f6d9-b77b-4c56-8292-5dc9b3990e31 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.364452 Oct 19 06:50:18.015697 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 121/226] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:50:17 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:18.027421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ecdc5b0-f8c8-4371-8523-f5ad0b44fe73 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:18.123368 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ecdc5b0-f8c8-4371-8523-f5ad0b44fe73 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.099808 Oct 19 06:50:18.124169 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 106/227] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:18 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:50:18.149512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3609d83-ff4f-4782-80cd-60d3e6dda93f tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-3404392"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:18.155014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-f3609d83-ff4f-4782-80cd-60d3e6dda93f tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Generated uuid 19a3e4ff-143e-4a52-8943-20fc70099299 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:18.296782 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3609d83-ff4f-4782-80cd-60d3e6dda93f tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 195 microversion: 2.1 time: 0.154285 Oct 19 06:50:18.303792 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 122/228] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:50:18 2022] POST /compute/v2.1/os-aggregates => generated 195 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:18.304057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Action: 'update', calling method: .version_select at 0x7f6d651a3d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:18.310683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5c4822c-3c35-4ee5-be44-64e252b0d7bc tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:18.334610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5c4822c-3c35-4ee5-be44-64e252b0d7bc tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:18.335886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5c4822c-3c35-4ee5-be44-64e252b0d7bc tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:18.337037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5c4822c-3c35-4ee5-be44-64e252b0d7bc tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:18.552502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:18.554895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:18.557515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:18.559085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:18.560438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:18.561551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:18.639041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:18.639532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:18.640814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:18.642046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:18.642716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:18.643353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:18.713516 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5c4822c-3c35-4ee5-be44-64e252b0d7bc tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 240 microversion: 2.1 time: 0.408197 Oct 19 06:50:18.720606 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 123/229] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:50:18 2022] POST /compute/v2.1/os-aggregates/8/action => generated 240 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:18.720606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:18.720606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:18.731046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:18.731609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:18.732415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:18.733211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:18.733739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:18.735105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:18.802596 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-887be744-e213-4db5-a822-00dddcde9406 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/a49fdc4af3204927ba066b0938a8620b?user_id=5a10b29063ed4e908739c6252afc3aea" status: 200 len: 328 microversion: 2.1 time: 0.507815 Oct 19 06:50:18.803888 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 107/230] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 06:50:18 2022] PUT /compute/v2.1/os-quota-sets/a49fdc4af3204927ba066b0938a8620b?user_id=5a10b29063ed4e908739c6252afc3aea => generated 328 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:18.808852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25fd2419-740c-46d1-9d0b-fb1afa942458 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:18.818205 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25fd2419-740c-46d1-9d0b-fb1afa942458 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.012964 Oct 19 06:50:18.819125 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 108/231] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 06:50:18 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:18.823981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b57f21f4-7f83-46e2-8720-e803cc5e1311 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Calling method '.version_select at 0x7f6d6513d790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:18.998442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:19.007285 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d5d3f85-dc8f-4cd8-94f4-0b76eb035d37 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.291620 Oct 19 06:50:19.010214 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 124/232] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:18 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:19.032481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cda0c55-e394-431e-88a0-c5eb661ae4d6 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861333-10"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:19.047580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cda0c55-e394-431e-88a0-c5eb661ae4d6 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:19.048074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cda0c55-e394-431e-88a0-c5eb661ae4d6 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:19.048979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cda0c55-e394-431e-88a0-c5eb661ae4d6 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:19.303055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=5,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:19.318186 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b57f21f4-7f83-46e2-8720-e803cc5e1311 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/a49fdc4af3204927ba066b0938a8620b?user_id=5a10b29063ed4e908739c6252afc3aea" status: 200 len: 370 microversion: 2.1 time: 0.496978 Oct 19 06:50:19.328454 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 109/233] 10.222.0.39 () {58 vars in 1323 bytes} [Wed Oct 19 06:50:18 2022] GET /compute/v2.1/os-quota-sets/a49fdc4af3204927ba066b0938a8620b?user_id=5a10b29063ed4e908739c6252afc3aea => generated 370 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:19.332061 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cda0c55-e394-431e-88a0-c5eb661ae4d6 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 224 microversion: 2.1 time: 0.318883 Oct 19 06:50:19.340149 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 125/234] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:50:19 2022] POST /compute/v2.1/os-aggregates/8/action => generated 224 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:19.346762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cb010ea-576d-41a3-a4d3-d083386de21e tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:19.427410 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cb010ea-576d-41a3-a4d3-d083386de21e tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.085912 Oct 19 06:50:19.428206 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 126/235] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:19 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:50:19.443656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c21fe45-641a-4d9f-a247-3f7f3f2096a1 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-313422773"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:19.447872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-5c21fe45-641a-4d9f-a247-3f7f3f2096a1 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Generated uuid 908dbbe9-1947-48d2-b042-558b61cd3a07 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:19.582810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-668bdecf-30f2-4638-9753-1941badb9d06 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Calling method '.version_select at 0x7f6d6532ae50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:19.585373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-668bdecf-30f2-4638-9753-1941badb9d06 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '78e3b84168cd458ba9da8642aa3b4bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cf241f14c442a0b2a8283e51fba0e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-668bdecf-30f2-4638-9753-1941badb9d06 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Request method failure captured: Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54pegs6y3JZMstpAMi4F4WQ4KM5wUz9iU4DV15mYIh8kiJ0M4CDJSKZofKlO5d0JoFRjtuOmnO3rM5EGA5UZ4nAHr8sXnYzbzffluVFrKWA0zzobXht9YnTieDganETrSFMnFbOmtA9NvBjJyI2gCyUDiiOtzwIIPfBFfx1plNj-Vc Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:19.587554 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a9cf241f14c442a0b2a8283e51fba0e7", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 78e3b84168cd458ba9da8642aa3b4bf1 Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: action_args: {} Oct 19 06:50:19.588706 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:19.589398 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 19 06:50:19.590491 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:19.591508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-668bdecf-30f2-4638-9753-1941badb9d06 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:19.592178 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c21fe45-641a-4d9f-a247-3f7f3f2096a1 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.153186 Oct 19 06:50:19.593488 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-668bdecf-30f2-4638-9753-1941badb9d06 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.243221 Oct 19 06:50:19.594564 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 127/236] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:50:19 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:19.594932 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 110/237] 10.222.0.39 () {58 vars in 1167 bytes} [Wed Oct 19 06:50:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 264 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:19.613259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a59f0150-3494-4f64-95c8-4d71f4629d91 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Calling method '.version_select at 0x7f6d653204c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:19.614890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b23973b-8643-47e1-a9ab-ba49d5d844c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:19.622736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a59f0150-3494-4f64-95c8-4d71f4629d91 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '78e3b84168cd458ba9da8642aa3b4bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cf241f14c442a0b2a8283e51fba0e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a59f0150-3494-4f64-95c8-4d71f4629d91 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Request method failure captured: Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54pegs6y3JZMstpAMi4F4WQ4KM5wUz9iU4DV15mYIh8kiJ0M4CDJSKZofKlO5d0JoFRjtuOmnO3rM5EGA5UZ4nAHr8sXnYzbzffluVFrKWA0zzobXht9YnTieDganETrSFMnFbOmtA9NvBjJyI2gCyUDiiOtzwIIPfBFfx1plNj-Vc Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:50:19.625415 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a9cf241f14c442a0b2a8283e51fba0e7", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 78e3b84168cd458ba9da8642aa3b4bf1 Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: action_args: {} Oct 19 06:50:19.635030 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:19.635760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 19 06:50:19.636852 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:19.638143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a59f0150-3494-4f64-95c8-4d71f4629d91 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:19.638143 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a59f0150-3494-4f64-95c8-4d71f4629d91 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.027149 Oct 19 06:50:19.638143 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 128/238] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:50:19 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:19.640731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b23973b-8643-47e1-a9ab-ba49d5d844c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:19.641395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b23973b-8643-47e1-a9ab-ba49d5d844c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:19.642111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b23973b-8643-47e1-a9ab-ba49d5d844c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:19.644162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15a2b3ed-62c7-4cb5-9ce3-ac7226c41695 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Calling method '.version_select at 0x7f6d6534b8b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:19.646142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15a2b3ed-62c7-4cb5-9ce3-ac7226c41695 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '78e3b84168cd458ba9da8642aa3b4bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cf241f14c442a0b2a8283e51fba0e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15a2b3ed-62c7-4cb5-9ce3-ac7226c41695 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Request method failure captured: Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54pegs6y3JZMstpAMi4F4WQ4KM5wUz9iU4DV15mYIh8kiJ0M4CDJSKZofKlO5d0JoFRjtuOmnO3rM5EGA5UZ4nAHr8sXnYzbzffluVFrKWA0zzobXht9YnTieDganETrSFMnFbOmtA9NvBjJyI2gCyUDiiOtzwIIPfBFfx1plNj-Vc Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:50:19.648519 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a9cf241f14c442a0b2a8283e51fba0e7", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 78e3b84168cd458ba9da8642aa3b4bf1 Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: action_args: {} Oct 19 06:50:19.649726 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:19.650490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 19 06:50:19.651713 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:19.653965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15a2b3ed-62c7-4cb5-9ce3-ac7226c41695 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:19.655542 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15a2b3ed-62c7-4cb5-9ce3-ac7226c41695 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021036 Oct 19 06:50:19.657936 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 129/239] 10.222.0.39 () {58 vars in 1179 bytes} [Wed Oct 19 06:50:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:19.942771 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b23973b-8643-47e1-a9ab-ba49d5d844c7 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.340941 Oct 19 06:50:19.954656 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 111/240] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:50:19 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:19.979155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05f97fd9-ecf7-4fcf-adf9-857fbf0644c4 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:19.987952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-05f97fd9-ecf7-4fcf-adf9-857fbf0644c4 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '72ca823747e34494a2117e9fb885b6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117b129cac5f421eb3c00e935c695d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05f97fd9-ecf7-4fcf-adf9-857fbf0644c4 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Request method failure captured: Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 43 Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT53_juCqGmIhkAqdJ10Q5RYU7OyWpFIMh2ee7VXb0es9zqs03useyl5hsFD607cAvefhSfqzsu3-u6OxHX9Urdt_mPnsyqniZzB1RDeMZTtUlWcWottLq-fU4uwkLlWYFHzZYmBqps8fQXWWtBIqy6M6PA9PButCWjp3QnYZqlDUE5k Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:19.995895 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/117b129cac5f421eb3c00e935c695d28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_117b129cac5f421eb3c00e935c695d28", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 117b129cac5f421eb3c00e935c695d28 Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-62711846 Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 72ca823747e34494a2117e9fb885b6b2 Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-62711846-project Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: {"remove_host": {"host": "n-h1-861333-10"}} Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:19.997585 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h1-861333-10'}}} Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:19.998302 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 19 06:50:20.000640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.005314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05f97fd9-ecf7-4fcf-adf9-857fbf0644c4 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:20.006670 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-05f97fd9-ecf7-4fcf-adf9-857fbf0644c4 tempest-AggregatesAdminNegativeTestJSON-62711846 tempest-AggregatesAdminNegativeTestJSON-62711846-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.037305 Oct 19 06:50:20.008312 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 112/241] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:50:19 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:20.018083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b94c8e1f-adc5-4eba-b31d-cc3f02dcd2fc tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:20.032888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94c8e1f-adc5-4eba-b31d-cc3f02dcd2fc tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.039318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94c8e1f-adc5-4eba-b31d-cc3f02dcd2fc tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.039318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94c8e1f-adc5-4eba-b31d-cc3f02dcd2fc tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:20.160571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Calling method '.version_select at 0x7f6d65401670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:20.160571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.160571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.160571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:20.202605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.203112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.203546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:20.226501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.226988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.227860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:20.252284 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bee9ceb7-0238-447d-a7bf-069a6393d609 tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.582954 Oct 19 06:50:20.253568 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 130/242] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:50:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:20.258369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:20.264074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:20.278603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.279106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.279563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:20.283078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.283629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.284071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:20.313707 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b94c8e1f-adc5-4eba-b31d-cc3f02dcd2fc tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.300961 Oct 19 06:50:20.314288 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 113/243] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Oct 19 06:50:20 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:20.318877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbed5a0b-c94c-4dc3-ad8b-fc11fb893fd2 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Calling method '.version_select at 0x7f6d6513d700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:20.320679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbed5a0b-c94c-4dc3-ad8b-fc11fb893fd2 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '78e3b84168cd458ba9da8642aa3b4bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cf241f14c442a0b2a8283e51fba0e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbed5a0b-c94c-4dc3-ad8b-fc11fb893fd2 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Request method failure captured: Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54pegs6y3JZMstpAMi4F4WQ4KM5wUz9iU4DV15mYIh8kiJ0M4CDJSKZofKlO5d0JoFRjtuOmnO3rM5EGA5UZ4nAHr8sXnYzbzffluVFrKWA0zzobXht9YnTieDganETrSFMnFbOmtA9NvBjJyI2gCyUDiiOtzwIIPfBFfx1plNj-Vc Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:20.322227 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a9cf241f14c442a0b2a8283e51fba0e7", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 78e3b84168cd458ba9da8642aa3b4bf1 Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1'} Oct 19 06:50:20.323374 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:20.324054 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 19 06:50:20.325557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.327280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbed5a0b-c94c-4dc3-ad8b-fc11fb893fd2 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:20.327280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbed5a0b-c94c-4dc3-ad8b-fc11fb893fd2 tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011877 Oct 19 06:50:20.328132 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 114/244] 10.222.0.39 () {58 vars in 1173 bytes} [Wed Oct 19 06:50:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:20.349419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f09c1bff-e85f-486d-b51c-33af438feed5 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:20.448768 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f09c1bff-e85f-486d-b51c-33af438feed5 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.111663 Oct 19 06:50:20.454744 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 115/245] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:20 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:50:20.459395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39c953ad-7424-4f64-9f25-548aabb829db tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Calling method '.version_select at 0x7f6d650cbc10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:20.461026 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-39c953ad-7424-4f64-9f25-548aabb829db tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] HTTP exception thrown: Hypervisor with ID '20647055-e6db-4c65-adef-e10404687806' could not be found. Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39c953ad-7424-4f64-9f25-548aabb829db tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Request method failure captured: Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/20647055-e6db-4c65-adef-e10404687806/uptime HTTP/1.1 Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54rwwkwdS-XkCV2R1PyJ3_Y4C7tYalfmXq7llvAsfbMtH61wcOrBe3gCXE_gUFSJk4cnFJKmRzrC0IR2VQPwfaudw7s8QR1MyxZTRMDQIgqoPmqf4OdFms6ItMdI2vGNGgqrvjKYnwpNSPkOGemXjnYath67GTQZChEGEpUHtsP8dw Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 61cc9023a41d4c34ab5713a4790c84ce Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1397113999 Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:50:20.479220 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/61cc9023a41d4c34ab5713a4790c84ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61cc9023a41d4c34ab5713a4790c84ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61cc9023a41d4c34ab5713a4790c84ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_61cc9023a41d4c34ab5713a4790c84ce", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1397113999 Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 61cc9023a41d4c34ab5713a4790c84ce Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1397113999 Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 46a82c7e023c432090775fd2cc2a76b4 Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: exception: Hypervisor with ID '20647055-e6db-4c65-adef-e10404687806' could not be found. Oct 19 06:50:20.480500 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '20647055-e6db-4c65-adef-e10404687806'} Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '20647055-e6db-4c65-adef-e10404687806' Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 19 06:50:20.481144 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '20647055-e6db-4c65-adef-e10404687806' could not be found. Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.482306 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.483366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.483366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:20.483366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:20.483366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:20.483366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:20.483366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '20647055-e6db-4c65-adef-e10404687806' could not be found. Oct 19 06:50:20.483366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.489653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39c953ad-7424-4f64-9f25-548aabb829db tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Returning 404 to user: Hypervisor with ID '20647055-e6db-4c65-adef-e10404687806' could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:20.489653 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39c953ad-7424-4f64-9f25-548aabb829db tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/20647055-e6db-4c65-adef-e10404687806/uptime" status: 404 len: 123 microversion: 2.1 time: 0.030586 Oct 19 06:50:20.489653 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 116/246] 10.222.0.39 () {58 vars in 1278 bytes} [Wed Oct 19 06:50:20 2022] GET /compute/v2.1/os-hypervisors/20647055-e6db-4c65-adef-e10404687806/uptime => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:20.497148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6270b8a-1cb9-43d0-ad89-5f70333fde8e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Calling method '.version_select at 0x7f6d6513d1f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:20.587667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:20.596416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:20.605424 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1881cb9e-bbc2-4cc7-9982-c6ccc3cff308 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.350593 Oct 19 06:50:20.620128 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 131/247] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:20 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:20.623324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fc77979-4f9a-4393-ac3d-a2800838c795 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-599511490"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:20.626751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-1fc77979-4f9a-4393-ac3d-a2800838c795 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Generated uuid 3aa23e32-8174-430f-b2a3-970f7f7cc190 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:20.698024 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fc77979-4f9a-4393-ac3d-a2800838c795 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080260 Oct 19 06:50:20.699302 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 132/248] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:50:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:20.708187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9015c9c9-fa6f-462c-8a4b-36cbc3d77232 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-470994189"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:20.712290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-9015c9c9-fa6f-462c-8a4b-36cbc3d77232 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Generated uuid e9a5d270-7797-4cb1-ab23-df7bf2a6d502 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:20.836378 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9015c9c9-fa6f-462c-8a4b-36cbc3d77232 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.135977 Oct 19 06:50:20.839909 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 133/249] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:50:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:20.849953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Calling method '.version_select at 0x7f6d6572a310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:20.856635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.858543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.860170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:20.879185 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6270b8a-1cb9-43d0-ad89-5f70333fde8e tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/ab03561c13b7404191bfe5117efc206d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.390898 Oct 19 06:50:20.879950 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 117/250] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 06:50:20 2022] GET /compute/v2.1/os-quota-sets/ab03561c13b7404191bfe5117efc206d/defaults => generated 371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:20.885381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:20.914141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.915199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.915945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:20.928349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.928349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.928349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:20.945865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.compute.aggregates [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 19 06:50:20.953927 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Request method failure captured: Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 42 Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54CHyXnxcY_BZ7RcOeMhveEDVsBqhyQpMx83MmBuO3cDwWyTU-XZwhGnBD-JtLDkKri3l1Ipivj7pvs3dUe_u6jQEOOZvhUloAwUxT6uPv3mAcJktOLBtBeN2xmmulQh9wMzDflATScGwOUbXlx15mnZ1UgHDKl5poaDzjLyP0OdTE Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:50:20.958151 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cff4856e6284bd1884c414f89d14493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0cff4856e6284bd1884c414f89d14493", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0cff4856e6284bd1884c414f89d14493 Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200555685 Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8ab63b69ed624e6c888ca1babe8ef28b Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: {"remove_host": {"host": "nonexist_host"}} Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:20.962800 n-d-861333-10 devstack@n-api.service[127568]: exception: Cannot remove host nonexist_host in aggregate 10 Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 19 06:50:20.963503 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 19 06:50:20.964686 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.965839 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:20.966965 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:20.966965 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:20.966965 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:20.966965 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:20.966965 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 Oct 19 06:50:20.966965 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:20.966965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:20.966965 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb2dbdfb-50cb-48de-9446-0ea94c97fe70 tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.080380 Oct 19 06:50:20.971220 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 118/251] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 06:50:20 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:50:20.977865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7a61945-5d7c-48cd-8d89-e3e7e7a99e06 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:20.994456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7a61945-5d7c-48cd-8d89-e3e7e7a99e06 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:20.995164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7a61945-5d7c-48cd-8d89-e3e7e7a99e06 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:20.995769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7a61945-5d7c-48cd-8d89-e3e7e7a99e06 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:21.155205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:21.159447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:21.162961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:21.185706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:21.186410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:21.187635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:21.197943 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea07bf66-a9e4-4def-9617-275119ed7e6f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.356632 Oct 19 06:50:21.198762 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 134/252] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:50:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:21.207512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05f7d62e-bb38-4c83-8a8a-d4f9a32d4bef tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Action: 'update', calling method: .version_select at 0x7f6d6540a700>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:21.363725 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7a61945-5d7c-48cd-8d89-e3e7e7a99e06 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.389923 Oct 19 06:50:21.364390 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 119/253] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 06:50:20 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:21.369822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c40d3282-b909-4f31-8b4c-a51de65eae33 req-b4d84f61-72ad-4337-b7e9-0b97a630d461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8494338-c7cd-45d0-a10c-44f411189512", "name": "network-vif-plugged", "status": "completed", "tag": "67919d54-1f84-4a84-b595-a64f27391900"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:21.388407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c40d3282-b909-4f31-8b4c-a51de65eae33 req-b4d84f61-72ad-4337-b7e9-0b97a630d461 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:21.389113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c40d3282-b909-4f31-8b4c-a51de65eae33 req-b4d84f61-72ad-4337-b7e9-0b97a630d461 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:21.389546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c40d3282-b909-4f31-8b4c-a51de65eae33 req-b4d84f61-72ad-4337-b7e9-0b97a630d461 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:21.397285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:21.410487 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c40d3282-b909-4f31-8b4c-a51de65eae33 req-b4d84f61-72ad-4337-b7e9-0b97a630d461 service nova] Creating event network-vif-plugged:67919d54-1f84-4a84-b595-a64f27391900 for instance a8494338-c7cd-45d0-a10c-44f411189512 on n-h2-861333-10 Oct 19 06:50:21.419150 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c40d3282-b909-4f31-8b4c-a51de65eae33 req-b4d84f61-72ad-4337-b7e9-0b97a630d461 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053271 Oct 19 06:50:21.419754 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 120/254] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:21.430327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d436688-0128-43d8-a515-f4741c21088c tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:21.530543 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d436688-0128-43d8-a515-f4741c21088c tempest-AggregatesAdminNegativeTestJSON-200555685 tempest-AggregatesAdminNegativeTestJSON-200555685-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.108913 Oct 19 06:50:21.531444 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 121/255] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:21 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:50:21.539489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a0bc6ea-bef8-42bc-8ee9-cade0b63afdf tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Calling method '.version_select at 0x7f6d6513daf0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:21.542364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a0bc6ea-bef8-42bc-8ee9-cade0b63afdf tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '78e3b84168cd458ba9da8642aa3b4bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cf241f14c442a0b2a8283e51fba0e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a0bc6ea-bef8-42bc-8ee9-cade0b63afdf tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Request method failure captured: Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54pegs6y3JZMstpAMi4F4WQ4KM5wUz9iU4DV15mYIh8kiJ0M4CDJSKZofKlO5d0JoFRjtuOmnO3rM5EGA5UZ4nAHr8sXnYzbzffluVFrKWA0zzobXht9YnTieDganETrSFMnFbOmtA9NvBjJyI2gCyUDiiOtzwIIPfBFfx1plNj-Vc Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:21.548542 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a9cf241f14c442a0b2a8283e51fba0e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a9cf241f14c442a0b2a8283e51fba0e7", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: a9cf241f14c442a0b2a8283e51fba0e7 Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703 Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 78e3b84168cd458ba9da8642aa3b4bf1 Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1522713703-project Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1'} Oct 19 06:50:21.549747 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:21.550751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 19 06:50:21.551806 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.572908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a0bc6ea-bef8-42bc-8ee9-cade0b63afdf tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:21.578772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f7d62e-bb38-4c83-8a8a-d4f9a32d4bef tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:21.582871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f7d62e-bb38-4c83-8a8a-d4f9a32d4bef tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:21.583408 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a0bc6ea-bef8-42bc-8ee9-cade0b63afdf tempest-HypervisorAdminNegativeTestJSON-1522713703 tempest-HypervisorAdminNegativeTestJSON-1522713703-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.050477 Oct 19 06:50:21.583522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f7d62e-bb38-4c83-8a8a-d4f9a32d4bef tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:21.585853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f7d62e-bb38-4c83-8a8a-d4f9a32d4bef tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:21.590655 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 122/256] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:21.595248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f7d62e-bb38-4c83-8a8a-d4f9a32d4bef tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:21.595711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f7d62e-bb38-4c83-8a8a-d4f9a32d4bef tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:21.598369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-745dc59d-4032-41af-99bc-8cdaf02975b4 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:21.614060 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-745dc59d-4032-41af-99bc-8cdaf02975b4 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.021940 Oct 19 06:50:21.615966 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 123/257] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:50:21 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:21.628120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6d49fd1-8241-47b6-91f6-80077082892f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Calling method '.version_select at 0x7f6d6532af70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:21.630823 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b6d49fd1-8241-47b6-91f6-80077082892f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] HTTP exception thrown: Hypervisor with ID '92f6030e-b665-4eae-8636-7add266ee2ca' could not be found. Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6d49fd1-8241-47b6-91f6-80077082892f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Request method failure captured: Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/92f6030e-b665-4eae-8636-7add266ee2ca HTTP/1.1 Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54rwwkwdS-XkCV2R1PyJ3_Y4C7tYalfmXq7llvAsfbMtH61wcOrBe3gCXE_gUFSJk4cnFJKmRzrC0IR2VQPwfaudw7s8QR1MyxZTRMDQIgqoPmqf4OdFms6ItMdI2vGNGgqrvjKYnwpNSPkOGemXjnYath67GTQZChEGEpUHtsP8dw Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 61cc9023a41d4c34ab5713a4790c84ce Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1397113999 Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:50:21.634954 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/61cc9023a41d4c34ab5713a4790c84ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61cc9023a41d4c34ab5713a4790c84ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61cc9023a41d4c34ab5713a4790c84ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_61cc9023a41d4c34ab5713a4790c84ce", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1397113999 Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 61cc9023a41d4c34ab5713a4790c84ce Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1397113999 Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 46a82c7e023c432090775fd2cc2a76b4 Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: exception: Hypervisor with ID '92f6030e-b665-4eae-8636-7add266ee2ca' could not be found. Oct 19 06:50:21.636207 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '92f6030e-b665-4eae-8636-7add266ee2ca'} Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '92f6030e-b665-4eae-8636-7add266ee2ca' Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 19 06:50:21.636957 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 06:50:21.638164 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '92f6030e-b665-4eae-8636-7add266ee2ca' could not be found. Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '92f6030e-b665-4eae-8636-7add266ee2ca' could not be found. Oct 19 06:50:21.639199 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:21.642337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6d49fd1-8241-47b6-91f6-80077082892f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] Returning 404 to user: Hypervisor with ID '92f6030e-b665-4eae-8636-7add266ee2ca' could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:21.643561 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6d49fd1-8241-47b6-91f6-80077082892f tempest-HypervisorAdminNegativeTestJSON-1397113999 tempest-HypervisorAdminNegativeTestJSON-1397113999-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/92f6030e-b665-4eae-8636-7add266ee2ca" status: 404 len: 123 microversion: 2.1 time: 0.026256 Oct 19 06:50:21.644031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:21.644647 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 124/258] 10.222.0.39 () {58 vars in 1257 bytes} [Wed Oct 19 06:50:21 2022] GET /compute/v2.1/os-hypervisors/92f6030e-b665-4eae-8636-7add266ee2ca => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:21.686223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a014e595-cfeb-47fc-9964-8153e2b7f507 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:21.739151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a014e595-cfeb-47fc-9964-8153e2b7f507 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:21.739556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a014e595-cfeb-47fc-9964-8153e2b7f507 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:21.742653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a014e595-cfeb-47fc-9964-8153e2b7f507 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:22.055071 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a014e595-cfeb-47fc-9964-8153e2b7f507 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.384448 Oct 19 06:50:22.055697 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 125/259] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 06:50:21 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:22.065439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:22.067429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:22.081900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:22.082415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:22.082856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:22.085064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:22.086207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:22.087020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:22.288079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:22.310666 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2bde442-8fc7-4a69-95a0-777880681d45 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.253871 Oct 19 06:50:22.324878 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 126/260] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:22 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:22.341742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8904e026-278e-4085-90fa-b918219c4c42 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:22.436587 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8904e026-278e-4085-90fa-b918219c4c42 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.099177 Oct 19 06:50:22.438609 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 127/261] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:22 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:50:22.450482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ebe507b5-e54b-4099-91fc-39c075524a1c tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1484264704"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:22.461105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-ebe507b5-e54b-4099-91fc-39c075524a1c tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Generated uuid c664ca9e-72db-4dd6-b82a-d60c29d47cd9 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:22.571608 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ebe507b5-e54b-4099-91fc-39c075524a1c tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.125372 Oct 19 06:50:22.572858 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 128/262] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:50:22 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:22.589789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78fd2e62-416a-4a18-ad31-66ca20769500 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:22.604073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78fd2e62-416a-4a18-ad31-66ca20769500 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:22.604337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78fd2e62-416a-4a18-ad31-66ca20769500 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:22.605381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78fd2e62-416a-4a18-ad31-66ca20769500 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:22.871384 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05f7d62e-bb38-4c83-8a8a-d4f9a32d4bef tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/ab03561c13b7404191bfe5117efc206d" status: 200 len: 329 microversion: 2.1 time: 1.671484 Oct 19 06:50:22.872477 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 135/263] 10.222.0.39 () {60 vars in 1263 bytes} [Wed Oct 19 06:50:21 2022] PUT /compute/v2.1/os-quota-sets/ab03561c13b7404191bfe5117efc206d => generated 329 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:22.889985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e822166a-719d-42a1-b138-a5f91d88e233 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Action: 'update', calling method: .version_select at 0x7f6d658b74c0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:22.891502 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-78fd2e62-416a-4a18-ad31-66ca20769500 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 244 microversion: 2.1 time: 0.311436 Oct 19 06:50:22.894364 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 129/264] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 06:50:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 244 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:22.908254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5ae3131-0d83-4e8f-98ea-9cddadad4588 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:22.924066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5ae3131-0d83-4e8f-98ea-9cddadad4588 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:22.929589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5ae3131-0d83-4e8f-98ea-9cddadad4588 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:22.931117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5ae3131-0d83-4e8f-98ea-9cddadad4588 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:23.239320 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5ae3131-0d83-4e8f-98ea-9cddadad4588 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.336253 Oct 19 06:50:23.240692 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 130/265] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 06:50:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:23.255761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-444cf7b5-1301-4184-8866-9916ee67f86a tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:23.375764 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-444cf7b5-1301-4184-8866-9916ee67f86a tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.126104 Oct 19 06:50:23.376871 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 131/266] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:23 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:50:23.378822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e822166a-719d-42a1-b138-a5f91d88e233 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:23.379447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e822166a-719d-42a1-b138-a5f91d88e233 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:23.380204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e822166a-719d-42a1-b138-a5f91d88e233 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:23.383673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e822166a-719d-42a1-b138-a5f91d88e233 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:23.384637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:23.384809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e822166a-719d-42a1-b138-a5f91d88e233 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:23.387332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e822166a-719d-42a1-b138-a5f91d88e233 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:23.388197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:23.403366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:23.404141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:23.406817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:23.407665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:23.408179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:23.408608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:23.794857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:23.821233 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33a06c3f-da98-4720-8206-2496cf8cf317 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1321 microversion: 2.1 time: 0.442708 Oct 19 06:50:23.832212 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 132/267] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:23 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:23.832212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e58949bd-51c0-4f76-9a68-696c66814293 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2106849607"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:23.833904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-e58949bd-51c0-4f76-9a68-696c66814293 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Generated uuid eae323a7-e310-4006-9c19-a576c2932c44 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:23.981703 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e58949bd-51c0-4f76-9a68-696c66814293 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.158127 Oct 19 06:50:23.989450 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 133/268] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:50:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:23.990316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-246bddb1-29ca-4e8d-b750-97acd6da4279 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-72028092"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:23.999836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-246bddb1-29ca-4e8d-b750-97acd6da4279 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Generated uuid e00e66dc-446a-4810-98c1-8cf3e98e53cb for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:24.147725 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-246bddb1-29ca-4e8d-b750-97acd6da4279 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.163848 Oct 19 06:50:24.149034 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 134/269] 10.222.0.39 () {62 vars in 1205 bytes} [Wed Oct 19 06:50:23 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:24.154023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd52907d-ffe5-485e-9efe-aba673636235 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:24.288923 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd52907d-ffe5-485e-9efe-aba673636235 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.138564 Oct 19 06:50:24.291186 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 135/270] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:24 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:50:24.307162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db07cf4b-d0df-41b4-b9b7-9c792f13a8f5 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1346585856"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:24.414468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=13 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:24.518170 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db07cf4b-d0df-41b4-b9b7-9c792f13a8f5 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/14" status: 200 len: 300 microversion: 2.41 time: 0.223909 Oct 19 06:50:24.519463 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 136/271] 10.222.0.39 () {62 vars in 1213 bytes} [Wed Oct 19 06:50:24 2022] PUT /compute/v2.1/os-aggregates/14 => generated 300 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:24.527108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc70033f-60b0-4f8e-bcc7-9df26c75d70b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:24.547357 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fc70033f-60b0-4f8e-bcc7-9df26c75d70b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc70033f-60b0-4f8e-bcc7-9df26c75d70b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Request method failure captured: Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54DOz26tYNlF1UrdGCboXflMveBE_sevQ1JEWHxugkbQSvOQ33QYEvtZNCoCYYISqrWDUjjM9baSuHz_x0qXL3kR1j3SZbPzVqh2cpTHEug9LWm9bywqp-DnP9YzzmYAERfLFEYafjcfKepC_q9sJDAs0eNTp3ibgqdP9ZIn8JKclE Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 89e6d5b6fe464dfcbd0618903146212e Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:50:24.553506 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_89e6d5b6fe464dfcbd0618903146212e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 89e6d5b6fe464dfcbd0618903146212e Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-425727033-project-admin Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1dd60fade4ab42a18cc4916fa6fd93cd Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-425727033-project-admin Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: exception: Aggregate 13 could not be found. Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '13'} Oct 19 06:50:24.557926 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:24.558876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 19 06:50:24.560546 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.561739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc70033f-60b0-4f8e-bcc7-9df26c75d70b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:24.561739 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc70033f-60b0-4f8e-bcc7-9df26c75d70b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.034181 Oct 19 06:50:24.563463 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 137/272] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:24 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:50:24.573291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da6cf91f-9b04-4e92-b414-64c739653a58 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:24.602710 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da6cf91f-9b04-4e92-b414-64c739653a58 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 300 microversion: 2.41 time: 0.037519 Oct 19 06:50:24.604236 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 138/273] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 06:50:24 2022] GET /compute/v2.1/os-aggregates/14 => generated 300 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:24.615321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbd8c8b2-7c51-43fd-aced-ac518806eb42 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:24.636482 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-cbd8c8b2-7c51-43fd-aced-ac518806eb42 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbd8c8b2-7c51-43fd-aced-ac518806eb42 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Request method failure captured: Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54DOz26tYNlF1UrdGCboXflMveBE_sevQ1JEWHxugkbQSvOQ33QYEvtZNCoCYYISqrWDUjjM9baSuHz_x0qXL3kR1j3SZbPzVqh2cpTHEug9LWm9bywqp-DnP9YzzmYAERfLFEYafjcfKepC_q9sJDAs0eNTp3ibgqdP9ZIn8JKclE Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 89e6d5b6fe464dfcbd0618903146212e Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:50:24.640026 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_89e6d5b6fe464dfcbd0618903146212e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 89e6d5b6fe464dfcbd0618903146212e Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-425727033-project-admin Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1dd60fade4ab42a18cc4916fa6fd93cd Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-425727033-project-admin Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: exception: Aggregate 13 could not be found. Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '13'} Oct 19 06:50:24.641960 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:50:24.642644 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:24.644576 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:24.646348 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:24.646348 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:24.646348 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:24.646348 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 19 06:50:24.646348 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:24.649596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbd8c8b2-7c51-43fd-aced-ac518806eb42 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:24.650739 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbd8c8b2-7c51-43fd-aced-ac518806eb42 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.045590 Oct 19 06:50:24.651954 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 139/274] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:24 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:50:24.661097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2132c04-cf1c-4861-b8af-4c5f8889869c tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:24.680220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2132c04-cf1c-4861-b8af-4c5f8889869c tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:24.680717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2132c04-cf1c-4861-b8af-4c5f8889869c tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:24.681158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2132c04-cf1c-4861-b8af-4c5f8889869c tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:25.035120 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2132c04-cf1c-4861-b8af-4c5f8889869c tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 316 microversion: 2.41 time: 0.377818 Oct 19 06:50:25.043541 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 140/275] 10.222.0.39 () {62 vars in 1235 bytes} [Wed Oct 19 06:50:24 2022] POST /compute/v2.1/os-aggregates/14/action => generated 316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:25.043541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30024517-7551-498e-a403-20f5f69acdc8 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1316645152", "name": "tempest-test_aggregate-556348695"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:25.045667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-30024517-7551-498e-a403-20f5f69acdc8 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Generated uuid d53b7a5d-b815-4293-a62d-206e60c8722e for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:25.149745 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30024517-7551-498e-a403-20f5f69acdc8 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.111739 Oct 19 06:50:25.152040 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 141/276] 10.222.0.39 () {60 vars in 1165 bytes} [Wed Oct 19 06:50:25 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:25.159515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:25.160606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:25.170735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=28,nova_api:UPDATE=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:25.176751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:25.177246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:25.177888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:25.178627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:25.179258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:25.179927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:25.286002 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e822166a-719d-42a1-b138-a5f91d88e233 tempest-QuotasAdminTestJSON-75800372 tempest-QuotasAdminTestJSON-75800372-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/ab03561c13b7404191bfe5117efc206d" status: 200 len: 329 microversion: 2.1 time: 2.404569 Oct 19 06:50:25.286594 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 136/277] 10.222.0.39 () {60 vars in 1263 bytes} [Wed Oct 19 06:50:22 2022] PUT /compute/v2.1/os-quota-sets/ab03561c13b7404191bfe5117efc206d => generated 329 bytes in 2407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:25.291860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46ba2ed3-786c-45d5-896a-8d1eeb194082 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861333-10"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:25.311125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ba2ed3-786c-45d5-896a-8d1eeb194082 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:25.311727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ba2ed3-786c-45d5-896a-8d1eeb194082 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:25.314318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ba2ed3-786c-45d5-896a-8d1eeb194082 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:25.509378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:25.518871 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-005caf6f-bb5f-4b17-a500-3efbe660175f tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1470 microversion: 2.1 time: 0.365191 Oct 19 06:50:25.536530 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 142/278] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:25 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1470 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:25.542403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89aaadce-6fbe-47ce-bbc0-243df14e2b87 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:25.564074 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46ba2ed3-786c-45d5-896a-8d1eeb194082 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 300 microversion: 2.41 time: 0.276227 Oct 19 06:50:25.565973 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 137/279] 10.222.0.39 () {62 vars in 1235 bytes} [Wed Oct 19 06:50:25 2022] POST /compute/v2.1/os-aggregates/14/action => generated 300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:25.663293 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89aaadce-6fbe-47ce-bbc0-243df14e2b87 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.125555 Oct 19 06:50:25.663926 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 143/280] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:25 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:50:25.901938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8125af6-1639-4446-9f8f-9144a5c98fbf tempest-QuotaClassesAdminTestJSON-177518538 tempest-QuotaClassesAdminTestJSON-177518538-project-admin] Calling method '.version_select at 0x7f6d6534bd30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:25.948036 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8125af6-1639-4446-9f8f-9144a5c98fbf tempest-QuotaClassesAdminTestJSON-177518538 tempest-QuotaClassesAdminTestJSON-177518538-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.379899 Oct 19 06:50:25.951402 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 138/281] 10.222.0.39 () {58 vars in 1185 bytes} [Wed Oct 19 06:50:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:25.968260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96627584-c4af-4c29-b046-eb8a255a2c22 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:26.105861 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96627584-c4af-4c29-b046-eb8a255a2c22 tempest-AggregatesAdminTestV241-597923071 tempest-AggregatesAdminTestV241-597923071-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.41 time: 0.152663 Oct 19 06:50:26.106444 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 139/282] 10.222.0.39 () {60 vars in 1196 bytes} [Wed Oct 19 06:50:25 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:26.120636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b57f3ec-599f-43f9-ab1f-1b20c16c7641 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:26.137368 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6b57f3ec-599f-43f9-ab1f-1b20c16c7641 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b57f3ec-599f-43f9-ab1f-1b20c16c7641 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Request method failure captured: Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54DOz26tYNlF1UrdGCboXflMveBE_sevQ1JEWHxugkbQSvOQ33QYEvtZNCoCYYISqrWDUjjM9baSuHz_x0qXL3kR1j3SZbPzVqh2cpTHEug9LWm9bywqp-DnP9YzzmYAERfLFEYafjcfKepC_q9sJDAs0eNTp3ibgqdP9ZIn8JKclE Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 89e6d5b6fe464dfcbd0618903146212e Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:50:26.139572 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_89e6d5b6fe464dfcbd0618903146212e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 89e6d5b6fe464dfcbd0618903146212e Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminTestJSON-425727033-project-admin Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 1dd60fade4ab42a18cc4916fa6fd93cd Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminTestJSON-425727033-project-admin Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: exception: Aggregate 15 could not be found. Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '15'} Oct 19 06:50:26.142089 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:26.142802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 19 06:50:26.143789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.146248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b57f3ec-599f-43f9-ab1f-1b20c16c7641 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:26.148732 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b57f3ec-599f-43f9-ab1f-1b20c16c7641 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.041326 Oct 19 06:50:26.149297 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 140/283] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:26 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:50:26.154188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c41dbaf-9f44-4f82-8951-12ad45378dc8 tempest-QuotaClassesAdminTestJSON-177518538 tempest-QuotaClassesAdminTestJSON-177518538-project-admin] Action: 'update', calling method: .version_select at 0x7f6d65320e50>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:26.214323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed6a0f04-d434-4479-929a-42059219194d tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:26.216901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed6a0f04-d434-4479-929a-42059219194d tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] [instance: f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:26.225853 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ed6a0f04-d434-4479-929a-42059219194d tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] HTTP exception thrown: Instance f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef could not be found. Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed6a0f04-d434-4479-929a-42059219194d tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Request method failure captured: Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef/action HTTP/1.1 Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 15 Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54ZraZmsHHFgKQ67KhSXWQTjvYb7GxfSSxwRr1DaXMh4VX2d4wlhcwZe9oXrXtYPYktU_05XBBVma5f33WBOz3jBz-Eat2Iben_8Rqv7yjLWPGreXB8UL_Qr5e8_xCIg8qLWppLscR-QsPDt5-J_T_qkoytmNx5QaQQ4wFySujAJ64 Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:50:26.226704 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02e81d30f79a4afc96ba9c1da07adc93", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 655b7372d15e420c9112edc0d5fa8e58 Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: {"migrate": {}} Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:26.232378 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef could not be found. Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef', 'body': {'migrate': {}}} Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef could not be found. Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:26.233189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef could not be found. Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef could not be found. Oct 19 06:50:26.234277 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.235195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed6a0f04-d434-4479-929a-42059219194d tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Returning 404 to user: Instance f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:26.235195 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed6a0f04-d434-4479-929a-42059219194d tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef/action" status: 404 len: 111 microversion: 2.1 time: 0.563025 Oct 19 06:50:26.235195 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 144/284] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:50:25 2022] POST /compute/v2.1/servers/f81e5802-5b8f-41ad-9bcb-9e9f0f3d0aef/action => generated 111 bytes in 564 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:26.237182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47b3d446-f288-43fa-92be-c5c04b892bcf tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:26.251552 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-47b3d446-f288-43fa-92be-c5c04b892bcf tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47b3d446-f288-43fa-92be-c5c04b892bcf tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Request method failure captured: Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54DOz26tYNlF1UrdGCboXflMveBE_sevQ1JEWHxugkbQSvOQ33QYEvtZNCoCYYISqrWDUjjM9baSuHz_x0qXL3kR1j3SZbPzVqh2cpTHEug9LWm9bywqp-DnP9YzzmYAERfLFEYafjcfKepC_q9sJDAs0eNTp3ibgqdP9ZIn8JKclE Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 89e6d5b6fe464dfcbd0618903146212e Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:50:26.253246 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/89e6d5b6fe464dfcbd0618903146212e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_89e6d5b6fe464dfcbd0618903146212e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 89e6d5b6fe464dfcbd0618903146212e Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-425727033 Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-425727033-project-admin Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1dd60fade4ab42a18cc4916fa6fd93cd Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-425727033-project-admin Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: exception: Aggregate 15 could not be found. Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '15'} Oct 19 06:50:26.255008 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:50:26.255808 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:26.257064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:26.259501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:26.259501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:26.259501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:26.259501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 19 06:50:26.259501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:26.259501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47b3d446-f288-43fa-92be-c5c04b892bcf tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:26.259501 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47b3d446-f288-43fa-92be-c5c04b892bcf tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.024367 Oct 19 06:50:26.259501 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 145/285] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:26 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:50:26.266506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-831a1008-151c-44fd-b79a-2bfa08136ef8 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1131043353"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:26.272077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-831a1008-151c-44fd-b79a-2bfa08136ef8 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Generated uuid 11875dc0-61f5-4d35-b8cd-75716a872a8b for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:26.372074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=97,nova_cell0:UPDATE=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:26.374346 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-831a1008-151c-44fd-b79a-2bfa08136ef8 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.112216 Oct 19 06:50:26.376446 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 146/286] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:50:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:26.391176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3aca729e-2c8f-4043-ac50-7c8cd7fa31a7 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:26.403336 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3aca729e-2c8f-4043-ac50-7c8cd7fa31a7 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.015391 Oct 19 06:50:26.404253 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 147/287] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:26 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:26.417994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fb8f1d4-9ba0-48cc-9811-70890ba65054 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:26.541059 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0fb8f1d4-9ba0-48cc-9811-70890ba65054 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.127977 Oct 19 06:50:26.541713 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 148/288] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 06:50:26 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:26.552611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9727b0b-2c0c-4806-9f84-861784efdd43 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:26.561297 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9727b0b-2c0c-4806-9f84-861784efdd43 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.012319 Oct 19 06:50:26.561894 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 149/289] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:50:26 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:26.578330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ecd0adc-d9a6-4036-972f-dd61fb156cb4 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:26.687707 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ecd0adc-d9a6-4036-972f-dd61fb156cb4 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.112968 Oct 19 06:50:26.689329 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 150/290] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:26 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 19 06:50:26.700871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd141de2-526c-4804-ad9b-ce9ce85607f5 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1082807425", "availability_zone": "tempest-test_az-1023726963"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:26.704984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-bd141de2-526c-4804-ad9b-ce9ce85607f5 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Generated uuid 0c557b81-785d-48e4-8fc8-fe8eb5af45ca for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:26.806016 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd141de2-526c-4804-ad9b-ce9ce85607f5 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.109956 Oct 19 06:50:26.806682 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 151/291] 10.222.0.39 () {60 vars in 1165 bytes} [Wed Oct 19 06:50:26 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:26.818744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb7958b7-6fc9-4b2f-bff7-e67583526651 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1082807425_new", "availability_zone": "tempest-test_az-1023726963_new"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:26.940257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb7958b7-6fc9-4b2f-bff7-e67583526651 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:26.940695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb7958b7-6fc9-4b2f-bff7-e67583526651 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:26.942747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb7958b7-6fc9-4b2f-bff7-e67583526651 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:27.039635 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb7958b7-6fc9-4b2f-bff7-e67583526651 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.225029 Oct 19 06:50:27.041027 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 152/292] 10.222.0.39 () {60 vars in 1173 bytes} [Wed Oct 19 06:50:26 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:27.047188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1250167020", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:27.133346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:50:27.468561 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c41dbaf-9f44-4f82-8951-12ad45378dc8 tempest-QuotaClassesAdminTestJSON-177518538 tempest-QuotaClassesAdminTestJSON-177518538-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.317745 Oct 19 06:50:27.470673 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 141/293] 10.222.0.39 () {60 vars in 1206 bytes} [Wed Oct 19 06:50:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:27.475742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eea41d19-2868-49af-aae4-0f0f6ad3cd2b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:27.486871 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eea41d19-2868-49af-aae4-0f0f6ad3cd2b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.014621 Oct 19 06:50:27.487652 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 142/294] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:50:27 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:27.566451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:50:27.568916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:50:27.569623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:50:27.570293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:50:27.570900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:50:27.590592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:27.592212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:27.592746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:27.594596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:27.595926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:27.596693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:27.629815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Getting quotas for project c294e39032fd4538817ebdb2d62ac1b7. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:27.638068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Getting quotas for user c250b5dd666c4df89fcf483b04391a50 and project c294e39032fd4538817ebdb2d62ac1b7. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:27.651567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:50:27.653988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:50:27.813539 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b152364-a7bb-4074-b452-fecaec042821 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771200 Oct 19 06:50:27.824802 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 153/295] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:50:27.838751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d7f66e1-9513-4a57-8aac-3ec411ee04a8 tempest-QuotaClassesAdminTestJSON-177518538 tempest-QuotaClassesAdminTestJSON-177518538-project-admin] Calling method '.version_select at 0x7f6d65088ee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:27.872874 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d7f66e1-9513-4a57-8aac-3ec411ee04a8 tempest-QuotaClassesAdminTestJSON-177518538 tempest-QuotaClassesAdminTestJSON-177518538-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.046068 Oct 19 06:50:27.873463 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 154/296] 10.222.0.39 () {58 vars in 1185 bytes} [Wed Oct 19 06:50:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:27.889898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9bd7a1be-e77f-4e08-8df4-2e27a3bfcf10 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:27.976963 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9bd7a1be-e77f-4e08-8df4-2e27a3bfcf10 tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.099655 Oct 19 06:50:27.977551 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 155/297] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:27 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 06:50:27.985995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3c230df-cd81-444f-9648-6458db10a4bb tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:27.986614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3c230df-cd81-444f-9648-6458db10a4bb tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:27.996051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:INSERT=10,nova_api:DELETE=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:28.054064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3c230df-cd81-444f-9648-6458db10a4bb tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:28.064956 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3c230df-cd81-444f-9648-6458db10a4bb tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1222 microversion: 2.1 time: 0.083238 Oct 19 06:50:28.064956 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 156/298] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:27 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:28.068939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-145da4f1-0a1c-4816-a014-c95d05c5f778 tempest-QuotaClassesAdminTestJSON-177518538 tempest-QuotaClassesAdminTestJSON-177518538-project-admin] Action: 'update', calling method: .version_select at 0x7f6d650993a0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:28.104123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1241685372", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "a7a2cd42-c826-4d50-96f4-6d6e6885e6b0"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:28.196508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] validate_networks() for [('a7a2cd42-c826-4d50-96f4-6d6e6885e6b0', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:50:29.181358 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-145da4f1-0a1c-4816-a014-c95d05c5f778 tempest-QuotaClassesAdminTestJSON-177518538 tempest-QuotaClassesAdminTestJSON-177518538-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.116201 Oct 19 06:50:29.182269 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 157/299] 10.222.0.39 () {60 vars in 1206 bytes} [Wed Oct 19 06:50:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:29.187714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cc97054-d99e-4046-8393-f678e3dfff9b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-603322761"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:29.191502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-1cc97054-d99e-4046-8393-f678e3dfff9b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Generated uuid 96bb32cc-2502-464d-aebc-4a90eb42ceeb for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 06:50:29.292638 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1cc97054-d99e-4046-8393-f678e3dfff9b tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109059 Oct 19 06:50:29.293732 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 158/300] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 06:50:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:29.304425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:29.305044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:29.324431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:29.327054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:29.327747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:29.329385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:29.330938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:29.331378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:29.437574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:29.446954 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4167f6db-6d1e-406c-9543-71501a53340e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1226 microversion: 2.1 time: 0.152017 Oct 19 06:50:29.447715 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 159/301] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:29 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:29.453772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f2471e3-ac91-4485-9618-7bfa34b00c4a tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:29.466323 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f2471e3-ac91-4485-9618-7bfa34b00c4a tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.017105 Oct 19 06:50:29.467052 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 160/302] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:50:29 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:29.479907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18902d05-798c-4794-98c0-c7717b89077a tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:29.573510 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18902d05-798c-4794-98c0-c7717b89077a tempest-AggregatesAdminTestJSON-425727033 tempest-AggregatesAdminTestJSON-425727033-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.096094 Oct 19 06:50:29.577235 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 161/303] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:50:29 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 19 06:50:29.584925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:29.588011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:29.594110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:29.594807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:29.595965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:29.597681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:29.598401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:29.599001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:29.618841 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] HTTP exception thrown: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Request method failure captured: Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 HTTP/1.1 Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54B9UxUTdsq1Can81NyxLtRsCzPNdUUOGKrEJeEMifB-YNgrMDVYqT-j9bjNXuFiKUoo6M1IMgc2k_lvP0Ib7uBX3b21vFQwqOHc_vCYHbl7fEjVIE6hIOrP7sQXZBobJe3ep4pwRhFN_lXR2lQQbS2xJPTpn8SuIAVAbvpby4gnNc Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f2631c6f28d74660b55bdbe16c0cea3b Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-1056340055 Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:29.621530 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f2631c6f28d74660b55bdbe16c0cea3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2631c6f28d74660b55bdbe16c0cea3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2631c6f28d74660b55bdbe16c0cea3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f2631c6f28d74660b55bdbe16c0cea3b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-1056340055 Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f2631c6f28d74660b55bdbe16c0cea3b Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1056340055 Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-1056340055-project Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: fa92d335e7cd4168b7aa7e5daa3bd518 Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-1056340055-project Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.622731 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '7970343e-02b4-4dcc-a64f-4f014af41ba3'} Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:29.623387 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.624428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.628316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Returning 404 to user: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:29.629538 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7902cdad-c0f9-4ccf-ba78-0fb75b148b16 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 404 len: 111 microversion: 2.1 time: 0.049196 Oct 19 06:50:29.630851 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 162/304] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:50:29 2022] DELETE /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:50:29.640533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:29.641168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] [instance: 7970343e-02b4-4dcc-a64f-4f014af41ba3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:29.649072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:29.649706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:29.650197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:29.651007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:29.651470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:29.651948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:29.668590 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] HTTP exception thrown: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Request method failure captured: Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 HTTP/1.1 Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54B9UxUTdsq1Can81NyxLtRsCzPNdUUOGKrEJeEMifB-YNgrMDVYqT-j9bjNXuFiKUoo6M1IMgc2k_lvP0Ib7uBX3b21vFQwqOHc_vCYHbl7fEjVIE6hIOrP7sQXZBobJe3ep4pwRhFN_lXR2lQQbS2xJPTpn8SuIAVAbvpby4gnNc Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f2631c6f28d74660b55bdbe16c0cea3b Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-1056340055 Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:29.670123 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f2631c6f28d74660b55bdbe16c0cea3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2631c6f28d74660b55bdbe16c0cea3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2631c6f28d74660b55bdbe16c0cea3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f2631c6f28d74660b55bdbe16c0cea3b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-1056340055 Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f2631c6f28d74660b55bdbe16c0cea3b Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1056340055 Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-1056340055-project Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: fa92d335e7cd4168b7aa7e5daa3bd518 Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-1056340055-project Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.671984 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '7970343e-02b4-4dcc-a64f-4f014af41ba3'} Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:29.674272 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. Oct 19 06:50:29.675344 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:29.676336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] Returning 404 to user: Instance 7970343e-02b4-4dcc-a64f-4f014af41ba3 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:29.676336 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2e8451f-b690-4301-93d5-e0281dfae3d0 tempest-AggregatesAdminTestJSON-1056340055 tempest-AggregatesAdminTestJSON-1056340055-project] 10.222.0.39 "GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3" status: 404 len: 111 microversion: 2.1 time: 0.036631 Oct 19 06:50:29.676336 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 163/305] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:29 2022] GET /compute/v2.1/servers/7970343e-02b4-4dcc-a64f-4f014af41ba3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:50:30.311704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:50:30.312886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:50:30.313296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:50:30.313782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:50:30.314186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:50:30.325916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:30.326514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:30.327355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:30.328328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:30.328936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:30.329364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:30.356384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for project bdca3d9567f34867aa0d9d4489001792. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:30.362932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for user f67e466b1aa04d2cbafdbd390c178215 and project bdca3d9567f34867aa0d9d4489001792. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:30.376230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:50:30.378609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:50:30.405481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=3,nova_api:UPDATE=12,nova_api:INSERT=15 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:30.471576 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4a96ce1-3e62-4dad-8201-3d41dbf32a28 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.982436 Oct 19 06:50:30.473035 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 143/306] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:50:30.480984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:30.482270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:30.487626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-977b5998-b6a5-4f32-b402-4a0bbf732203 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:30.488286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-977b5998-b6a5-4f32-b402-4a0bbf732203 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:30.491434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:30.492199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:30.492940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:30.493879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:30.494618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:30.495261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:30.617899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-977b5998-b6a5-4f32-b402-4a0bbf732203 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:30.671142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-977b5998-b6a5-4f32-b402-4a0bbf732203 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1211 microversion: 2.1 time: 0.190508 Oct 19 06:50:30.674427 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 144/307] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:30 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1211 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:30.688538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:30.693812 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d85ae338-75b7-487f-baf9-72730903b718 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1282 microversion: 2.1 time: 0.219773 Oct 19 06:50:30.694648 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 164/308] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:30 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1282 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:31.703080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64f4d594-d4f1-4343-99f9-5be4a19271b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:31.707960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64f4d594-d4f1-4343-99f9-5be4a19271b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:31.724087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:31.724794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:31.770046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:31.774974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:31.774974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:31.774974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:31.774974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:31.775572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:31.885126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64f4d594-d4f1-4343-99f9-5be4a19271b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:31.895629 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64f4d594-d4f1-4343-99f9-5be4a19271b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1211 microversion: 2.1 time: 0.199239 Oct 19 06:50:32.105245 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 145/309] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:31 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1211 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:32.106205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:32.106205 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5aeeaa29-1a7f-4e3d-8eb1-e7b4e0ba52e1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1280 microversion: 2.1 time: 0.213534 Oct 19 06:50:32.106205 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 165/310] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:31 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:33.113786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:33.115313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:33.122005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:33.122471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:33.122959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:33.125765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:33.126235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:33.126856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:33.206360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:33.224761 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63b2bfae-3c82-4761-aff0-a00f9025978e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1263 microversion: 2.1 time: 0.115192 Oct 19 06:50:33.226256 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 166/311] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:33 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1263 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:33.238217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:33.238971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:33.245144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:33.245623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:33.247806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:33.247806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:33.247806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:33.247806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:33.435304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:33.449234 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fab15e62-516c-4c57-aab0-3f16b7d2da04 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1322 microversion: 2.1 time: 0.221843 Oct 19 06:50:33.449813 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 167/312] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:33 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:33.464327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6c0c4dca-5088-448f-ab6e-8412bc45bb79 req-be390da5-20ec-4dc2-81db-a1b26ee1ff5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eee3fae-d46b-4976-8f84-a6d1295ddb45", "tag": "97c607f1-08f7-44b2-8756-720b2e944a69"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:33.481997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6c0c4dca-5088-448f-ab6e-8412bc45bb79 req-be390da5-20ec-4dc2-81db-a1b26ee1ff5b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:33.482685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6c0c4dca-5088-448f-ab6e-8412bc45bb79 req-be390da5-20ec-4dc2-81db-a1b26ee1ff5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:33.483191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6c0c4dca-5088-448f-ab6e-8412bc45bb79 req-be390da5-20ec-4dc2-81db-a1b26ee1ff5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:33.501507 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6c0c4dca-5088-448f-ab6e-8412bc45bb79 req-be390da5-20ec-4dc2-81db-a1b26ee1ff5b service nova] Creating event network-changed:97c607f1-08f7-44b2-8756-720b2e944a69 for instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 on n-h1-861333-10 Oct 19 06:50:33.507489 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6c0c4dca-5088-448f-ab6e-8412bc45bb79 req-be390da5-20ec-4dc2-81db-a1b26ee1ff5b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056465 Oct 19 06:50:33.508346 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 168/313] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:33.669382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c31f939c-0eaf-41c2-9848-a45fd034cfc3 tempest-InstanceUsageAuditLogTestJSON-1764446741 tempest-InstanceUsageAuditLogTestJSON-1764446741-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:33.710099 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c31f939c-0eaf-41c2-9848-a45fd034cfc3 tempest-InstanceUsageAuditLogTestJSON-1764446741 tempest-InstanceUsageAuditLogTestJSON-1764446741-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19 06:50:33" status: 200 len: 318 microversion: 2.1 time: 0.686198 Oct 19 06:50:33.718929 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 146/314] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 06:50:33 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19%2006%3A50%3A33 => generated 318 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:33.725137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-060ec9f3-c63e-4dd7-b3cb-bad7c94d8cf9 tempest-InstanceUsageAuditLogTestJSON-1764446741 tempest-InstanceUsageAuditLogTestJSON-1764446741-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:33.760513 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-060ec9f3-c63e-4dd7-b3cb-bad7c94d8cf9 tempest-InstanceUsageAuditLogTestJSON-1764446741 tempest-InstanceUsageAuditLogTestJSON-1764446741-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.039383 Oct 19 06:50:33.761568 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 169/315] 10.222.0.39 () {58 vars in 1185 bytes} [Wed Oct 19 06:50:33 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:34.256803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:34.257763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:34.265157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:34.266652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:34.267075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:34.267781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:34.268425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:34.268859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:34.380727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:34.390874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6b97e12-c0eb-4ef2-9b23-570ef266b85e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1269 microversion: 2.1 time: 0.138332 Oct 19 06:50:34.391873 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 147/316] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:34 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:34.477655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:34.480410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:34.488545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:34.489143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:34.490037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:34.490958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:34.491602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:34.492290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:34.747450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:34.759465 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a957f94-809f-427c-803b-f67bb19088c0 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1322 microversion: 2.1 time: 0.285963 Oct 19 06:50:34.778562 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 170/317] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:34 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:35.416817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:35.417825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:35.426980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:35.427722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:35.428343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:35.429216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:35.429828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:35.430409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:35.690221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:35.698143 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d13976b5-f638-4e5e-9037-c7efccaa21a4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1311 microversion: 2.1 time: 0.287487 Oct 19 06:50:35.699014 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 148/318] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:35 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1311 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:35.795696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:35.797915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:35.809394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:35.810692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:35.816648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:35.816648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:35.816648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:35.817491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:36.104787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:36.112443 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5b130de-acf2-4d7b-bb5f-93358079b401 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1322 microversion: 2.1 time: 0.322909 Oct 19 06:50:36.113013 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 171/319] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:35 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:36.610987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-81718893-ea69-46ac-9274-a9897a4e8eaa req-6f0b53d1-1360-419d-9d3b-86bab9abe923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf535c5e-75cc-4e86-a7d7-6866903c675c", "tag": "dadfbd32-34d8-4d27-bbd2-6e23781bea92"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:36.623149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-81718893-ea69-46ac-9274-a9897a4e8eaa req-6f0b53d1-1360-419d-9d3b-86bab9abe923 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:36.623793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-81718893-ea69-46ac-9274-a9897a4e8eaa req-6f0b53d1-1360-419d-9d3b-86bab9abe923 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:36.625074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-81718893-ea69-46ac-9274-a9897a4e8eaa req-6f0b53d1-1360-419d-9d3b-86bab9abe923 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:36.638954 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-81718893-ea69-46ac-9274-a9897a4e8eaa req-6f0b53d1-1360-419d-9d3b-86bab9abe923 service nova] Creating event network-changed:dadfbd32-34d8-4d27-bbd2-6e23781bea92 for instance cf535c5e-75cc-4e86-a7d7-6866903c675c on n-h2-861333-10 Oct 19 06:50:36.644984 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-81718893-ea69-46ac-9274-a9897a4e8eaa req-6f0b53d1-1360-419d-9d3b-86bab9abe923 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037690 Oct 19 06:50:36.646226 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 149/320] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:36.722494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:36.724528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:36.733569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:36.734544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:36.734997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:36.735714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:36.736424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:36.736958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:37.085055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:37.093015 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a584ae3b-c504-4dbb-ac01-554d4994f502 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1311 microversion: 2.1 time: 0.375213 Oct 19 06:50:37.113136 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 172/321] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:36 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1311 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:37.137797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:37.139006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:37.152309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:37.157153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:37.157775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:37.158892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:37.160301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:37.163300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:37.427270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:37.443161 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09a03138-f042-45f5-abb0-7efd21247299 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1322 microversion: 2.1 time: 0.310624 Oct 19 06:50:37.458982 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 150/322] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:37 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:37.615164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=11 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:37.921231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-640661014", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": "none"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:37.994634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:50:37.995502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:50:37.996228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:50:37.996887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:50:37.997644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:50:38.009345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:38.010383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:38.011193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:38.012029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:38.012592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:38.013081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:38.032343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Getting quotas for project 0ac8c7e383444e50ab768e71e5f01646. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:38.039573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Getting quotas for user 510f17bc292043c69098a1b6e86a1964 and project 0ac8c7e383444e50ab768e71e5f01646. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:38.053713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:50:38.057155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:50:38.120090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:38.120848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:38.131333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:38.132612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:38.135340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:38.136333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:38.136802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:38.137230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:38.268895 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6172b5e-bc9f-468f-a33b-d89bc0788b2a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.913352 Oct 19 06:50:38.278083 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 173/323] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 06:50:38.289726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9e1e105-8a6b-4e8d-a10f-1e681acf5210 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:38.291713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9e1e105-8a6b-4e8d-a10f-1e681acf5210 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:38.392371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:38.401121 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-269a6e63-e4ff-477c-a764-e2e4f59f693f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1311 microversion: 2.1 time: 0.284718 Oct 19 06:50:38.405157 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 151/324] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:38 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1311 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:38.472780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:38.473597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:38.498135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:38.498749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:38.502808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:38.506253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:38.506745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:38.507191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:38.602720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9e1e105-8a6b-4e8d-a10f-1e681acf5210 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:38.614948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9e1e105-8a6b-4e8d-a10f-1e681acf5210 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:38.638003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9e1e105-8a6b-4e8d-a10f-1e681acf5210 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:38.688003 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9e1e105-8a6b-4e8d-a10f-1e681acf5210 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1452 microversion: 2.91 time: 0.407823 Oct 19 06:50:38.689393 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 174/325] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:38 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1452 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:38.810068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:38.821909 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a6bd085-0042-40f2-b8a0-962f5a257dee tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1322 microversion: 2.1 time: 0.354877 Oct 19 06:50:38.844007 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 152/326] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:38 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:50:39.429120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:39.429857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:39.443234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:39.444287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:39.444761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:39.445504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:39.446154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:39.446769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:39.717127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-487f71ca-ac0f-49c2-8ff2-8aa0c9bd0182 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:39.717802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-487f71ca-ac0f-49c2-8ff2-8aa0c9bd0182 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:39.744568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:39.746735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:39.756705 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0469294f-fcc4-49a3-afff-a05d78c3cc30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1311 microversion: 2.1 time: 0.331592 Oct 19 06:50:39.757796 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 175/327] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:39 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:39.850418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-487f71ca-ac0f-49c2-8ff2-8aa0c9bd0182 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:39.867501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-487f71ca-ac0f-49c2-8ff2-8aa0c9bd0182 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:39.867501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-487f71ca-ac0f-49c2-8ff2-8aa0c9bd0182 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:39.885106 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-487f71ca-ac0f-49c2-8ff2-8aa0c9bd0182 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1452 microversion: 2.91 time: 0.171726 Oct 19 06:50:39.891686 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 153/328] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:39 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:39.895353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:39.895980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:39.912425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:39.912937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:39.913395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:39.914121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:39.914588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:39.915057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:40.212133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:40.228349 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ddb71745-cf4f-4553-bf60-b48a8096fd5e tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1322 microversion: 2.1 time: 0.341131 Oct 19 06:50:40.228871 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 154/329] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:39 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:40.462153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:40.473913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef57c4f4-8067-4f89-911b-bea41839a1ba tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-574711881", "ram": 512, "vcpus": 1, "disk": 10, "id": 266872389, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:40.592053 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef57c4f4-8067-4f89-911b-bea41839a1ba tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.781596 Oct 19 06:50:40.601114 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 176/330] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:39 2022] POST /compute/v2.1/flavors => generated 412 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:50:40.609926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-166083406", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:40.674745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:50:41.075952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:50:41.076642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:50:41.080702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:50:41.080702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:50:41.080702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:50:41.090732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:41.091431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:41.092731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:41.093782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:41.095203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:41.096530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:41.119941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Getting quotas for project 0587af802f4f4b98aca0da31c1944b4b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:41.127048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Getting quotas for user 32e7566840814f1fa1d2c765bdada925 and project 0587af802f4f4b98aca0da31c1944b4b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:41.144223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3ba03b8-7413-40b3-b69f-9f1aa8d01b2c tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:41.154312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:50:41.164576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f3ba03b8-7413-40b3-b69f-9f1aa8d01b2c tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] HTTP exception thrown: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3ba03b8-7413-40b3-b69f-9f1aa8d01b2c tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Request method failure captured: Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/flavors/266872389/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT549qiLsmR8i_chX0i1aQCTVYxcFPRVicIR1lobuQq0h5Wl3aVI0CuOmgw4GObwPda5pRA2Bms7NtdDFAWREYYFUs6mB55xoxrZJRKtlto5Zos2WwwR76wQzlMsR4npNkH3ZMEJqaPWhrAWdjPRysprsaAgoGRV6H8hCcghyR7Z6TIc Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e57c48e940784381b697dbd7ed105a13 Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:41.164685 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e57c48e940784381b697dbd7ed105a13", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e57c48e940784381b697dbd7ed105a13 Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 553c37fbc00e4403a233042c1096494a Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:41.165904 n-d-861333-10 devstack@n-api.service[127568]: exception: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'flavor_id': '266872389', 'id': 'hw:cpu_thread_policy'} Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:41.166532 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:41.168781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:41.168781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:41.168781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:41.168781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:41.168781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:41.168781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. Oct 19 06:50:41.168781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:41.168781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3ba03b8-7413-40b3-b69f-9f1aa8d01b2c tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Returning 404 to user: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:41.168781 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3ba03b8-7413-40b3-b69f-9f1aa8d01b2c tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] 10.222.0.39 "GET /compute/v2.1/flavors/266872389/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.562817 Oct 19 06:50:41.170186 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 177/331] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:50:40 2022] GET /compute/v2.1/flavors/266872389/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 567 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:41.175088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:41.175702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:41.195218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:41.196621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:41.197082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:41.198719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:41.199387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:41.200516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:41.367922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:41.379538 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b18173e3-4105-42a0-b2e4-aaa940c96f30 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1311 microversion: 2.1 time: 0.208223 Oct 19 06:50:41.380387 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 178/332] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:41 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1311 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:41.392721 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28fc27f1-3d60-4e06-aae9-59a62b796a1f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925807 Oct 19 06:50:41.392721 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 155/333] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:50:41.405793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8534b796-b826-445e-b62b-9737204c78ed req-06864aa8-fb3a-4802-a90c-97694ad340ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eee3fae-d46b-4976-8f84-a6d1295ddb45", "name": "network-vif-plugged", "status": "completed", "tag": "97c607f1-08f7-44b2-8756-720b2e944a69"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:41.421933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8534b796-b826-445e-b62b-9737204c78ed req-06864aa8-fb3a-4802-a90c-97694ad340ed service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:41.422478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8534b796-b826-445e-b62b-9737204c78ed req-06864aa8-fb3a-4802-a90c-97694ad340ed service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:41.422840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8534b796-b826-445e-b62b-9737204c78ed req-06864aa8-fb3a-4802-a90c-97694ad340ed service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:41.434208 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8534b796-b826-445e-b62b-9737204c78ed req-06864aa8-fb3a-4802-a90c-97694ad340ed service nova] Creating event network-vif-plugged:97c607f1-08f7-44b2-8756-720b2e944a69 for instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 on n-h1-861333-10 Oct 19 06:50:41.458033 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8534b796-b826-445e-b62b-9737204c78ed req-06864aa8-fb3a-4802-a90c-97694ad340ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064496 Oct 19 06:50:41.464658 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 156/334] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:41.472574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:41.477394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:41.483674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:41.484310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:41.484759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:41.485526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:41.486240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:41.486688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:41.718779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-98284b01-12b2-4509-afd1-8b683587eab3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Calling method '.version_select at 0x7f6d650993a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:41.741043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:41.754018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:41.759855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:41.773596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06c1fcf7-05dc-4544-baa6-22d08dabe73c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1504 microversion: 2.91 time: 0.307386 Oct 19 06:50:41.784420 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 157/335] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:41 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:41.789507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8aa9100a-22a3-4c73-ab7a-4030767bc301 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:41.807907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8aa9100a-22a3-4c73-ab7a-4030767bc301 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '553c37fbc00e4403a233042c1096494a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57c48e940784381b697dbd7ed105a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8aa9100a-22a3-4c73-ab7a-4030767bc301 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Request method failure captured: Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/flavors/266872389/os-extra_specs HTTP/1.1 Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 66 Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT549qiLsmR8i_chX0i1aQCTVYxcFPRVicIR1lobuQq0h5Wl3aVI0CuOmgw4GObwPda5pRA2Bms7NtdDFAWREYYFUs6mB55xoxrZJRKtlto5Zos2WwwR76wQzlMsR4npNkH3ZMEJqaPWhrAWdjPRysprsaAgoGRV6H8hCcghyR7Z6TIc Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e57c48e940784381b697dbd7ed105a13 Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:50:41.816546 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e57c48e940784381b697dbd7ed105a13", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e57c48e940784381b697dbd7ed105a13 Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 553c37fbc00e4403a233042c1096494a Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 19 06:50:41.817969 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'flavor_id': '266872389', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:41.818726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 19 06:50:41.819932 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:41.822835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8aa9100a-22a3-4c73-ab7a-4030767bc301 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:41.828758 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8aa9100a-22a3-4c73-ab7a-4030767bc301 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] 10.222.0.39 "POST /compute/v2.1/flavors/266872389/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.048088 Oct 19 06:50:41.829458 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 158/336] 10.222.0.39 () {60 vars in 1221 bytes} [Wed Oct 19 06:50:41 2022] POST /compute/v2.1/flavors/266872389/os-extra_specs => generated 124 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:41.841335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:41.841851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:41.857602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:41.858636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:41.859436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:41.861484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:41.862201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:41.862857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:41.965899 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-98284b01-12b2-4509-afd1-8b683587eab3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 200 len: 371 microversion: 2.1 time: 0.571249 Oct 19 06:50:41.973840 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 179/337] 10.222.0.39 () {58 vars in 1242 bytes} [Wed Oct 19 06:50:41 2022] GET /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 371 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:41.982113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9f35460-e89d-4f8c-b8a4-eae8624eb066 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:41.982985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e9f35460-e89d-4f8c-b8a4-eae8624eb066 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:41.993662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:42.121522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e9f35460-e89d-4f8c-b8a4-eae8624eb066 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:42.136580 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e9f35460-e89d-4f8c-b8a4-eae8624eb066 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1219 microversion: 2.1 time: 0.159486 Oct 19 06:50:42.139031 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 180/338] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:41 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:42.166105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-440a2dea-dfee-454b-95d9-9bc042b01bc0 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:42.274979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:42.283233 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57d687ff-4dcc-4b30-8071-58817aa55938 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1322 microversion: 2.1 time: 0.452459 Oct 19 06:50:42.286215 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 159/339] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:41 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:42.293136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f9fc15b-bbb2-4055-a1fb-68f427a8fbe3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Action: 'update', calling method: .version_select at 0x7f6d65330700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:42.299916 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-440a2dea-dfee-454b-95d9-9bc042b01bc0 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/266872389/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.159340 Oct 19 06:50:42.305617 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 181/340] 10.222.0.39 () {60 vars in 1221 bytes} [Wed Oct 19 06:50:42 2022] POST /compute/v2.1/flavors/266872389/os-extra_specs => generated 66 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:50:42.504050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8bc2b68d-f702-4219-80fc-643d48a402b1 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Action: 'create', calling method: .version_select at 0x7f6d6513dee0>, body: {"keypair": {"name": "tempest-keypair-250810681", "type": "ssh", "user_id": "c9bf186d6afe44289998deb491d69d14", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwYYkiWuqROPSyd+NSbP3OG1R1RQPNnuaoGoy5xN8NUGccPInzajtjM0k7Dfc2GcaP/7RiSgTRZU7cLkNsWgOQieaNl7M+BdBRSIyXd3dzblFxDd5cn0y+j4S24IpUKdw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:42.570380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8bc2b68d-f702-4219-80fc-643d48a402b1 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Getting quotas for project 124ce1b1781b4d20900f4b39d1c0f493. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:42.678390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8bc2b68d-f702-4219-80fc-643d48a402b1 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Getting quotas for user 16502213e4344cc680ea2a9706ee40e9 and project 124ce1b1781b4d20900f4b39d1c0f493. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:42.679116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f9fc15b-bbb2-4055-a1fb-68f427a8fbe3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:42.679116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f9fc15b-bbb2-4055-a1fb-68f427a8fbe3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:42.679116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f9fc15b-bbb2-4055-a1fb-68f427a8fbe3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:42.679116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f9fc15b-bbb2-4055-a1fb-68f427a8fbe3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:42.679456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f9fc15b-bbb2-4055-a1fb-68f427a8fbe3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:42.679456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f9fc15b-bbb2-4055-a1fb-68f427a8fbe3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:42.849772 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8bc2b68d-f702-4219-80fc-643d48a402b1 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.544345 Oct 19 06:50:42.857607 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 182/341] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 06:50:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 546 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 06:50:42.857607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc8ac426-60f7-44bc-8d61-904f6585793f tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:42.861294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dc8ac426-60f7-44bc-8d61-904f6585793f tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '553c37fbc00e4403a233042c1096494a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57c48e940784381b697dbd7ed105a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc8ac426-60f7-44bc-8d61-904f6585793f tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Request method failure captured: Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT549qiLsmR8i_chX0i1aQCTVYxcFPRVicIR1lobuQq0h5Wl3aVI0CuOmgw4GObwPda5pRA2Bms7NtdDFAWREYYFUs6mB55xoxrZJRKtlto5Zos2WwwR76wQzlMsR4npNkH3ZMEJqaPWhrAWdjPRysprsaAgoGRV6H8hCcghyR7Z6TIc Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e57c48e940784381b697dbd7ed105a13 Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:42.863255 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e57c48e940784381b697dbd7ed105a13", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e57c48e940784381b697dbd7ed105a13 Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 553c37fbc00e4403a233042c1096494a Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:42.864712 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'flavor_id': '266872389', 'id': 'hw:numa_nodes'} Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:42.865333 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:42.867502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc8ac426-60f7-44bc-8d61-904f6585793f tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:42.869141 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc8ac426-60f7-44bc-8d61-904f6585793f tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] 10.222.0.39 "DELETE /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013652 Oct 19 06:50:42.869141 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 183/342] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 06:50:42 2022] DELETE /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:42.877474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:42.879416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:42.887651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:42.888284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:42.888587 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f9fc15b-bbb2-4055-a1fb-68f427a8fbe3 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 200 len: 328 microversion: 2.1 time: 0.600776 Oct 19 06:50:42.888873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:42.900130 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 160/343] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:42 2022] PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 328 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:42.900558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:42.900558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:42.900558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:42.900778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:42.900778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:42.920578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:42.924060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:42.924889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:42.925846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:42.926516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:42.931083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.074405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:43.092513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:43.094578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:43.100197 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5aa51ac-8a34-41b5-bb29-9ba271550217 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1522 microversion: 2.91 time: 0.204331 Oct 19 06:50:43.105797 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 161/344] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:42 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:43.106145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-161ddafb-5e55-41c0-a34b-2b823cab13fa tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Action: 'create', calling method: .version_select at 0x7f6d652671f0>, body: {"keypair": {"name": "tempest-keypair-1542402101", "type": "ssh", "user_id": "c9bf186d6afe44289998deb491d69d14", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgei1qiPobbN8b4TpLGy+6u3hqibcf6/vwZpvH4DN0dlk5EgeKNYTjWIVQbiQR0xOIvIdtE7dcTjv/ZaypyXuaPkebs7NbqN/urhFKAJVRqeGG/5P7w2MDS8fN/yzpySQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:43.133177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-161ddafb-5e55-41c0-a34b-2b823cab13fa tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Getting quotas for project 124ce1b1781b4d20900f4b39d1c0f493. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:43.139002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-161ddafb-5e55-41c0-a34b-2b823cab13fa tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Getting quotas for user 16502213e4344cc680ea2a9706ee40e9 and project 124ce1b1781b4d20900f4b39d1c0f493. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:43.178034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:43.189039 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bc8e3fa-a01f-4b14-ac98-1fa5a53ef000 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1311 microversion: 2.1 time: 0.316906 Oct 19 06:50:43.190072 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 184/345] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:42 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:43.195319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63777d3a-4509-4482-ac3c-cc69303bdbb7 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:43.222089 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63777d3a-4509-4482-ac3c-cc69303bdbb7 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/266872389/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030576 Oct 19 06:50:43.223432 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 185/346] 10.222.0.39 () {60 vars in 1221 bytes} [Wed Oct 19 06:50:43 2022] POST /compute/v2.1/flavors/266872389/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:50:43.292943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-913266168", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:43.305882 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-161ddafb-5e55-41c0-a34b-2b823cab13fa tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.203846 Oct 19 06:50:43.307174 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 162/347] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 06:50:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 06:50:43.313063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:43.314066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:43.321470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.321970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.322414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.323439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.323920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.324386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.357766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:50:43.442317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:43.460765 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4b116a5-c77c-44e8-b145-89786334087f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1223 microversion: 2.1 time: 0.152072 Oct 19 06:50:43.461756 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 163/348] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:43 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:43.466794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61b86c74-eefc-4c48-872b-27ef211aedd6 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:43.470358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61b86c74-eefc-4c48-872b-27ef211aedd6 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '553c37fbc00e4403a233042c1096494a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57c48e940784381b697dbd7ed105a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61b86c74-eefc-4c48-872b-27ef211aedd6 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Request method failure captured: Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 22 Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT549qiLsmR8i_chX0i1aQCTVYxcFPRVicIR1lobuQq0h5Wl3aVI0CuOmgw4GObwPda5pRA2Bms7NtdDFAWREYYFUs6mB55xoxrZJRKtlto5Zos2WwwR76wQzlMsR4npNkH3ZMEJqaPWhrAWdjPRysprsaAgoGRV6H8hCcghyR7Z6TIc Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e57c48e940784381b697dbd7ed105a13 Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:50:43.472221 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e57c48e940784381b697dbd7ed105a13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e57c48e940784381b697dbd7ed105a13", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e57c48e940784381b697dbd7ed105a13 Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 553c37fbc00e4403a233042c1096494a Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: {"hw:numa_nodes": "1"} Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:43.473795 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'flavor_id': '266872389', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:43.474659 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 19 06:50:43.475936 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.479611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61b86c74-eefc-4c48-872b-27ef211aedd6 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:43.480647 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61b86c74-eefc-4c48-872b-27ef211aedd6 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977 tempest-FlavorsExtraSpecsNegativeTestJSON-1713544977-project] 10.222.0.39 "PUT /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017801 Oct 19 06:50:43.490125 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 164/349] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:43 2022] PUT /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:43.491326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:43.492092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:43.500009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.501001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.501956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.502778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.503381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.503803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.633738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:50:43.633738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:50:43.633738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:50:43.633738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:50:43.633738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:50:43.662817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.662817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.662817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.662817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.663331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.663331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.672420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Getting quotas for project 59a0c47de78642819343b750edf9933c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:43.678585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Getting quotas for user c0980bd1c4f74dbc9601752bd83a9ee5 and project 59a0c47de78642819343b750edf9933c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:43.692531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.utils [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] cores quota exceeded for 59a0c47de78642819343b750edf9933c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127568) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 19 06:50:43.693367 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Request method failure captured: Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 144 Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54-2v1Kd20rFj2IJKAwYPJE8sgiBIzOyoN2Qev9PJJHYHgOYzXzL0DTmqAtdVzEaiVtrEeKlwMXE38eUdA0Y2B-wVegWn96IQXpETd-U1rPpbb4FD27yQX1H0qoLGHVGWerC-tny6oVpudo78vaOPHigWebmr2ROo7JGK2qPu0hXFM Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 59a0c47de78642819343b750edf9933c Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:43.699366 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/59a0c47de78642819343b750edf9933c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59a0c47de78642819343b750edf9933c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59a0c47de78642819343b750edf9933c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_59a0c47de78642819343b750edf9933c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 59a0c47de78642819343b750edf9933c Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-QuotasAdminNegativeTest-1426258858-project Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c0980bd1c4f74dbc9601752bd83a9ee5 Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-QuotasAdminNegativeTest-1426258858-project Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-913266168", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} Oct 19 06:50:43.701030 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-913266168', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452'}}} Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 06:50:43.701886 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:43.703192 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.710440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:43.712171 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:43.712171 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:43.712171 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:43.712171 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:43.712171 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 06:50:43.712171 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.712171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:43.712171 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41e1ae8a-833a-43d9-8466-6fd9f67a8fd7 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.478430 Oct 19 06:50:43.712171 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 186/350] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:43 2022] POST /compute/v2.1/servers => generated 111 bytes in 481 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:43.724942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:43.732951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8fc8070-673d-4953-b045-dcdec38718d8 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Calling method '.version_select at 0x7f6d6502fe50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:43.736163 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77491636-5a1d-4c30-8d23-76a7278df3d7 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1472 microversion: 2.1 time: 0.249043 Oct 19 06:50:43.738727 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 165/351] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:43 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:43.743684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a7ce093-7a7e-41c1-883c-f24570c61596 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:43.751552 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2a7ce093-7a7e-41c1-883c-f24570c61596 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] HTTP exception thrown: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a7ce093-7a7e-41c1-883c-f24570c61596 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Request method failure captured: Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/flavors/266872389/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54_wXfYcJ4Usd8ol4FnC-1atyRaUnQOlIfc3wdMCbQrlejUzu8uPu_ZS5TKPDhy5y0OB_dlvrYj35uPtQJEnCVlhGxzXgn3ZNTvuK7CgBiicmaxNQfT90EbDD9fy_V00bCPuxwStIzjejtK-FivpGwXTPlcu3Ycmz4VFpAJGzNpJZc Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: eaa63abf1e454381822484fa0049a280 Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:50:43.753226 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eaa63abf1e454381822484fa0049a280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eaa63abf1e454381822484fa0049a280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eaa63abf1e454381822484fa0049a280"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eaa63abf1e454381822484fa0049a280", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: eaa63abf1e454381822484fa0049a280 Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: b5b85196d1c04aa08ed629660f966435 Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:43.754702 n-d-861333-10 devstack@n-api.service[127567]: exception: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'flavor_id': '266872389', 'id': 'hw:cpu_thread_policy'} Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:43.755497 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.757047 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:43.757047 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:43.757047 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:43.757047 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:43.757047 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:43.757047 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. Oct 19 06:50:43.757047 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:43.758286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a7ce093-7a7e-41c1-883c-f24570c61596 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Returning 404 to user: Flavor 266872389 has no extra specs with key hw:cpu_thread_policy. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:43.759150 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a7ce093-7a7e-41c1-883c-f24570c61596 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/266872389/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.019161 Oct 19 06:50:43.759699 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 166/352] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 06:50:43 2022] DELETE /compute/v2.1/flavors/266872389/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:43.761520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8fc8070-673d-4953-b045-dcdec38718d8 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-250810681?user_id=c9bf186d6afe44289998deb491d69d14" status: 200 len: 511 microversion: 2.10 time: 0.034591 Oct 19 06:50:43.775121 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 187/353] 10.222.0.39 () {60 vars in 1337 bytes} [Wed Oct 19 06:50:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-250810681?user_id=c9bf186d6afe44289998deb491d69d14 => generated 511 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:43.775220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7be9356c-b2c5-4f18-b2c3-0ea2996c50d5 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Action: 'update', calling method: .version_select at 0x7f6d65274ee0>, body: {"quota_set": {"cores": 20}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:43.778700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:43.779449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:43.797706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.798316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.799990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.799990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.801816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.801816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.889843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7be9356c-b2c5-4f18-b2c3-0ea2996c50d5 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.891369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7be9356c-b2c5-4f18-b2c3-0ea2996c50d5 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.892302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7be9356c-b2c5-4f18-b2c3-0ea2996c50d5 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.893831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7be9356c-b2c5-4f18-b2c3-0ea2996c50d5 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:43.894564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7be9356c-b2c5-4f18-b2c3-0ea2996c50d5 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:43.894906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7be9356c-b2c5-4f18-b2c3-0ea2996c50d5 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:43.941518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lazy-loading 'flavor' on Instance uuid 3eee3fae-d46b-4976-8f84-a6d1295ddb45 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:50:43.980229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:44.079809 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7be9356c-b2c5-4f18-b2c3-0ea2996c50d5 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 200 len: 329 microversion: 2.1 time: 0.318626 Oct 19 06:50:44.080849 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 167/354] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:43 2022] PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 329 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:44.086077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89fe954d-8919-456e-b190-75f1605cb077 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:44.091694 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-89fe954d-8919-456e-b190-75f1605cb077 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89fe954d-8919-456e-b190-75f1605cb077 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Request method failure captured: Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 27 Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54_wXfYcJ4Usd8ol4FnC-1atyRaUnQOlIfc3wdMCbQrlejUzu8uPu_ZS5TKPDhy5y0OB_dlvrYj35uPtQJEnCVlhGxzXgn3ZNTvuK7CgBiicmaxNQfT90EbDD9fy_V00bCPuxwStIzjejtK-FivpGwXTPlcu3Ycmz4VFpAJGzNpJZc Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: eaa63abf1e454381822484fa0049a280 Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:50:44.093886 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eaa63abf1e454381822484fa0049a280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eaa63abf1e454381822484fa0049a280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eaa63abf1e454381822484fa0049a280"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eaa63abf1e454381822484fa0049a280", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: eaa63abf1e454381822484fa0049a280 Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: b5b85196d1c04aa08ed629660f966435 Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: {"hw:cpu_policy": "shared"} Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:44.101611 n-d-861333-10 devstack@n-api.service[127567]: exception: Request body and URI mismatch Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'flavor_id': '266872389', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:44.102573 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:44.104147 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:44.104147 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:44.104147 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 19 06:50:44.104147 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.104147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89fe954d-8919-456e-b190-75f1605cb077 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:44.104147 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89fe954d-8919-456e-b190-75f1605cb077 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.013122 Oct 19 06:50:44.104147 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 168/355] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:44 2022] PUT /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes => generated 73 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:50:44.104623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-acfe43ef-23a2-4e96-a7b1-0fec0f73e5c9 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Action: 'create', calling method: .version_select at 0x7f6d65330af0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-860406368", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYXSuhlfe9hr8T95MW77mO4wu+GK5Vy5DkOIKIzVgqnj4zDqpEFWTDDW8IRLXO43e5sfr3vSLfiDQDYch9HcNYxFg9E/yTrJ4CFd2gvQozS/TFRGDBQzVOFUNUPj5qT5g=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:44.118388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-acfe43ef-23a2-4e96-a7b1-0fec0f73e5c9 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Getting quotas for project 124ce1b1781b4d20900f4b39d1c0f493. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:44.123555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-acfe43ef-23a2-4e96-a7b1-0fec0f73e5c9 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Getting quotas for user 16502213e4344cc680ea2a9706ee40e9 and project 124ce1b1781b4d20900f4b39d1c0f493. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:44.247728 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-acfe43ef-23a2-4e96-a7b1-0fec0f73e5c9 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.149752 Oct 19 06:50:44.249088 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 169/356] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 06:50:44 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 06:50:44.257822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-326453b0-74b4-40a4-8499-52e00d2645bd tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Calling method '.version_select at 0x7f6d65274a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:44.329465 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-326453b0-74b4-40a4-8499-52e00d2645bd tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 200 len: 371 microversion: 2.1 time: 0.078956 Oct 19 06:50:44.330453 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 170/357] 10.222.0.39 () {58 vars in 1242 bytes} [Wed Oct 19 06:50:44 2022] GET /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:44.335728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68f65f79-7f2e-4861-b6aa-4fa40b48f7a3 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:44.341820 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34638163-5416-40dc-97ce-c497b0f86f54 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45/action" status: 202 len: 0 microversion: 2.1 time: 0.568140 Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68f65f79-7f2e-4861-b6aa-4fa40b48f7a3 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Request method failure captured: Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 49 Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54_wXfYcJ4Usd8ol4FnC-1atyRaUnQOlIfc3wdMCbQrlejUzu8uPu_ZS5TKPDhy5y0OB_dlvrYj35uPtQJEnCVlhGxzXgn3ZNTvuK7CgBiicmaxNQfT90EbDD9fy_V00bCPuxwStIzjejtK-FivpGwXTPlcu3Ycmz4VFpAJGzNpJZc Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: eaa63abf1e454381822484fa0049a280 Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:50:44.342746 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eaa63abf1e454381822484fa0049a280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eaa63abf1e454381822484fa0049a280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eaa63abf1e454381822484fa0049a280"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eaa63abf1e454381822484fa0049a280", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: eaa63abf1e454381822484fa0049a280 Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: b5b85196d1c04aa08ed629660f966435 Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 19 06:50:44.345044 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'flavor_id': '266872389', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance: Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 19 06:50:44.345802 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.347611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:44.349899 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:44.349899 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:44.349899 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:50:44.349899 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:50:44.349899 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 06:50:44.349899 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:44.350723 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 188/358] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:50:43 2022] POST /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:50:44.350816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68f65f79-7f2e-4861-b6aa-4fa40b48f7a3 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:44.350816 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68f65f79-7f2e-4861-b6aa-4fa40b48f7a3 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.013470 Oct 19 06:50:44.350816 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 171/359] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:44 2022] PUT /compute/v2.1/flavors/266872389/os-extra_specs/hw:numa_nodes => generated 117 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:50:44.350816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:44.350816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:44.360320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:44.360879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:44.361416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:44.361865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:44.362555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:44.363230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:44.363348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:44.363653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:44.377809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:44.379080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:44.380696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:44.384745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:44.385321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:44.385836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:44.543270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:44.551735 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4b726cd-2603-4b88-bec8-48dce4556456 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1311 microversion: 2.1 time: 0.205083 Oct 19 06:50:44.564256 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 172/360] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:44 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:44.564256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c00fa321-8b69-476b-a681-123dd88fd272 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Calling method '.version_select at 0x7f6d651cb3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:44.565054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:44.565169 n-d-861333-10 devstack@n-api.service[127567]: WARNING oslo_db.sqlalchemy.utils [None req-c00fa321-8b69-476b-a681-123dd88fd272 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 06:50:44.572652 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c00fa321-8b69-476b-a681-123dd88fd272 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] 10.222.0.39 "GET /compute/v2.1/os-keypairs?user_id=c9bf186d6afe44289998deb491d69d14" status: 200 len: 725 microversion: 2.10 time: 0.015672 Oct 19 06:50:44.572652 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 173/361] 10.222.0.39 () {60 vars in 1259 bytes} [Wed Oct 19 06:50:44 2022] GET /compute/v2.1/os-keypairs?user_id=c9bf186d6afe44289998deb491d69d14 => generated 725 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:44.573075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:44.574582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f07014a7-42c7-472a-b558-563415236eaf tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Action: 'update', calling method: .version_select at 0x7f6d6523e5e0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:44.584299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:44.586823 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3658554a-300b-4956-86ef-620414ca1a8a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1510 microversion: 2.91 time: 0.240190 Oct 19 06:50:44.608286 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 189/362] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:44 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:44.621996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-203d1b41-e62e-4e8f-9086-587bbde38fac tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:44.622670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-203d1b41-e62e-4e8f-9086-587bbde38fac tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:44.629005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-203d1b41-e62e-4e8f-9086-587bbde38fac tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:44.629671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-203d1b41-e62e-4e8f-9086-587bbde38fac tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:44.630115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-203d1b41-e62e-4e8f-9086-587bbde38fac tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:44.630823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-203d1b41-e62e-4e8f-9086-587bbde38fac tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:44.631275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-203d1b41-e62e-4e8f-9086-587bbde38fac tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:44.631758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-203d1b41-e62e-4e8f-9086-587bbde38fac tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:44.949282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f07014a7-42c7-472a-b558-563415236eaf tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:44.950002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f07014a7-42c7-472a-b558-563415236eaf tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:44.950773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f07014a7-42c7-472a-b558-563415236eaf tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:44.951721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f07014a7-42c7-472a-b558-563415236eaf tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:44.952399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f07014a7-42c7-472a-b558-563415236eaf tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:44.953977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f07014a7-42c7-472a-b558-563415236eaf tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:44.966118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:45.093549 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f07014a7-42c7-472a-b558-563415236eaf tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 200 len: 328 microversion: 2.1 time: 0.522664 Oct 19 06:50:45.104155 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 174/363] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:44 2022] PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 328 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:45.120865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3aeea62-0c14-42a6-b28b-303806e929cf tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:45.281654 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3aeea62-0c14-42a6-b28b-303806e929cf tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/266872389" status: 202 len: 0 microversion: 2.1 time: 0.185296 Oct 19 06:50:45.283627 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 175/364] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 06:50:45 2022] DELETE /compute/v2.1/flavors/266872389 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:50:45.291752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:45.293131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:45.303175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:45.304399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:45.305261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:45.307843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:45.308780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:45.309501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:45.406850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:45.427722 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-885410bf-c82d-4cb3-b229-a4f6b3f98847 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1277 microversion: 2.1 time: 0.141247 Oct 19 06:50:45.430603 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 176/365] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:45 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:45.450932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd4d5005-878c-4998-9130-54b262e7750d tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Calling method '.version_select at 0x7f6d651cb3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:45.496866 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-203d1b41-e62e-4e8f-9086-587bbde38fac tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1633 microversion: 2.1 time: 0.889747 Oct 19 06:50:45.512133 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 190/366] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:44 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1633 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:45.516139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e9f0b6f0-efe1-43a6-a35d-7913eedf286c req-05eb0908-034b-4a1f-a33f-eb5f58e0421d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf535c5e-75cc-4e86-a7d7-6866903c675c", "name": "network-vif-plugged", "status": "completed", "tag": "dadfbd32-34d8-4d27-bbd2-6e23781bea92"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:45.525241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e9f0b6f0-efe1-43a6-a35d-7913eedf286c req-05eb0908-034b-4a1f-a33f-eb5f58e0421d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:45.525708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e9f0b6f0-efe1-43a6-a35d-7913eedf286c req-05eb0908-034b-4a1f-a33f-eb5f58e0421d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:45.526182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e9f0b6f0-efe1-43a6-a35d-7913eedf286c req-05eb0908-034b-4a1f-a33f-eb5f58e0421d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:45.537227 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e9f0b6f0-efe1-43a6-a35d-7913eedf286c req-05eb0908-034b-4a1f-a33f-eb5f58e0421d service nova] Creating event network-vif-plugged:dadfbd32-34d8-4d27-bbd2-6e23781bea92 for instance cf535c5e-75cc-4e86-a7d7-6866903c675c on n-h2-861333-10 Oct 19 06:50:45.543227 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e9f0b6f0-efe1-43a6-a35d-7913eedf286c req-05eb0908-034b-4a1f-a33f-eb5f58e0421d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035898 Oct 19 06:50:45.544076 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 191/367] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:45.549343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44c17d2f-4994-450a-b13b-6c238a5cc337 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:45.587937 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd4d5005-878c-4998-9130-54b262e7750d tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-860406368" status: 204 len: 0 microversion: 2.10 time: 0.155070 Oct 19 06:50:45.591739 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 177/368] 10.222.0.39 () {60 vars in 1322 bytes} [Wed Oct 19 06:50:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-860406368 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 06:50:45.597626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-924410289", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:45.608653 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44c17d2f-4994-450a-b13b-6c238a5cc337 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031 tempest-FlavorsExtraSpecsNegativeTestJSON-129857031-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063139 Oct 19 06:50:45.612580 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 192/369] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:50:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:45.633976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:45.634787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:45.651461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:45.651947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:45.654172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:45.655494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:45.655674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:45.656377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:45.699651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:50:46.027651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:50:46.028343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:50:46.028980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:50:46.029537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:50:46.030112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:50:46.048936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.049708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.050302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.051174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.055674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.056367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.081572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=91,nova_cell0:UPDATE=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:46.082741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Getting quotas for project 59a0c47de78642819343b750edf9933c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:46.085226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:46.088930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Getting quotas for user c0980bd1c4f74dbc9601752bd83a9ee5 and project 59a0c47de78642819343b750edf9933c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:46.097856 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d98c6203-c41f-46cf-80e1-1d10243a0358 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1311 microversion: 2.1 time: 0.482956 Oct 19 06:50:46.100617 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 193/370] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:45 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1311 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:46.104646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.utils [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] instances quota exceeded for 59a0c47de78642819343b750edf9933c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127567) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 19 06:50:46.105629 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Request method failure captured: Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 144 Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54-2v1Kd20rFj2IJKAwYPJE8sgiBIzOyoN2Qev9PJJHYHgOYzXzL0DTmqAtdVzEaiVtrEeKlwMXE38eUdA0Y2B-wVegWn96IQXpETd-U1rPpbb4FD27yQX1H0qoLGHVGWerC-tny6oVpudo78vaOPHigWebmr2ROo7JGK2qPu0hXFM Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 59a0c47de78642819343b750edf9933c Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:50:46.109764 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/59a0c47de78642819343b750edf9933c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59a0c47de78642819343b750edf9933c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59a0c47de78642819343b750edf9933c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_59a0c47de78642819343b750edf9933c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 59a0c47de78642819343b750edf9933c Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-QuotasAdminNegativeTest-1426258858-project Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c0980bd1c4f74dbc9601752bd83a9ee5 Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-QuotasAdminNegativeTest-1426258858-project Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-924410289", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} Oct 19 06:50:46.110871 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-924410289', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452'}}} Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 06:50:46.111508 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:46.112515 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:46.113744 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:46.114836 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:46.114836 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:46.114836 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:46.114836 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:46.114836 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 06:50:46.114836 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:46.115174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-059eb2d4-7dd1-4398-8ff5-a6c40b9afd48 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Calling method '.version_select at 0x7f6d64f48670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:46.116323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:46.117320 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-279885cc-c501-4760-b59f-e9e4c2abe134 tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.524135 Oct 19 06:50:46.121762 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 178/371] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:45 2022] POST /compute/v2.1/servers => generated 119 bytes in 529 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:46.127646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:46.128461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:46.136926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.137734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.138410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.139327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.139999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.141213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.244294 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-059eb2d4-7dd1-4398-8ff5-a6c40b9afd48 tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542402101?user_id=c9bf186d6afe44289998deb491d69d14" status: 204 len: 0 microversion: 2.10 time: 0.142199 Oct 19 06:50:46.244804 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 194/372] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 06:50:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542402101?user_id=c9bf186d6afe44289998deb491d69d14 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 06:50:46.250623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6005332e-9ffe-4add-8157-689ab88f3f9d tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Action: 'update', calling method: .version_select at 0x7f6d64fca040>, body: {"quota_set": {"instances": 10}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:46.304347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:46.315548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:46.317263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:46.323778 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28d94203-3f41-4d0f-a08a-c9c3bc442651 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1531 microversion: 2.91 time: 0.200723 Oct 19 06:50:46.335055 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 179/373] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:46 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1531 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:46.335055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-988c24e8-ed66-481c-90af-f2a3ca02454f tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] Calling method '.version_select at 0x7f6d6523e0d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:46.453906 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-988c24e8-ed66-481c-90af-f2a3ca02454f tempest-KeyPairsV210TestJSON-415267734 tempest-KeyPairsV210TestJSON-415267734-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-250810681?user_id=c9bf186d6afe44289998deb491d69d14" status: 204 len: 0 microversion: 2.10 time: 0.127983 Oct 19 06:50:46.454571 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 180/374] 10.222.0.39 () {60 vars in 1340 bytes} [Wed Oct 19 06:50:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-250810681?user_id=c9bf186d6afe44289998deb491d69d14 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 06:50:46.556220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=57 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:46.561343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6005332e-9ffe-4add-8157-689ab88f3f9d tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.575083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6005332e-9ffe-4add-8157-689ab88f3f9d tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.575985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6005332e-9ffe-4add-8157-689ab88f3f9d tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.578884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6005332e-9ffe-4add-8157-689ab88f3f9d tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.579573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6005332e-9ffe-4add-8157-689ab88f3f9d tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.580430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6005332e-9ffe-4add-8157-689ab88f3f9d tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.729366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:46.729981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:46.736818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.737303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.737920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.738769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.739474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.740049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.881006 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6005332e-9ffe-4add-8157-689ab88f3f9d tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 200 len: 329 microversion: 2.1 time: 0.634775 Oct 19 06:50:46.888918 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 195/375] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:46 2022] PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 329 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:46.898589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:46.899203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:46.907189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.907676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.908143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.908925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:46.909385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:46.909811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:46.972407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lazy-loading 'services' on Instance uuid 6e036b18-232a-4e33-9790-c4f8b72c337c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:50:47.073354 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20dbcb8b-16dd-455c-a533-77207b07057c tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1938 microversion: 2.91 time: 0.615626 Oct 19 06:50:47.074286 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 181/376] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:46 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1938 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:47.088196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e283cc0e-aa23-40e9-80c7-1e8f5fae0790 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:47.088826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e283cc0e-aa23-40e9-80c7-1e8f5fae0790 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:47.098912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e283cc0e-aa23-40e9-80c7-1e8f5fae0790 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:47.100004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e283cc0e-aa23-40e9-80c7-1e8f5fae0790 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:47.100004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e283cc0e-aa23-40e9-80c7-1e8f5fae0790 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:47.100941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e283cc0e-aa23-40e9-80c7-1e8f5fae0790 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:47.101129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e283cc0e-aa23-40e9-80c7-1e8f5fae0790 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:47.104999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e283cc0e-aa23-40e9-80c7-1e8f5fae0790 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:47.281377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:47.290552 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30b85beb-675e-4036-86b8-b5d1e4223970 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1319 microversion: 2.1 time: 0.397089 Oct 19 06:50:47.291139 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 196/377] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:46 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:47.296299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fef4cf87-4397-43fe-ba58-d189f7bc9cbd tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Calling method '.version_select at 0x7f6d650cb280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:47.685437 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e283cc0e-aa23-40e9-80c7-1e8f5fae0790 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1616 microversion: 2.1 time: 0.609933 Oct 19 06:50:47.699791 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 182/378] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:47 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1616 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:47.702360 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fef4cf87-4397-43fe-ba58-d189f7bc9cbd tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 200 len: 371 microversion: 2.1 time: 0.409538 Oct 19 06:50:47.704967 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 197/379] 10.222.0.39 () {58 vars in 1242 bytes} [Wed Oct 19 06:50:47 2022] GET /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:47.715062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:47.716469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:47.723379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:47.724480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:47.735584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:47.736656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:47.738794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:47.741347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:47.742354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:47.743595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:47.745097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:47.745097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:47.745884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:47.746834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:47.748058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:47.749465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:47.938037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lazy-loading 'services' on Instance uuid 6e036b18-232a-4e33-9790-c4f8b72c337c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:50:47.976625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fb62607-017b-476f-8b6a-5277cf1f53dd tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1938 microversion: 2.91 time: 0.275492 Oct 19 06:50:47.981140 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 183/380] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:47 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1938 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:47.989042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0740cd66-c256-4f82-9b89-7085bf28cac1 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Action: 'update', calling method: .version_select at 0x7f6d65274ca0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:48.178774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:48.192414 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed84a744-6e27-421e-a781-90961534af13 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1493 microversion: 2.1 time: 0.481844 Oct 19 06:50:48.193638 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 198/381] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:47 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1493 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:48.221529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:48.222378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:48.239284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:48.245102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:48.245729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:48.247485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:48.250423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:48.251142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:48.332671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0740cd66-c256-4f82-9b89-7085bf28cac1 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:48.334202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0740cd66-c256-4f82-9b89-7085bf28cac1 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:48.334906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0740cd66-c256-4f82-9b89-7085bf28cac1 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:48.336290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0740cd66-c256-4f82-9b89-7085bf28cac1 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:48.337011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0740cd66-c256-4f82-9b89-7085bf28cac1 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:48.337653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0740cd66-c256-4f82-9b89-7085bf28cac1 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:48.569559 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0740cd66-c256-4f82-9b89-7085bf28cac1 tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 200 len: 325 microversion: 2.1 time: 0.572127 Oct 19 06:50:48.572147 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 184/382] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:47 2022] PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 325 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:48.609526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aed6687a-dbeb-41e1-8175-c1c21c91c0bf tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:48.616354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aed6687a-dbeb-41e1-8175-c1c21c91c0bf tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:48.616926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aed6687a-dbeb-41e1-8175-c1c21c91c0bf tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:48.617430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aed6687a-dbeb-41e1-8175-c1c21c91c0bf tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:48.618812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aed6687a-dbeb-41e1-8175-c1c21c91c0bf tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:48.619367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aed6687a-dbeb-41e1-8175-c1c21c91c0bf tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:48.619865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aed6687a-dbeb-41e1-8175-c1c21c91c0bf tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:48.667055 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aed6687a-dbeb-41e1-8175-c1c21c91c0bf tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.077667 Oct 19 06:50:48.679335 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 185/383] 10.222.0.39 () {60 vars in 1217 bytes} [Wed Oct 19 06:50:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:50:48.920873 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] HTTP exception thrown: Cannot 'migrate' instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 while it is in vm_state suspended Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Request method failure captured: Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45/action HTTP/1.1 Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 15 Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54ZraZmsHHFgKQ67KhSXWQTjvYb7GxfSSxwRr1DaXMh4VX2d4wlhcwZe9oXrXtYPYktU_05XBBVma5f33WBOz3jBz-Eat2Iben_8Rqv7yjLWPGreXB8UL_Qr5e8_xCIg8qLWppLscR-QsPDt5-J_T_qkoytmNx5QaQQ4wFySujAJ64 Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:50:48.923676 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02e81d30f79a4afc96ba9c1da07adc93", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 655b7372d15e420c9112edc0d5fa8e58 Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: {"migrate": {}} Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:50:48.924947 n-d-861333-10 devstack@n-api.service[127568]: exception: Cannot 'migrate' instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 while it is in vm_state suspended Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '3eee3fae-d46b-4976-8f84-a6d1295ddb45', 'body': {'migrate': {}}} Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 in vm_state suspended. Cannot resize while the instance is in this state. Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:48.925691 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 while it is in vm_state suspended Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:48.926837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:48.927961 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:48.927961 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:48.927961 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 while it is in vm_state suspended Oct 19 06:50:48.927961 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:48.936125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Returning 409 to user: Cannot 'migrate' instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 while it is in vm_state suspended {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:48.936125 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-556137be-818c-4f43-99e4-7c2a07860573 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45/action" status: 409 len: 148 microversion: 2.1 time: 0.735363 Oct 19 06:50:48.937356 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 199/384] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:50:48 2022] POST /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45/action => generated 148 bytes in 743 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:50:48.981168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:48.982495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:48.994655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:48.995299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:48.995833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:48.996674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:48.997253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:48.997785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:49.165940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c9e9f76e-9a20-45e8-b38d-2504764793b4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:49.168355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c9e9f76e-9a20-45e8-b38d-2504764793b4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:49.170151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:49.176402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9e9f76e-9a20-45e8-b38d-2504764793b4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:49.177635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9e9f76e-9a20-45e8-b38d-2504764793b4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:49.178590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9e9f76e-9a20-45e8-b38d-2504764793b4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:49.179702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9e9f76e-9a20-45e8-b38d-2504764793b4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:49.180928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9e9f76e-9a20-45e8-b38d-2504764793b4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:49.181986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9e9f76e-9a20-45e8-b38d-2504764793b4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:49.420983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:49.430470 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a5b4835-16cf-4705-9ee7-0a535464d6b2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1319 microversion: 2.1 time: 0.491666 Oct 19 06:50:49.441191 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 200/385] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:48 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:49.447772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-da4de133-46ff-4e45-a3d8-ad537a56a40a req-c45165fb-7fe7-49b3-bb7f-eadc1347648c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94fb96e-22d0-493e-9d10-80009cf6ebb9", "tag": "111330a2-4b6f-402e-9ce0-bbcdc21f670f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:49.464820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-da4de133-46ff-4e45-a3d8-ad537a56a40a req-c45165fb-7fe7-49b3-bb7f-eadc1347648c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:49.465476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-da4de133-46ff-4e45-a3d8-ad537a56a40a req-c45165fb-7fe7-49b3-bb7f-eadc1347648c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:49.466621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-da4de133-46ff-4e45-a3d8-ad537a56a40a req-c45165fb-7fe7-49b3-bb7f-eadc1347648c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:49.485617 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-da4de133-46ff-4e45-a3d8-ad537a56a40a req-c45165fb-7fe7-49b3-bb7f-eadc1347648c service nova] Creating event network-changed:111330a2-4b6f-402e-9ce0-bbcdc21f670f for instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 on n-h2-861333-10 Oct 19 06:50:49.491201 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-da4de133-46ff-4e45-a3d8-ad537a56a40a req-c45165fb-7fe7-49b3-bb7f-eadc1347648c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048299 Oct 19 06:50:49.492343 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 201/386] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:49.500160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:49.500962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:49.507834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=86,nova_api:SAVEPOINT=4,nova_api:INSERT=4,nova_api:RELEASE=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:49.510421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:49.511233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:49.511969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:49.512856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:49.513476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:49.514036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:49.585599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lazy-loading 'flavor' on Instance uuid 6e036b18-232a-4e33-9790-c4f8b72c337c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:50:49.613953 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c9e9f76e-9a20-45e8-b38d-2504764793b4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1646 microversion: 2.1 time: 0.932488 Oct 19 06:50:49.614572 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 186/387] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:48 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1646 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:49.641740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-358476532", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:49.778967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:50:50.298347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:50:50.299535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:50:50.300393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:50:50.301031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:50:50.301819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:50:50.320589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:50.328655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:50.328655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:50.328655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:50.328655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:50.329246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:50.359421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Getting quotas for project 59a0c47de78642819343b750edf9933c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:50.371474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Getting quotas for user c0980bd1c4f74dbc9601752bd83a9ee5 and project 59a0c47de78642819343b750edf9933c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:50.406037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.utils [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] ram quota exceeded for 59a0c47de78642819343b750edf9933c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127567) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 19 06:50:50.412618 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Request method failure captured: Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 144 Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54-2v1Kd20rFj2IJKAwYPJE8sgiBIzOyoN2Qev9PJJHYHgOYzXzL0DTmqAtdVzEaiVtrEeKlwMXE38eUdA0Y2B-wVegWn96IQXpETd-U1rPpbb4FD27yQX1H0qoLGHVGWerC-tny6oVpudo78vaOPHigWebmr2ROo7JGK2qPu0hXFM Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 59a0c47de78642819343b750edf9933c Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:50:50.421193 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/59a0c47de78642819343b750edf9933c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59a0c47de78642819343b750edf9933c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59a0c47de78642819343b750edf9933c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_59a0c47de78642819343b750edf9933c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 59a0c47de78642819343b750edf9933c Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-QuotasAdminNegativeTest-1426258858-project Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c0980bd1c4f74dbc9601752bd83a9ee5 Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-QuotasAdminNegativeTest-1426258858-project Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-358476532", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} Oct 19 06:50:50.423254 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-358476532', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452'}}} Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 06:50:50.424146 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:50.425323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.426653 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:50.427979 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:50.427979 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:50.427979 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:50.427979 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:50.427979 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 06:50:50.427979 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.430434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:50.459647 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31c1f3bf-1851-42e0-b240-461a7f1b93da tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.798410 Oct 19 06:50:50.460343 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 187/388] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:49 2022] POST /compute/v2.1/servers => generated 110 bytes in 845 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:50.467792 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c859496-347f-483f-9abb-14d68d30069f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "POST /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c/action" status: 202 len: 0 microversion: 2.91 time: 0.972942 Oct 19 06:50:50.469955 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 202/389] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:50:49 2022] POST /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c/action => generated 0 bytes in 977 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:50:50.483237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46a1c790-ae44-41f7-bff6-1b73d4b67c05 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:50.485471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46a1c790-ae44-41f7-bff6-1b73d4b67c05 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:50.489629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30978ab5-5037-415a-a2b4-a23ef5bb1757 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:50.493542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a1c790-ae44-41f7-bff6-1b73d4b67c05 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:50.494720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a1c790-ae44-41f7-bff6-1b73d4b67c05 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:50.498888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a1c790-ae44-41f7-bff6-1b73d4b67c05 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:50.499307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a1c790-ae44-41f7-bff6-1b73d4b67c05 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:50.501028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a1c790-ae44-41f7-bff6-1b73d4b67c05 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:50.501425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a1c790-ae44-41f7-bff6-1b73d4b67c05 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30978ab5-5037-415a-a2b4-a23ef5bb1757 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Request method failure captured: Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512/action HTTP/1.1 Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 39 Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54ZraZmsHHFgKQ67KhSXWQTjvYb7GxfSSxwRr1DaXMh4VX2d4wlhcwZe9oXrXtYPYktU_05XBBVma5f33WBOz3jBz-Eat2Iben_8Rqv7yjLWPGreXB8UL_Qr5e8_xCIg8qLWppLscR-QsPDt5-J_T_qkoytmNx5QaQQ4wFySujAJ64 Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:50:50.523030 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02e81d30f79a4afc96ba9c1da07adc93", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 655b7372d15e420c9112edc0d5fa8e58 Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: {"os-resetState": {"state": "invalid"}} Oct 19 06:50:50.524344 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'a8494338-c7cd-45d0-a10c-44f411189512', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:50.525037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:50:50.527454 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 19 06:50:50.530670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:50.530670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30978ab5-5037-415a-a2b4-a23ef5bb1757 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:50.530670 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-30978ab5-5037-415a-a2b4-a23ef5bb1757 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512/action" status: 400 len: 144 microversion: 2.1 time: 0.049527 Oct 19 06:50:50.530670 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 188/390] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:50:50 2022] POST /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512/action => generated 144 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:50:50.539653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:50.543732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:50.556598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:50.558626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:50.560247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:50.564814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:50.565408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:50.565972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:50.893556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:50.899040 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46a1c790-ae44-41f7-bff6-1b73d4b67c05 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1646 microversion: 2.1 time: 0.421876 Oct 19 06:50:50.903585 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 203/391] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:50 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1646 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:50.906755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-267a00d1-24cf-4ab7-a47c-382fa899afba tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Action: 'update', calling method: .version_select at 0x7f6d64e3f430>, body: {"quota_set": {"ram": 51200}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:50.931067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:50.942826 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6054d15f-f2ce-46d6-a0e6-361957f7a12d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1319 microversion: 2.1 time: 0.415051 Oct 19 06:50:50.944520 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 189/392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:50 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:50.951762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:50.952832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:50.965325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:50.965819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:50.966263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:50.966969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:50.967501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:50.968813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:51.067140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:51.081515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:51.083361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22fba018-a0a5-4968-bf05-fd857a1f0394 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.144444 Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 190/393] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:50 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37f24230-67c6-48d8-9d3b-ad251e56b7f1 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37f24230-67c6-48d8-9d3b-ad251e56b7f1 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Request method failure captured: Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512/action HTTP/1.1 Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 31 Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54ZraZmsHHFgKQ67KhSXWQTjvYb7GxfSSxwRr1DaXMh4VX2d4wlhcwZe9oXrXtYPYktU_05XBBVma5f33WBOz3jBz-Eat2Iben_8Rqv7yjLWPGreXB8UL_Qr5e8_xCIg8qLWppLscR-QsPDt5-J_T_qkoytmNx5QaQQ4wFySujAJ64 Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:51.104981 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02e81d30f79a4afc96ba9c1da07adc93", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 655b7372d15e420c9112edc0d5fa8e58 Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:51.106193 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: {"os-resetState": {"state": 1}} Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'a8494338-c7cd-45d0-a10c-44f411189512', 'body': {'os-resetState': {'state': 1}}} Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 1 Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:51.107333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:50:51.118208 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:50:51.119457 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 19 06:50:51.119457 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.119457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37f24230-67c6-48d8-9d3b-ad251e56b7f1 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:51.119457 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37f24230-67c6-48d8-9d3b-ad251e56b7f1 tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512/action" status: 400 len: 120 microversion: 2.1 time: 0.016138 Oct 19 06:50:51.119457 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 191/394] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:50:51 2022] POST /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512/action => generated 120 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:50:51.119457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-985b3f03-320d-4967-b448-f2755c9ea777 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:51.123433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985b3f03-320d-4967-b448-f2755c9ea777 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:51.128792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985b3f03-320d-4967-b448-f2755c9ea777 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:51.128792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985b3f03-320d-4967-b448-f2755c9ea777 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:51.128792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985b3f03-320d-4967-b448-f2755c9ea777 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:51.128792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985b3f03-320d-4967-b448-f2755c9ea777 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:51.129119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985b3f03-320d-4967-b448-f2755c9ea777 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:51.190521 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-985b3f03-320d-4967-b448-f2755c9ea777 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.079087 Oct 19 06:50:51.191898 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 192/395] 10.222.0.39 () {58 vars in 1176 bytes} [Wed Oct 19 06:50:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:51.206945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdef0421-d467-44fd-bb13-83e8af761dfe tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:51.210029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bdef0421-d467-44fd-bb13-83e8af761dfe tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Failed to fetch instance by id 999 {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 06:50:51.211472 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bdef0421-d467-44fd-bb13-83e8af761dfe tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdef0421-d467-44fd-bb13-83e8af761dfe tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Request method failure captured: Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 37 Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54ZraZmsHHFgKQ67KhSXWQTjvYb7GxfSSxwRr1DaXMh4VX2d4wlhcwZe9oXrXtYPYktU_05XBBVma5f33WBOz3jBz-Eat2Iben_8Rqv7yjLWPGreXB8UL_Qr5e8_xCIg8qLWppLscR-QsPDt5-J_T_qkoytmNx5QaQQ4wFySujAJ64 Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:50:51.214503 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02e81d30f79a4afc96ba9c1da07adc93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02e81d30f79a4afc96ba9c1da07adc93", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 02e81d30f79a4afc96ba9c1da07adc93 Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848446809 Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 655b7372d15e420c9112edc0d5fa8e58 Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848446809-project-admin Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: {"os-resetState": {"state": "error"}} Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:51.215682 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 999 could not be found. Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:51.216458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdef0421-d467-44fd-bb13-83e8af761dfe tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:51.217795 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bdef0421-d467-44fd-bb13-83e8af761dfe tempest-ServersAdminNegativeTestJSON-1848446809 tempest-ServersAdminNegativeTestJSON-1848446809-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.013731 Oct 19 06:50:51.222851 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 193/396] 10.222.0.39 () {60 vars in 1179 bytes} [Wed Oct 19 06:50:51 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:50:51.227386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-861333-10", "block_migration": true, "disk_over_commit": false}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:51.230099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:51.251841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:51.252374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:51.254196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:51.254968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:51.255440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:51.255888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:51.399183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-267a00d1-24cf-4ab7-a47c-382fa899afba tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:51.401909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-267a00d1-24cf-4ab7-a47c-382fa899afba tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:51.401909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-267a00d1-24cf-4ab7-a47c-382fa899afba tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:51.401909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-267a00d1-24cf-4ab7-a47c-382fa899afba tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:51.403541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-267a00d1-24cf-4ab7-a47c-382fa899afba tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:51.404236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-267a00d1-24cf-4ab7-a47c-382fa899afba tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:51.497709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lazy-loading 'flavor' on Instance uuid cf535c5e-75cc-4e86-a7d7-6866903c675c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:50:51.613246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Going to try to live migrate instance to n-h1-861333-10 {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 06:50:51.648639 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-267a00d1-24cf-4ab7-a47c-382fa899afba tempest-QuotasAdminNegativeTest-1685323974 tempest-QuotasAdminNegativeTest-1685323974-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 200 len: 329 microversion: 2.1 time: 0.746843 Oct 19 06:50:51.649255 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 204/397] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:50 2022] PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 329 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:51.670604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:51.671287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:51.681586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:51.694521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:51.694521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:51.694521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:51.694521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:51.695058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:51.738718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:50:52.193097 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9fc96f39-f622-4b41-a243-40a85f47ad34 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 204 len: 0 microversion: 2.1 time: 0.540502 Oct 19 06:50:52.194385 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 205/398] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:50:51 2022] DELETE /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:50:52.201990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b57890dc-2243-4413-9e27-4ad9bdd706bd tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Action: 'update', calling method: .version_select at 0x7f6d64f0c940>, body: {"quota_set": {"ram": 0}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:52.207278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b57890dc-2243-4413-9e27-4ad9bdd706bd tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c0980bd1c4f74dbc9601752bd83a9ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a0c47de78642819343b750edf9933c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b57890dc-2243-4413-9e27-4ad9bdd706bd tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Request method failure captured: Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c HTTP/1.1 Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 25 Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54-2v1Kd20rFj2IJKAwYPJE8sgiBIzOyoN2Qev9PJJHYHgOYzXzL0DTmqAtdVzEaiVtrEeKlwMXE38eUdA0Y2B-wVegWn96IQXpETd-U1rPpbb4FD27yQX1H0qoLGHVGWerC-tny6oVpudo78vaOPHigWebmr2ROo7JGK2qPu0hXFM Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 59a0c47de78642819343b750edf9933c Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:52.217318 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/59a0c47de78642819343b750edf9933c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59a0c47de78642819343b750edf9933c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59a0c47de78642819343b750edf9933c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_59a0c47de78642819343b750edf9933c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 59a0c47de78642819343b750edf9933c Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1426258858 Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-QuotasAdminNegativeTest-1426258858-project Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c0980bd1c4f74dbc9601752bd83a9ee5 Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-QuotasAdminNegativeTest-1426258858-project Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: {"quota_set": {"ram": 0}} Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 19 06:50:52.219465 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '59a0c47de78642819343b750edf9933c', 'body': {'quota_set': {'ram': 0}}} Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:50:52.221243 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:52.222535 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:52.223828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:52.223828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:52.223828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:52.223828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:52.223828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 19 06:50:52.223828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:52.229402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b57890dc-2243-4413-9e27-4ad9bdd706bd tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:52.229402 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b57890dc-2243-4413-9e27-4ad9bdd706bd tempest-QuotasAdminNegativeTest-1426258858 tempest-QuotasAdminNegativeTest-1426258858-project] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c" status: 403 len: 116 microversion: 2.1 time: 0.029588 Oct 19 06:50:52.229402 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 206/399] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:50:52 2022] PUT /compute/v2.1/os-quota-sets/59a0c47de78642819343b750edf9933c => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:52.238724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:52.240223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:52.248403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:52.249015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:52.249581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:52.250386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:52.250941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:52.251469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:52.460891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:52.475618 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f00c0cc7-f16a-4911-8bae-81c62a26f0c9 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1319 microversion: 2.1 time: 0.246272 Oct 19 06:50:52.477181 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 207/400] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:52 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:52.485269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:52.486447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:52.496631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:52.498191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:52.498893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:52.499968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:52.501057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:52.502101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:52.610639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:52.619988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:52.622173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:52.632515 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8027b013-e89c-4617-b935-2aa31e0dec4d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.153223 Oct 19 06:50:52.634494 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 208/401] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:52 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:52.640664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:52.641797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:52.649361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:52.649952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:52.650269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:52.651142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:52.651740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:52.659526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:52.895201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:52.909113 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce47f52f-d219-4674-ba01-867bf39e76a4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1469 microversion: 2.1 time: 0.273346 Oct 19 06:50:52.911467 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 209/402] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:52 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1469 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:53.505983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:53.506600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:53.519446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:53.526408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:53.526866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:53.531677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:53.533699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:53.534468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:53.978171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:53.992242 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72cd9db8-ee7b-4f7f-8ae6-13a0e0e259f1 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1319 microversion: 2.1 time: 0.490121 Oct 19 06:50:53.992829 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 210/403] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:53 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:54.331680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Calling method '.version_select at 0x7f6d65dead30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:54.333562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:54.334701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:54.335365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:54.356775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:54.357211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:54.357651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:54.372405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:54.373313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:54.374107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:54.382344 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-089a9619-e26a-48e4-acce-660b7db99e17 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.387380 Oct 19 06:50:54.383413 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 211/404] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:50:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:54.395143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:54.395946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:54.404527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:54.406429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:54.407061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:54.407996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:54.409340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:54.410009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:54.526405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:54.542241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:54.546013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:54.553516 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-88b525c8-f8c0-44ac-977d-95f16fc54170 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.161983 Oct 19 06:50:54.561777 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 212/405] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:54 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:54.561777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:54.564563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:54.596592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:54.598261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:54.598726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:54.599474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:54.604786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:54.605668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:55.138417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:55.152146 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e7be59f-b8ab-43db-bc1c-d7e307b0ca1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1469 microversion: 2.1 time: 0.595372 Oct 19 06:50:55.153063 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 213/406] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:54 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1469 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:55.372700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37961f06-41e5-4180-b314-480a71e62e9b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:55.393224 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37961f06-41e5-4180-b314-480a71e62e9b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.238788 Oct 19 06:50:55.398241 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 214/407] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:50:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:55.556401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8033900-a603-491b-b214-fb5d97a244a3 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] Calling method '.version_select at 0x7f6d64d46310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:55.558509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8033900-a603-491b-b214-fb5d97a244a3 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'f63f5ce74dd842af9c2099b408a90b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3feb478f51a4b12a76f0e62464706ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8033900-a603-491b-b214-fb5d97a244a3 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] Request method failure captured: Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/n-h1-861333-10/search HTTP/1.1 Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT55LkE5BONdaFmaSbQfD8WysLvl6RDGNDae8A6TcDjMKDa6G4DGUb5PPiWtjsxhABYjAnyvqEH98_MigDWnYOSDePbTTlS8lcH31lw0U7F69fCgpy2DxLNeTEJzxMo6-mG6N0y8zsKpEGoHOtgc5qvL2aYH98Vb6irEwrM0VvXWirss Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b3feb478f51a4b12a76f0e62464706ef Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1428174786 Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:55.560336 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3feb478f51a4b12a76f0e62464706ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3feb478f51a4b12a76f0e62464706ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3feb478f51a4b12a76f0e62464706ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3feb478f51a4b12a76f0e62464706ef", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1428174786 Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b3feb478f51a4b12a76f0e62464706ef Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1428174786 Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f63f5ce74dd842af9c2099b408a90b4b Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 19 06:50:55.561822 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'n-h1-861333-10'} Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:55.563298 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 19 06:50:55.566386 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:55.567400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8033900-a603-491b-b214-fb5d97a244a3 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:55.567400 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8033900-a603-491b-b214-fb5d97a244a3 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/n-h1-861333-10/search" status: 403 len: 117 microversion: 2.1 time: 0.166054 Oct 19 06:50:55.572073 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 215/408] 10.222.0.39 () {58 vars in 1212 bytes} [Wed Oct 19 06:50:55 2022] GET /compute/v2.1/os-hypervisors/n-h1-861333-10/search => generated 117 bytes in 173 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:55.582950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c24aa7d8-583d-4cf6-8fa0-aab67ac0d9d0 req-1e114cec-06bb-4bea-8588-479f94d21c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94fb96e-22d0-493e-9d10-80009cf6ebb9", "name": "network-vif-plugged", "status": "completed", "tag": "111330a2-4b6f-402e-9ce0-bbcdc21f670f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:55.595719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c24aa7d8-583d-4cf6-8fa0-aab67ac0d9d0 req-1e114cec-06bb-4bea-8588-479f94d21c4e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:55.596243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c24aa7d8-583d-4cf6-8fa0-aab67ac0d9d0 req-1e114cec-06bb-4bea-8588-479f94d21c4e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:55.596680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c24aa7d8-583d-4cf6-8fa0-aab67ac0d9d0 req-1e114cec-06bb-4bea-8588-479f94d21c4e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:55.610226 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c24aa7d8-583d-4cf6-8fa0-aab67ac0d9d0 req-1e114cec-06bb-4bea-8588-479f94d21c4e service nova] Creating event network-vif-plugged:111330a2-4b6f-402e-9ce0-bbcdc21f670f for instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 on n-h2-861333-10 Oct 19 06:50:55.615358 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c24aa7d8-583d-4cf6-8fa0-aab67ac0d9d0 req-1e114cec-06bb-4bea-8588-479f94d21c4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041875 Oct 19 06:50:55.617244 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 216/409] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:55.622340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:55.623691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:55.632362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:55.633038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:55.633634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:55.635037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:55.635037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:55.635326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:55.940011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:55.950196 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a3efcfc-2f8c-4e6e-a54a-92dd571970e7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1319 microversion: 2.1 time: 0.332815 Oct 19 06:50:55.963848 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 217/410] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:55 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:55.963848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-69c44a89-0cfa-4550-a9fe-d8c2524b9bfa req-38d574ae-a466-47bc-9446-5e9d757ce491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eee3fae-d46b-4976-8f84-a6d1295ddb45", "name": "network-vif-deleted", "tag": "97c607f1-08f7-44b2-8756-720b2e944a69"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:55.974564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-69c44a89-0cfa-4550-a9fe-d8c2524b9bfa req-38d574ae-a466-47bc-9446-5e9d757ce491 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:55.975079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-69c44a89-0cfa-4550-a9fe-d8c2524b9bfa req-38d574ae-a466-47bc-9446-5e9d757ce491 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:55.975512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-69c44a89-0cfa-4550-a9fe-d8c2524b9bfa req-38d574ae-a466-47bc-9446-5e9d757ce491 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:55.988745 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-69c44a89-0cfa-4550-a9fe-d8c2524b9bfa req-38d574ae-a466-47bc-9446-5e9d757ce491 service nova] Creating event network-vif-deleted:97c607f1-08f7-44b2-8756-720b2e944a69 for instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 on n-h1-861333-10 Oct 19 06:50:55.993806 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-69c44a89-0cfa-4550-a9fe-d8c2524b9bfa req-38d574ae-a466-47bc-9446-5e9d757ce491 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041018 Oct 19 06:50:55.994623 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 218/411] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:56.137556 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00a68a07-afca-4ef8-9b3d-074d96468c7c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c/action" status: 202 len: 0 microversion: 2.1 time: 4.913803 Oct 19 06:50:56.138764 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 194/412] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:50:51 2022] POST /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c/action => generated 0 bytes in 4916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:50:56.147063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66b2152e-fbd3-4072-9a45-8a53d39d38c8 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Calling method '.version_select at 0x7f6d64ff6d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.150802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66b2152e-fbd3-4072-9a45-8a53d39d38c8 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.152789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66b2152e-fbd3-4072-9a45-8a53d39d38c8 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.154504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66b2152e-fbd3-4072-9a45-8a53d39d38c8 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.171221 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-66b2152e-fbd3-4072-9a45-8a53d39d38c8 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66b2152e-fbd3-4072-9a45-8a53d39d38c8 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Request method failure captured: Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT55N7abCyL2IR4QfAwCaE0_ccK2xI1rqRjbMJWF7wO5GNFskvS7rgEG_PfLFCnBcw61UDCClpDcDL_Z6NTEqcGKqBAj2O49mAG-XawU-fnS2Y1aJrFEZfzWyJ0obfCM901uSB_BEJS6RFReZub_q_uUNovZIzuZyCpzx4lHgdpddhBM Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 12eb59f3583b4dc5be281a9cf01b4fce Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1956644564 Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:50:56.175262 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12eb59f3583b4dc5be281a9cf01b4fce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12eb59f3583b4dc5be281a9cf01b4fce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12eb59f3583b4dc5be281a9cf01b4fce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12eb59f3583b4dc5be281a9cf01b4fce", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1956644564 Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 12eb59f3583b4dc5be281a9cf01b4fce Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1956644564 Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 3a3e75bb2d6e4f5cbef4e02ef0ecd1f5 Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 06:50:56.176859 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:56.177760 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:56.179052 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:56.179052 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:56.179052 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:56.179052 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 06:50:56.179052 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:56.182044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66b2152e-fbd3-4072-9a45-8a53d39d38c8 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:56.183343 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66b2152e-fbd3-4072-9a45-8a53d39d38c8 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.043163 Oct 19 06:50:56.184121 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 195/413] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:56.199121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.199917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:56.219290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.219991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.220879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.223752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.224566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.225434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.314012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7b0c02a-7aa2-4def-acbe-4ee76ba0e698 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1101507590", "id": 1245314497, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:56.325601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:56.334772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:56.336282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:56.341869 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb94bd96-8c94-4fd5-9190-a1f16a3cb6dc tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.156577 Oct 19 06:50:56.342433 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 196/414] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:56.355552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.356196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:56.368641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.369522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.370013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.370883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.371352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.371916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.478890 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7b0c02a-7aa2-4def-acbe-4ee76ba0e698 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.482557 Oct 19 06:50:56.479486 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 219/415] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:55 2022] POST /compute/v2.1/flavors => generated 425 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:56.491175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.492018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:56.499558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.506210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.506210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.506210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.506210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.506571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.540900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:56.541556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.542124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.542629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.543150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lazy-loading 'fault' on Instance uuid 3eee3fae-d46b-4976-8f84-a6d1295ddb45 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:50:56.543864 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c1a60cc-d6c4-4b8c-8c0f-bd74b2be0ab5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.200443 Oct 19 06:50:56.544771 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 197/416] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:56.583008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Calling method '.version_select at 0x7f6d64ff6940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.586684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.589523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.590027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.605720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.606204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.606640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.617212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.617922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.618360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.618786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:56.621607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:56.625354 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2978fddd-c291-443b-abb9-9cd7f5e9dcde tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.079151 Oct 19 06:50:56.626967 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 198/417] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:56.627105 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8aa7ec6-e26f-4efd-87ff-bf56a02c5699 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 200 len: 1312 microversion: 2.1 time: 0.145843 Oct 19 06:50:56.628389 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 220/418] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:56.636994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6aa3280-eff7-4172-859e-761bd3750173 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] Calling method '.version_select at 0x7f6d64cd4430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.639031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6aa3280-eff7-4172-859e-761bd3750173 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'f63f5ce74dd842af9c2099b408a90b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3feb478f51a4b12a76f0e62464706ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6aa3280-eff7-4172-859e-761bd3750173 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] Request method failure captured: Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT55LkE5BONdaFmaSbQfD8WysLvl6RDGNDae8A6TcDjMKDa6G4DGUb5PPiWtjsxhABYjAnyvqEH98_MigDWnYOSDePbTTlS8lcH31lw0U7F69fCgpy2DxLNeTEJzxMo6-mG6N0y8zsKpEGoHOtgc5qvL2aYH98Vb6irEwrM0VvXWirss Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b3feb478f51a4b12a76f0e62464706ef Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1428174786 Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:50:56.641823 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3feb478f51a4b12a76f0e62464706ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3feb478f51a4b12a76f0e62464706ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3feb478f51a4b12a76f0e62464706ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3feb478f51a4b12a76f0e62464706ef", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1428174786 Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b3feb478f51a4b12a76f0e62464706ef Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1428174786 Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f63f5ce74dd842af9c2099b408a90b4b Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 19 06:50:56.642972 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1'} Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:50:56.644037 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 19 06:50:56.655501 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:56.657189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6aa3280-eff7-4172-859e-761bd3750173 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:56.657189 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6aa3280-eff7-4172-859e-761bd3750173 tempest-HypervisorAdminNegativeUnderV252Test-1428174786 tempest-HypervisorAdminNegativeUnderV252Test-1428174786-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.012637 Oct 19 06:50:56.657189 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 221/419] 10.222.0.39 () {58 vars in 1176 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:56.657391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f869963-9e42-4494-8f90-9bd656d3f63d tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.658465 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f869963-9e42-4494-8f90-9bd656d3f63d tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031203 Oct 19 06:50:56.659034 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 199/420] 10.222.0.39 () {58 vars in 1182 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:50:56.663654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2dd2e34e-8beb-409f-9b37-60fc05cae841 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Calling method '.version_select at 0x7f6d64f48790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.667318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2dd2e34e-8beb-409f-9b37-60fc05cae841 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.667318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2dd2e34e-8beb-409f-9b37-60fc05cae841 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.667318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2dd2e34e-8beb-409f-9b37-60fc05cae841 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.670667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-242e2376-294f-4aa7-8f04-2d808b1013dd tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-928087008", "id": 1066405721, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:56.689128 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-2dd2e34e-8beb-409f-9b37-60fc05cae841 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] HTTP exception thrown: No hypervisor matching 'c8fde6bd-8bf5-494a-b273-e9a996601da8' could be found. Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2dd2e34e-8beb-409f-9b37-60fc05cae841 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Request method failure captured: Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/c8fde6bd-8bf5-494a-b273-e9a996601da8/servers HTTP/1.1 Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT55N7abCyL2IR4QfAwCaE0_ccK2xI1rqRjbMJWF7wO5GNFskvS7rgEG_PfLFCnBcw61UDCClpDcDL_Z6NTEqcGKqBAj2O49mAG-XawU-fnS2Y1aJrFEZfzWyJ0obfCM901uSB_BEJS6RFReZub_q_uUNovZIzuZyCpzx4lHgdpddhBM Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 12eb59f3583b4dc5be281a9cf01b4fce Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1956644564 Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:50:56.691022 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12eb59f3583b4dc5be281a9cf01b4fce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12eb59f3583b4dc5be281a9cf01b4fce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12eb59f3583b4dc5be281a9cf01b4fce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12eb59f3583b4dc5be281a9cf01b4fce", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1956644564 Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 12eb59f3583b4dc5be281a9cf01b4fce Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1956644564 Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 3a3e75bb2d6e4f5cbef4e02ef0ecd1f5 Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: exception: No hypervisor matching 'c8fde6bd-8bf5-494a-b273-e9a996601da8' could be found. Oct 19 06:50:56.692222 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'c8fde6bd-8bf5-494a-b273-e9a996601da8'} Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'c8fde6bd-8bf5-494a-b273-e9a996601da8' could be found. Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:56.692895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:56.693894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:56.693894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:56.693894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:56.693894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:56.693894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'c8fde6bd-8bf5-494a-b273-e9a996601da8' could be found. Oct 19 06:50:56.693894 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:50:56.695429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2dd2e34e-8beb-409f-9b37-60fc05cae841 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] Returning 404 to user: No hypervisor matching 'c8fde6bd-8bf5-494a-b273-e9a996601da8' could be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:56.696518 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2dd2e34e-8beb-409f-9b37-60fc05cae841 tempest-HypervisorAdminNegativeUnderV252Test-1956644564 tempest-HypervisorAdminNegativeUnderV252Test-1956644564-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/c8fde6bd-8bf5-494a-b273-e9a996601da8/servers" status: 404 len: 123 microversion: 2.1 time: 0.037262 Oct 19 06:50:56.697273 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 222/421] 10.222.0.39 () {58 vars in 1281 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/os-hypervisors/c8fde6bd-8bf5-494a-b273-e9a996601da8/servers => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:56.741943 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-242e2376-294f-4aa7-8f04-2d808b1013dd tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.076551 Oct 19 06:50:56.749315 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 200/422] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:50:56 2022] POST /compute/v2.1/flavors => generated 424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:56.760144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b4f5feb-f965-4163-94cb-e5a5ade647a0 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.772362 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b4f5feb-f965-4163-94cb-e5a5ade647a0 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019954 Oct 19 06:50:56.780924 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 223/423] 10.222.0.39 () {58 vars in 1182 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:50:56.796182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64b7669b-2520-42ac-971a-25cdb443858e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Action: 'create', calling method: .version_select at 0x7f6d651b6b80>, body: {"keypair": {"name": "tempest-keypair-864135909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6l8t+HOJvKkLxSu9Ost+a9+6oJ5wUxgJ2T2hrb+cSzuo4bhdTnKywC6mHcKLsD0v/ZJW9qy3UWmKtV8h4I2tHwQB7cejYPCa45Ez62U8RN/5JVVIEWOplXp4IDx9av9w=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:56.830290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-64b7669b-2520-42ac-971a-25cdb443858e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Getting quotas for project 5c20a486a1684575950a9e9566635cc1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:50:56.835639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-64b7669b-2520-42ac-971a-25cdb443858e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Getting quotas for user 98bedc34dad443bbbd646b8ff2f5ed26 and project 5c20a486a1684575950a9e9566635cc1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:50:56.967755 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64b7669b-2520-42ac-971a-25cdb443858e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181676 Oct 19 06:50:56.969075 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 201/424] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 06:50:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:56.976663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:56.977471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:56.986704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.987293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.987939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:56.988900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:56.989555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:56.990262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:57.242102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:57.251066 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-506464d2-374c-4162-95c0-420f4e2e4b67 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1319 microversion: 2.1 time: 0.279926 Oct 19 06:50:57.251638 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 224/425] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:56 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:57.371878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:57.373116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:57.381200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:57.381991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:57.383210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:57.384075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:57.384917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:57.393727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:57.514077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:57.529468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:57.538487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:57.546754 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-667295c1-9ee1-49be-a4e1-dd4bf85b6e12 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.179291 Oct 19 06:50:57.564130 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 202/426] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:57 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:57.570539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:57.570539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:57.582962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:57.583571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:57.584149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:57.589145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:57.589768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:57.590329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:57.659779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:57.660500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: 3eee3fae-d46b-4976-8f84-a6d1295ddb45] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:57.674009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:57.674985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:57.675825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:57.676866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:57.679619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:57.680963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:57.716973 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] HTTP exception thrown: Instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 could not be found. Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Request method failure captured: Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 HTTP/1.1 Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT54WlRiVEu-XVj33ZVXIWkuJF8SgSuaUTio-RBXxJl0mGKMwKWqp8PI-VcgO7tYgL2WU7jDAdnSIGNS7p2ARtUleqHaFxW4DctrNzIGh85-muk0nFffeGITJM3Nuipl80nz2Wk3PQvgBQfjWtGNB7a7fO5fNXciECVc4iNfqpNzca3U Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c294e39032fd4538817ebdb2d62ac1b7 Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-710235845 Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:50:57.718831 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c294e39032fd4538817ebdb2d62ac1b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c294e39032fd4538817ebdb2d62ac1b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c294e39032fd4538817ebdb2d62ac1b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c294e39032fd4538817ebdb2d62ac1b7", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-710235845 Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c294e39032fd4538817ebdb2d62ac1b7 Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-710235845 Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-710235845-project Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c250b5dd666c4df89fcf483b04391a50 Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-710235845-project Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 could not be found. Oct 19 06:50:57.723429 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3eee3fae-d46b-4976-8f84-a6d1295ddb45'} Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 could not be found. Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:50:57.724611 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 could not be found. Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 could not be found. Oct 19 06:50:57.726306 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:50:57.729923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Returning 404 to user: Instance 3eee3fae-d46b-4976-8f84-a6d1295ddb45 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:50:57.732598 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba01e848-fbf0-46d6-86b1-1aed2ad9db26 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45" status: 404 len: 111 microversion: 2.1 time: 0.078828 Oct 19 06:50:57.734041 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 203/427] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:57 2022] GET /compute/v2.1/servers/3eee3fae-d46b-4976-8f84-a6d1295ddb45 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:50:57.745156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:57.748881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:57.768037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:57.768774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:57.772586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:57.775152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:57.775813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:57.778635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:57.848666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:50:57.940963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:57.953515 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8a9f551-c5f6-4466-8cc3-36e0890ba1b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.387779 Oct 19 06:50:57.954326 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 225/428] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:57 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:58.277410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:58.278426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:58.288575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:58.289965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:58.291081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:58.293699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:58.294366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:58.296498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:58.562117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:58.571431 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1e97bea-696c-45c3-800e-d600b709ef8f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1469 microversion: 2.1 time: 0.297990 Oct 19 06:50:58.573355 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 226/429] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:58 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1469 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:58.586701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:58.587321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:58.599283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:58.609592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:58.609592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:58.609592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:58.609592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:58.609993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:58.609993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:50:58.659550 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8024e03-bee9-42c5-8249-289a52382cb6 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 204 len: 0 microversion: 2.1 time: 0.919580 Oct 19 06:50:58.659966 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 204/430] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:50:57 2022] DELETE /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 0 bytes in 921 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:50:58.727164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:58.743381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:58.749156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:58.772009 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5ba39ec-86fc-489b-9e90-f74767925074 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.188993 Oct 19 06:50:58.785396 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 227/431] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:50:58 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:50:58.803597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:58.806269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:58.816344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:58.816344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:58.816344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:58.817508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:58.818190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:58.818823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:59.237505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:59.238356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:59.252531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:59.256647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:59.259094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:59.259939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:59.262284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:59.262729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:59.316972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:50:59.382943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:50:59.389549 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-296ef83b-5b72-49b7-8df1-7a2a5b3f21fd tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1476 microversion: 2.1 time: 0.596225 Oct 19 06:50:59.390119 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 228/432] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:58 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1476 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:50:59.418211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:59.425192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:59.446730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:59.447219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:59.447652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:59.448394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:59.448831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:59.449262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:59.697994 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e79cef1-b4f8-4dbf-aac3-e23c246479eb tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 204 len: 0 microversion: 2.1 time: 1.036718 Oct 19 06:50:59.698665 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 205/433] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:50:58 2022] DELETE /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:50:59.719409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-65d683ef-656a-46cf-9480-0d41e7ee1251 req-91b3595b-2549-405c-a17c-2bfdf4d294b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf535c5e-75cc-4e86-a7d7-6866903c675c", "name": "network-vif-unplugged", "status": "completed", "tag": "dadfbd32-34d8-4d27-bbd2-6e23781bea92"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:50:59.732504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-65d683ef-656a-46cf-9480-0d41e7ee1251 req-91b3595b-2549-405c-a17c-2bfdf4d294b9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:59.733347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-65d683ef-656a-46cf-9480-0d41e7ee1251 req-91b3595b-2549-405c-a17c-2bfdf4d294b9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:59.734608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-65d683ef-656a-46cf-9480-0d41e7ee1251 req-91b3595b-2549-405c-a17c-2bfdf4d294b9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:59.747586 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-65d683ef-656a-46cf-9480-0d41e7ee1251 req-91b3595b-2549-405c-a17c-2bfdf4d294b9 service nova] Creating event network-vif-unplugged:dadfbd32-34d8-4d27-bbd2-6e23781bea92 for instance cf535c5e-75cc-4e86-a7d7-6866903c675c on n-h2-861333-10 Oct 19 06:50:59.753385 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-65d683ef-656a-46cf-9480-0d41e7ee1251 req-91b3595b-2549-405c-a17c-2bfdf4d294b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040015 Oct 19 06:50:59.754281 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 206/434] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:50:59.770908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:50:59.778234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:50:59.790840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:59.794364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:59.795038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:59.800257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:50:59.802735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:50:59.802735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:50:59.993238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:00.004201 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d3534eaf-62d3-495a-af8a-cb5001f091a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.605076 Oct 19 06:51:00.004988 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 229/435] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:59 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:00.016338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:00.017193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:00.040949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:00.043644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:00.048728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:00.050010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:00.050718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:00.051361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:00.281510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:00.301800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:00.303244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:00.318652 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd91d6e4-c001-4dac-9d88-6fbcdc6c5fa2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.309087 Oct 19 06:51:00.319240 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 230/436] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:00 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:00.360417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:00.360417 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39afaccb-d68b-44e3-9606-138bee4b2407 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1475 microversion: 2.1 time: 0.600392 Oct 19 06:51:00.360417 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 207/437] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:50:59 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1475 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:00.416326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:00.417960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:00.438956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:00.439532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:00.440040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:00.440917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:00.441382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:00.441895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:00.625332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1681129277", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:00.717283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:51:00.859602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:00.870035 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3ed91ce-b500-4890-a5b3-e2c24c5859f4 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1476 microversion: 2.1 time: 0.458172 Oct 19 06:51:00.872644 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 208/438] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:00 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1476 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:01.032912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:01.033525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:01.046899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:01.050837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:01.056184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:01.056184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:01.060520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:01.061123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:01.158805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:01.428080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:01.505648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:01.531840 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-063793b8-198d-4768-b179-8fe23bddee18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.504065 Oct 19 06:51:01.534593 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 209/439] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:01 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:01.574164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:01.576984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:01.590050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:01.590542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:01.590983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:01.591695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:01.592190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:01.592606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:01.626666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=17 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:01.787611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:01.800534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:01.805560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:01.823734 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-888f1c1e-b4ba-41bb-b5d6-03da6ec2f529 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.284961 Oct 19 06:51:01.824527 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 210/440] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:01 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:01.832402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:01.833036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:01.842430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:01.842910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:01.843632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:01.844599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:01.845174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:01.845839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.087648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:02.098426 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9f185d0-e81e-4dec-8738-9643f9c7032f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1475 microversion: 2.1 time: 0.270162 Oct 19 06:51:02.099228 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 211/441] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:01 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1475 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:02.121719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:02.122370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:02.129745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:02.130376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:02.133824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.134571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:02.135072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:02.135471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.407478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:02.415755 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b914229-cbe4-4559-8620-79c8fd9d8e1b tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1476 microversion: 2.1 time: 0.297959 Oct 19 06:51:02.424649 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 212/442] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:02 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:02.509756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:02.510377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:02.511185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:02.511756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:02.512641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:02.536136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:02.540221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:02.543355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.547957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:02.550383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:02.553083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.557838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:02.561986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:02.570732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:02.575994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:02.576507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.577403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:02.581974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:02.582664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.623726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Getting quotas for project e0c1b9404e43444f805bea3a620bd5a3. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:02.642542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Getting quotas for user 9180029316e04d02bab52adfe49f26e5 and project e0c1b9404e43444f805bea3a620bd5a3. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:02.662285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:51:02.665620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:51:02.812942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:02.823793 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dfe485e-04b1-41bb-a9f7-6081532ebf2f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.270110 Oct 19 06:51:02.838409 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 213/443] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:02 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:02.849649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ec389424-ef91-49e4-9076-a5e8ed5be960 req-e0ea2c85-b259-4191-8849-1adf1bc488b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf535c5e-75cc-4e86-a7d7-6866903c675c", "tag": "dadfbd32-34d8-4d27-bbd2-6e23781bea92"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:02.862242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec389424-ef91-49e4-9076-a5e8ed5be960 req-e0ea2c85-b259-4191-8849-1adf1bc488b8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:02.863115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec389424-ef91-49e4-9076-a5e8ed5be960 req-e0ea2c85-b259-4191-8849-1adf1bc488b8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:02.863761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec389424-ef91-49e4-9076-a5e8ed5be960 req-e0ea2c85-b259-4191-8849-1adf1bc488b8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.877299 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ec389424-ef91-49e4-9076-a5e8ed5be960 req-e0ea2c85-b259-4191-8849-1adf1bc488b8 service nova] Creating event network-changed:dadfbd32-34d8-4d27-bbd2-6e23781bea92 for instance cf535c5e-75cc-4e86-a7d7-6866903c675c on n-h2-861333-10 Oct 19 06:51:02.884512 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ec389424-ef91-49e4-9076-a5e8ed5be960 req-e0ea2c85-b259-4191-8849-1adf1bc488b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039116 Oct 19 06:51:02.886363 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 214/444] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:02.893417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:02.894437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:02.896949 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f49b60a9-b83f-40a5-ad39-c218bb1593b9 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.575316 Oct 19 06:51:02.903981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:02.904876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:02.904998 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 231/445] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:51:02.906182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.907186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:02.907824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:02.908528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:02.915501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59ead99d-fc16-4188-b5b6-294ccc1a16a7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:02.916849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59ead99d-fc16-4188-b5b6-294ccc1a16a7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:02.932549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:03.252718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59ead99d-fc16-4188-b5b6-294ccc1a16a7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:03.272518 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59ead99d-fc16-4188-b5b6-294ccc1a16a7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1223 microversion: 2.1 time: 0.365560 Oct 19 06:51:03.275439 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 232/446] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:02 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1223 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:03.289110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:03.291229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:03.301279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:03.303995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:03.305046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:03.305980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:03.307340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:03.308961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:03.348650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:03.364775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:03.366232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:03.379577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:03.389944 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43de3110-ef43-4c2d-ab2d-b4aa49c1d006 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.502155 Oct 19 06:51:03.393012 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 215/447] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:02 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:03.461777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:03.462653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:03.476008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:03.476578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:03.481795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:03.482183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:03.486101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:03.486560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:03.959745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:03.970842 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e13310ef-2e5b-4aa1-8d50-d295a8ccb714 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1475 microversion: 2.1 time: 0.689910 Oct 19 06:51:03.971428 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 233/448] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:03 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1475 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:03.989610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:03.999328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:04.007856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:04.008586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:04.009346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:04.010378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:04.010984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:04.011604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:04.162455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:04.179728 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09efb5b3-1fff-4599-8c1b-abf4b70969c1 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1476 microversion: 2.1 time: 0.734520 Oct 19 06:51:04.180745 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 216/449] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:03 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1476 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:04.193645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-604836411", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "1066405721", "adminPass": "***", "networks": [{"uuid": "22d08965-0b3f-49c9-85c6-d5880d8fee48"}], "security_groups": [{"name": "tempest-securitygroup--1287056228"}], "key_name": "tempest-keypair-864135909", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:04.415882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:04.425093 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1873689-7a0e-40ff-b4f1-7f5e59de6354 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.444668 Oct 19 06:51:04.426191 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 234/450] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:03 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:04.464752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:04.469347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:04.483665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:04.484718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:04.497811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:04.502576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:04.505318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:04.506411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:04.592388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] validate_networks() for [('22d08965-0b3f-49c9-85c6-d5880d8fee48', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:51:04.627698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:04.635857 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46595244-ed31-4aa5-98e3-9c94c7b48b71 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1227 microversion: 2.1 time: 0.208337 Oct 19 06:51:04.637658 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 235/451] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:04 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1227 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:04.642718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:04.643522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:04.654879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:04.655570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:04.658044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:04.659054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:04.659880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:04.660586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:04.759831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:04.777957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:04.785913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:04.799375 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a9d121e-e1a7-4b9e-89c2-a2ceb733c42d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.160348 Oct 19 06:51:04.800810 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 236/452] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:04 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:04.928790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-bd30a8c6-ba90-45f1-8c7c-cdf6255775e2 req-91a78a0a-446e-446c-946f-506a1720efb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94fb96e-22d0-493e-9d10-80009cf6ebb9", "name": "network-vif-deleted", "tag": "111330a2-4b6f-402e-9ce0-bbcdc21f670f"}, {"server_uuid": "a8494338-c7cd-45d0-a10c-44f411189512", "name": "network-vif-deleted", "tag": "67919d54-1f84-4a84-b595-a64f27391900"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:04.979253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bd30a8c6-ba90-45f1-8c7c-cdf6255775e2 req-91a78a0a-446e-446c-946f-506a1720efb2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:04.981298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bd30a8c6-ba90-45f1-8c7c-cdf6255775e2 req-91a78a0a-446e-446c-946f-506a1720efb2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:04.986206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bd30a8c6-ba90-45f1-8c7c-cdf6255775e2 req-91a78a0a-446e-446c-946f-506a1720efb2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.012504 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-bd30a8c6-ba90-45f1-8c7c-cdf6255775e2 req-91a78a0a-446e-446c-946f-506a1720efb2 service nova] Creating event network-vif-deleted:111330a2-4b6f-402e-9ce0-bbcdc21f670f for instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 on n-h2-861333-10 Oct 19 06:51:05.017612 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-bd30a8c6-ba90-45f1-8c7c-cdf6255775e2 req-91a78a0a-446e-446c-946f-506a1720efb2 service nova] Creating event network-vif-deleted:67919d54-1f84-4a84-b595-a64f27391900 for instance a8494338-c7cd-45d0-a10c-44f411189512 on n-h2-861333-10 Oct 19 06:51:05.024384 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-bd30a8c6-ba90-45f1-8c7c-cdf6255775e2 req-91a78a0a-446e-446c-946f-506a1720efb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100363 Oct 19 06:51:05.025289 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 237/453] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:51:05.033341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:05.041886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:05.050421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.051871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.052670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.053726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.054535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.056060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.132402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.132402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.132402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.132402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lazy-loading 'fault' on Instance uuid f94fb96e-22d0-493e-9d10-80009cf6ebb9 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:05.200742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:05.241962 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec50650e-771f-478c-8029-ddb7d2e5878a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 200 len: 1309 microversion: 2.1 time: 0.214832 Oct 19 06:51:05.243212 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 238/454] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:05 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 1309 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:05.253484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:05.257496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:05.264536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.266240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.267054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.268047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.268744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.269961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.326229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.327566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.332714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.333382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lazy-loading 'fault' on Instance uuid a8494338-c7cd-45d0-a10c-44f411189512 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:05.427696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b5dd666c4df89fcf483b04391a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294e39032fd4538817ebdb2d62ac1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:05.455314 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68d97c3d-035d-4f26-a549-fbc155ea40df tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 200 len: 1311 microversion: 2.1 time: 0.208916 Oct 19 06:51:05.459774 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 239/455] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:05 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:05.476763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:05.477525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:05.501665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.503806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.504010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.506988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.507524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.509304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.766652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:05.798861 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a82635e4-0f89-4dfe-8bbd-7447ecc5442d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.314416 Oct 19 06:51:05.798861 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 240/456] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:05 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:05.805455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:05.806139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:05.815635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.816272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.821612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.821612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.821612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.821612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.860820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:05.862000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:05.862474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:05.862954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:05.863605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:05.877289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.881157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.881843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.882809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:05.884598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:05.885307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:05.902881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:05.928394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Getting quotas for project 5c20a486a1684575950a9e9566635cc1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:05.936688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Getting quotas for user 98bedc34dad443bbbd646b8ff2f5ed26 and project 5c20a486a1684575950a9e9566635cc1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:05.957985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:51:05.961542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:05.971187 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f27cea5-a948-412f-836d-6bd6055adc9d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1275 microversion: 2.1 time: 0.173143 Oct 19 06:51:05.973964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:51:05.984825 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 241/457] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:05 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:05.993451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:05.995039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:06.019592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:06.022916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:06.023570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:06.024537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:06.025975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:06.026599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:06.150633 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ecdb9d6-d825-4a46-a4c7-0986b81cd959 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.968523 Oct 19 06:51:06.153812 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 217/458] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:51:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:51:06.172078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:06.183363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:06.194326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:06.212578 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26aa396c-8ac2-43c7-8d96-d8d9ee06be53 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.226537 Oct 19 06:51:06.213966 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 242/459] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:05 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:06.238276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ae35848-7bae-4505-a286-29e2d6bbcfac tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:06.244384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ae35848-7bae-4505-a286-29e2d6bbcfac tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:06.395611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ae35848-7bae-4505-a286-29e2d6bbcfac tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:06.405755 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ae35848-7bae-4505-a286-29e2d6bbcfac tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1263 microversion: 2.1 time: 0.190228 Oct 19 06:51:06.423541 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 243/460] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:06 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:06.440400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:06.441030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:06.467786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:06.468848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:06.475656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:06.486731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:06.487227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:06.487672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:06.527647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1101749245", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:06.536392 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] HTTP exception thrown: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Request method failure captured: Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 HTTP/1.1 Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT549h4_s69-zOn6bOJa38phHWMu-VGBKcdEkodvRVNmiijl15E_YOYNVe-M8q0Id7yIZtwAQL6OW8Dl3qyX5U8nN1eM_BXzUJwUc0RK9dgCYy6av1W80LGvSa7HPn5Jg2Yb3luKz59K7gP4DUfNlrnrR2x3BE-VpU9CFeFDjgD3k_ko Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:51:06.543628 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0587af802f4f4b98aca0da31c1944b4b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 32e7566840814f1fa1d2c765bdada925 Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:06.544867 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'f94fb96e-22d0-493e-9d10-80009cf6ebb9'} Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:06.545555 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:06.547228 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.552628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Returning 404 to user: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:06.553602 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f31472b-37c7-4b25-b281-0957ea590683 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 404 len: 111 microversion: 2.1 time: 0.128822 Oct 19 06:51:06.554186 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 244/461] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:06 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:06.560661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:06.560661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] [instance: a8494338-c7cd-45d0-a10c-44f411189512] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:06.583657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:06.589083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:06.590715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:06.592336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:06.594370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:06.596349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:06.633440 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] HTTP exception thrown: Instance a8494338-c7cd-45d0-a10c-44f411189512 could not be found. Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Request method failure captured: Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 HTTP/1.1 Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54WlRiVEu-XVj33ZVXIWkuJF8SgSuaUTio-RBXxJl0mGKMwKWqp8PI-VcgO7tYgL2WU7jDAdnSIGNS7p2ARtUleqHaFxW4DctrNzIGh85-muk0nFffeGITJM3Nuipl80nz2Wk3PQvgBQfjWtGNB7a7fO5fNXciECVc4iNfqpNzca3U Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c294e39032fd4538817ebdb2d62ac1b7 Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-710235845 Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:51:06.635040 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c294e39032fd4538817ebdb2d62ac1b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c294e39032fd4538817ebdb2d62ac1b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c294e39032fd4538817ebdb2d62ac1b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c294e39032fd4538817ebdb2d62ac1b7", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-710235845 Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c294e39032fd4538817ebdb2d62ac1b7 Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-710235845 Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersAdminNegativeTestJSON-710235845-project Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c250b5dd666c4df89fcf483b04391a50 Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-710235845-project Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance a8494338-c7cd-45d0-a10c-44f411189512 could not be found. Oct 19 06:51:06.642475 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'a8494338-c7cd-45d0-a10c-44f411189512'} Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8494338-c7cd-45d0-a10c-44f411189512 could not be found. Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:06.643429 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8494338-c7cd-45d0-a10c-44f411189512 could not be found. Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8494338-c7cd-45d0-a10c-44f411189512 could not be found. Oct 19 06:51:06.644876 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:06.645929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] Returning 404 to user: Instance a8494338-c7cd-45d0-a10c-44f411189512 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:06.645929 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b2f4c17-b10d-4cd3-ab12-785c0a6ca461 tempest-ServersAdminNegativeTestJSON-710235845 tempest-ServersAdminNegativeTestJSON-710235845-project] 10.222.0.39 "GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512" status: 404 len: 111 microversion: 2.1 time: 0.081323 Oct 19 06:51:06.645929 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 245/462] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:06 2022] GET /compute/v2.1/servers/a8494338-c7cd-45d0-a10c-44f411189512 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:06.693190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:06.694687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:06.695952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:06.697044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:06.699242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:06.733363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:06.735149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:06.736063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:06.739837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:06.742939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:06.743552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:06.802572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Getting quotas for project 185c53532d5b4a1aa230c3b6e7372121. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:06.809289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Getting quotas for user 68286a193ef048c8997eb1fdb0ecfe7c and project 185c53532d5b4a1aa230c3b6e7372121. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:06.813591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2139850151", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:06.856329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:51:06.858526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:51:06.945390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:51:07.024973 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c7fec5a-1595-45e2-9190-f86f9bfe1cd5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.869427 Oct 19 06:51:07.026135 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 218/463] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 06:51:07.033092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:07.034126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:07.046943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:07.047446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:07.047902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:07.048826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:07.049294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:07.049725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:07.302734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:07.305070 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54c47bd6-cbec-423a-a3e9-15647b1f0dea tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.277880 Oct 19 06:51:07.320593 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 219/464] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:07 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:07.326248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:07.327096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:07.334195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:07.334899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:07.335530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:07.336767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:07.337376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:07.337947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:07.447294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:07.455832 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9541732a-611e-431f-8b98-22d1cea8fd1f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1281 microversion: 2.1 time: 0.134079 Oct 19 06:51:07.457631 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 220/465] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:07 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:07.462937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3161fd5b-9b21-4b7e-9cc9-29d301fee078 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:07.465596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3161fd5b-9b21-4b7e-9cc9-29d301fee078 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:07.566937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3161fd5b-9b21-4b7e-9cc9-29d301fee078 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:07.580230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3161fd5b-9b21-4b7e-9cc9-29d301fee078 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:07.581686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3161fd5b-9b21-4b7e-9cc9-29d301fee078 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:07.599619 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3161fd5b-9b21-4b7e-9cc9-29d301fee078 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "PUT /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1359 microversion: 2.75 time: 0.140661 Oct 19 06:51:07.605678 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 221/466] 10.222.0.39 () {62 vars in 1297 bytes} [Wed Oct 19 06:51:07 2022] PUT /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:07.623478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:07.624085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:07.647271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:07.647776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:07.648247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:07.657084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:07.657084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:07.657084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:07.724016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:07.724637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:07.725210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:07.725849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:07.726482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:07.738439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:07.739114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:07.739840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:07.740531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:07.742149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:07.742802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:07.743389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:07.753964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:07.755424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:07.770647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Getting quotas for project 0587af802f4f4b98aca0da31c1944b4b. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:07.771234 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e08a26e-8c4a-49b5-92bc-cebfa364001f tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.164416 Oct 19 06:51:07.775787 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 222/467] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:07 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:07.777741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Getting quotas for user 32e7566840814f1fa1d2c765bdada925 and project 0587af802f4f4b98aca0da31c1944b4b. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:07.786605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c31d93f0-d053-4515-be09-7c2472514f4a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:07.787462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c31d93f0-d053-4515-be09-7c2472514f4a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:07.795584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:51:07.799412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:51:07.903038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c31d93f0-d053-4515-be09-7c2472514f4a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:07.910955 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c31d93f0-d053-4515-be09-7c2472514f4a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1263 microversion: 2.1 time: 0.133973 Oct 19 06:51:07.920541 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 223/468] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:07 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1263 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:07.926886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c46b56b-1278-4b5c-b0f1-55e43c34de22 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:07.927751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c46b56b-1278-4b5c-b0f1-55e43c34de22 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:08.003264 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6dfdd04-4f33-42db-94ef-87065e0c4e5f tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.192944 Oct 19 06:51:08.004097 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 246/469] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:51:08.019931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14469868-999f-4037-8c66-0903b2837efa tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:08.021558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14469868-999f-4037-8c66-0903b2837efa tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:08.074518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c46b56b-1278-4b5c-b0f1-55e43c34de22 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:08.090272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c46b56b-1278-4b5c-b0f1-55e43c34de22 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:08.091842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c46b56b-1278-4b5c-b0f1-55e43c34de22 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:08.103978 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c46b56b-1278-4b5c-b0f1-55e43c34de22 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1359 microversion: 2.75 time: 0.181967 Oct 19 06:51:08.104852 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 224/470] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:07 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:08.216630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14469868-999f-4037-8c66-0903b2837efa tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:08.228350 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14469868-999f-4037-8c66-0903b2837efa tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1220 microversion: 2.1 time: 0.216260 Oct 19 06:51:08.239227 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 247/471] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:08 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1220 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:08.332857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:08.333893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:08.364643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:08.365951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:08.366920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:08.367983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:08.369707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:08.370399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:08.486119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:08.486737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:08.497703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:08.501221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:08.501679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:08.504866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:08.507899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:08.507899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:08.755455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:08.780395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d07e0f3-32cd-4ca0-95e8-ff1565dd294d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.436157 Oct 19 06:51:08.780395 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 225/472] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:08 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:08.817085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:08.817870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:08.830918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:08.833430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:08.834268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:08.837399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:08.838627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:08.840079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:08.961216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:08.973425 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c3a23f1-3ccc-4588-9b10-739bd313d0ee tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1323 microversion: 2.1 time: 0.491989 Oct 19 06:51:08.974652 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 248/473] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:08 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:08.993713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:08.999399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:09.001237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:09.004746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:09.011668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:09.036581 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-99bbf309-a94c-489f-bd2b-560dfd848f00 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.215767 Oct 19 06:51:09.036757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:09.036835 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 226/474] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:08 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:09.036905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:09.036905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:09.036905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:09.037115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:09.037115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:09.078972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:09.136824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:09.137593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:09.147516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:09.152456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:09.153005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:09.154046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:09.154736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:09.156097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:09.185418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:09.206422 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b1f2352-89e7-4cd0-a016-df996aeee199 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1315 microversion: 2.1 time: 0.219963 Oct 19 06:51:09.223667 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 249/475] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:08 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:09.255671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ba18e0c-5167-4465-9001-f3555be8053d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:09.256463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ba18e0c-5167-4465-9001-f3555be8053d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:09.283751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:09.297462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:09.299482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:09.311068 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce1a72d3-b439-4de9-b9eb-f7073e60918f tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1363 microversion: 2.75 time: 0.178093 Oct 19 06:51:09.312158 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 227/476] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:09 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:09.338364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ba18e0c-5167-4465-9001-f3555be8053d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:09.346651 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ba18e0c-5167-4465-9001-f3555be8053d tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1220 microversion: 2.1 time: 0.095025 Oct 19 06:51:09.349701 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 250/477] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:09 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:09.788918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:09.789047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:09.798355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:09.803216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:09.803216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:09.803216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:09.803216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:09.803586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:09.999940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:10.000596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:10.010733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.011227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.011658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.012379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.019673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.020629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.027721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.038473 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a786f45-c3c5-4a5f-844a-3662832aa1df tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.253912 Oct 19 06:51:10.039685 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 228/478] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:09 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:10.059278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:10.060165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:10.077567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.078858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.084819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.086027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.086667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.087681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.213383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.227252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.240660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.252958 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c2a15a1-127d-46d1-a245-d4c3a756771e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.197596 Oct 19 06:51:10.253553 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 229/479] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:10 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:51:10.260524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:10.261301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:10.288960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.289466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.289912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.290626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.291207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.291634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.429680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.440005 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5b03596-e298-46a1-af25-c7802bc88036 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1323 microversion: 2.1 time: 0.184837 Oct 19 06:51:10.441476 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 230/480] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:10 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:10.485249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4d916035-5f75-4206-a69e-2213e42fae0c req-9db7b211-ee69-4c17-ae64-7ae2115a6ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357a0b94-6975-4406-b90e-86c6f9a6bdd9", "tag": "b27d7bd9-cb5c-473d-a0d3-ac635278856e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:10.522885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4d916035-5f75-4206-a69e-2213e42fae0c req-9db7b211-ee69-4c17-ae64-7ae2115a6ae3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.523375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4d916035-5f75-4206-a69e-2213e42fae0c req-9db7b211-ee69-4c17-ae64-7ae2115a6ae3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.527327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4d916035-5f75-4206-a69e-2213e42fae0c req-9db7b211-ee69-4c17-ae64-7ae2115a6ae3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.534617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.544011 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8584bc91-32a9-40ec-a9ae-a0a36944cdf7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1323 microversion: 2.1 time: 0.550368 Oct 19 06:51:10.544706 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 251/481] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:09 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:10.553629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:10.554624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:10.561631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.562897 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4d916035-5f75-4206-a69e-2213e42fae0c req-9db7b211-ee69-4c17-ae64-7ae2115a6ae3 service nova] Creating event network-changed:b27d7bd9-cb5c-473d-a0d3-ac635278856e for instance 357a0b94-6975-4406-b90e-86c6f9a6bdd9 on n-h1-861333-10 Oct 19 06:51:10.563038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.563515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.564483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.566095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.566771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.569057 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4d916035-5f75-4206-a69e-2213e42fae0c req-9db7b211-ee69-4c17-ae64-7ae2115a6ae3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108623 Oct 19 06:51:10.569891 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 231/482] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:10.575240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:10.575980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:10.582515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.582994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.583690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.584629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:10.585291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:10.586907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:10.708612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.719424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.720924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.728951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:10.729424 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1506f691-4ceb-4285-8a85-48cdad28b22e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1216 microversion: 2.1 time: 0.156913 Oct 19 06:51:10.742048 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 232/483] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:10 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:10.743244 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18990946-85bc-4e00-adef-5306528957bd tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1411 microversion: 2.75 time: 0.196604 Oct 19 06:51:10.745072 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 252/484] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:10 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1411 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:11.071876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:11.074147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:11.087119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.097096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.100850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:11.101680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.102165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.102600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:11.283963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:11.285176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:11.294645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.297283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.298224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:11.303807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.304475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.311151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:11.676690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:11.689028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:11.697971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:11.706796 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b2099d77-7f3c-4608-a529-f63b39181de4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.427521 Oct 19 06:51:11.712881 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 253/485] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:11 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:51:11.717943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:11.723038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:11.741076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.741570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.742008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:11.742713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.743170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.743601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:11.767374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:11.782225 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37addc67-7c96-425f-a337-66b2b7a821e5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.716496 Oct 19 06:51:11.785378 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 233/486] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:11 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:11.794983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:11.802258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:11.816037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.816904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.819357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:11.820809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.823324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.834949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:11.904167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:11.917601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47eeb9b9-6cb5-4aa5-9701-ea0fc1c794ce tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1321 microversion: 2.1 time: 0.202950 Oct 19 06:51:11.925309 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 254/487] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:11 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:11.935774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:11.938166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:11.950511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.951467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.951467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:11.952191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:11.952653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:11.953647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:12.112164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:12.121910 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-508cd60b-e8ae-4bc0-85d8-004064cf03b0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1272 microversion: 2.1 time: 0.194713 Oct 19 06:51:12.123043 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 255/488] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:11 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:12.130959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:12.131569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:12.147309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:12.147821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:12.148293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:12.149009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:12.149464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:12.152519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:12.277625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:12.316388 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1cf3864-809a-4228-b9a7-d41322e7a9cc tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1323 microversion: 2.1 time: 0.520310 Oct 19 06:51:12.325885 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 234/489] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:11 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:12.475285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:12.490795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:12.492265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:12.502162 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b715514-e0b5-495f-8d9f-5165ff682659 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1417 microversion: 2.75 time: 0.377798 Oct 19 06:51:12.503741 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 256/490] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:12 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1417 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:12.743490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:12.744628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:12.755002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:12.755829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:12.756835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:12.760231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:12.760231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:12.760231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:12.811210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:12.812719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:12.818780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:12.819264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:12.819702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:12.820423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:12.821038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:12.821618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:12.881881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:12.891956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:12.893737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:12.899628 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7092d5b-3d45-4be8-ac7f-3ee9a4e1c036 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.160621 Oct 19 06:51:12.900844 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 235/491] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:12 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:12.951462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:12.952554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:12.961699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:12.963455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:12.964624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:12.969142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:12.969142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:12.969142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:13.171681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:13.183931 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9536703f-5309-48ac-958e-2eea719e4682 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.376420 Oct 19 06:51:13.185517 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 257/492] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:12 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:13.191479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:13.192199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:13.198949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:13.199687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:13.200347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:13.201377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:13.201906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:13.202325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:13.294027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:13.303341 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67e156c5-f41b-48c9-9557-19d7cf3d3ff0 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1280 microversion: 2.1 time: 0.116628 Oct 19 06:51:13.303948 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 258/493] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:13 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1280 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:13.348450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:13.348799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:13.360448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:13.361107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:13.361555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:13.362406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:13.362867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:13.363296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:13.399646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:13.411092 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86b9112f-62e0-47d3-af31-b275afbe16d9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1389 microversion: 2.1 time: 0.466746 Oct 19 06:51:13.412546 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 236/494] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:12 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1389 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:13.530714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:13.531238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:13.541283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:13.541780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:13.542217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:13.542915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:13.552906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:13.553350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:13.726275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:13.737995 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57730184-2802-4c10-ba99-e9763f7db838 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1323 microversion: 2.1 time: 0.393563 Oct 19 06:51:13.741385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:13.742524 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 259/495] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:13 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:13.768974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:13.772713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:13.784297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:13.786182 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fffc66b1-bb68-40d0-b466-c60d960cd6e4 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1417 microversion: 2.75 time: 0.259337 Oct 19 06:51:13.792881 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 237/496] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:13 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1417 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:51:13.929132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:13.929749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:13.942097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:13.942884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:13.943499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:13.944945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:13.947217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:13.947674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.087572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:14.099749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:14.107260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:14.114353 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38a4546f-62c4-4dc7-bb6c-4301df77b3af tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.189082 Oct 19 06:51:14.115415 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 260/497] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:13 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:51:14.210836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:14.211476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:14.218098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.218614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.219047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.219750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.220223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.228430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.344973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:14.346112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:14.357714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.358808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.359787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.360819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.361480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.362747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.496317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:14.505657 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a614417-d81c-476e-bd7c-a6fa2fa4fe60 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1278 microversion: 2.1 time: 0.180828 Oct 19 06:51:14.506939 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 261/498] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:14 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:14.512300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:14.513388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:14.521733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.525367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.525367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.525367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.525642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.525642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.781495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:14.798399 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d24dc8d-d890-4552-90ad-fb235955278a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1389 microversion: 2.1 time: 0.290067 Oct 19 06:51:14.799608 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 262/499] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:14 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1389 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:14.807287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:14.811450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:14.817024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:14.821007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.821531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.821964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.824432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.824432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.824432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.949921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:14.954441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:14.960571 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86b3f6ef-9ad0-4e91-b65e-0d7b58e78d47 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1503 microversion: 2.1 time: 0.753841 Oct 19 06:51:14.962157 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 238/500] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:14 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1503 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:14.967546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:14.968379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:14.974716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.975376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.977286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:14.977286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:14.977286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:14.978088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.049752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:15.060159 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6695ce7d-8ba0-4947-89dc-f44c44416d31 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1323 microversion: 2.1 time: 0.259189 Oct 19 06:51:15.061446 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 263/501] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:14 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:15.106037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:15.114977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:15.116622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:15.121831 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39baa5d7-afc0-470b-a856-65eb7bfcdd2c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1438 microversion: 2.75 time: 0.158503 Oct 19 06:51:15.122503 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 239/502] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:14 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1438 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:15.146556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:15.147458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:15.154548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:15.164483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.164483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.164483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.164483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.164864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.164950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:15.165127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.169159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.169974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.170689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.172185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.172794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.173370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.279445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:15.280977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:15.281581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:15.282101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:15.282508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:15.282911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:15.291925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:15.293994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:15.301398 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce5d5eeb-e00c-4469-b6f8-43ba0566e2b7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.161614 Oct 19 06:51:15.328517 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 264/503] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:15 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:15.334172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c2556367-52f6-4844-b5c4-02dca40e7e0e req-4afcdcb8-be5e-4111-87ba-d065fa6f9143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe37e8c6-900b-4c99-bc7c-2511c6d8108f", "tag": "e0e59f88-59bd-479d-a40f-9b5af6c40d02"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:15.344917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c2556367-52f6-4844-b5c4-02dca40e7e0e req-4afcdcb8-be5e-4111-87ba-d065fa6f9143 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.345554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c2556367-52f6-4844-b5c4-02dca40e7e0e req-4afcdcb8-be5e-4111-87ba-d065fa6f9143 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.346173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c2556367-52f6-4844-b5c4-02dca40e7e0e req-4afcdcb8-be5e-4111-87ba-d065fa6f9143 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.360944 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c2556367-52f6-4844-b5c4-02dca40e7e0e req-4afcdcb8-be5e-4111-87ba-d065fa6f9143 service nova] Creating event network-changed:e0e59f88-59bd-479d-a40f-9b5af6c40d02 for instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f on n-h2-861333-10 Oct 19 06:51:15.371759 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c2556367-52f6-4844-b5c4-02dca40e7e0e req-4afcdcb8-be5e-4111-87ba-d065fa6f9143 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040957 Oct 19 06:51:15.372570 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 265/504] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:15.541441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:15.547314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:15.555232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.555920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.556596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.557633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.558463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.569076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.597585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:15.621124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.623024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.627201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.629065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.632885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.633629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.910171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:15.920471 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0853707a-e890-441c-859b-cb981dc2ad4e tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1320 microversion: 2.1 time: 0.386236 Oct 19 06:51:15.938302 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 266/505] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:15 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1320 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:15.947499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:15.948747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:15.979586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.980145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.980619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:15.984881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:15.985574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:15.991759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.001313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:16.012688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:16.014880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:16.054071 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27744024-9562-48d7-b599-7dc02cc859fb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "POST /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af/action" status: 202 len: 1495 microversion: 2.75 time: 0.904446 Oct 19 06:51:16.065671 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 240/506] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:51:15 2022] POST /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af/action => generated 1495 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 06:51:16.069353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:16.072025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:16.089048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.090018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.091868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.092850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.104061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.106744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.400717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:16.405657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:16.414876 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f6ff163-d8bf-4fea-939e-b44496223677 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1389 microversion: 2.1 time: 0.475039 Oct 19 06:51:16.417008 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 267/507] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:15 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1389 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:16.422974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:16.423964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:16.433197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.434081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.434677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.435436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.435891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.436337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.521374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:16.535798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:16.537557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:16.544434 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51429476-b282-40b9-b8dc-ee5878f19fb5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.126181 Oct 19 06:51:16.547167 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 268/508] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:16 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:16.551484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:16.553127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:16.558711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.559443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.560198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.561042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.561497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.561916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.618503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:16.626973 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9098c734-9221-42b4-b23c-9e9040affdba tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1493 microversion: 2.1 time: 0.570602 Oct 19 06:51:16.640378 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 241/509] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:16 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1493 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:16.652717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:16.653884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:16.663027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.663858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.664562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.665431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.666144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.666789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.778073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:16.808423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:16.823396 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9095be8-2228-44d7-9da3-57bdefb9871f tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1323 microversion: 2.1 time: 0.276976 Oct 19 06:51:16.829353 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 269/510] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:16 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:16.842534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c26d8ca-cd81-405c-b41c-053d47a72f95 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '.version_select at 0x7f6d64d46790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:16.846836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c26d8ca-cd81-405c-b41c-053d47a72f95 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.847644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c26d8ca-cd81-405c-b41c-053d47a72f95 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.848241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c26d8ca-cd81-405c-b41c-053d47a72f95 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.866230 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c26d8ca-cd81-405c-b41c-053d47a72f95 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 402 microversion: 2.1 time: 0.035466 Oct 19 06:51:16.867043 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 270/511] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:51:16 2022] GET /compute/v2.1/os-migrations => generated 402 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:16.881731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2d68c8d-19d9-44a4-a10e-0ffb8ef88abc tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:16.882299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2d68c8d-19d9-44a4-a10e-0ffb8ef88abc tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:16.888850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2d68c8d-19d9-44a4-a10e-0ffb8ef88abc tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.889330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2d68c8d-19d9-44a4-a10e-0ffb8ef88abc tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.889770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2d68c8d-19d9-44a4-a10e-0ffb8ef88abc tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:16.891229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2d68c8d-19d9-44a4-a10e-0ffb8ef88abc tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:16.891680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2d68c8d-19d9-44a4-a10e-0ffb8ef88abc tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:16.892117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2d68c8d-19d9-44a4-a10e-0ffb8ef88abc tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:17.059684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:17.070528 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2d68c8d-19d9-44a4-a10e-0ffb8ef88abc tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1646 microversion: 2.1 time: 0.190858 Oct 19 06:51:17.071990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:17.072277 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 271/512] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:16 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1646 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:17.076852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:17.079406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:17.081214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:17.089671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:17.090181 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ebca92d-01cd-4393-a975-205757fc8d4e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1558 microversion: 2.91 time: 0.448036 Oct 19 06:51:17.090883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:17.091274 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 242/513] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:16 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1558 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:17.092052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:17.093200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:17.093840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:17.094413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:17.172353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-40596397-6ddb-4ba8-9fc9-3f90d4b960e9 req-585b8fca-cefc-49f1-9523-d81641ec6f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357a0b94-6975-4406-b90e-86c6f9a6bdd9", "name": "network-vif-plugged", "status": "completed", "tag": "b27d7bd9-cb5c-473d-a0d3-ac635278856e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:17.184336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-40596397-6ddb-4ba8-9fc9-3f90d4b960e9 req-585b8fca-cefc-49f1-9523-d81641ec6f3a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:17.185187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-40596397-6ddb-4ba8-9fc9-3f90d4b960e9 req-585b8fca-cefc-49f1-9523-d81641ec6f3a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:17.186020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-40596397-6ddb-4ba8-9fc9-3f90d4b960e9 req-585b8fca-cefc-49f1-9523-d81641ec6f3a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:17.198270 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-40596397-6ddb-4ba8-9fc9-3f90d4b960e9 req-585b8fca-cefc-49f1-9523-d81641ec6f3a service nova] Creating event network-vif-plugged:b27d7bd9-cb5c-473d-a0d3-ac635278856e for instance 357a0b94-6975-4406-b90e-86c6f9a6bdd9 on n-h1-861333-10 Oct 19 06:51:17.205282 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-40596397-6ddb-4ba8-9fc9-3f90d4b960e9 req-585b8fca-cefc-49f1-9523-d81641ec6f3a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038290 Oct 19 06:51:17.206706 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 243/514] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:51:17.309261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1163259351", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "a7a2cd42-c826-4d50-96f4-6d6e6885e6b0"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:17.339182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:17.348009 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c7573af-ece7-4c97-9d8a-316276146406 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1320 microversion: 2.1 time: 0.273844 Oct 19 06:51:17.353945 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 272/515] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:17 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:17.397579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] validate_networks() for [('a7a2cd42-c826-4d50-96f4-6d6e6885e6b0', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:51:17.438734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:17.439479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:17.447001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:17.447648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:17.448357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:17.449384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:17.455730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:17.455730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:17.758811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:18.039604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:18.050158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55d17412-753e-4568-ac96-940d1d658f18 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1389 microversion: 2.1 time: 0.615277 Oct 19 06:51:18.050743 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 273/516] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:17 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1389 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:18.060936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:18.065290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:18.073820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:18.075002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:18.075610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:18.076633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:18.077377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:18.078065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:18.078849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=38 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:18.200344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:18.217704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:18.219377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:18.240192 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7630dd33-5e7e-441c-8e69-656a048d18f5 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.188337 Oct 19 06:51:18.242399 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 274/517] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:18 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:18.267105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:18.270751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:18.291216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:18.297433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:18.303072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:18.304612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:18.304739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:18.309041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:18.712452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:18.726819 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b885b7e-d440-4779-8764-9c3f0ed2e66b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1323 microversion: 2.1 time: 0.478354 Oct 19 06:51:18.744148 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 275/518] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:18 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1323 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:18.744148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:18.744148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:18.756418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:18.756913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:18.757354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:18.759605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:18.760081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:18.760541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:18.916785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:18.934461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:18.936884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:18.956199 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31f7a24f-2320-4d6f-8f44-d2b85514e2d9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.224038 Oct 19 06:51:18.975934 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 276/519] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:18 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:18.981523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:18.982409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:18.990727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:18.991327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:18.992010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:18.992844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:18.993418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:18.993940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:19.150808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:19.163809 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7164fe46-2793-4b77-8a70-eaf9655353a7 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1320 microversion: 2.1 time: 0.186058 Oct 19 06:51:19.165150 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 277/520] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:18 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:19.172410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:19.173554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:19.183202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:19.183856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:19.184992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:19.185824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:19.186390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:19.186944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:19.344146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=20 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:19.365289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:19.371286 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cfa2b824-e5dc-4b93-84a2-d836d45a7dc2 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1389 microversion: 2.1 time: 0.204657 Oct 19 06:51:19.385454 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 278/521] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:19 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1389 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:19.392320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:19.393660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:19.402897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:19.403681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:19.404530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:19.405422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:19.407293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:19.408227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:19.489666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:19.490713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:19.491416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:19.492071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:19.493580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:19.515930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:19.516444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:19.516888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:19.517678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:19.518819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:19.519260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:19.533876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:19.545764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:19.556185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:19.564863 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28493ca2-5db5-4ef3-8769-76d36c4488c0 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.191607 Oct 19 06:51:19.581214 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 279/522] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:19 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:19.582108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for project bdca3d9567f34867aa0d9d4489001792. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:19.582108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for user f67e466b1aa04d2cbafdbd390c178215 and project bdca3d9567f34867aa0d9d4489001792. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:19.606543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:51:19.612720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:51:19.762348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:19.763486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:19.775269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:19.781722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:19.781722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:19.781722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:19.781722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:19.782137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:19.844565 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b41c55e3-15ea-4bfa-84fe-a058d59d324d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.539978 Oct 19 06:51:19.851596 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 244/523] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:51:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:51:19.867287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a421fa6-f3fd-4e4c-9419-52cdff7dff39 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:19.868057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a421fa6-f3fd-4e4c-9419-52cdff7dff39 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:20.097571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:20.146463 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b289f79-ece7-412c-89df-7978a9c2093a tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1473 microversion: 2.1 time: 0.387157 Oct 19 06:51:20.146463 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 280/524] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:19 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1473 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:20.160841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:20.164059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:20.177894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.184741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.185705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.186720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.188160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.188904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.287121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a421fa6-f3fd-4e4c-9419-52cdff7dff39 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:20.299991 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a421fa6-f3fd-4e4c-9419-52cdff7dff39 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1211 microversion: 2.1 time: 0.437452 Oct 19 06:51:20.301116 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 245/525] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:19 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1211 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:20.314035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:20.314547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:20.338156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.338658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.339101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.339817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.344659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.345305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.352947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:20.364624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:20.371424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:20.372729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de363287-67ac-42e6-a210-0c2f6b25d162 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.224176 Oct 19 06:51:20.373826 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 281/526] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:20 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:20.379353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:20.380210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:20.387065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.387800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.388417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.393700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.393700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.393700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.460581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Request method failure captured: Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9/diagnostics HTTP/1.1 Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT55RYWaWCHjmYAgu4o5LxNiXsOUemmrRPD_EnclXc1WRJZj-Rg-6cm_RbY20jfahGN1IshUErqkBEBNhw-rEu2gnrhi-2BsdWPCl_2R8r7q7WpZ45Gppk40IQFSUspyVV0AM8JJnbHLL7NnygVECwDUftAKunAfS-CIovgT1PoG2Z-U Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e0c1b9404e43444f805bea3a620bd5a3 Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1056251942 Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:51:20.467232 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0c1b9404e43444f805bea3a620bd5a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0c1b9404e43444f805bea3a620bd5a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0c1b9404e43444f805bea3a620bd5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0c1b9404e43444f805bea3a620bd5a3", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1056251942 Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e0c1b9404e43444f805bea3a620bd5a3 Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1056251942 Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerDiagnosticsNegativeTest-1056251942-project Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 9180029316e04d02bab52adfe49f26e5 Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1056251942-project Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:51:20.469001 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': '357a0b94-6975-4406-b90e-86c6f9a6bdd9'} Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:51:20.469865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 19 06:51:20.471295 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:20.474363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:20.475463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7cb7c6d1-9189-4b2b-8a99-d22598ebf4b1 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.170732 Oct 19 06:51:20.477071 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 246/527] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 06:51:20 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9/diagnostics => generated 117 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:20.609968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1ae8c989-071f-48f3-926b-4ad1bc0bf59a req-ae43145b-0727-4e29-9267-6fa691dcc194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb46828-0fa9-44fe-8217-364a1ee8b77a", "tag": "611e2dc7-eca5-40b7-9342-04acfdcf9f5c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:20.622475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1ae8c989-071f-48f3-926b-4ad1bc0bf59a req-ae43145b-0727-4e29-9267-6fa691dcc194 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.623295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1ae8c989-071f-48f3-926b-4ad1bc0bf59a req-ae43145b-0727-4e29-9267-6fa691dcc194 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.623972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1ae8c989-071f-48f3-926b-4ad1bc0bf59a req-ae43145b-0727-4e29-9267-6fa691dcc194 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.643954 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1ae8c989-071f-48f3-926b-4ad1bc0bf59a req-ae43145b-0727-4e29-9267-6fa691dcc194 service nova] Creating event network-changed:611e2dc7-eca5-40b7-9342-04acfdcf9f5c for instance ffb46828-0fa9-44fe-8217-364a1ee8b77a on n-h2-861333-10 Oct 19 06:51:20.650155 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1ae8c989-071f-48f3-926b-4ad1bc0bf59a req-ae43145b-0727-4e29-9267-6fa691dcc194 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168262 Oct 19 06:51:20.651361 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 247/528] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:20.657071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:20.659671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:20.660883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:20.668661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.670502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.671144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.672619 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-702cb79c-64b3-47ab-a1c0-b21c112e8866 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1320 microversion: 2.1 time: 0.296693 Oct 19 06:51:20.673224 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 282/529] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:20 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:20.673560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.674193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.675418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.692848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:20.693349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:20.703783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.704427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.704929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.706994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:20.710615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:20.711100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:20.799938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:51:20.971628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:21.235224 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1855c64-9c52-4f07-9eb0-091199eb695d tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 204 len: 0 microversion: 2.1 time: 0.560657 Oct 19 06:51:21.239484 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 283/530] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:51:20 2022] DELETE /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:51:21.254076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:21.256203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:21.267112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.277113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.277113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.277113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.277113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.277688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.405688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:21.416971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:21.424176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:21.425509 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d200565-d0a8-4c9d-badd-df0928898d91 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.183971 Oct 19 06:51:21.426415 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 284/531] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:21 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:21.436428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:21.437064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:21.444807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.445446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.445895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.447025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.447486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.448699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.456623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:21.473341 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d2b6e79-35fc-4bdb-9caf-4cef4f9fa14c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1389 microversion: 2.1 time: 0.820374 Oct 19 06:51:21.486615 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 248/532] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:20 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1389 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:21.496767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:21.497652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:21.504512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.505377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.506228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.507109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.507722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.508372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.610730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:21.622725 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5288671-00f8-4dec-922a-66988a50213c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1215 microversion: 2.1 time: 0.134641 Oct 19 06:51:21.631416 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 249/533] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:21 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:21.631416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4858494b-e0b7-4191-922f-b00928ffa814 req-e4dd2228-3977-4a35-9544-795340747ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe37e8c6-900b-4c99-bc7c-2511c6d8108f", "name": "network-vif-plugged", "status": "completed", "tag": "e0e59f88-59bd-479d-a40f-9b5af6c40d02"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:21.647678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4858494b-e0b7-4191-922f-b00928ffa814 req-e4dd2228-3977-4a35-9544-795340747ec2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.648478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4858494b-e0b7-4191-922f-b00928ffa814 req-e4dd2228-3977-4a35-9544-795340747ec2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.648903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4858494b-e0b7-4191-922f-b00928ffa814 req-e4dd2228-3977-4a35-9544-795340747ec2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.661233 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4858494b-e0b7-4191-922f-b00928ffa814 req-e4dd2228-3977-4a35-9544-795340747ec2 service nova] Creating event network-vif-plugged:e0e59f88-59bd-479d-a40f-9b5af6c40d02 for instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f on n-h2-861333-10 Oct 19 06:51:21.671504 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4858494b-e0b7-4191-922f-b00928ffa814 req-e4dd2228-3977-4a35-9544-795340747ec2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046224 Oct 19 06:51:21.676692 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 250/534] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:21.686376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:21.689825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:21.703956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.709508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.709508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.709508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.709508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.710357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.723997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:21.735319 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37920acf-4b03-4d33-9081-51b2e2fe992b tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1479 microversion: 2.1 time: 0.307606 Oct 19 06:51:21.737548 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 285/535] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:21 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1479 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:21.743980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:21.761106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:21.781718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.782487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.787082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.787848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:21.788605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:21.789200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:21.993371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:22.007000 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-438d85ef-c581-482c-b0a1-b82bde2fa914 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1320 microversion: 2.1 time: 0.264489 Oct 19 06:51:22.007000 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 286/536] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:21 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:22.165111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:22.177907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:22.181254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:22.185233 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68fdc06f-0419-4ed5-9e75-d7ab3de7408c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.506903 Oct 19 06:51:22.185980 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 251/537] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:21 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:22.461767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:22.462438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:22.491095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:22.491095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:22.491095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:22.491095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:22.491497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:22.491497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:22.522536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:22.523397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:22.556796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:22.557949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:22.559394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:22.561168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:22.564687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:22.565224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:22.601345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:22.615046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:22.617767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:22.623312 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68487a01-d378-4aea-aa7c-8be0dd38f734 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.167393 Oct 19 06:51:22.624135 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 287/538] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:22 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:22.668970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:22.670490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:22.687274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:22.687274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:22.687274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:22.689045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:22.689749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:22.690327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:22.793288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:22.806285 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84c0f200-566b-4b45-a027-7023f741ffda tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1215 microversion: 2.1 time: 0.151771 Oct 19 06:51:22.812189 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 288/539] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:22 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:22.833520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:22.834163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:22.852015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:22.852729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:22.853173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:22.853876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:22.854769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:22.855550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:23.110113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:23.123003 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7f4066d-4cbf-43a7-a0f8-2f9973c0b7bd tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1479 microversion: 2.1 time: 0.310909 Oct 19 06:51:23.124197 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 289/540] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:22 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1479 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:23.131242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:23.131242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:23.137291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:23.138588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:23.139289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:23.140178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:23.141481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:23.142202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:23.286037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:23.309097 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a008c3d2-064f-4793-bfb1-38fae1548474 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1389 microversion: 2.1 time: 0.798763 Oct 19 06:51:23.309097 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 252/541] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:22 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1389 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:23.314124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:23.314930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:23.324828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:23.325332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:23.327339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:23.327339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:23.327339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:23.327609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:23.357392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:23.369101 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-800016d0-f58c-4b7d-a23e-f940acaf9ef3 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1320 microversion: 2.1 time: 0.242925 Oct 19 06:51:23.378769 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 290/542] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:23 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:23.469068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:23.484643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:23.494247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:23.505694 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be6d0d5f-a87e-40b9-afbd-1b4f618ec1a3 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.197772 Oct 19 06:51:23.506824 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 253/543] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:23 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:23.658934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:23.660435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:23.673153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:23.678551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:23.679228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:23.681853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:23.684081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:23.684716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:23.832198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:23.833235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:23.851939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:23.854008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:23.854008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:23.857813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:23.860014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:23.863357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:24.052509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:24.064121 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3fe40ed5-bd6f-411d-a1de-f38f9bb451e0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1271 microversion: 2.1 time: 0.238205 Oct 19 06:51:24.066594 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 254/544] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:23 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:24.269267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-636637366", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b05059e7-85f2-4cad-a60f-f98042236a76"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:24.349174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:24.370897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:24.372574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:24.378934 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7381280e-1ba9-4385-96d0-63c4867a2e3e tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.724692 Oct 19 06:51:24.394911 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 291/545] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:23 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:24.423578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] validate_networks() for [('b05059e7-85f2-4cad-a60f-f98042236a76', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:51:24.426328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:24.429118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:24.443763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:24.445620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:24.447214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:24.447963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:24.448456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:24.448886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:24.797989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:24.812997 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c220257-2445-4690-926b-9be200cfe6e2 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1437 microversion: 2.1 time: 0.405234 Oct 19 06:51:24.842456 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 292/546] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:24 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1437 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:24.848678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:24.849861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:24.863864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:24.868793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:24.871076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:24.872028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:24.872740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:24.873343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:25.515960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:25.533432 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18395df5-b23b-4acb-8fa0-fa738b94b000 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1586 microversion: 2.1 time: 0.687194 Oct 19 06:51:25.544180 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 293/547] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:24 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1586 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:25.558168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:25.562836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:25.573975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:25.576576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:25.577754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:25.578528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:25.578999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:25.579432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:25.658271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:25.659396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:25.659880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:25.660323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:25.660736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:25.671420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:25.673008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:25.673689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:25.674598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:25.675058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:25.675752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:25.699415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:25.705150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for user 641a9af15ca24743baa3049fa9ad2e68 and project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:25.720294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:51:25.722998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:51:25.977115 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58bee897-6a10-4ebb-9635-db53dad5a083 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.849219 Oct 19 06:51:25.982247 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 255/548] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 06:51:25.997435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:25.998699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:26.064041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.064041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.064041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.064041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.065006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.065006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.115952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:26.126904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:26.127918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:26.133674 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e044202-7964-4a48-86f1-f9d39d0e3231 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.149359 Oct 19 06:51:26.154753 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 256/549] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:25 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:26.165921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b23965f5-5568-4bb1-9be4-991fcdf36553 req-0d83181e-1cbf-45be-80fa-f6e69d40db55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357a0b94-6975-4406-b90e-86c6f9a6bdd9", "name": "network-vif-deleted", "tag": "b27d7bd9-cb5c-473d-a0d3-ac635278856e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:26.176074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b23965f5-5568-4bb1-9be4-991fcdf36553 req-0d83181e-1cbf-45be-80fa-f6e69d40db55 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.176823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b23965f5-5568-4bb1-9be4-991fcdf36553 req-0d83181e-1cbf-45be-80fa-f6e69d40db55 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.178401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b23965f5-5568-4bb1-9be4-991fcdf36553 req-0d83181e-1cbf-45be-80fa-f6e69d40db55 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.196532 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b23965f5-5568-4bb1-9be4-991fcdf36553 req-0d83181e-1cbf-45be-80fa-f6e69d40db55 service nova] Creating event network-vif-deleted:b27d7bd9-cb5c-473d-a0d3-ac635278856e for instance 357a0b94-6975-4406-b90e-86c6f9a6bdd9 on n-h1-861333-10 Oct 19 06:51:26.202153 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b23965f5-5568-4bb1-9be4-991fcdf36553 req-0d83181e-1cbf-45be-80fa-f6e69d40db55 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046028 Oct 19 06:51:26.204478 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 257/550] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:26.212737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:26.213849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:26.225543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.226035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.227552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.227552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.227989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.228393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.251138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:26.317009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:26.317009 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7d68957-2df0-43de-892c-ef8a757e7e31 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1269 microversion: 2.1 time: 0.109647 Oct 19 06:51:26.317786 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 258/551] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:26 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:26.322018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:26.322621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:26.328515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.328991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.329659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.330721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.331411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.332192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.431249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:26.439414 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d014d9f2-e0eb-4d10-af3f-63c6e067a0cb tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1320 microversion: 2.1 time: 0.888354 Oct 19 06:51:26.444502 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 294/552] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:25 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1320 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:26.455720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16a61a5e-3139-418e-b544-5e303209a3ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:26.456555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16a61a5e-3139-418e-b544-5e303209a3ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:26.469054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a61a5e-3139-418e-b544-5e303209a3ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.469812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a61a5e-3139-418e-b544-5e303209a3ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.470473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a61a5e-3139-418e-b544-5e303209a3ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.474005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a61a5e-3139-418e-b544-5e303209a3ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.475101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a61a5e-3139-418e-b544-5e303209a3ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.475645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a61a5e-3139-418e-b544-5e303209a3ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.486407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:26.492739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:26.495591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:26.521923 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fc973e9-efe2-4db2-bce7-5703172e568b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.191343 Oct 19 06:51:26.521923 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 259/553] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:26 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:26.521923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:26.521923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:26.538961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.538961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.538961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.538961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.545197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.545197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.644082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:26.644810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:26.645416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:26.646029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lazy-loading 'fault' on Instance uuid 357a0b94-6975-4406-b90e-86c6f9a6bdd9 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:26.725779 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16a61a5e-3139-418e-b544-5e303209a3ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.282189 Oct 19 06:51:26.733300 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 295/554] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 06:51:26 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:26.739036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02d930d0-3e3f-4804-8482-a9e34233be29 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:26.739954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02d930d0-3e3f-4804-8482-a9e34233be29 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:26.800978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9180029316e04d02bab52adfe49f26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c1b9404e43444f805bea3a620bd5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:26.810675 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c26502d-ab06-4063-88c5-d97aec61a2c7 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 200 len: 1313 microversion: 2.1 time: 0.298806 Oct 19 06:51:26.811276 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 260/555] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:26 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:27.076181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02d930d0-3e3f-4804-8482-a9e34233be29 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.084539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02d930d0-3e3f-4804-8482-a9e34233be29 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.098662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02d930d0-3e3f-4804-8482-a9e34233be29 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.102969 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02d930d0-3e3f-4804-8482-a9e34233be29 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1261 microversion: 2.25 time: 0.367765 Oct 19 06:51:27.104429 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 296/556] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:26 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1261 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:27.174681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:27.175547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:27.242496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.242496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.245345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.250885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.255772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.256369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.281130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7dd1133c-2d38-48f2-bf85-629d7f6e49b9 req-d8980098-c8a1-48bc-9a97-01e780e935d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb46828-0fa9-44fe-8217-364a1ee8b77a", "name": "network-vif-plugged", "status": "completed", "tag": "611e2dc7-eca5-40b7-9342-04acfdcf9f5c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:27.306975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7dd1133c-2d38-48f2-bf85-629d7f6e49b9 req-d8980098-c8a1-48bc-9a97-01e780e935d8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.307724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7dd1133c-2d38-48f2-bf85-629d7f6e49b9 req-d8980098-c8a1-48bc-9a97-01e780e935d8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.308369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7dd1133c-2d38-48f2-bf85-629d7f6e49b9 req-d8980098-c8a1-48bc-9a97-01e780e935d8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.363519 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7dd1133c-2d38-48f2-bf85-629d7f6e49b9 req-d8980098-c8a1-48bc-9a97-01e780e935d8 service nova] Creating event network-vif-plugged:611e2dc7-eca5-40b7-9342-04acfdcf9f5c for instance ffb46828-0fa9-44fe-8217-364a1ee8b77a on n-h2-861333-10 Oct 19 06:51:27.373400 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7dd1133c-2d38-48f2-bf85-629d7f6e49b9 req-d8980098-c8a1-48bc-9a97-01e780e935d8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095855 Oct 19 06:51:27.374583 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 297/557] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:27.394900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:27.397399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:27.404619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.405479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.406185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.407214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.407954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.408760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.539930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.556175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.585426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.586883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.588992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:27.591005 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb0bd2f0-6a59-4005-a249-b8458eceb2bd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1269 microversion: 2.1 time: 0.195514 Oct 19 06:51:27.608580 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 298/558] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:27 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1269 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:27.622011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:27.622820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:27.627634 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-300bbce7-8c64-48a9-9e51-63faf4f03e60 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.458729 Oct 19 06:51:27.634514 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 261/559] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:27 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:27.641142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:27.646615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:27.650585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.651335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.652005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.653078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.653751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.654381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.672633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.682961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.683739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.689021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.689021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.689021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.801784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.820479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.822740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:27.834157 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2530d987-20c4-4a93-aa71-b911a75d57e6 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.198229 Oct 19 06:51:27.835035 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 262/560] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:27 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:27.839900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:27.840742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] [instance: 357a0b94-6975-4406-b90e-86c6f9a6bdd9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:27.848030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.848758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.849389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.850371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:27.850993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:27.851583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:27.869803 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] HTTP exception thrown: Instance 357a0b94-6975-4406-b90e-86c6f9a6bdd9 could not be found. Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Request method failure captured: Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 HTTP/1.1 Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT55RYWaWCHjmYAgu4o5LxNiXsOUemmrRPD_EnclXc1WRJZj-Rg-6cm_RbY20jfahGN1IshUErqkBEBNhw-rEu2gnrhi-2BsdWPCl_2R8r7q7WpZ45Gppk40IQFSUspyVV0AM8JJnbHLL7NnygVECwDUftAKunAfS-CIovgT1PoG2Z-U Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e0c1b9404e43444f805bea3a620bd5a3 Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1056251942 Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:51:27.871490 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0c1b9404e43444f805bea3a620bd5a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0c1b9404e43444f805bea3a620bd5a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0c1b9404e43444f805bea3a620bd5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0c1b9404e43444f805bea3a620bd5a3", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1056251942 Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e0c1b9404e43444f805bea3a620bd5a3 Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1056251942 Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerDiagnosticsNegativeTest-1056251942-project Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 9180029316e04d02bab52adfe49f26e5 Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1056251942-project Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 357a0b94-6975-4406-b90e-86c6f9a6bdd9 could not be found. Oct 19 06:51:27.873069 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '357a0b94-6975-4406-b90e-86c6f9a6bdd9'} Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357a0b94-6975-4406-b90e-86c6f9a6bdd9 could not be found. Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:27.873917 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357a0b94-6975-4406-b90e-86c6f9a6bdd9 could not be found. Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357a0b94-6975-4406-b90e-86c6f9a6bdd9 could not be found. Oct 19 06:51:27.875484 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:27.876765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] Returning 404 to user: Instance 357a0b94-6975-4406-b90e-86c6f9a6bdd9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:27.876765 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f30160a1-7392-483b-9c8d-64d3aa9f4b21 tempest-ServerDiagnosticsNegativeTest-1056251942 tempest-ServerDiagnosticsNegativeTest-1056251942-project] 10.222.0.39 "GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9" status: 404 len: 111 microversion: 2.1 time: 0.037531 Oct 19 06:51:27.876765 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 263/561] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:27 2022] GET /compute/v2.1/servers/357a0b94-6975-4406-b90e-86c6f9a6bdd9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:28.154679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:28.155702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:28.184786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:28.185711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:28.186403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:28.188857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:28.190084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:28.190871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:28.455470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:28.471621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:28.477875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:28.484429 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8cef7b0-4f33-4485-9c14-a0ca6b08d505 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1257 microversion: 2.25 time: 0.337354 Oct 19 06:51:28.488563 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 264/562] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:28 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1257 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:28.623649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:28.625857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:28.653890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:28.655504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:28.656000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:28.658955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:28.659508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:28.661171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:28.799694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:28.818462 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15edd281-55f0-493c-b077-b3764e225d88 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1320 microversion: 2.1 time: 1.208317 Oct 19 06:51:28.819602 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 299/563] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:27 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1320 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:28.824455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:28.830407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:28.845605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:28.846121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:28.846567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:28.847287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:28.847748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:28.851949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:29.024853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:29.044224 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18f192be-85f5-4bc0-94ad-917b2a165d07 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 0.426749 Oct 19 06:51:29.053311 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 265/564] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:28 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:29.064699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:29.071286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:29.081982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:29.082722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:29.083327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:29.084212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:29.084823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:29.085401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:29.225151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:29.243772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:29.253287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:29.266090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:29.268315 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9323bd99-ba9a-4d30-8cb7-99bb7241abc4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.447494 Oct 19 06:51:29.270792 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 300/565] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:28 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:29.339019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:29.348873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:29.350325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:29.393978 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-caa6acb0-d79f-4c35-ac8c-4f28d709ae12 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.339269 Oct 19 06:51:29.399059 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 266/566] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:29 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:29.519793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:29.520719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:29.530113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:29.533918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:29.535892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:29.537503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:29.538386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:29.545682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:29.846358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:29.847250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:29.861188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:29.861740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:29.865921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:29.866841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:29.873043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:29.875376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:30.247422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:30.258357 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa17f0ef-2edd-40e8-86bc-d886cfebd8c2 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1470 microversion: 2.1 time: 0.415966 Oct 19 06:51:30.258942 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 267/567] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:29 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1470 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:30.273254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:30.274668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:30.295130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:30.295889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:30.298793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:30.299915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:30.300583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:30.301479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:30.358345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:30.378087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:30.380591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:30.384470 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b637eb6-087f-4fc5-875d-605f742d5a0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1321 microversion: 2.25 time: 0.868064 Oct 19 06:51:30.398066 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 301/568] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:29 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1321 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:30.450492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d08c468b-9e0b-4d62-9506-87f6bdce6ac3 tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:30.461582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d08c468b-9e0b-4d62-9506-87f6bdce6ac3 tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:30.491716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08c468b-9e0b-4d62-9506-87f6bdce6ac3 tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:30.492607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08c468b-9e0b-4d62-9506-87f6bdce6ac3 tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:30.493366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08c468b-9e0b-4d62-9506-87f6bdce6ac3 tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:30.494895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08c468b-9e0b-4d62-9506-87f6bdce6ac3 tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:30.508866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08c468b-9e0b-4d62-9506-87f6bdce6ac3 tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:30.509395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08c468b-9e0b-4d62-9506-87f6bdce6ac3 tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:30.543887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:30.568033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:30.578601 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33c03a74-358b-459a-970a-f8fe5b1de03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 0.317118 Oct 19 06:51:30.583839 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 268/569] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:30 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:30.592938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:30.599327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:30.610593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:30.611094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:30.611527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:30.614177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:30.614657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:30.615095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:30.737540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:30.748692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:30.755465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:30.769388 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f8360e9-a904-4c68-9895-d7bf0e46b6c0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.184324 Oct 19 06:51:30.785563 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 269/570] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:30 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:30.797733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:30.798770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:30.807628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:30.808381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:30.808994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:30.809889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:30.810575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:30.811339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:31.023781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:31.036284 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d08c468b-9e0b-4d62-9506-87f6bdce6ac3 tempest-DeleteServersAdminTestJSON-638824272 tempest-DeleteServersAdminTestJSON-638824272-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a/action" status: 202 len: 0 microversion: 2.1 time: 0.599283 Oct 19 06:51:31.037858 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 302/571] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:51:30 2022] POST /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:51:31.048052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:31.049220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:31.055159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:31.061966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:31.074378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:31.081589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:31.081589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:31.081589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:31.083393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:31.084406 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-030ee787-b4e9-4fde-9131-7eddb6c59a81 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.297375 Oct 19 06:51:31.085034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:31.088333 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 270/572] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:30 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:31.132433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:31.133376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:31.133965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:31.134564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lazy-loading 'fault' on Instance uuid ffb46828-0fa9-44fe-8217-364a1ee8b77a {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:31.453198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:31.455950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:31.462952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:31.463683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:31.464365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:31.465246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:31.466643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:31.467512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:31.837424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:31.839443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:31.848787 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19014320-c5e7-4a69-9728-76aefd7ec171 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1453 microversion: 2.1 time: 0.807167 Oct 19 06:51:31.860524 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 303/573] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:31 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1453 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:31.866090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:31.866887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:31.874954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:31.881493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:31.882190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:31.883098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:31.883706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:31.885167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:31.889618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:31.903821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:31.909513 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4131234c-c48e-4e9b-b559-ec83c1358b3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1361 microversion: 2.25 time: 0.491292 Oct 19 06:51:31.925313 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 271/574] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:31 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1361 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:31.936822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:31.940594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:31.954523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:31.956993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:31.957622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:31.959723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:31.961532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:31.962186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:32.142721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:32.155653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:32.159072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:32.171193 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc96d707-72f8-41f2-9357-2c34aced59a5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.244503 Oct 19 06:51:32.173535 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 272/575] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:31 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:32.192402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:32.195546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:32.207452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:32.219415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:32.220166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:32.224049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:32.235675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:32.237097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:32.309333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:51:32.507539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:32.692626 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f9b43e7-530c-48d4-ac43-6232093752d8 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 204 len: 0 microversion: 2.1 time: 0.512866 Oct 19 06:51:32.696221 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 273/576] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:51:32 2022] DELETE /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:51:32.710922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:32.716990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:32.734803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:32.736721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:32.742385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:32.742385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:32.742385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:32.742385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:32.921327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:32.939559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:32.944974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:32.950741 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23b4e55e-fce0-4424-9b9b-59e32b33adac tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.256247 Oct 19 06:51:32.951519 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 274/577] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:32 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:32.973472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:32.974943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:32.992658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:32.995182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:32.995666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:32.996455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.001312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.001970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.139518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.139518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.139518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.139518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lazy-loading 'fault' on Instance uuid ffb46828-0fa9-44fe-8217-364a1ee8b77a {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:33.277269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:33.322309 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4bef47bb-5411-49c4-a616-5b6a938f6532 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 1.460262 Oct 19 06:51:33.332704 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 304/578] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:31 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:33.356758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:33.362324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:33.380801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.381395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.392908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.393922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.394640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.395219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.510601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:33.519764 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afb21dfb-5c0e-49c3-b338-c3556c7247da tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1459 microversion: 2.1 time: 0.566902 Oct 19 06:51:33.520833 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 275/579] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:32 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1459 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:33.526282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:33.527206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:33.549169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.549900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.550353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.551073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.551537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.551967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.652297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:33.662434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:33.665586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:33.671810 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd9d29c9-0d88-46a6-bf63-85094420caed tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.149897 Oct 19 06:51:33.673633 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 276/580] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:33 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:33.678659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:33.679564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:33.686376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.687871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.688933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.690149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.690888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.691538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.770400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:33.785170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:33.786949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:33.788122 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4b45c44-aa26-48e9-bc0b-089084506ca1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1361 microversion: 2.25 time: 0.451874 Oct 19 06:51:33.790291 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 305/581] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:33 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1361 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:33.795487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e11d8680-f48e-4942-9b70-a83c10ffceec req-8af74e76-c1e2-4dbc-9dcc-7fd148c9c238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe37e8c6-900b-4c99-bc7c-2511c6d8108f", "tag": "e0e59f88-59bd-479d-a40f-9b5af6c40d02"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:33.830674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e11d8680-f48e-4942-9b70-a83c10ffceec req-8af74e76-c1e2-4dbc-9dcc-7fd148c9c238 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.831864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e11d8680-f48e-4942-9b70-a83c10ffceec req-8af74e76-c1e2-4dbc-9dcc-7fd148c9c238 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.832474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e11d8680-f48e-4942-9b70-a83c10ffceec req-8af74e76-c1e2-4dbc-9dcc-7fd148c9c238 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.859896 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e11d8680-f48e-4942-9b70-a83c10ffceec req-8af74e76-c1e2-4dbc-9dcc-7fd148c9c238 service nova] Creating event network-changed:e0e59f88-59bd-479d-a40f-9b5af6c40d02 for instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f on n-h2-861333-10 Oct 19 06:51:33.865559 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e11d8680-f48e-4942-9b70-a83c10ffceec req-8af74e76-c1e2-4dbc-9dcc-7fd148c9c238 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073928 Oct 19 06:51:33.866780 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 306/582] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:33.868356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:33.876910 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-142d5ab2-84d6-4389-9dac-0d80bb94dca1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 200 len: 1586 microversion: 2.1 time: 0.201936 Oct 19 06:51:33.877793 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 277/583] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:33 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 1586 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:33.981054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:33.981762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:33.996504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:33.997040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:33.998188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:33.999126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:34.000914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-936be754-81c1-4b07-8771-fa3ae17d5a92 req-caac7096-13f5-497a-aba8-15d0c4bcc907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f4b644a-9003-441d-a9fe-e1c6a6db83c1", "tag": "c3c575e8-a2aa-48e4-b018-4a01e5f71e1f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:34.001238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:34.002434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:34.018210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-936be754-81c1-4b07-8771-fa3ae17d5a92 req-caac7096-13f5-497a-aba8-15d0c4bcc907 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:34.020338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-936be754-81c1-4b07-8771-fa3ae17d5a92 req-caac7096-13f5-497a-aba8-15d0c4bcc907 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:34.023017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-936be754-81c1-4b07-8771-fa3ae17d5a92 req-caac7096-13f5-497a-aba8-15d0c4bcc907 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:34.111278 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-936be754-81c1-4b07-8771-fa3ae17d5a92 req-caac7096-13f5-497a-aba8-15d0c4bcc907 service nova] Creating event network-changed:c3c575e8-a2aa-48e4-b018-4a01e5f71e1f for instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 on n-h1-861333-10 Oct 19 06:51:34.141658 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-936be754-81c1-4b07-8771-fa3ae17d5a92 req-caac7096-13f5-497a-aba8-15d0c4bcc907 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145363 Oct 19 06:51:34.152520 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 278/584] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:51:34.308270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:34.317663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:34.323173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:34.355697 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0dd413d-c8d0-4d71-b6d9-362e5c930f64 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.376305 Oct 19 06:51:34.368282 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 307/585] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:33 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:34.392600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:34.393238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:34.421631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:34.423061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:34.423402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:34.424176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:34.424645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:34.425077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:34.559972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-353a34eb-79b0-49cb-b300-bf0533642579 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Action: 'create', calling method: .version_select at 0x7f6d64e5fdc0>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:35.557315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:35.574384 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f9a31e8-37c1-4776-ac22-1d7fd8a8def9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 1.197215 Oct 19 06:51:35.582647 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 308/586] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:34 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:35.598311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:35.599366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:35.618872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:35.621054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:35.631034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:35.631911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:35.632595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:35.633349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:35.688582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:35.712490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:35.736565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:35.743238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:35.746563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:35.747370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lazy-loading 'fault' on Instance uuid ffb46828-0fa9-44fe-8217-364a1ee8b77a {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:36.284993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e7566840814f1fa1d2c765bdada925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0587af802f4f4b98aca0da31c1944b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:36.307702 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4fb5202-6a3f-40fa-94de-d150d3feb4ec tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 200 len: 1417 microversion: 2.1 time: 0.718486 Oct 19 06:51:36.309620 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 309/587] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:35 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 1417 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:36.337655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:36.356997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:36.382657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:36.383447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:36.384618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:36.386074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:36.392801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:36.393524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:36.572288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:36.598019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:36.603896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:36.612537 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-09548997-32ba-461e-a9fa-a627ad65b2a6 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.293782 Oct 19 06:51:36.615675 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 310/588] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:36 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:36.620602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:36.627351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:36.646577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:36.647299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:36.647737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:36.654417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:36.655282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:36.655958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:36.865664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:36.909040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:36.911650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:36.913717 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba8c63fc-0db6-4ed0-9f71-d3a50fbeac94 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1361 microversion: 2.25 time: 0.296610 Oct 19 06:51:36.915014 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 311/589] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:36 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:36.924877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:36.925708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:36.932827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:36.936542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:36.936542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:36.936542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:36.936542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:36.936965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:37.067333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:37.079581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:37.085795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:37.092495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:37.097205 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6f35e5c-e880-4fad-9b5f-5c7aebbef9a7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.180927 Oct 19 06:51:37.122820 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 312/590] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:36 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:37.315849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-995007220", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:37.434626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:51:37.998836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:37.999531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:38.000633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:38.005227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:38.005227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:38.016425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.017292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.018835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.018835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.019811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.020437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.047685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Getting quotas for project 1af903b4f61c4892b3a577b039737bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:38.055132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Getting quotas for user 90be7740f30e48b5b7575fa74719f4e2 and project 1af903b4f61c4892b3a577b039737bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:38.070800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:51:38.074892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:51:38.266365 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95ad7b83-0b57-42fa-a45a-a2f4dd1dc7d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141550 Oct 19 06:51:38.295622 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 313/591] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:51:38.299661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2f7bdd3d-d191-4ded-a011-c8845427c7c5 req-60ca75aa-4178-48a2-8b83-08b842d34a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a33734-978d-4ec5-8a10-062f8208e013", "tag": "8f191a47-185e-4db5-97b0-9f273b9ba3c8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:38.312982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2f7bdd3d-d191-4ded-a011-c8845427c7c5 req-60ca75aa-4178-48a2-8b83-08b842d34a5a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.313571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2f7bdd3d-d191-4ded-a011-c8845427c7c5 req-60ca75aa-4178-48a2-8b83-08b842d34a5a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.314125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2f7bdd3d-d191-4ded-a011-c8845427c7c5 req-60ca75aa-4178-48a2-8b83-08b842d34a5a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.341422 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2f7bdd3d-d191-4ded-a011-c8845427c7c5 req-60ca75aa-4178-48a2-8b83-08b842d34a5a service nova] Creating event network-changed:8f191a47-185e-4db5-97b0-9f273b9ba3c8 for instance f1a33734-978d-4ec5-8a10-062f8208e013 on n-h1-861333-10 Oct 19 06:51:38.350398 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2f7bdd3d-d191-4ded-a011-c8845427c7c5 req-60ca75aa-4178-48a2-8b83-08b842d34a5a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059826 Oct 19 06:51:38.353102 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 314/592] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:38.367680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cd0d5a75-b141-47e8-a3c2-80bd4bd371f2 req-4f3140f7-32a9-4b8f-94f3-c84137787c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb46828-0fa9-44fe-8217-364a1ee8b77a", "name": "network-vif-deleted", "tag": "611e2dc7-eca5-40b7-9342-04acfdcf9f5c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:38.384052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cd0d5a75-b141-47e8-a3c2-80bd4bd371f2 req-4f3140f7-32a9-4b8f-94f3-c84137787c15 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.385421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cd0d5a75-b141-47e8-a3c2-80bd4bd371f2 req-4f3140f7-32a9-4b8f-94f3-c84137787c15 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.386068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cd0d5a75-b141-47e8-a3c2-80bd4bd371f2 req-4f3140f7-32a9-4b8f-94f3-c84137787c15 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.401215 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cd0d5a75-b141-47e8-a3c2-80bd4bd371f2 req-4f3140f7-32a9-4b8f-94f3-c84137787c15 service nova] Creating event network-vif-deleted:611e2dc7-eca5-40b7-9342-04acfdcf9f5c for instance ffb46828-0fa9-44fe-8217-364a1ee8b77a on n-h2-861333-10 Oct 19 06:51:38.409860 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cd0d5a75-b141-47e8-a3c2-80bd4bd371f2 req-4f3140f7-32a9-4b8f-94f3-c84137787c15 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052220 Oct 19 06:51:38.415515 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 315/593] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:38.422179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:38.422959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:38.430902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.431012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.432169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.432956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.433482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.434624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.537723 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-353a34eb-79b0-49cb-b300-bf0533642579 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.290159 Oct 19 06:51:38.538371 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 279/594] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 06:51:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:51:38.552742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:38.552742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:38.575992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.577938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.579723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.580913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.583236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.583871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.644687 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] HTTP exception thrown: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Request method failure captured: Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a HTTP/1.1 Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT549h4_s69-zOn6bOJa38phHWMu-VGBKcdEkodvRVNmiijl15E_YOYNVe-M8q0Id7yIZtwAQL6OW8Dl3qyX5U8nN1eM_BXzUJwUc0RK9dgCYy6av1W80LGvSa7HPn5Jg2Yb3luKz59K7gP4DUfNlrnrR2x3BE-VpU9CFeFDjgD3k_ko Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:51:38.649578 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0587af802f4f4b98aca0da31c1944b4b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 32e7566840814f1fa1d2c765bdada925 Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:38.651255 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'ffb46828-0fa9-44fe-8217-364a1ee8b77a'} Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:38.652135 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:38.653613 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:38.655764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Returning 404 to user: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:38.657756 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8df0f6be-e65d-4211-b0ab-c1df0a14b20a tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 404 len: 111 microversion: 2.1 time: 0.118418 Oct 19 06:51:38.660802 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 280/595] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:38 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:38.667628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:38.671111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:38.678866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.679667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.680493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.682860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.687009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.688394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.858459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:38.876505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:38.877963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:38.889160 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-640e5829-f8fd-4a8d-b382-63c82ef3fdcb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.226958 Oct 19 06:51:38.892470 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 281/596] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:38 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:38.897060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:38.897965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:38.908998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.909874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.914077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.915538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:38.916587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:38.917645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:38.996138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:39.020760 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d374fde-96cf-4542-a872-fd33b8f2c5e9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 0.603755 Oct 19 06:51:39.034516 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 316/597] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:38 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:39.060565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:39.062461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:39.078823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:39.079704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:39.089098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:39.092278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:39.094170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:39.097456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:39.269554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:39.282029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:39.288748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:39.289380 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-064022db-1afb-4bb8-af02-b0cd732f9779 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1361 microversion: 2.25 time: 0.397308 Oct 19 06:51:39.290499 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 282/598] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:38 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:39.301982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1944886253", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:39.320318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:39.339917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:39.345813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:39.379910 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3e34b7f-08a7-4ddb-b4a9-71d0cd391518 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.340806 Oct 19 06:51:39.379910 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 317/599] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:39 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:39.397974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-660d7d05-5563-4100-a70d-7800d3427182 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Calling method '.version_select at 0x7f6d64c42f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:39.443681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:51:39.865460 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-660d7d05-5563-4100-a70d-7800d3427182 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/c4695c6a-5639-46eb-9ce0-ce324622ee79" status: 200 len: 142 microversion: 2.1 time: 0.486712 Oct 19 06:51:39.866744 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 318/600] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 06:51:39 2022] GET /compute/v2.1/os-floating-ips/c4695c6a-5639-46eb-9ce0-ce324622ee79 => generated 142 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:39.872251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:39.874001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:39.898800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:39.899673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:39.900217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:39.901273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:39.902090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:39.902728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:39.917261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:39.919021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:39.919021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:39.919485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:39.920159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:39.930894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:39.931718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:39.932415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:39.933361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:39.934037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:39.934683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:39.942057 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] HTTP exception thrown: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Request method failure captured: Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a HTTP/1.1 Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT549h4_s69-zOn6bOJa38phHWMu-VGBKcdEkodvRVNmiijl15E_YOYNVe-M8q0Id7yIZtwAQL6OW8Dl3qyX5U8nN1eM_BXzUJwUc0RK9dgCYy6av1W80LGvSa7HPn5Jg2Yb3luKz59K7gP4DUfNlrnrR2x3BE-VpU9CFeFDjgD3k_ko Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:51:39.944240 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0587af802f4f4b98aca0da31c1944b4b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 32e7566840814f1fa1d2c765bdada925 Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:39.948836 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'ffb46828-0fa9-44fe-8217-364a1ee8b77a'} Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:39.949706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:39.950946 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:39.952098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Returning 404 to user: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:39.952098 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6bc9414-42d6-489a-9bbd-f8f40d7ce878 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 404 len: 111 microversion: 2.1 time: 0.078794 Oct 19 06:51:39.955470 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 319/601] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:51:39 2022] DELETE /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:39.962395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f30db4c5-142b-49fb-9977-a3c265b0af6a tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Calling method '.version_select at 0x7f6d64c42af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:39.964831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Getting quotas for project 1af903b4f61c4892b3a577b039737bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:39.973048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Getting quotas for user 90be7740f30e48b5b7575fa74719f4e2 and project 1af903b4f61c4892b3a577b039737bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:39.994595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:51:39.997304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:51:40.167768 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7c81205-30da-4f2c-8375-b9b4976812e9 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875491 Oct 19 06:51:40.201853 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 283/602] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:51:40.218648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:40.220095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:40.230642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.231493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.232190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:40.235252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.236041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.241264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:40.330344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:40.340972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:40.343124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:40.350864 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-edb52bac-1d08-4b65-b6fa-8f92a4f92c30 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.143081 Oct 19 06:51:40.352053 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 284/603] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:40 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:40.369158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f30db4c5-142b-49fb-9977-a3c265b0af6a tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.411607 Oct 19 06:51:40.369952 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 320/604] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 06:51:39 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:40.375985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:40.376851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:40.384691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:40.384691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: ffb46828-0fa9-44fe-8217-364a1ee8b77a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:40.385378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.386055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.386500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:40.387202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.387660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.388088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:40.398537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.400255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.400878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:40.401915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.402522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.403219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:40.435588 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] HTTP exception thrown: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Request method failure captured: Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a HTTP/1.1 Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT549h4_s69-zOn6bOJa38phHWMu-VGBKcdEkodvRVNmiijl15E_YOYNVe-M8q0Id7yIZtwAQL6OW8Dl3qyX5U8nN1eM_BXzUJwUc0RK9dgCYy6av1W80LGvSa7HPn5Jg2Yb3luKz59K7gP4DUfNlrnrR2x3BE-VpU9CFeFDjgD3k_ko Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:51:40.437699 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0587af802f4f4b98aca0da31c1944b4b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 32e7566840814f1fa1d2c765bdada925 Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:40.439214 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'ffb46828-0fa9-44fe-8217-364a1ee8b77a'} Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:40.448087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. Oct 19 06:51:40.450913 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:40.452828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Returning 404 to user: Instance ffb46828-0fa9-44fe-8217-364a1ee8b77a could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:40.452828 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05f31eac-f139-4332-97dc-787602cb4652 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a" status: 404 len: 111 microversion: 2.1 time: 0.085666 Oct 19 06:51:40.452828 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 285/605] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:40 2022] GET /compute/v2.1/servers/ffb46828-0fa9-44fe-8217-364a1ee8b77a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:40.460223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fd0c04f-f297-4993-a86c-d3ee5c0ee098 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:40.461392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fd0c04f-f297-4993-a86c-d3ee5c0ee098 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:40.557555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fd0c04f-f297-4993-a86c-d3ee5c0ee098 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:40.568137 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fd0c04f-f297-4993-a86c-d3ee5c0ee098 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1214 microversion: 2.1 time: 0.119403 Oct 19 06:51:40.569281 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 286/606] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:40 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:40.574599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:40.575423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:40.583199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.584003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.584620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:40.585483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.592491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.596690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:40.681906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:40.686666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:40.792264 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2323b9dd-c110-4187-812b-7768593ae543 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 0.363798 Oct 19 06:51:40.792264 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 321/607] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:40 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:40.792264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-689bdc5f-b335-4424-a4e8-a48c8e1b44db tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Calling method '.version_select at 0x7f6d64c425e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:40.916170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:40.916170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:40.917562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:40.917562 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-190a4c69-94be-4f6b-9a9c-6d8a65833cf2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1361 microversion: 2.25 time: 0.337340 Oct 19 06:51:40.932442 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 287/608] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:40 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1361 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:40.941737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:40.941737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:40.950710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.951234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.951711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:40.952434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:40.953459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:40.953901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.059496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:41.059496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:41.059851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:41.064824 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8876d551-43d6-4f0a-bef9-083939000ea3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.131375 Oct 19 06:51:41.065473 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 288/609] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:40 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:41.070358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:41.070963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:41.079303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:41.079303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:41.079303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.079766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:41.080227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:41.080731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.094853 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] HTTP exception thrown: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Request method failure captured: Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 HTTP/1.1 Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT549h4_s69-zOn6bOJa38phHWMu-VGBKcdEkodvRVNmiijl15E_YOYNVe-M8q0Id7yIZtwAQL6OW8Dl3qyX5U8nN1eM_BXzUJwUc0RK9dgCYy6av1W80LGvSa7HPn5Jg2Yb3luKz59K7gP4DUfNlrnrR2x3BE-VpU9CFeFDjgD3k_ko Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:51:41.096527 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0587af802f4f4b98aca0da31c1944b4b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 32e7566840814f1fa1d2c765bdada925 Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.097895 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'f94fb96e-22d0-493e-9d10-80009cf6ebb9'} Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:41.098808 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.100360 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.102527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Returning 404 to user: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:41.102527 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21231a9c-caa1-4149-849d-4a0f84bc5603 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 404 len: 111 microversion: 2.1 time: 0.031435 Oct 19 06:51:41.102527 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 289/610] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:51:41 2022] DELETE /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:41.107423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:41.107765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] [instance: f94fb96e-22d0-493e-9d10-80009cf6ebb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:41.110735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:41.114155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:41.114725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:41.115226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.115983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:41.116537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:41.117027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.130875 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] HTTP exception thrown: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Request method failure captured: Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 HTTP/1.1 Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT549h4_s69-zOn6bOJa38phHWMu-VGBKcdEkodvRVNmiijl15E_YOYNVe-M8q0Id7yIZtwAQL6OW8Dl3qyX5U8nN1eM_BXzUJwUc0RK9dgCYy6av1W80LGvSa7HPn5Jg2Yb3luKz59K7gP4DUfNlrnrR2x3BE-VpU9CFeFDjgD3k_ko Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:51:41.132537 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0587af802f4f4b98aca0da31c1944b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0587af802f4f4b98aca0da31c1944b4b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0587af802f4f4b98aca0da31c1944b4b Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-181029480 Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 32e7566840814f1fa1d2c765bdada925 Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersAdminTestJSON-181029480-project Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.133941 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'f94fb96e-22d0-493e-9d10-80009cf6ebb9'} Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:41.134710 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. Oct 19 06:51:41.135830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:51:41.136919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] Returning 404 to user: Instance f94fb96e-22d0-493e-9d10-80009cf6ebb9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:41.136919 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d027d10e-a65b-4910-b12d-086ad1454d64 tempest-DeleteServersAdminTestJSON-181029480 tempest-DeleteServersAdminTestJSON-181029480-project] 10.222.0.39 "GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9" status: 404 len: 111 microversion: 2.1 time: 0.031394 Oct 19 06:51:41.136919 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 290/611] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:41 2022] GET /compute/v2.1/servers/f94fb96e-22d0-493e-9d10-80009cf6ebb9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:41.390498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:41.391100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:41.397023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:41.397545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:41.397985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.398684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:41.399140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:41.399570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.469422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:41.490138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:41.490138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:41.490138 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29d342e1-e2d4-4488-80c3-a2796decc23e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.103071 Oct 19 06:51:41.490666 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 291/612] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:41 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:51:41.592342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57e90475-cbb1-48f2-af82-d9716656f98b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:41.593291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57e90475-cbb1-48f2-af82-d9716656f98b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:41.655220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-57e90475-cbb1-48f2-af82-d9716656f98b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:41.667369 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57e90475-cbb1-48f2-af82-d9716656f98b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1214 microversion: 2.1 time: 0.077134 Oct 19 06:51:41.667369 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 292/613] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:41 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:41.729230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b04c94ae-3ed6-4b27-95ac-af4b4b2e98ac req-81b99e92-18e7-48a8-b3dc-9a9dd36f0212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f4b644a-9003-441d-a9fe-e1c6a6db83c1", "name": "network-vif-plugged", "status": "completed", "tag": "c3c575e8-a2aa-48e4-b018-4a01e5f71e1f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:41.741840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b04c94ae-3ed6-4b27-95ac-af4b4b2e98ac req-81b99e92-18e7-48a8-b3dc-9a9dd36f0212 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:41.742586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b04c94ae-3ed6-4b27-95ac-af4b4b2e98ac req-81b99e92-18e7-48a8-b3dc-9a9dd36f0212 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:41.743188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b04c94ae-3ed6-4b27-95ac-af4b4b2e98ac req-81b99e92-18e7-48a8-b3dc-9a9dd36f0212 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.761481 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b04c94ae-3ed6-4b27-95ac-af4b4b2e98ac req-81b99e92-18e7-48a8-b3dc-9a9dd36f0212 service nova] Creating event network-vif-plugged:c3c575e8-a2aa-48e4-b018-4a01e5f71e1f for instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 on n-h1-861333-10 Oct 19 06:51:41.767418 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b04c94ae-3ed6-4b27-95ac-af4b4b2e98ac req-81b99e92-18e7-48a8-b3dc-9a9dd36f0212 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046072 Oct 19 06:51:41.768602 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 293/614] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:51:41.779405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:41.782085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:41.789090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:41.789929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:41.790523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.791401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:41.792003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:41.792621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:41.855989 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-689bdc5f-b335-4424-a4e8-a48c8e1b44db tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/c4695c6a-5639-46eb-9ce0-ce324622ee79" status: 202 len: 0 microversion: 2.1 time: 1.118333 Oct 19 06:51:41.857372 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 322/615] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:51:40 2022] DELETE /compute/v2.1/os-floating-ips/c4695c6a-5639-46eb-9ce0-ce324622ee79 => generated 0 bytes in 1121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:51:41.869256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d52c9b83-5268-4b71-962e-89928af05184 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Action: 'create', calling method: .version_select at 0x7f6d64c420d0>, body: {"pool": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:42.110421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.121721 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a00bb3c6-c73f-4de5-8d47-9bd0e78a7276 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 0.349502 Oct 19 06:51:42.122524 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 294/616] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:41 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:42.132147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:42.133038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:42.149813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:42.152847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:42.153297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:42.154697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:42.155167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:42.155592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:42.333978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.342802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.351269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.352862 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0347a5ac-c5fd-4eef-b93b-91f9303c7d33 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1361 microversion: 2.25 time: 0.229149 Oct 19 06:51:42.368551 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 295/617] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:42 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:42.381452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:42.382432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:42.397481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:42.407669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:42.407669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:42.407669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:42.407669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:42.408036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:42.485827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.498507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.500771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.506559 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ccef052-11fe-455f-b169-093f61c47cd7 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.136496 Oct 19 06:51:42.520646 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 296/618] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:42 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:42.534173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:42.535040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:42.541358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:42.559736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:42.559736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:42.559736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:42.559736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:42.560365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:42.623204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.628165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:42.633213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.634660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.641111 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b9610a5-674d-4d51-af51-efe7f446ad88 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.118000 Oct 19 06:51:42.641700 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 297/619] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:42 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:42.687722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:42.688456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:42.694397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:42.694957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:42.695490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:42.696530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:42.697056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:42.700921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:42.766079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:42.773874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9439a33-9af9-4278-a8eb-93625629155a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1210 microversion: 2.1 time: 0.090929 Oct 19 06:51:42.781050 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 298/620] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:42 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:43.149700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:43.151766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:43.157246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.157852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.158296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.159016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.159478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.159910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.303918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.316874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4dbe9687-7e7a-4da2-b42b-f33dc5492260 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 0.171099 Oct 19 06:51:43.317820 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 299/621] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:43 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:51:43.383505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:43.384615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:43.391231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.391689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.392187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.393134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.393625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.394057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.541578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.556361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.556361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.557561 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dbc4ffbd-a388-4092-ac45-04c45ba86af0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1361 microversion: 2.25 time: 0.178564 Oct 19 06:51:43.560653 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 300/622] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:43 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:43.578356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:43.579116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:43.585866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.586362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.586804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.587514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.588183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.588922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.672226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.682847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.684352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.689457 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60b93a4f-f732-402f-803d-4efc8af6c9fa tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1447 microversion: 2.75 time: 0.127137 Oct 19 06:51:43.694356 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 301/623] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:43 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:43.695368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:43.695563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:43.701570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.702061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.702600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.703805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.704587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.710251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.799608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.809652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.811564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:43.817531 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8bc049fe-77e0-4b41-a18c-527a220f8c04 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1535 microversion: 2.91 time: 0.125942 Oct 19 06:51:43.828441 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 302/624] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:43 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1535 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:43.828441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d4584cfa-a728-4e8a-8e4d-ba52faba8302 req-ffe20bf4-c235-477d-99cc-0c3ea960f3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a33734-978d-4ec5-8a10-062f8208e013", "name": "network-vif-plugged", "status": "completed", "tag": "8f191a47-185e-4db5-97b0-9f273b9ba3c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:43.834600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4584cfa-a728-4e8a-8e4d-ba52faba8302 req-ffe20bf4-c235-477d-99cc-0c3ea960f3cd service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.835348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4584cfa-a728-4e8a-8e4d-ba52faba8302 req-ffe20bf4-c235-477d-99cc-0c3ea960f3cd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.836129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4584cfa-a728-4e8a-8e4d-ba52faba8302 req-ffe20bf4-c235-477d-99cc-0c3ea960f3cd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.860378 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d4584cfa-a728-4e8a-8e4d-ba52faba8302 req-ffe20bf4-c235-477d-99cc-0c3ea960f3cd service nova] Creating event network-vif-plugged:8f191a47-185e-4db5-97b0-9f273b9ba3c8 for instance f1a33734-978d-4ec5-8a10-062f8208e013 on n-h1-861333-10 Oct 19 06:51:43.869327 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d4584cfa-a728-4e8a-8e4d-ba52faba8302 req-ffe20bf4-c235-477d-99cc-0c3ea960f3cd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048894 Oct 19 06:51:43.870466 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 303/625] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:43.885091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:43.891930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:43.900998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.901498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.904621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:43.905574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:43.906784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:43.907369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:44.086742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:44.117150 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5c6e7df-10fc-44f5-9091-f0365dedce29 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1210 microversion: 2.1 time: 0.244453 Oct 19 06:51:44.118917 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 304/626] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:43 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1210 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:44.339430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:44.340415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:44.348650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:44.353775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:44.353775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:44.353775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:44.353775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:44.354147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:44.545823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:44.559211 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bbe4f1a5-c0ca-492e-9570-8d3c0aa37439 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 0.224080 Oct 19 06:51:44.560313 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 305/627] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:44 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:44.584640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:44.586894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:44.591294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:44.591788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:44.592258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:44.592986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:44.593464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:44.594409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:44.768818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:44.777516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:44.778957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:44.780178 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14d2387f-eb68-422c-a862-4f8ace44a9f4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1558 microversion: 2.25 time: 0.199420 Oct 19 06:51:44.780700 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 306/628] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:44 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:51:44.785315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:44.789244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:44.793258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:44.793766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:44.794184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:44.794879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:44.795344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:44.795761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:44.862730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:44.871101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:44.872570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:44.877880 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-045c6078-e142-45c9-934d-21da3a164c9b tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1453 microversion: 2.75 time: 0.096025 Oct 19 06:51:44.878471 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 307/629] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:44 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:44.972055 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d52c9b83-5268-4b71-962e-89928af05184 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.108639 Oct 19 06:51:44.972844 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 323/630] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 06:51:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:51:44.977889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:44.982183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:44.987487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:44.987977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:44.988471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:44.989480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:44.989941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:44.990368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.082389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:45.093998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:45.096388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:45.104726 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-375487f8-6435-44cf-9baa-be09df5cc253 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1535 microversion: 2.91 time: 0.128531 Oct 19 06:51:45.104726 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 324/631] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:44 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1535 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:45.110690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-533a45db-fcda-4fc9-b9b6-42b46ea37b01 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Calling method '.version_select at 0x7f6d64bd60d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:45.191252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:45.191873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:45.197988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.202466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.202466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.202466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.202723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.202723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.343733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:45.361436 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0574910-cf7e-4e13-b19d-6b6825652fd6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 2052 microversion: 2.25 time: 0.481804 Oct 19 06:51:45.362670 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 308/632] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:44 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 2052 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:45.368441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:45.369319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:45.390269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.390974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.392242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.395464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.396035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.396535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.479204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:45.487780 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33143460-5348-4b4c-b155-544db2da3f09 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1266 microversion: 2.1 time: 0.123718 Oct 19 06:51:45.488620 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 309/633] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:45 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:45.493116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:45.493712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:45.504601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.505587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.506428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.508017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.508747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.509463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.663979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:45.678347 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c71bd8bf-4656-45a1-a4c6-231b4ef4b2a5 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 2052 microversion: 2.25 time: 0.188466 Oct 19 06:51:45.678909 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 310/634] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:45 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 2052 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:45.691297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:45.691297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:45.691297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.691297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.691977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.691977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.692399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.693037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.923576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:45.932405 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6f35541-ce66-45b3-9394-e122e3717647 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1311 microversion: 2.1 time: 0.252463 Oct 19 06:51:45.933243 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 311/635] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:45 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:45.938242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ce8f276b-0c4c-4786-983b-e291fcd1d343 req-2cabcd6e-e9ba-4229-a9ea-eb7e8e40494f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da", "tag": "acdc01a7-4d46-4006-821e-225a7f07253f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:45.948998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce8f276b-0c4c-4786-983b-e291fcd1d343 req-2cabcd6e-e9ba-4229-a9ea-eb7e8e40494f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.949552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce8f276b-0c4c-4786-983b-e291fcd1d343 req-2cabcd6e-e9ba-4229-a9ea-eb7e8e40494f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.950051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce8f276b-0c4c-4786-983b-e291fcd1d343 req-2cabcd6e-e9ba-4229-a9ea-eb7e8e40494f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.961880 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ce8f276b-0c4c-4786-983b-e291fcd1d343 req-2cabcd6e-e9ba-4229-a9ea-eb7e8e40494f service nova] Creating event network-changed:acdc01a7-4d46-4006-821e-225a7f07253f for instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da on n-h2-861333-10 Oct 19 06:51:45.966910 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ce8f276b-0c4c-4786-983b-e291fcd1d343 req-2cabcd6e-e9ba-4229-a9ea-eb7e8e40494f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032337 Oct 19 06:51:45.967627 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 312/636] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:45.973192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7eb1aa9-8c1e-4d1e-9da6-7d0b2c9da590 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:45.977022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7eb1aa9-8c1e-4d1e-9da6-7d0b2c9da590 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.977552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7eb1aa9-8c1e-4d1e-9da6-7d0b2c9da590 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.977941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7eb1aa9-8c1e-4d1e-9da6-7d0b2c9da590 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:45.978667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7eb1aa9-8c1e-4d1e-9da6-7d0b2c9da590 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:45.979127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7eb1aa9-8c1e-4d1e-9da6-7d0b2c9da590 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:45.979554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7eb1aa9-8c1e-4d1e-9da6-7d0b2c9da590 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:46.003461 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7eb1aa9-8c1e-4d1e-9da6-7d0b2c9da590 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.034392 Oct 19 06:51:46.003978 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 313/637] 10.222.0.39 () {60 vars in 1217 bytes} [Wed Oct 19 06:51:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:51:46.008664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:46.009374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:46.016478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:46.016964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:46.017398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:46.018107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:46.018556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:46.018980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:46.132559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:46.142108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:46.143974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:46.150137 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c70cc85-4a64-4a17-879e-b622e6380249 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1453 microversion: 2.75 time: 0.145090 Oct 19 06:51:46.163538 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 314/638] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:46 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:46.167650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-10", "block_migration": "auto"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:46.171498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:46.178231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:46.178816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:46.179437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:46.181407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:46.182427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:46.183056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:46.217762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'flavor' on Instance uuid 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:46.221747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:46.231345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Going to try to live migrate instance to n-h2-861333-10 {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 06:51:46.273655 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-533a45db-fcda-4fc9-b9b6-42b46ea37b01 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/af53e777-eebc-4c90-8167-099286b8f173" status: 202 len: 0 microversion: 2.1 time: 1.168957 Oct 19 06:51:46.274247 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 325/639] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:51:45 2022] DELETE /compute/v2.1/os-floating-ips/af53e777-eebc-4c90-8167-099286b8f173 => generated 0 bytes in 1170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:51:46.279095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:46.279697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:46.287609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:46.288163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:46.288731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:46.289925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:46.290403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:46.290834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:46.359442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:46.367498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:46.369496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:46.375642 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37ead5af-bcd9-4e3c-a886-b9825dc522ec tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1535 microversion: 2.91 time: 0.099536 Oct 19 06:51:46.376362 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 326/640] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:46 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1535 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:46.381040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15b12df8-268f-4502-b0fa-632117b5e8b3 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Calling method '.version_select at 0x7f6d64bfcb80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:46.425573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-15b12df8-268f-4502-b0fa-632117b5e8b3 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP af53e777-eebc-4c90-8167-099286b8f173 could not be found", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 06:51:46.426267 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-15b12df8-268f-4502-b0fa-632117b5e8b3 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] HTTP exception thrown: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15b12df8-268f-4502-b0fa-632117b5e8b3 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Request method failure captured: Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-floating-ips/af53e777-eebc-4c90-8167-099286b8f173 HTTP/1.1 Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT552yOa32g-pP7n_x8g5oZ8qrlDTkjYO0lqtct7DPeBiKvtpes2P2Z3dUtzQxc239iEDkgzcVft6LUuTdBfNVtTuSEswXENimJG74rh2PplYQNVA0IfE7FUB1t5fiqV8a6onuJRVbVN83-ml5wL41LBlQ5RDEUL9yTez7JvWzvqj_T0 Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 911ad132ad444d5aa9b5259df093b0df Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsTestJSON-114460186 Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:51:46.438520 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/911ad132ad444d5aa9b5259df093b0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/911ad132ad444d5aa9b5259df093b0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/911ad132ad444d5aa9b5259df093b0df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_911ad132ad444d5aa9b5259df093b0df", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsTestJSON-114460186 Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 911ad132ad444d5aa9b5259df093b0df Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsTestJSON-114460186 Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsTestJSON-114460186-project Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c20833d458294add92853fdc89e6b43f Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsTestJSON-114460186-project Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: exception: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'af53e777-eebc-4c90-8167-099286b8f173'} Oct 19 06:51:46.441388 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 06:51:46.442354 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP af53e777-eebc-4c90-8167-099286b8f173 could not be found Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77525520-fad1-4c74-b1ee-8756c24dc78e'] Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173. Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:46.443805 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:46.445358 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:46.446854 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 Oct 19 06:51:46.446854 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.446854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15b12df8-268f-4502-b0fa-632117b5e8b3 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Returning 404 to user: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:46.446854 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15b12df8-268f-4502-b0fa-632117b5e8b3 tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/af53e777-eebc-4c90-8167-099286b8f173" status: 404 len: 111 microversion: 2.1 time: 0.062415 Oct 19 06:51:46.446854 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 327/641] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 06:51:46 2022] GET /compute/v2.1/os-floating-ips/af53e777-eebc-4c90-8167-099286b8f173 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:51:46.449626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4d89214-e1f3-43ab-8c3b-bb26da3be9df tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Calling method '.version_select at 0x7f6d64b2ac10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:46.510635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-c4d89214-e1f3-43ab-8c3b-bb26da3be9df tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP af53e777-eebc-4c90-8167-099286b8f173 could not be found", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 06:51:46.513801 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c4d89214-e1f3-43ab-8c3b-bb26da3be9df tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] HTTP exception thrown: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4d89214-e1f3-43ab-8c3b-bb26da3be9df tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Request method failure captured: Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-floating-ips/af53e777-eebc-4c90-8167-099286b8f173 HTTP/1.1 Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT552yOa32g-pP7n_x8g5oZ8qrlDTkjYO0lqtct7DPeBiKvtpes2P2Z3dUtzQxc239iEDkgzcVft6LUuTdBfNVtTuSEswXENimJG74rh2PplYQNVA0IfE7FUB1t5fiqV8a6onuJRVbVN83-ml5wL41LBlQ5RDEUL9yTez7JvWzvqj_T0 Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 911ad132ad444d5aa9b5259df093b0df Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsTestJSON-114460186 Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:51:46.520908 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/911ad132ad444d5aa9b5259df093b0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/911ad132ad444d5aa9b5259df093b0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/911ad132ad444d5aa9b5259df093b0df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_911ad132ad444d5aa9b5259df093b0df", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsTestJSON-114460186 Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 911ad132ad444d5aa9b5259df093b0df Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsTestJSON-114460186 Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsTestJSON-114460186-project Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c20833d458294add92853fdc89e6b43f Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsTestJSON-114460186-project Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: exception: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'af53e777-eebc-4c90-8167-099286b8f173'} Oct 19 06:51:46.524840 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 06:51:46.525621 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP af53e777-eebc-4c90-8167-099286b8f173 could not be found Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28b6d4fb-d76e-456b-b7f6-0781e0defa11'] Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173. Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:46.526655 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:51:46.527773 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:51:46.528893 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 Oct 19 06:51:46.528893 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:51:46.528893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4d89214-e1f3-43ab-8c3b-bb26da3be9df tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] Returning 404 to user: Floating IP not found for ID af53e777-eebc-4c90-8167-099286b8f173 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:51:46.531745 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4d89214-e1f3-43ab-8c3b-bb26da3be9df tempest-FloatingIPsTestJSON-114460186 tempest-FloatingIPsTestJSON-114460186-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/af53e777-eebc-4c90-8167-099286b8f173" status: 404 len: 111 microversion: 2.1 time: 0.077438 Oct 19 06:51:46.534528 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 328/642] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:51:46 2022] DELETE /compute/v2.1/os-floating-ips/af53e777-eebc-4c90-8167-099286b8f173 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:51:46.541259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:46.542228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:46.551341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:46.552137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:46.552861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:46.555196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:46.555898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:46.556588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:46.685987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:46.698559 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9144b53-708c-4cd8-83e6-72be1a01771a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1284 microversion: 2.1 time: 0.162743 Oct 19 06:51:46.699471 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 329/643] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:46 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:47.067233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cae71864-af58-42b9-91e8-5e45c757301a tempest-FlavorMetadataValidation-1023027732 tempest-FlavorMetadataValidation-1023027732-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-57832943", "id": 125794320, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:47.186239 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cae71864-af58-42b9-91e8-5e45c757301a tempest-FlavorMetadataValidation-1023027732 tempest-FlavorMetadataValidation-1023027732-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 466 microversion: 2.86 time: 0.294162 Oct 19 06:51:47.186937 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 330/644] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:51:46 2022] POST /compute/v2.1/flavors => generated 466 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:51:47.196911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:47.197528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:47.204040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:47.204563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:47.205027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:47.205702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:47.206159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:47.206592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:47.811336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:47.819950 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c2e3620-6361-49c6-8961-6027c049fd68 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1493 microversion: 2.1 time: 0.631529 Oct 19 06:51:47.820556 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 331/645] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:47 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1493 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:47.824944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:47.825621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:47.831967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:47.832486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:47.834133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:47.834848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:47.835303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:47.835890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:47.959621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:47.968138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:47.969619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:47.976008 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2bf5a8ea-a5ca-4c2e-8518-bdeaf6d99b3d tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1438 microversion: 2.75 time: 0.153905 Oct 19 06:51:47.976971 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 332/646] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:47 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1438 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:48.007139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4be12f2b-0e8f-4d0c-9db2-ca40960c9914 tempest-FlavorMetadataValidation-1023027732 tempest-FlavorMetadataValidation-1023027732-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:48.178733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:48.179809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:48.300858 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4be12f2b-0e8f-4d0c-9db2-ca40960c9914 tempest-FlavorMetadataValidation-1023027732 tempest-FlavorMetadataValidation-1023027732-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/125794320/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.309440 Oct 19 06:51:48.304168 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 333/647] 10.222.0.39 () {62 vars in 1262 bytes} [Wed Oct 19 06:51:47 2022] POST /compute/v2.1/flavors/125794320/os-extra_specs => generated 62 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:48.311363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:48.312480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:48.321147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:48.322055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:48.322786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:48.324441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:48.325449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:48.326123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:48.424547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:48.444432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:48.452255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:48.467268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:48.469608 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-703329f7-56f5-44e4-afb8-aa8cba1ce8ca tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1478 microversion: 2.91 time: 0.165629 Oct 19 06:51:48.470548 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 334/648] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:48 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1478 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:48.475345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:48.476251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:48.485121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:48.485854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:48.486535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:48.487480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:48.488264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:48.488910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:48.821360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:48.830515 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06d9622b-3160-483f-b1aa-00f79d7517ce tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1314 microversion: 2.1 time: 0.358673 Oct 19 06:51:48.831493 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 335/649] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:48 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:48.842282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7049044-ce30-499f-863c-340689d5f7e8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:48.843124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b7049044-ce30-499f-863c-340689d5f7e8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:48.849643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7049044-ce30-499f-863c-340689d5f7e8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:48.850205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7049044-ce30-499f-863c-340689d5f7e8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:48.850716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7049044-ce30-499f-863c-340689d5f7e8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:48.851544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7049044-ce30-499f-863c-340689d5f7e8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:48.852247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7049044-ce30-499f-863c-340689d5f7e8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:48.852643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7049044-ce30-499f-863c-340689d5f7e8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:49.172757 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7049044-ce30-499f-863c-340689d5f7e8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1646 microversion: 2.1 time: 0.334649 Oct 19 06:51:49.173425 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 336/650] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:48 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1646 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:49.296438 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b0e3ce6-3a10-4a81-b4b3-a2e18c5d54bb tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1/action" status: 202 len: 0 microversion: 2.25 time: 3.134731 Oct 19 06:51:49.299853 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 315/651] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:51:46 2022] POST /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1/action => generated 0 bytes in 3139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:51:49.307884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cace2042-07dd-4810-b07d-6f6f5a36c5e2 tempest-FlavorMetadataValidation-1023027732 tempest-FlavorMetadataValidation-1023027732-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:49.318848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:49.321903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:49.329994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:49.330551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:49.330993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:49.331760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:49.332260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:49.332850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:49.404640 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cace2042-07dd-4810-b07d-6f6f5a36c5e2 tempest-FlavorMetadataValidation-1023027732 tempest-FlavorMetadataValidation-1023027732-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/125794320" status: 202 len: 0 microversion: 2.86 time: 0.101138 Oct 19 06:51:49.405291 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 316/652] 10.222.0.39 () {60 vars in 1199 bytes} [Wed Oct 19 06:51:49 2022] DELETE /compute/v2.1/flavors/125794320 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:51:49.414310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-861333-10"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:49.416703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:49.423292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:49.423984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:49.424896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:49.426224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:49.426950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:49.427724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:49.428297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:51:49.428797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:51:49.429863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:51:49.430285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:51:49.430698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:51:49.485747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-861333-10". {{(pid=127567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 06:51:49.680695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:49.688330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:49.689284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:49.690135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:49.691060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:49.691721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:49.692379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:49.868778 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d67cf7ae-b4fb-4561-bd3a-880201b074da tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c/action" status: 202 len: 0 microversion: 2.91 time: 0.462340 Oct 19 06:51:49.869712 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 317/653] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:51:49 2022] POST /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:51:49.900963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9fa5175-ada5-4c43-b428-50f2d133ffe2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:49.902600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9fa5175-ada5-4c43-b428-50f2d133ffe2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:49.919494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9fa5175-ada5-4c43-b428-50f2d133ffe2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:49.928839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9fa5175-ada5-4c43-b428-50f2d133ffe2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:49.929751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9fa5175-ada5-4c43-b428-50f2d133ffe2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:49.930716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9fa5175-ada5-4c43-b428-50f2d133ffe2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:49.931414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9fa5175-ada5-4c43-b428-50f2d133ffe2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:49.932051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9fa5175-ada5-4c43-b428-50f2d133ffe2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:50.031998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:50.195741 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1f441ee-9fdd-4362-bddf-0b6c0dbe4059 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af/action" status: 202 len: 1944 microversion: 2.75 time: 1.021136 Oct 19 06:51:50.202579 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 337/654] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:51:49 2022] POST /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af/action => generated 1944 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 06:51:50.222757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:50.226990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:50.251097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:50.253779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:50.256014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:50.257927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:50.258623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:50.260210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:50.463913 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9fa5175-ada5-4c43-b428-50f2d133ffe2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1646 microversion: 2.1 time: 0.585818 Oct 19 06:51:50.463913 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 318/655] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:49 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1646 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:50.471455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f9edea2-ce2b-4929-9de8-b8ff1c2cf1c2 tempest-FlavorMetadataValidation-1023027732 tempest-FlavorMetadataValidation-1023027732-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:50.517787 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f9edea2-ce2b-4929-9de8-b8ff1c2cf1c2 tempest-FlavorMetadataValidation-1023027732 tempest-FlavorMetadataValidation-1023027732-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.053056 Oct 19 06:51:50.521594 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 319/656] 10.222.0.39 () {60 vars in 1187 bytes} [Wed Oct 19 06:51:50 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:50.547056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:50.548381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:50.559731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:50.560575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:50.561239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:50.562276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:50.563585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:50.564322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:50.647484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:50.663888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:50.666309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:50.671982 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d37d098-8ffa-45e6-aa60-3c929eefb50e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.464776 Oct 19 06:51:50.673660 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 338/657] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:50 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:50.687803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:50.693489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:50.707444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:50.708311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:50.710722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:50.711719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:50.717844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:50.721603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:50.851208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:50.863889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:50.866745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:50.879532 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffc9f564-1bb3-4bfc-9c76-96d805a52d74 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1486 microversion: 2.91 time: 0.203193 Oct 19 06:51:50.882233 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 339/658] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:50 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1486 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:50.886850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-27fec5c4-1bba-48eb-9523-a407e836ecdb req-b1fca5dc-1203-40f8-82a5-596ce5af9aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d5afde-b404-4a25-96cc-a1b35ee53ca0", "tag": "ac44155c-d8ed-4b6d-920f-dea43c5484b6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:50.917444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-27fec5c4-1bba-48eb-9523-a407e836ecdb req-b1fca5dc-1203-40f8-82a5-596ce5af9aae service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:50.917444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-27fec5c4-1bba-48eb-9523-a407e836ecdb req-b1fca5dc-1203-40f8-82a5-596ce5af9aae service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:50.917444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-27fec5c4-1bba-48eb-9523-a407e836ecdb req-b1fca5dc-1203-40f8-82a5-596ce5af9aae service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:50.930140 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-27fec5c4-1bba-48eb-9523-a407e836ecdb req-b1fca5dc-1203-40f8-82a5-596ce5af9aae service nova] Creating event network-changed:ac44155c-d8ed-4b6d-920f-dea43c5484b6 for instance c0d5afde-b404-4a25-96cc-a1b35ee53ca0 on n-h2-861333-10 Oct 19 06:51:50.936423 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-27fec5c4-1bba-48eb-9523-a407e836ecdb req-b1fca5dc-1203-40f8-82a5-596ce5af9aae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052800 Oct 19 06:51:50.938339 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 340/659] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:50.944096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:50.945196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:50.951651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:50.953650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:50.954487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:50.955419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:50.956124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:50.956775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.076677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:51.114398 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90968c5c-9ef1-423c-9e81-ae0d42408106 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.174280 Oct 19 06:51:51.128138 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 341/660] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:50 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:51.128138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cda79086-da0a-4142-830a-cc307d3ed232 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:51.137651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cda79086-da0a-4142-830a-cc307d3ed232 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.142478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cda79086-da0a-4142-830a-cc307d3ed232 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.142478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cda79086-da0a-4142-830a-cc307d3ed232 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.142478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cda79086-da0a-4142-830a-cc307d3ed232 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.142478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cda79086-da0a-4142-830a-cc307d3ed232 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.143427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cda79086-da0a-4142-830a-cc307d3ed232 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.162831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:51.186784 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50ae05b1-7f08-4474-9d59-867b828454e6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1314 microversion: 2.1 time: 0.662160 Oct 19 06:51:51.189701 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 320/661] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:50 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:51.221693 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cda79086-da0a-4142-830a-cc307d3ed232 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.103696 Oct 19 06:51:51.233680 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 342/662] 10.222.0.39 () {58 vars in 1176 bytes} [Wed Oct 19 06:51:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:51.244627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20c4ac32-e1f7-4891-9349-b0b949e83643 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:51.245720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20c4ac32-e1f7-4891-9349-b0b949e83643 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:51.254637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20c4ac32-e1f7-4891-9349-b0b949e83643 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.255757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20c4ac32-e1f7-4891-9349-b0b949e83643 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.256450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20c4ac32-e1f7-4891-9349-b0b949e83643 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.257433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20c4ac32-e1f7-4891-9349-b0b949e83643 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.258054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20c4ac32-e1f7-4891-9349-b0b949e83643 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.258664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20c4ac32-e1f7-4891-9349-b0b949e83643 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.537379 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20c4ac32-e1f7-4891-9349-b0b949e83643 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013/action" status: 202 len: 0 microversion: 2.1 time: 0.297216 Oct 19 06:51:51.538793 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 321/663] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:51:51 2022] POST /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:51:51.549155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-adf93b98-397a-46dc-ac15-6e6a8d5cc63b tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:51.550136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-adf93b98-397a-46dc-ac15-6e6a8d5cc63b tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:51.561585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adf93b98-397a-46dc-ac15-6e6a8d5cc63b tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.562893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adf93b98-397a-46dc-ac15-6e6a8d5cc63b tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.563342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adf93b98-397a-46dc-ac15-6e6a8d5cc63b tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.564150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adf93b98-397a-46dc-ac15-6e6a8d5cc63b tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.564676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adf93b98-397a-46dc-ac15-6e6a8d5cc63b tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.565030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adf93b98-397a-46dc-ac15-6e6a8d5cc63b tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.696365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:51.704919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:51.705826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:51.715557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.716340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.717377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.718147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.719340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.719949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.834490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:51.842599 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-adf93b98-397a-46dc-ac15-6e6a8d5cc63b tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1651 microversion: 2.1 time: 0.298763 Oct 19 06:51:51.843198 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 343/664] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:51 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1651 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:51.911593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:51.912448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:51.920530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.921033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.921474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:51.922215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:51.922665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:51.923281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:52.020687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:52.030347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:52.032772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:52.039606 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11ab19d3-eac6-42e3-ab8e-32e2c8518fc9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1488 microversion: 2.91 time: 0.134573 Oct 19 06:51:52.052155 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 344/665] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:51 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1488 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:52.150419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:52.151103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:52.157842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:52.158332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:52.159147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:52.159855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:52.160397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:52.160822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:52.176835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:52.186447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:52.189234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:52.190578 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4309f0a2-1571-4943-9259-e9eea0b3ba5c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.495424 Oct 19 06:51:52.191335 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 322/666] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:51 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:52.223584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:52.224728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:52.232753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:52.233508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:52.235197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:52.236393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:52.236865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:52.237930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:52.245338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:52.278764 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae7f58d1-ba93-4c74-9607-f98c0b289321 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.132209 Oct 19 06:51:52.282164 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 345/667] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:52 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:52.609756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:52.622953 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0641b6b-98a0-4482-90cc-b53c562e8737 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1314 microversion: 2.1 time: 0.411248 Oct 19 06:51:52.633791 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 323/668] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:52 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:52.871724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15e77b2c-7b2b-4ec9-b364-433ddc8984d9 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:52.872381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15e77b2c-7b2b-4ec9-b364-433ddc8984d9 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:52.882063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15e77b2c-7b2b-4ec9-b364-433ddc8984d9 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:52.882906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15e77b2c-7b2b-4ec9-b364-433ddc8984d9 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:52.883500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15e77b2c-7b2b-4ec9-b364-433ddc8984d9 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:52.884438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15e77b2c-7b2b-4ec9-b364-433ddc8984d9 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:52.884904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15e77b2c-7b2b-4ec9-b364-433ddc8984d9 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:52.885515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15e77b2c-7b2b-4ec9-b364-433ddc8984d9 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:53.068589 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15e77b2c-7b2b-4ec9-b364-433ddc8984d9 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1631 microversion: 2.1 time: 0.203096 Oct 19 06:51:53.069070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:53.073848 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 346/669] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:52 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1631 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:53.080063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:53.095187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-10", "block_migration": true, "disk_over_commit": false}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:53.098765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:53.099054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:53.099430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:53.099944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:53.100754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:53.101296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:53.101946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:53.110351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:53.111656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:53.112435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:53.113636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:53.114261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:53.114840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:53.194311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lazy-loading 'flavor' on Instance uuid f1a33734-978d-4ec5-8a10-062f8208e013 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:53.206955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Going to try to live migrate instance to n-h2-861333-10 {{(pid=127568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 06:51:53.290723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:53.303461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:53.304942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:53.307822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:53.322999 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb8d23a0-0f65-46b9-b5a4-13e17d3acb89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.257634 Oct 19 06:51:53.323879 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 324/670] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:53 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:53.354377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:53.358055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:53.370589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:53.371102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:53.371542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:53.372290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:53.374431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:53.375503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:53.761230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:53.803569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:53.805489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:53.806943 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-de88f753-d1af-4794-ad05-67f2b9244c97 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.481608 Oct 19 06:51:53.808153 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 325/671] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:53 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:53.813204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:53.814082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:53.820897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:53.821791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:53.822458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:53.823553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:53.824305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:53.825725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:53.937361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:53.966102 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-442499eb-7a87-40bd-8240-7a1d401f730a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.156738 Oct 19 06:51:53.976969 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 326/672] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:53 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:53.976969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6e487d6c-8345-47d9-8ff3-c28dc6cb5dae req-b9a65ade-3169-47ac-9228-4a9df62da685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da", "name": "network-vif-plugged", "status": "completed", "tag": "acdc01a7-4d46-4006-821e-225a7f07253f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:53.995350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e487d6c-8345-47d9-8ff3-c28dc6cb5dae req-b9a65ade-3169-47ac-9228-4a9df62da685 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:53.996700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e487d6c-8345-47d9-8ff3-c28dc6cb5dae req-b9a65ade-3169-47ac-9228-4a9df62da685 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:53.997216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e487d6c-8345-47d9-8ff3-c28dc6cb5dae req-b9a65ade-3169-47ac-9228-4a9df62da685 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:54.024163 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6e487d6c-8345-47d9-8ff3-c28dc6cb5dae req-b9a65ade-3169-47ac-9228-4a9df62da685 service nova] Creating event network-vif-plugged:acdc01a7-4d46-4006-821e-225a7f07253f for instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da on n-h2-861333-10 Oct 19 06:51:54.034190 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6e487d6c-8345-47d9-8ff3-c28dc6cb5dae req-b9a65ade-3169-47ac-9228-4a9df62da685 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064227 Oct 19 06:51:54.051413 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 327/673] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:54.051413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:54.051413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:54.060130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:54.060889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:54.061386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:54.062103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:54.062590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:54.063024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:54.628703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:54.644700 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0313722-2df9-4d0b-89fa-b3fa741c6ba5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1314 microversion: 2.1 time: 0.603050 Oct 19 06:51:54.661036 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 328/674] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:54 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:54.680562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1aadfead-79bb-4fab-a10a-2ecf4cab83ec req-9945cb82-f02b-43e9-894f-db8ec3eea483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f4b644a-9003-441d-a9fe-e1c6a6db83c1", "name": "network-vif-unplugged", "status": "completed", "tag": "c3c575e8-a2aa-48e4-b018-4a01e5f71e1f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:54.694401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1aadfead-79bb-4fab-a10a-2ecf4cab83ec req-9945cb82-f02b-43e9-894f-db8ec3eea483 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:54.695397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1aadfead-79bb-4fab-a10a-2ecf4cab83ec req-9945cb82-f02b-43e9-894f-db8ec3eea483 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:54.695808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1aadfead-79bb-4fab-a10a-2ecf4cab83ec req-9945cb82-f02b-43e9-894f-db8ec3eea483 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:54.711977 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1aadfead-79bb-4fab-a10a-2ecf4cab83ec req-9945cb82-f02b-43e9-894f-db8ec3eea483 service nova] Creating event network-vif-unplugged:c3c575e8-a2aa-48e4-b018-4a01e5f71e1f for instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 on n-h1-861333-10 Oct 19 06:51:54.717353 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1aadfead-79bb-4fab-a10a-2ecf4cab83ec req-9945cb82-f02b-43e9-894f-db8ec3eea483 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055013 Oct 19 06:51:54.718653 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 329/675] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:54.725973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:54.727025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:54.734567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:54.735305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:54.736265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:54.743235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:54.743235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:54.743235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:54.829862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:54.847482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:54.847482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:54.849999 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fada45f8-7951-4588-86f0-c8a78239453d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.130012 Oct 19 06:51:54.864637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 330/676] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:54 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:54.880311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:54.881456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:54.891061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:54.891061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:54.891862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:54.893143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:54.896284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:54.897012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:54.933621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:55.136321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:55.151057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:55.153158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:55.154539 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-089c8e3a-8af9-421d-a074-3f47f864afb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.288559 Oct 19 06:51:55.156694 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 331/677] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:54 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:55.174741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:55.175358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:55.182865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:55.183863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:55.184501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:55.185743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:55.186355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:55.187109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:55.389715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:55.413589 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-24186580-61f4-4c75-8213-8bc1b367a79a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.255394 Oct 19 06:51:55.422316 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 332/678] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:55 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:55.674819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:55.675436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:55.690515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:55.691652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:55.692512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:55.693400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:55.696091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:55.697022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:55.848598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:55.862123 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd0bd718-60de-46a3-9606-9c4c6a9f555a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1314 microversion: 2.1 time: 0.192474 Oct 19 06:51:55.863466 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 333/679] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:55 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:55.894191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:55.895460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:55.903844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:55.904604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:55.905129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:55.906113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:55.906660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:55.907221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:55.988243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:55.993068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:56.001447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:56.002946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:56.008935 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e25e1a00-012c-40c8-88fb-0407129b4c20 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.121012 Oct 19 06:51:56.009656 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 334/680] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:55 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:56.185092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:56.185715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:56.192546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:56.193038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:56.193484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:56.194189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:56.195667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:56.196142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:56.376978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:56.394543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:56.402176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:56.402403 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ab757e6-4552-42e0-b2dc-77bac9a36813 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.222176 Oct 19 06:51:56.420363 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 335/681] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:56 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:51:56.443104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:56.443799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:56.456746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:56.457284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:56.457752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:56.458660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:56.459243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:56.459982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:56.574343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:56.617156 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ad473a7-b6c3-4f52-95e2-76d9a3110971 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.172306 Oct 19 06:51:56.618170 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 336/682] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:56 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:51:56.740388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7bff7f2a-d73f-4121-a21e-995398e0120e req-7a4b5c76-4303-40f5-8273-ba19b6100e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f4b644a-9003-441d-a9fe-e1c6a6db83c1", "tag": "c3c575e8-a2aa-48e4-b018-4a01e5f71e1f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:56.750205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7bff7f2a-d73f-4121-a21e-995398e0120e req-7a4b5c76-4303-40f5-8273-ba19b6100e68 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:56.756925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7bff7f2a-d73f-4121-a21e-995398e0120e req-7a4b5c76-4303-40f5-8273-ba19b6100e68 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:56.757510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7bff7f2a-d73f-4121-a21e-995398e0120e req-7a4b5c76-4303-40f5-8273-ba19b6100e68 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:56.777466 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7bff7f2a-d73f-4121-a21e-995398e0120e req-7a4b5c76-4303-40f5-8273-ba19b6100e68 service nova] Creating event network-changed:c3c575e8-a2aa-48e4-b018-4a01e5f71e1f for instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 on n-h1-861333-10 Oct 19 06:51:56.783610 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7bff7f2a-d73f-4121-a21e-995398e0120e req-7a4b5c76-4303-40f5-8273-ba19b6100e68 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049671 Oct 19 06:51:56.784600 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 337/683] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:51:56.892580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:56.893299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:56.903489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:56.903901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:56.908637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:56.909478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:56.911572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:56.912028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:57.378585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:57.390213 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b5fa334-0562-4f9e-8bea-bcc75562bf8c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1314 microversion: 2.1 time: 0.502011 Oct 19 06:51:57.393980 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 338/684] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:56 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:57.600387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3988296-7c07-477d-9c66-c228dcad9736 tempest-FlavorsV261TestJSON-1564792284 tempest-FlavorsV261TestJSON-1564792284-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-806488012", "id": 530680526, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:57.701927 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3988296-7c07-477d-9c66-c228dcad9736 tempest-FlavorsV261TestJSON-1564792284 tempest-FlavorsV261TestJSON-1564792284-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.302316 Oct 19 06:51:57.704058 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 339/685] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:51:57 2022] POST /compute/v2.1/flavors => generated 464 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:51:57.709089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:57.709921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:57.717683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:57.720225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:57.721194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:57.722815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:57.723491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:57.724312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:57.821230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:57.830940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:57.832533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:57.841720 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef3d95f0-8844-46ee-a741-a79b6927e977 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.136401 Oct 19 06:51:57.842848 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 340/686] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:57 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:57.861303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e400c54b-9d56-4e44-a7a1-25fd916ea8ac req-ea3539e0-b377-4454-b224-b15fd782b6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d5afde-b404-4a25-96cc-a1b35ee53ca0", "name": "network-vif-plugged", "status": "completed", "tag": "ac44155c-d8ed-4b6d-920f-dea43c5484b6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:57.872935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e400c54b-9d56-4e44-a7a1-25fd916ea8ac req-ea3539e0-b377-4454-b224-b15fd782b6a3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:57.873687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e400c54b-9d56-4e44-a7a1-25fd916ea8ac req-ea3539e0-b377-4454-b224-b15fd782b6a3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:57.874286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e400c54b-9d56-4e44-a7a1-25fd916ea8ac req-ea3539e0-b377-4454-b224-b15fd782b6a3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:57.888880 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e400c54b-9d56-4e44-a7a1-25fd916ea8ac req-ea3539e0-b377-4454-b224-b15fd782b6a3 service nova] Creating event network-vif-plugged:ac44155c-d8ed-4b6d-920f-dea43c5484b6 for instance c0d5afde-b404-4a25-96cc-a1b35ee53ca0 on n-h2-861333-10 Oct 19 06:51:57.895215 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e400c54b-9d56-4e44-a7a1-25fd916ea8ac req-ea3539e0-b377-4454-b224-b15fd782b6a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050129 Oct 19 06:51:57.900179 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 341/687] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:57.905765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:57.906489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:57.913073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:57.913562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:57.914202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:57.914942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:57.915447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:57.915828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:58.161122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:58.170499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:58.172688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:58.174152 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4b33443-6ea3-4724-8e25-10e7495ef989 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.272641 Oct 19 06:51:58.189384 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 342/688] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:57 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:58.271473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e10c4d09-add3-44b5-b6a2-1959b44b2898 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Action: 'create', calling method: .version_select at 0x7f6d64def820>, body: {"keypair": {"name": "tempest-keypair-228840666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfqpVgJfkviC8raMmsCXL9AUM1lFwfRxOnsPSU0JPMBGAMJCcsxx88GoRK8Im63agv6K2386fZ/4ohKvM+qwi+mZajDrgettBytq5NhJZd2tYKi6+7E4US1Lbdoa1tMdA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:58.293767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-e10c4d09-add3-44b5-b6a2-1959b44b2898 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:58.300777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-e10c4d09-add3-44b5-b6a2-1959b44b2898 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for user cd85f92e51ed4ba0af0094c60dd800f1 and project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:58.415053 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e10c4d09-add3-44b5-b6a2-1959b44b2898 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.224390 Oct 19 06:51:58.415921 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 343/689] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Oct 19 06:51:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 226 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 06:51:58.420535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:58.421253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:58.431389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:58.432028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:58.434383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:58.434383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:58.434927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:58.435469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:58.533335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:51:58.551599 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e113947-a619-4999-8a33-b092b05771df tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.134640 Oct 19 06:51:58.558533 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 344/690] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:58 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:58.694220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f33676de-38ef-47f0-a9f2-e90eac59a3e0 tempest-FlavorsV261TestJSON-1207395852 tempest-FlavorsV261TestJSON-1207395852-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:58.705112 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f33676de-38ef-47f0-a9f2-e90eac59a3e0 tempest-FlavorsV261TestJSON-1207395852 tempest-FlavorsV261TestJSON-1207395852-project] 10.222.0.39 "GET /compute/v2.1/flavors/530680526" status: 200 len: 464 microversion: 2.61 time: 0.144913 Oct 19 06:51:58.705676 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 345/691] 10.222.0.39 () {60 vars in 1196 bytes} [Wed Oct 19 06:51:58 2022] GET /compute/v2.1/flavors/530680526 => generated 464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:51:58.717817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:58.718426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:58.727149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:58.727676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:58.728134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:58.728860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:58.729322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:58.732437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:58.938168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:58.955120 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c510689b-6ec1-4fcc-be8d-54e7fa70c09b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1314 microversion: 2.1 time: 0.248150 Oct 19 06:51:58.955826 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 346/692] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:51:58 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:51:58.968202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76ce3a71-4d32-4abc-892e-44d85d655f75 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64d91550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:58.986791 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76ce3a71-4d32-4abc-892e-44d85d655f75 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-228840666" status: 200 len: 511 microversion: 2.2 time: 0.022334 Oct 19 06:51:58.988045 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 347/693] 10.222.0.39 () {60 vars in 1255 bytes} [Wed Oct 19 06:51:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-228840666 => generated 511 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:51:58.993505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64f8b7c7-63f3-4ffa-960c-e7b41a1dadec tempest-FlavorsV261TestJSON-1564792284 tempest-FlavorsV261TestJSON-1564792284-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:59.116356 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64f8b7c7-63f3-4ffa-960c-e7b41a1dadec tempest-FlavorsV261TestJSON-1564792284 tempest-FlavorsV261TestJSON-1564792284-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/530680526" status: 200 len: 465 microversion: 2.61 time: 0.127058 Oct 19 06:51:59.117114 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 348/694] 10.222.0.39 () {62 vars in 1216 bytes} [Wed Oct 19 06:51:58 2022] PUT /compute/v2.1/flavors/530680526 => generated 465 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:51:59.130468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:59.131602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:59.146854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:59.147478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:59.147911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:59.148670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:59.149111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:59.149529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:59.239870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:59.248524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:59.250703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:59.256280 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-834a160c-259c-453f-98e3-c4613f77c513 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.138322 Oct 19 06:51:59.257445 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 349/695] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:59 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:59.275051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe0c5f79-b0b6-4a92-ae40-5f11b82a9eaf tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64def670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:59.351419 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe0c5f79-b0b6-4a92-ae40-5f11b82a9eaf tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-228840666" status: 204 len: 0 microversion: 2.2 time: 0.092860 Oct 19 06:51:59.352303 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 350/696] 10.222.0.39 () {60 vars in 1258 bytes} [Wed Oct 19 06:51:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-228840666 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:51:59.360730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45fee310-fad3-4ab6-a4ff-6a2f53e0c54f tempest-FlavorsV261TestJSON-1207395852 tempest-FlavorsV261TestJSON-1207395852-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:59.408500 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45fee310-fad3-4ab6-a4ff-6a2f53e0c54f tempest-FlavorsV261TestJSON-1207395852 tempest-FlavorsV261TestJSON-1207395852-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 7155 microversion: 2.61 time: 0.035478 Oct 19 06:51:59.409496 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 351/697] 10.222.0.39 () {60 vars in 1187 bytes} [Wed Oct 19 06:51:59 2022] GET /compute/v2.1/flavors/detail => generated 7155 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:59.414232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:59.414864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:59.422078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:59.422571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:59.423006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:59.423712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:59.424188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:59.424612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:59.620031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:59.633609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:59.638594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:51:59.639730 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef4d4367-5078-4ba6-9cfa-ec155b88ca4d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.229172 Oct 19 06:51:59.641816 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 352/698] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:59 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:59.648745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d628d0b3-76f6-4e24-a932-5b97c42b5dfc tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Action: 'create', calling method: .version_select at 0x7f6d64db0280>, body: {"keypair": {"name": "tempest-keypair-1684555560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6oITkVWSK3NqYI9TmSVkJJO3kkQxzf1Sq+ilr/35dbnovTxelwNUj1cfKBwSZfnGwepxf2SEV55rNiqaLy73MpwJSbzy2hQod9XOO4DqJjeFKZWB/C6+lmP7cI80BNig=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:51:59.685469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d628d0b3-76f6-4e24-a932-5b97c42b5dfc tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:51:59.693852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d628d0b3-76f6-4e24-a932-5b97c42b5dfc tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for user cd85f92e51ed4ba0af0094c60dd800f1 and project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:51:59.696731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:51:59.808495 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d628d0b3-76f6-4e24-a932-5b97c42b5dfc tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.164435 Oct 19 06:51:59.808785 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 353/699] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Oct 19 06:51:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 06:51:59.821074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ecded5ee-7a2f-4e14-a886-91557ffe826b tempest-FlavorsV261TestJSON-1207395852 tempest-FlavorsV261TestJSON-1207395852-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:59.867722 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ecded5ee-7a2f-4e14-a886-91557ffe826b tempest-FlavorsV261TestJSON-1207395852 tempest-FlavorsV261TestJSON-1207395852-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.61 time: 0.051174 Oct 19 06:51:59.881365 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 354/700] 10.222.0.39 () {60 vars in 1166 bytes} [Wed Oct 19 06:51:59 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:51:59.889725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:51:59.890425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:51:59.903702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:59.906423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:59.906423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:51:59.906423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:51:59.906423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:51:59.906804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:00.020470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:00.042732 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf728698-06aa-4d60-bdb3-4ad3a77a3a70 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.159982 Oct 19 06:52:00.043868 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 355/701] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:51:59 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:00.052765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ecbf685-9e4d-47e3-b16d-ce354312a71b tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64db3040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:00.928203 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ecbf685-9e4d-47e3-b16d-ce354312a71b tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684555560" status: 204 len: 0 microversion: 2.2 time: 0.883303 Oct 19 06:52:00.933461 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 356/702] 10.222.0.39 () {60 vars in 1261 bytes} [Wed Oct 19 06:52:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684555560 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:00.938259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f58b2474-d550-4a55-b7d3-b645c7d34b8d tempest-FlavorsV261TestJSON-1564792284 tempest-FlavorsV261TestJSON-1564792284-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:01.018996 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f58b2474-d550-4a55-b7d3-b645c7d34b8d tempest-FlavorsV261TestJSON-1564792284 tempest-FlavorsV261TestJSON-1564792284-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/530680526" status: 202 len: 0 microversion: 2.61 time: 0.084340 Oct 19 06:52:01.019642 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 357/703] 10.222.0.39 () {60 vars in 1199 bytes} [Wed Oct 19 06:52:00 2022] DELETE /compute/v2.1/flavors/530680526 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:01.024445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:01.025097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:01.032679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.033288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.033760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.034462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.034973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.035426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.169698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:01.185687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:01.190587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:01.195144 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86382159-29ee-49f6-aa5a-f0b43f1eb4bf tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1463 microversion: 2.1 time: 0.174395 Oct 19 06:52:01.195735 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 358/704] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:01 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1463 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:01.200430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:01.201010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:01.207817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.208366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.208867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.209805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.210364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.210792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.289779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:01.298032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:01.299437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:01.304865 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ababb19-dc37-414d-bcfd-aa65d5800c61 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.107929 Oct 19 06:52:01.305515 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 359/705] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:01 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:01.310178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:01.310779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:01.320028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.320689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.321232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.322044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.322610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.323268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.463586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:01.472270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:01.476324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:01.476324 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b5f2ba9-0617-4903-9fb4-1ee996ef7576 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.168434 Oct 19 06:52:01.476324 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 360/706] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:01 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:01.480646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2b178a1-c05a-4efc-a6dc-ec734031aefa tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Action: 'create', calling method: .version_select at 0x7f6d64e5fdc0>, body: {"keypair": {"name": "tempest-keypair-776019566", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:01.496155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d2b178a1-c05a-4efc-a6dc-ec734031aefa tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:01.502508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d2b178a1-c05a-4efc-a6dc-ec734031aefa tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for user cd85f92e51ed4ba0af0094c60dd800f1 and project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:01.597546 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2b178a1-c05a-4efc-a6dc-ec734031aefa tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.121105 Oct 19 06:52:01.598161 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 361/707] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Oct 19 06:52:01 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 06:52:01.602732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f41c0ec-6e44-443b-82e2-cf45a9587dbb tempest-FlavorsV261TestJSON-1564792284 tempest-FlavorsV261TestJSON-1564792284-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:01.627010 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f41c0ec-6e44-443b-82e2-cf45a9587dbb tempest-FlavorsV261TestJSON-1564792284 tempest-FlavorsV261TestJSON-1564792284-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.027720 Oct 19 06:52:01.627612 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 362/708] 10.222.0.39 () {60 vars in 1187 bytes} [Wed Oct 19 06:52:01 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:01.632635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:01.633222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:01.639520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.640002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.640501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.641198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.641654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.642078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.724537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:01.746698 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe3cd16f-7df2-4d14-b4b8-697ed0f1b40a tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.117769 Oct 19 06:52:01.747295 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 363/709] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:01 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:01.768663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:01.769273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:01.775855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.776374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.777165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.780476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:01.780476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:01.780476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:01.950483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:01.960813 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd3330c6-e06c-4ed8-8067-77c8a30e5f25 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1463 microversion: 2.1 time: 0.200098 Oct 19 06:52:01.961404 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 364/710] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:01 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1463 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:01.965980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-316f0293-134e-4fde-8173-800dbe901b17 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64e19700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:02.088530 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-316f0293-134e-4fde-8173-800dbe901b17 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-776019566" status: 204 len: 0 microversion: 2.2 time: 0.126048 Oct 19 06:52:02.089703 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 365/711] 10.222.0.39 () {60 vars in 1258 bytes} [Wed Oct 19 06:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-776019566 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:02.101275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1133413423", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:02.156468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:52:02.444618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:52:02.445325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:52:02.445961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:52:02.446547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:52:02.447138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:52:02.458290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:02.458788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:02.459229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:02.459964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:02.460750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:02.461196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:02.492744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Getting quotas for project 1af903b4f61c4892b3a577b039737bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:02.500849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Getting quotas for user 90be7740f30e48b5b7575fa74719f4e2 and project 1af903b4f61c4892b3a577b039737bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:02.517409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:52:02.520762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:52:02.709684 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20348704-96c3-4cb8-805c-8c379d73bdff tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612202 Oct 19 06:52:02.711030 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 366/712] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:52:02.721610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28e98b7d-110b-4aff-b354-2342695f0995 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Action: 'create', calling method: .version_select at 0x7f6d64e5f160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-528183889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrOHkWa/xtGmjuALIrk/Y2/2hoffsUmkuQoNXneOO/3XqXEbX7Ji6h2M1vUetFo6FhZgxPhc9qV9ZAT42VReIjgoMPVR4lna0jL2m3u9flD2I5/jN2rmsMq4TerPT7f9g=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:02.746224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-28e98b7d-110b-4aff-b354-2342695f0995 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:02.752881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-28e98b7d-110b-4aff-b354-2342695f0995 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for user cd85f92e51ed4ba0af0094c60dd800f1 and project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:02.854191 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28e98b7d-110b-4aff-b354-2342695f0995 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.142035 Oct 19 06:52:02.854805 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 367/713] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Oct 19 06:52:02 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 06:52:02.866815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:02.866815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:02.866815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:02.867674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:02.867674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:02.868193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:02.868657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:02.869087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:02.935240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:02.946211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:02.947702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:02.958219 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a20779c4-f0a9-468a-afa5-74167a57fb0e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.098560 Oct 19 06:52:02.958219 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 368/714] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:02 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:02.969967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:02.970765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:02.977269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:02.977848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:02.978357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:02.979060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:02.979688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:02.980233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:03.123223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:03.132292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:03.133818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:03.135062 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64afe38c-73b8-40d4-8b14-cdc8a36a72ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.179053 Oct 19 06:52:03.135705 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 369/715] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:02 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:03.157268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d137f35-adff-4ba3-913a-9533f6dcc96d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:03.157889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d137f35-adff-4ba3-913a-9533f6dcc96d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:03.216533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d137f35-adff-4ba3-913a-9533f6dcc96d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:03.225271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=44 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:03.237013 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d137f35-adff-4ba3-913a-9533f6dcc96d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1214 microversion: 2.1 time: 0.076308 Oct 19 06:52:03.237013 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 370/716] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:03 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:03.237013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:03.237961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:03.243243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:03.244640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:03.245141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:03.246516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:03.246999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:03.247429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:03.354093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:03.379712 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-513b018a-395a-4f53-9619-0863ac76a6e4 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.152429 Oct 19 06:52:03.380943 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 371/717] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:03 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:03.385695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1838c52-09a4-432d-bee9-e4a8c261412c tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Action: 'create', calling method: .version_select at 0x7f6d64e19ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1145800803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+2g6PBf8lBp8jBKG8GPgsX+NQqIO0K/cDYFT9rBXmK6zLHHQ/jo+c95RehjxQrk6Ktet258wpDJB+DSGzmoWaIzft8wm1kKVFJBaQ99ki98A5Zpk4e/fABMmkp45Kc7g=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:03.404286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c1838c52-09a4-432d-bee9-e4a8c261412c tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:03.407949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:03.411948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c1838c52-09a4-432d-bee9-e4a8c261412c tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for user cd85f92e51ed4ba0af0094c60dd800f1 and project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:03.489797 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1838c52-09a4-432d-bee9-e4a8c261412c tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.107633 Oct 19 06:52:03.490982 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 372/718] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Oct 19 06:52:03 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 06:52:03.505107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa915b18-7646-4572-be69-d4abcfc19096 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Action: 'create', calling method: .version_select at 0x7f6d64d633a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-300897343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMIKSAWTJe3aI0HABVnP+KXxvnJYT20tFs4LJax6ea13uggeJhGiMOfasy25DxcLd2GlR8NMAG9bzOKbsrsnFWRX/sjX5CSNv25iwq4FdV8exRejm6WD+qwI1ADBozKZw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:03.525264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fa915b18-7646-4572-be69-d4abcfc19096 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:03.531518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fa915b18-7646-4572-be69-d4abcfc19096 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for user cd85f92e51ed4ba0af0094c60dd800f1 and project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:03.647463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa915b18-7646-4572-be69-d4abcfc19096 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.146181 Oct 19 06:52:03.648445 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 373/719] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Oct 19 06:52:03 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 19 06:52:03.659817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:03.660357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:03.669333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:03.669889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:03.670452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:03.671460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:03.671932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:03.672403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:03.709383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:52:04.070917 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2997df48-9830-47c3-9c21-fdf776c05e03 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 204 len: 0 microversion: 2.1 time: 0.414836 Oct 19 06:52:04.071549 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 374/720] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:52:03 2022] DELETE /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:04.076440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5fe0129e-d3e3-4057-b8fa-690966f89ddb tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64d68e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:04.086790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:04.096728 n-d-861333-10 devstack@n-api.service[127567]: WARNING oslo_db.sqlalchemy.utils [None req-5fe0129e-d3e3-4057-b8fa-690966f89ddb tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 06:52:04.106805 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5fe0129e-d3e3-4057-b8fa-690966f89ddb tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.032642 Oct 19 06:52:04.106805 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 375/721] 10.222.0.39 () {60 vars in 1177 bytes} [Wed Oct 19 06:52:04 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:04.111677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:04.112936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:04.121051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.121775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.122560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:04.123512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.125353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.129673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:04.224160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:04.233098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:04.234571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:04.239729 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5125f3c-9ed6-4ece-86bf-24f0b011d840 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.131779 Oct 19 06:52:04.240348 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 376/722] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:04 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:04.244792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba29ee60-cfaa-4f06-816a-6f12526a3917 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64def0d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:04.335197 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba29ee60-cfaa-4f06-816a-6f12526a3917 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-300897343" status: 204 len: 0 microversion: 2.2 time: 0.092593 Oct 19 06:52:04.338726 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 377/723] 10.222.0.39 () {60 vars in 1318 bytes} [Wed Oct 19 06:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-300897343 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:04.349127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:04.350921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:04.365675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.366185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.366634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:04.367341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.367808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.368278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:04.573961 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a5a1455-3f92-4130-b58f-bd5e6b32109c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013/action" status: 202 len: 0 microversion: 2.1 time: 11.483050 Oct 19 06:52:04.574662 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 347/724] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:51:53 2022] POST /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013/action => generated 0 bytes in 11485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 06:52:04.581824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1595685423", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "1245314497", "adminPass": "***", "networks": [{"uuid": "22d08965-0b3f-49c9-85c6-d5880d8fee48"}], "security_groups": [{"name": "tempest-securitygroup--1287056228"}], "key_name": "tempest-keypair-864135909", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:04.623639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:04.638974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:04.641073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:04.642846 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1efce520-6ecc-4338-a500-b37346e78796 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.303941 Oct 19 06:52:04.668335 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 378/725] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:04 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:04.670397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:04.671086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:04.678688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.679177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.679645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:04.680505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.680992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.681962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:04.739322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] validate_networks() for [('22d08965-0b3f-49c9-85c6-d5880d8fee48', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:52:04.754053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:04.762554 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d24acb41-c82b-49ad-906a-e8f54f86d984 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1210 microversion: 2.1 time: 0.096291 Oct 19 06:52:04.767208 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 379/726] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:04 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:04.768392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5abb19f-1142-44d2-b1cd-2943adbf9492 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64def280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:04.846186 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5abb19f-1142-44d2-b1cd-2943adbf9492 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1145800803" status: 204 len: 0 microversion: 2.2 time: 0.080051 Oct 19 06:52:04.847399 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 380/727] 10.222.0.39 () {60 vars in 1321 bytes} [Wed Oct 19 06:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1145800803 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:04.853628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:04.854941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:04.865917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.866617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.868504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:04.872869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.872869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.872869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:04.951754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:04.977980 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28c4bff4-2221-4da9-a43f-224f77a70f86 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.129383 Oct 19 06:52:04.978658 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 381/728] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:04 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:04.983788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:04.984549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:04.990495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.991182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.991700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:04.992496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:04.992955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:04.993612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:05.135626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:05.144695 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e50dae79-6cad-41d7-adfb-4912b46e849e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.164982 Oct 19 06:52:05.145277 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 382/729] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:04 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:05.153211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7bccdc3-272f-424b-86f7-2a155a8e5876 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64d685e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:05.178595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:52:05.179025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:52:05.179501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:52:05.179912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:52:05.180391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:52:05.189908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:05.190403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:05.190821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:05.191587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:05.192045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:05.192741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:05.231781 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7bccdc3-272f-424b-86f7-2a155a8e5876 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-528183889" status: 204 len: 0 microversion: 2.2 time: 0.082316 Oct 19 06:52:05.234366 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 383/730] 10.222.0.39 () {60 vars in 1318 bytes} [Wed Oct 19 06:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-528183889 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:05.247318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-baed9a67-9540-4904-83e3-c13d3c7aef70 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Action: 'create', calling method: .version_select at 0x7f6d64db0310>, body: {"keypair": {"name": "tempest-keypair-1682467428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV4eaSgPeiajTukwIqLDPFBMOz3YCBeeUtzKIkZdOcaf6EDBHrFn33gcKfeOv2iydG3mncr+389PT8r7qpzbObf7392XBSo8UnKYuDL+9/D5Q0HgzgQG/H47tQm/aQJCg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:05.267721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-baed9a67-9540-4904-83e3-c13d3c7aef70 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:05.274869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-baed9a67-9540-4904-83e3-c13d3c7aef70 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for user cd85f92e51ed4ba0af0094c60dd800f1 and project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:05.340335 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-baed9a67-9540-4904-83e3-c13d3c7aef70 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.097382 Oct 19 06:52:05.343774 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 384/731] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Oct 19 06:52:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 06:52:05.345920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:05.346699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:05.354720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:05.355231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:05.355707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:05.356739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:05.357200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:05.357631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:05.382466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:05.391468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Getting quotas for project 5c20a486a1684575950a9e9566635cc1. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:05.396453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Getting quotas for user 98bedc34dad443bbbd646b8ff2f5ed26 and project 5c20a486a1684575950a9e9566635cc1. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:05.408984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:52:05.412719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:52:05.427647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:05.435952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:05.438039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:05.446711 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7532b651-a8c5-4df2-8940-13a1d79b13e7 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.104669 Oct 19 06:52:05.457056 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 385/732] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:05 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:05.463457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-370c6a8e-35b8-47a4-9faa-0f1514a55345 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64db3e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:05.474250 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-370c6a8e-35b8-47a4-9faa-0f1514a55345 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-1682467428" status: 200 len: 513 microversion: 2.2 time: 0.025908 Oct 19 06:52:05.477595 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 386/733] 10.222.0.39 () {60 vars in 1258 bytes} [Wed Oct 19 06:52:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1682467428 => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:05.488096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29393ae0-251a-4305-915f-e1491079c86b tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64f01ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:05.492192 n-d-861333-10 devstack@n-api.service[127567]: WARNING oslo_db.sqlalchemy.utils [None req-29393ae0-251a-4305-915f-e1491079c86b tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 06:52:05.497758 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29393ae0-251a-4305-915f-e1491079c86b tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.013738 Oct 19 06:52:05.498391 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 387/734] 10.222.0.39 () {60 vars in 1177 bytes} [Wed Oct 19 06:52:05 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:05.515308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5901385c-8b34-4f4a-afaa-ddbed5db9749 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64d7aa60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:05.580482 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-49e6e705-3bf8-42d8-b1bb-74a3cf4f2b7e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.004688 Oct 19 06:52:05.583277 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 348/735] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:52:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:52:05.603030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2fb62b27-bf58-47ae-b10d-eef0dc83502e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:05.603649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2fb62b27-bf58-47ae-b10d-eef0dc83502e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:05.627699 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5901385c-8b34-4f4a-afaa-ddbed5db9749 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682467428" status: 204 len: 0 microversion: 2.2 time: 0.115586 Oct 19 06:52:05.629319 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 388/736] 10.222.0.39 () {60 vars in 1261 bytes} [Wed Oct 19 06:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682467428 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 06:52:05.648650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Action: 'create', calling method: .version_select at 0x7f6d64d1f670>, body: {"keypair": {"name": "tempest-keypair-1147395591", "type": "x509"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:05.686367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:05.702294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for user cd85f92e51ed4ba0af0094c60dd800f1 and project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:05.721099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2fb62b27-bf58-47ae-b10d-eef0dc83502e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:05.729102 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2fb62b27-bf58-47ae-b10d-eef0dc83502e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1264 microversion: 2.1 time: 0.129727 Oct 19 06:52:05.731875 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 349/737] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:05 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1264 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:05.738230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.processutils [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp7sctdj_r/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp7sctdj_r/temp.key -subj /CN=cd85f92e51ed4ba0af0094c60dd800f1 -extensions v3_req_client {{(pid=127567) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 19 06:52:05.741545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:05.743040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:05.757890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:05.760425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:05.762947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:05.763880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:05.764562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:05.767107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:05.922513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.processutils [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp7sctdj_r/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp7sctdj_r/temp.key -subj /CN=cd85f92e51ed4ba0af0094c60dd800f1 -extensions v3_req_client" returned: 0 in 0.183s {{(pid=127567) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 19 06:52:05.924300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.processutils [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp7sctdj_r/temp.key -password pass: {{(pid=127567) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 19 06:52:06.022549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.processutils [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp7sctdj_r/temp.key -password pass:" returned: 0 in 0.098s {{(pid=127567) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 19 06:52:06.150452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:06.161376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:06.162991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:06.163940 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5816099c-39e6-44f2-8b99-3d876e8d1226 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.431014 Oct 19 06:52:06.169455 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 350/738] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:05 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:06.169455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:06.169868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:06.178708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:06.179213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:06.179660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:06.180402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:06.180871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:06.181311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:06.257163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:06.263512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Getting quotas for user cd85f92e51ed4ba0af0094c60dd800f1 and project 41cb516dcca24d75a6760c5ec897bc80. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:06.288667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:06.293261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:06.300710 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-766697ad-85cc-48e4-83d0-f0aceb6768e1 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.665930 Oct 19 06:52:06.301973 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 389/739] 10.222.0.39 () {62 vars in 1198 bytes} [Wed Oct 19 06:52:05 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 668 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:06.305237 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9111b7c9-085b-498b-8ec9-c125ef23b942 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1266 microversion: 2.1 time: 0.139495 Oct 19 06:52:06.312768 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 351/740] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:06 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:06.317489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:06.318190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:06.326516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:06.327050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:06.327491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:06.328804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:06.329266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:06.330101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:06.331475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:06.340311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:06.351559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:06.352068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:06.352544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:06.357267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:06.358016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:06.364714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:06.450264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:06.482550 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6360948e-63bf-4763-8a85-6f5e0c5e83b0 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.178730 Oct 19 06:52:06.483533 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 390/741] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:06 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:06.490959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a9fbcee-6933-452e-a3eb-81e2dc0f3839 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64db00d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:06.501235 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a9fbcee-6933-452e-a3eb-81e2dc0f3839 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-1147395591" status: 200 len: 1534 microversion: 2.2 time: 0.016528 Oct 19 06:52:06.504151 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 391/742] 10.222.0.39 () {60 vars in 1258 bytes} [Wed Oct 19 06:52:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1147395591 => generated 1534 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:06.513043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:06.513809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:06.537129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:06.537602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:06.538042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:06.539437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:06.539901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:06.540356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:06.655846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:06.658612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:06.671859 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a61f669-5aa4-4010-8e70-55d65d0959f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.357289 Oct 19 06:52:06.672269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:06.677112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:06.688405 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 352/743] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:06 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:06.700434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8baebf86-2625-4466-b877-8561836aeb03 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64c5ae50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:06.702859 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-caca9af0-d7f8-40f1-864a-fccf04249555 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.199435 Oct 19 06:52:06.705453 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 392/744] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:06 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:06.721685 n-d-861333-10 devstack@n-api.service[127568]: WARNING oslo_db.sqlalchemy.utils [None req-8baebf86-2625-4466-b877-8561836aeb03 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 06:52:06.748344 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8baebf86-2625-4466-b877-8561836aeb03 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.052708 Oct 19 06:52:06.748344 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 353/745] 10.222.0.39 () {60 vars in 1177 bytes} [Wed Oct 19 06:52:06 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:06.756537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-965acf39-76db-4205-9b06-0f507f42f119 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] Calling method '.version_select at 0x7f6d64db0d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:06.772042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0495ad2-52c6-4bad-9684-4ebf80a2630e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:06.774236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0495ad2-52c6-4bad-9684-4ebf80a2630e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:06.853026 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-965acf39-76db-4205-9b06-0f507f42f119 tempest-KeyPairsV22TestJSON-366167599 tempest-KeyPairsV22TestJSON-366167599-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147395591" status: 204 len: 0 microversion: 2.2 time: 0.100152 Oct 19 06:52:06.854811 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 393/746] 10.222.0.39 () {60 vars in 1261 bytes} [Wed Oct 19 06:52:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147395591 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:06.913451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0495ad2-52c6-4bad-9684-4ebf80a2630e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:06.922326 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0495ad2-52c6-4bad-9684-4ebf80a2630e tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1264 microversion: 2.1 time: 0.158699 Oct 19 06:52:06.922948 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 354/747] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:06 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:07.096602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Calling method '.version_select at 0x7f6d64def9d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:07.098587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.099332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.099960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.123580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.125391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.126198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.137345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.137833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.138456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.144733 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a28ffba1-fcf2-4811-9be8-22e9cbcc6b7b tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.199385 Oct 19 06:52:07.146167 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 394/748] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:52:06 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:07.160702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Calling method '.version_select at 0x7f6d6494c940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:07.162455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.162972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.163585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.176307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.176630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.177066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.195549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:07.196723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:07.204699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.205327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.205580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.205956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.206134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.206648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.206971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.207654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.208205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.213103 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3b3db85-e31d-42d5-844b-28fc1b35736c tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/n-h1-861333-10/servers" status: 200 len: 434 microversion: 2.1 time: 0.059782 Oct 19 06:52:07.221638 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 355/749] 10.222.0.39 () {58 vars in 1215 bytes} [Wed Oct 19 06:52:07 2022] GET /compute/v2.1/os-hypervisors/n-h1-861333-10/servers => generated 434 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:52:07.226594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Calling method '.version_select at 0x7f6d64c59c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:07.231015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.231787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.232265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.263746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.264359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.267301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.296350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.297570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.298295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.306193 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32b56a3f-bd43-4ed5-9767-d4507bf205dd tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.082996 Oct 19 06:52:07.307483 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 356/750] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:52:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:07.319853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87885fc6-78bf-4032-b920-5b9dad217778 tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Calling method '.version_select at 0x7f6d64c59e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:07.322422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87885fc6-78bf-4032-b920-5b9dad217778 tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.323102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87885fc6-78bf-4032-b920-5b9dad217778 tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.323701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87885fc6-78bf-4032-b920-5b9dad217778 tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.339080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87885fc6-78bf-4032-b920-5b9dad217778 tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.339915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87885fc6-78bf-4032-b920-5b9dad217778 tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.340537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87885fc6-78bf-4032-b920-5b9dad217778 tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.349574 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87885fc6-78bf-4032-b920-5b9dad217778 tempest-HypervisorAdminUnderV252Test-613678429 tempest-HypervisorAdminUnderV252Test-613678429-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/n-h1-861333-10/search" status: 200 len: 105 microversion: 2.1 time: 0.035636 Oct 19 06:52:07.350546 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 357/751] 10.222.0.39 () {58 vars in 1212 bytes} [Wed Oct 19 06:52:07 2022] GET /compute/v2.1/os-hypervisors/n-h1-861333-10/search => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:52:07.355383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:07.356483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:07.365312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.367148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.367941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.368897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.369831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.370596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.434188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:07.447237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:07.449377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:07.451368 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-016587e2-236a-46b9-bce9-bba7a0dbe6da tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1568 microversion: 2.25 time: 0.264750 Oct 19 06:52:07.452455 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 395/752] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:07 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:07.521861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a97a8416-b2b1-4e3b-b88e-3770e392f82e req-a97904f6-abe4-4232-9e6a-f90dcf77702d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe37e8c6-900b-4c99-bc7c-2511c6d8108f", "name": "network-vif-deleted", "tag": "e0e59f88-59bd-479d-a40f-9b5af6c40d02"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:07.541557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a97a8416-b2b1-4e3b-b88e-3770e392f82e req-a97904f6-abe4-4232-9e6a-f90dcf77702d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.545000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a97a8416-b2b1-4e3b-b88e-3770e392f82e req-a97904f6-abe4-4232-9e6a-f90dcf77702d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.545540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a97a8416-b2b1-4e3b-b88e-3770e392f82e req-a97904f6-abe4-4232-9e6a-f90dcf77702d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.574614 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a97a8416-b2b1-4e3b-b88e-3770e392f82e req-a97904f6-abe4-4232-9e6a-f90dcf77702d service nova] Creating event network-vif-deleted:e0e59f88-59bd-479d-a40f-9b5af6c40d02 for instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f on n-h2-861333-10 Oct 19 06:52:07.596801 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a97a8416-b2b1-4e3b-b88e-3770e392f82e req-a97904f6-abe4-4232-9e6a-f90dcf77702d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075892 Oct 19 06:52:07.598252 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 396/753] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:52:07.612564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:07.613659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:07.623056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.623783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.626088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.627134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.627884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.628755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.794102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:07.864395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92689d3d-f654-4a48-ae78-d5ba4d4faa2c tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.240750 Oct 19 06:52:07.869656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:07.880587 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 397/754] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:07 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:07.883637 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe56b7e7-2d07-4115-8ad7-2d846dc5bbc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1272 microversion: 2.1 time: 0.531900 Oct 19 06:52:07.886017 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 358/755] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:07 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1272 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:07.893248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:07.894486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:07.895027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:07.895651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:07.910531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.911300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.911896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.912795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.913468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.914206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.915912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.916706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.917317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:07.919005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:07.919643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:07.920330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:08.011878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:08.031545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:08.033709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:08.051898 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9445140e-07dd-4410-b489-1c30f0eb4b77 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.164118 Oct 19 06:52:08.054597 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 359/756] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:07 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:08.068180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:08.069039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:08.087006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:08.091089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:08.091089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:08.091089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:08.092656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:08.094397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:08.228456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:08.241602 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c553e68-c236-4c35-be5a-9a806b751817 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1260 microversion: 2.1 time: 0.185715 Oct 19 06:52:08.242872 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 360/757] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:08 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:08.270689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:08.282942 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-888f3dd7-c549-42a8-940f-66a3fa8503e8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.401147 Oct 19 06:52:08.284445 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 398/758] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:07 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:08.482282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:08.483292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:08.520335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:08.529743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:08.530216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:08.536679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:08.539351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:08.539722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:08.901222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:08.902601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:08.908997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:08.918002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:08.918776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:08.920460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:08.921474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:08.923198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:08.923916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:08.924779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:08.925431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:08.926604 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-207d22d9-f86e-4fa2-a831-e7149e1c5154 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1558 microversion: 2.25 time: 0.451634 Oct 19 06:52:08.929320 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 361/759] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:08 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1558 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:08.938786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:08.941471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:08.947667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:08.948214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:08.948654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:08.949359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:08.949813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:08.950544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.257301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:09.274469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:09.289939 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76201abc-f7f6-452d-9dff-7ef79a41a575 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1314 microversion: 2.1 time: 0.359485 Oct 19 06:52:09.291198 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 362/760] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:08 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:09.295701 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efb44ce6-3f8f-4aff-a89e-bd8cbf77e62b tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.402690 Oct 19 06:52:09.299706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-83efd245-edfb-480f-bc97-99d02b652c18 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '.version_select at 0x7f6d64cd40d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:09.315827 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 399/761] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:08 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:09.320709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83efd245-edfb-480f-bc97-99d02b652c18 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.321288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83efd245-edfb-480f-bc97-99d02b652c18 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.321742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83efd245-edfb-480f-bc97-99d02b652c18 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.325719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:09.331507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:09.334026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.334846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.337033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.338660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.339438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.340991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.364048 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-83efd245-edfb-480f-bc97-99d02b652c18 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1775 microversion: 2.25 time: 0.071670 Oct 19 06:52:09.364715 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 363/762] 10.222.0.39 () {60 vars in 1184 bytes} [Wed Oct 19 06:52:09 2022] GET /compute/v2.1/os-migrations => generated 1775 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:09.370702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:09.371494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:09.395799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.396386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.397031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.399437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.400827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.401772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.553671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:09.582187 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-685f6570-0929-4162-8244-dfb8a101224a tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1324 microversion: 2.1 time: 0.216205 Oct 19 06:52:09.582883 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 364/763] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:09 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1324 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:09.602993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:09.603624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:09.630992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.631646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.632072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.633379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.634082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.635031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.849015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:09.858655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:09.864066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:09.880683 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8606c5e4-3f9f-499d-86df-a8bf874ffc39 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1531 microversion: 2.91 time: 0.563528 Oct 19 06:52:09.881262 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 400/764] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:09 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1531 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:09.885734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:09.886331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:09.898012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.903257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.903257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.903257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.904093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.910199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.939113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:09.946928 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae248f8f-82c1-45b0-bd3d-6a13560c3f04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.359329 Oct 19 06:52:09.948389 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 365/765] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:09 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:09.958240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:09.960837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:09.972717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.973225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.973676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:09.974404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:09.974933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:09.975558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:10.150488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:10.182704 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a343436-f2ae-4355-9b0d-42ebf6735b9e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 2052 microversion: 2.25 time: 0.299801 Oct 19 06:52:10.194907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lazy-loading 'services' on Instance uuid 6e036b18-232a-4e33-9790-c4f8b72c337c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:10.195550 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 401/766] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:09 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 2052 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:10.234164 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ece2f2cd-8289-490d-8a27-54df0e717c5b tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1938 microversion: 2.91 time: 0.278619 Oct 19 06:52:10.237702 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 366/767] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:09 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1938 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:10.262156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:10.262804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:10.271844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:10.272615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:10.273557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:10.274452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:10.275066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:10.275698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:10.315241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lazy-loading 'flavor' on Instance uuid 6e036b18-232a-4e33-9790-c4f8b72c337c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:10.322003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:10.322003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:10.326790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:10.332626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:10.333412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:10.334365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:10.335027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:10.336252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:10.575454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:10.598124 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e49eb163-4250-454b-96ed-97dbd0561120 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1314 microversion: 2.1 time: 0.284392 Oct 19 06:52:10.604363 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 367/768] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:10 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:10.613704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:10.615243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:10.630154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:10.630918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:10.631358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:10.632067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:10.632551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:10.633021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:10.655855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:10.719967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:10.746132 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8048d21-9eb8-48aa-b488-d83e633dd8d1 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.139034 Oct 19 06:52:10.760001 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 368/769] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:10 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:10.781921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1221724966", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b05059e7-85f2-4cad-a60f-f98042236a76"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:10.882909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] validate_networks() for [('b05059e7-85f2-4cad-a60f-f98042236a76', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:52:11.006594 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee73fb9c-988e-4678-9f76-e88d35f2def1 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "POST /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c/action" status: 202 len: 0 microversion: 2.91 time: 0.748475 Oct 19 06:52:11.007876 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 402/770] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:52:10 2022] POST /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:11.016422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e05a37e1-aec3-4a3d-988b-0cadc59eb693 req-086e60bd-7f3e-435e-91e5-039cfec16f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98efe809-4d62-40f1-80ef-41c1acd916ea", "tag": "bb98edc1-752f-4396-84de-fa36b5c95e05"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:11.027764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e05a37e1-aec3-4a3d-988b-0cadc59eb693 req-086e60bd-7f3e-435e-91e5-039cfec16f05 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.028491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e05a37e1-aec3-4a3d-988b-0cadc59eb693 req-086e60bd-7f3e-435e-91e5-039cfec16f05 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.029086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e05a37e1-aec3-4a3d-988b-0cadc59eb693 req-086e60bd-7f3e-435e-91e5-039cfec16f05 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.044281 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e05a37e1-aec3-4a3d-988b-0cadc59eb693 req-086e60bd-7f3e-435e-91e5-039cfec16f05 service nova] Creating event network-changed:bb98edc1-752f-4396-84de-fa36b5c95e05 for instance 98efe809-4d62-40f1-80ef-41c1acd916ea on n-h2-861333-10 Oct 19 06:52:11.050029 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e05a37e1-aec3-4a3d-988b-0cadc59eb693 req-086e60bd-7f3e-435e-91e5-039cfec16f05 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039890 Oct 19 06:52:11.051152 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 403/771] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:11.057600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:11.058466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:11.066389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.067238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.067903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.069680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.070639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.071409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.172639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:11.182575 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d49a8c18-d6c7-44e4-9503-b29b7a4f251f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1322 microversion: 2.1 time: 0.129418 Oct 19 06:52:11.183671 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 404/772] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:11 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1322 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:11.556683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-603a77cb-69f4-44a4-8f2c-ebef3352e7a4 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Calling method '.version_select at 0x7f6d64d633a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:11.577024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603a77cb-69f4-44a4-8f2c-ebef3352e7a4 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.577534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603a77cb-69f4-44a4-8f2c-ebef3352e7a4 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.578376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603a77cb-69f4-44a4-8f2c-ebef3352e7a4 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.582679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603a77cb-69f4-44a4-8f2c-ebef3352e7a4 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.583214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603a77cb-69f4-44a4-8f2c-ebef3352e7a4 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.587122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603a77cb-69f4-44a4-8f2c-ebef3352e7a4 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.639133 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-603a77cb-69f4-44a4-8f2c-ebef3352e7a4 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] 10.222.0.39 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.454203 Oct 19 06:52:11.642505 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 405/773] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Oct 19 06:52:11 2022] GET /compute/v2.1/limits => generated 511 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:11.654598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:11.655792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:11.663087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.663834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.664495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.665394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.666013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.667222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.896052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:52:11.896622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:52:11.897120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:52:11.897744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:52:11.898197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:52:11.912384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.912882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.913826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.915204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.915702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.916166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.950190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:11.951191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:11.956491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for user 641a9af15ca24743baa3049fa9ad2e68 and project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:11.957368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:11.963253 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69513986-0df2-488c-b36e-0e45e8d7f79c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.319513 Oct 19 06:52:11.972636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:52:11.975879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:52:11.981632 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 406/774] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:11 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:11.988882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:11.989798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:11.996237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.996865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.997382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:11.998144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:11.998696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:11.999208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:12.081846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:12.091675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:12.093390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:12.105127 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9262491-fafd-4e01-9ace-645796f93e38 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.121655 Oct 19 06:52:12.108560 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 407/775] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:11 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:12.116500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:12.117446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:12.124514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:12.125346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:12.125976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:12.127213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:12.127922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:12.128595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:12.139635 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b8c4396-a4d0-4b08-8b29-ddc4aadeb9ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.377083 Oct 19 06:52:12.147599 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 369/776] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 06:52:12.158778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5b93998-6661-4fb1-a6ad-e0223e7f8b54 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1621191792", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:12.249116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-b5b93998-6661-4fb1-a6ad-e0223e7f8b54 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:52:12.370985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:12.384525 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-219437bf-1912-4d3b-8445-be54439ee513 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1314 microversion: 2.1 time: 0.274593 Oct 19 06:52:12.385237 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 408/777] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:12 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:12.396544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:12.397328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:12.405732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:12.407597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:12.408277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:12.409632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:12.410975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:12.411696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:12.490697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:12.506855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b5b93998-6661-4fb1-a6ad-e0223e7f8b54 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Getting quotas for project 704d595e029147bc965c61c31bb7e949. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:12.518830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b5b93998-6661-4fb1-a6ad-e0223e7f8b54 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Getting quotas for user ca91632aa53d473dae718105c86a16f6 and project 704d595e029147bc965c61c31bb7e949. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:12.536091 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c67f1a76-133c-432c-a992-32fa1db83fd9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.149701 Oct 19 06:52:12.537010 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 409/778] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:12 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:12.542294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-813ad204-af04-4be7-9cc4-94fad19cad3a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:12.543650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-813ad204-af04-4be7-9cc4-94fad19cad3a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:12.555883 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b5b93998-6661-4fb1-a6ad-e0223e7f8b54 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5b93998-6661-4fb1-a6ad-e0223e7f8b54 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Request method failure captured: Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 1752 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT56aVaoa4KO_L7kqo7h7jlI44i49abLPeba0DFN24PpDX-tj7-_2o8RXrclPMeLzfwJDqL04kQ6_iDhADd9Bw-v5wiG3_vQDn2x9ZY2c9Zjbh7eiLGe4tTN_Lwg588p_1TMBvxb-3fCHKblvLp4be4hNt_EF_2qbY-pfiRB1trm4qzw Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 704d595e029147bc965c61c31bb7e949 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1576169285 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/704d595e029147bc965c61c31bb7e949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/704d595e029147bc965c61c31bb7e949"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/704d595e029147bc965c61c31bb7e949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_704d595e029147bc965c61c31bb7e949", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1576169285 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 704d595e029147bc965c61c31bb7e949 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1576169285 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: ca91632aa53d473dae718105c86a16f6 Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1621191792", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:52:12.563687 n-d-861333-10 devstack@n-api.service[127568]: exception: Maximum number of metadata items exceeds 128 Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1621191792', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:52:12.565913 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 19 06:52:12.568597 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:12.570350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5b93998-6661-4fb1-a6ad-e0223e7f8b54 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:52:12.571237 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5b93998-6661-4fb1-a6ad-e0223e7f8b54 tempest-AbsoluteLimitsNegativeTestJSON-1576169285 tempest-AbsoluteLimitsNegativeTestJSON-1576169285-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.422296 Oct 19 06:52:12.571833 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 370/779] 10.222.0.39 () {60 vars in 1148 bytes} [Wed Oct 19 06:52:12 2022] POST /compute/v2.1/servers => generated 87 bytes in 423 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:52:12.576695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:12.577615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:12.586355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:12.587031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:12.587648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:12.588703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:12.589547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:12.590880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:12.630723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-813ad204-af04-4be7-9cc4-94fad19cad3a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:12.649919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-813ad204-af04-4be7-9cc4-94fad19cad3a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:12.651467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-813ad204-af04-4be7-9cc4-94fad19cad3a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:12.658358 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-813ad204-af04-4be7-9cc4-94fad19cad3a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1262 microversion: 2.25 time: 0.120040 Oct 19 06:52:12.661486 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 410/780] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:12 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1262 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:12.767330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:12.775467 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4371ab01-adc5-4d3a-9a39-1b7b1f2f4928 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1390 microversion: 2.1 time: 0.202411 Oct 19 06:52:12.776031 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 371/781] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:12 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1390 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:12.947673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3e3eef27-1b9c-4e92-9666-c0c9b6b99dbe req-d7e8b2ef-1b1f-49b4-9209-6c1b22896943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d5974e-c2aa-4e04-ad3b-c075c14ee327", "tag": "e402da3c-527f-4e8a-b89f-b1f07ce69474"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:12.963929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3e3eef27-1b9c-4e92-9666-c0c9b6b99dbe req-d7e8b2ef-1b1f-49b4-9209-6c1b22896943 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:12.964527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3e3eef27-1b9c-4e92-9666-c0c9b6b99dbe req-d7e8b2ef-1b1f-49b4-9209-6c1b22896943 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:12.964870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3e3eef27-1b9c-4e92-9666-c0c9b6b99dbe req-d7e8b2ef-1b1f-49b4-9209-6c1b22896943 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:12.975596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3e3eef27-1b9c-4e92-9666-c0c9b6b99dbe req-d7e8b2ef-1b1f-49b4-9209-6c1b22896943 service nova] Creating event network-changed:e402da3c-527f-4e8a-b89f-b1f07ce69474 for instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 on n-h1-861333-10 Oct 19 06:52:12.980856 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3e3eef27-1b9c-4e92-9666-c0c9b6b99dbe req-d7e8b2ef-1b1f-49b4-9209-6c1b22896943 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036926 Oct 19 06:52:12.982055 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 411/782] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:12.996097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:12.998423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:13.003549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:13.007739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.008545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.009182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.010565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.011221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.011843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.154753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:13.158343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:13.165935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.166974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.167613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.168602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.169242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.170074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.326279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:13.344710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:13.346632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:13.348229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:13.352289 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e71e7cf-c843-4db4-87c3-529dc386b2d4 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.208061 Oct 19 06:52:13.352952 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 412/783] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:13 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:13.377797 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-207786ca-38b2-405e-a640-94cb25af488b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.372158 Oct 19 06:52:13.377797 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 372/784] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:12 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:13.408954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:13.409574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:13.417278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.417590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.418027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.418812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.419561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.420053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.568914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:13.569883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:13.576584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.577466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.578524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.579323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.579866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.580409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.769239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:13.795502 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-623b2aed-bb77-406c-8e54-4beed028abb9 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.230308 Oct 19 06:52:13.797183 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 373/785] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:13 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:13.803326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:13.804992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:13.813964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.814736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.815403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.816424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.817188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.818230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.912531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:13.921768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:13.924163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:13.925268 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d76d2c1b-2b67-487d-aaa8-a4b2ddfaba60 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1258 microversion: 2.25 time: 0.126795 Oct 19 06:52:13.925820 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 374/786] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:13 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1258 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:13.930818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:13.932000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:13.941912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.942735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.943391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.944398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:13.944955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:13.945449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:13.998053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:14.020239 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6629391-ee76-4e67-80b4-58de6addd739 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1314 microversion: 2.1 time: 0.614468 Oct 19 06:52:14.023016 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 413/787] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:13 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:14.131147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-12639b3b-191e-4a9a-a8af-a9d2e9c09732 req-b4b922b2-94f4-4aa6-993e-82033f1c1bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a33734-978d-4ec5-8a10-062f8208e013", "name": "network-vif-unplugged", "status": "completed", "tag": "8f191a47-185e-4db5-97b0-9f273b9ba3c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:14.146230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-12639b3b-191e-4a9a-a8af-a9d2e9c09732 req-b4b922b2-94f4-4aa6-993e-82033f1c1bb9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:14.147797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-12639b3b-191e-4a9a-a8af-a9d2e9c09732 req-b4b922b2-94f4-4aa6-993e-82033f1c1bb9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:14.148267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-12639b3b-191e-4a9a-a8af-a9d2e9c09732 req-b4b922b2-94f4-4aa6-993e-82033f1c1bb9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:14.161724 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-12639b3b-191e-4a9a-a8af-a9d2e9c09732 req-b4b922b2-94f4-4aa6-993e-82033f1c1bb9 service nova] Creating event network-vif-unplugged:8f191a47-185e-4db5-97b0-9f273b9ba3c8 for instance f1a33734-978d-4ec5-8a10-062f8208e013 on n-h1-861333-10 Oct 19 06:52:14.169763 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-12639b3b-191e-4a9a-a8af-a9d2e9c09732 req-b4b922b2-94f4-4aa6-993e-82033f1c1bb9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043001 Oct 19 06:52:14.177960 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 414/788] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:52:14.272250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:14.285994 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2464cdaa-d3fe-4702-94df-da1945d0c271 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1390 microversion: 2.1 time: 0.358656 Oct 19 06:52:14.287491 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 375/789] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:13 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1390 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:14.387255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:14.396788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:14.397645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:14.398382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:14.415615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:14.416774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:14.417226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:14.417951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:14.418413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:14.418841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:14.419160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:14.419856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:14.420403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:14.422769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:14.423439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:14.424062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:14.536009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:14.547396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:14.549264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:14.554858 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-731bee6a-b1c8-44e0-a74a-e2c494287eff tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.177387 Oct 19 06:52:14.555547 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 415/790] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:14 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:14.732416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:14.743456 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3ef2937-12c5-4f1a-b85e-b38e947d867c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.361931 Oct 19 06:52:14.746812 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 376/791] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:14 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:14.832209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:14.832825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:14.838974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:14.839470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:14.839980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:14.840649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:14.841158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:14.841541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:14.924295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:14.949006 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-937cd00b-9b8f-4a9c-802f-97e484406f07 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.120382 Oct 19 06:52:14.949729 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 416/792] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:14 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:14.955325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:14.956147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:14.962691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:14.963584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:14.964246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:14.965174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:14.965864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:14.966650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.049129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:15.050695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:15.051913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:15.068383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.070471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.071681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.072960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.074199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:15.075226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.077531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.079665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:15.082704 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5779c1f5-8e6b-4b68-a3e4-9044a810d42a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1322 microversion: 2.25 time: 0.135480 Oct 19 06:52:15.085091 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 377/793] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:14 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1322 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:52:15.222585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:15.232625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b159208-7d10-49b3-8049-bda67afa176b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1314 microversion: 2.1 time: 0.190490 Oct 19 06:52:15.233277 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 417/794] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:15 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:15.309904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:15.310688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:15.317272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.317768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.318631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.328779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.329011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.329895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.580366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:15.584169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:15.589444 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-116728ea-7782-4b40-a439-336c336078e8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1390 microversion: 2.1 time: 0.283541 Oct 19 06:52:15.589594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:15.597294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.598010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.598443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.599340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.599953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.600568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.604684 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 378/795] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:15 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1390 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:15.686071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:15.697650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:15.701122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:15.707875 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da5c7723-0b5b-4955-8748-cde28841d37e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.128026 Oct 19 06:52:15.708448 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 418/796] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:15 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:52:15.768377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:15.769008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:15.776760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.777667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.778270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.779162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.779620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.780265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.981872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:15.982474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:15.988878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.989941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.990588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:15.991484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:15.992344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:15.992967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:16.023684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:16.035559 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1a43033-27ff-4193-8b8a-d33cefe516b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.271772 Oct 19 06:52:16.036190 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 379/797] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:15 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:16.113013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:16.114007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:16.121758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:16.125397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:16.126031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:16.126650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:16.127485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:16.128058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:16.129271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:16.145083 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab9ce289-0903-4d54-a368-973f9127c6e3 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.167231 Oct 19 06:52:16.162113 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 419/798] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:15 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:52:16.196814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d219de17-f967-40ee-87f1-5ff469d1eb55 req-abe2d242-ec5e-41b1-b0f7-a6447171faa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a33734-978d-4ec5-8a10-062f8208e013", "tag": "8f191a47-185e-4db5-97b0-9f273b9ba3c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:16.206957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d219de17-f967-40ee-87f1-5ff469d1eb55 req-abe2d242-ec5e-41b1-b0f7-a6447171faa8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:16.207442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d219de17-f967-40ee-87f1-5ff469d1eb55 req-abe2d242-ec5e-41b1-b0f7-a6447171faa8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:16.208224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d219de17-f967-40ee-87f1-5ff469d1eb55 req-abe2d242-ec5e-41b1-b0f7-a6447171faa8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:16.217610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:16.226085 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d219de17-f967-40ee-87f1-5ff469d1eb55 req-abe2d242-ec5e-41b1-b0f7-a6447171faa8 service nova] Creating event network-changed:8f191a47-185e-4db5-97b0-9f273b9ba3c8 for instance f1a33734-978d-4ec5-8a10-062f8208e013 on n-h1-861333-10 Oct 19 06:52:16.232429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:16.232429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:16.232429 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3371d0ec-4645-483d-998f-dc72c6b24ca2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1322 microversion: 2.25 time: 0.122546 Oct 19 06:52:16.232429 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 380/799] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:16 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1322 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:16.243927 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d219de17-f967-40ee-87f1-5ff469d1eb55 req-abe2d242-ec5e-41b1-b0f7-a6447171faa8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050303 Oct 19 06:52:16.245941 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 420/800] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:52:16.259781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:16.260862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:16.268658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:16.269151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:16.269588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:16.270349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:16.271012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:16.271438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:16.616326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:16.617400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:16.626404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:16.626901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:16.627342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:16.632664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:16.633507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:16.633665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:16.969989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:16.979237 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d8686ed-1726-4584-ae15-5bff51f8ebc6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1314 microversion: 2.1 time: 0.724155 Oct 19 06:52:16.982147 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 381/801] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:16 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:16.988063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:16.988711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:17.001855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:17.002709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:17.003564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:17.004485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:17.005558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:17.006052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:17.083630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:17.092975 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89d5b8fa-a0c7-4998-ace1-407638ba57ea tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1390 microversion: 2.1 time: 0.482416 Oct 19 06:52:17.094063 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 421/802] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:16 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1390 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:17.098884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:17.099669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:17.106163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:17.108086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:17.108758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:17.109920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:17.110804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:17.111263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:17.111941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:17.142057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:17.156968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:17.156968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:17.162678 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93e66040-9ec2-4263-90dc-e3035c6e1809 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.179192 Oct 19 06:52:17.163569 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 382/803] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:16 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:17.181255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:17.182246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:17.190849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:17.192161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:17.193234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:17.194599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:17.196305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:17.197138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:17.356395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:17.361694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:17.371679 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ebb8a8a-865b-423b-8164-2e2f67ee6bfe tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.276246 Oct 19 06:52:17.373825 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 422/804] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:17 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:17.389393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:17.390175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:17.402730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:17.404409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:17.405573 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bce6a4e8-2023-42df-ad25-4c5a4cb726af tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.229478 Oct 19 06:52:17.407494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:17.408207 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 383/805] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:17 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:17.410161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:17.411063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:17.415042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3e3bd28b-2181-4733-848c-088f7fed3401 req-32a836d0-10f7-46ae-976e-df9e28700387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98efe809-4d62-40f1-80ef-41c1acd916ea", "name": "network-vif-plugged", "status": "completed", "tag": "bb98edc1-752f-4396-84de-fa36b5c95e05"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:17.415674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:17.459839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3e3bd28b-2181-4733-848c-088f7fed3401 req-32a836d0-10f7-46ae-976e-df9e28700387 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:17.463093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3e3bd28b-2181-4733-848c-088f7fed3401 req-32a836d0-10f7-46ae-976e-df9e28700387 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:17.466161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3e3bd28b-2181-4733-848c-088f7fed3401 req-32a836d0-10f7-46ae-976e-df9e28700387 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:17.494440 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3e3bd28b-2181-4733-848c-088f7fed3401 req-32a836d0-10f7-46ae-976e-df9e28700387 service nova] Creating event network-vif-plugged:bb98edc1-752f-4396-84de-fa36b5c95e05 for instance 98efe809-4d62-40f1-80ef-41c1acd916ea on n-h2-861333-10 Oct 19 06:52:17.510784 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3e3bd28b-2181-4733-848c-088f7fed3401 req-32a836d0-10f7-46ae-976e-df9e28700387 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101208 Oct 19 06:52:17.511678 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 384/806] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:17.586300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:17.601356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:17.604920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:17.610644 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d2a350a-a33e-44d7-8e18-2cf3e6f19885 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1320 microversion: 2.25 time: 0.233353 Oct 19 06:52:17.610644 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 423/807] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:17 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:18.007469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:18.013387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:18.017155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.017907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.018419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.024198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.025006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.025646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.117674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:18.118546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:18.125147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.131007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.132702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.133634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.135003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.137095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.361536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:18.371811 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-249a1096-84b2-401b-b6e3-bee921bbb876 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1314 microversion: 2.1 time: 0.369471 Oct 19 06:52:18.384630 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 385/808] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:18 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:18.395684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:18.400828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:18.404975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.405800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.407070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.409186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.409848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.410718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.457960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:18.460994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:18.483722 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e836c54a-3326-4e4b-bc92-a6103e056dcc tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1390 microversion: 2.1 time: 0.370715 Oct 19 06:52:18.485328 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 424/809] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:18 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1390 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:18.490875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:18.505646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:18.526941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.527406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.527862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.528621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.529084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.529511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.542633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:18.552904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:18.556561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:18.574719 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-641b2fea-c614-4344-8492-226458430cdb tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.188589 Oct 19 06:52:18.588126 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 386/810] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:18 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:18.588126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:18.588126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:18.588476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:18.617595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.618209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.618725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.619660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.620230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.620746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.724585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:18.758956 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da1c17be-3a60-4988-9a23-3182bff5b940 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.181187 Oct 19 06:52:18.772185 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 387/811] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:18 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:18.785207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:18.786073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:18.793202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.797291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.797812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:18.798613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:18.799232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:18.799735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:19.007707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:19.041780 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74ce55b2-f6a7-40fa-92ac-17232988f461 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.554254 Oct 19 06:52:19.044872 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 425/812] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:18 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:19.069397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:19.082903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:19.085840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:19.087831 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9405ab2d-ce99-4efd-a29a-dc60ddbf64a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.314373 Oct 19 06:52:19.089135 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 388/813] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:18 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:19.399602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:19.400274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:19.407759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:19.408587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:19.409092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:19.409982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:19.410532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:19.411388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:19.506987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:19.507607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:19.513972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:19.514497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:19.515136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:19.516622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:19.517089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:19.517527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:19.800399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:19.815779 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd019ed3-979e-454b-9c09-b4da076d67fd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1314 microversion: 2.1 time: 0.421196 Oct 19 06:52:19.838007 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 426/814] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:19 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:19.844153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:19.845329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:19.854551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:19.855468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:19.856186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:19.860662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:19.861441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:19.862313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:19.955782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:19.966778 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6916dcb3-ce61-4bca-a5f3-5ab5bdad0557 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1390 microversion: 2.1 time: 0.463500 Oct 19 06:52:19.968814 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 389/815] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:19 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1390 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:19.993018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:19.999707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:20.041959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:20.042610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:20.043377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:20.044305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:20.044887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:20.045397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:20.206675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:20.256711 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c659b32-2c20-494e-8dae-fa2275a87b3e tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.286530 Oct 19 06:52:20.273228 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 390/816] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:19 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:20.284911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:20.285828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:20.293703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:20.294485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:20.295121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:20.296040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:20.297272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:20.297926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:20.330819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:20.348787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:20.350436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:20.368908 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a380e52-d35f-4ebf-84b7-c1d80b7d5a94 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.528667 Oct 19 06:52:20.370961 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 427/817] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:19 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:20.379325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:20.379989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:20.392982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:20.393487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:20.394349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:20.395072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:20.395534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:20.395963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:20.725542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:20.740433 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f11c197-570c-4b61-81ec-b7b66223438d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.458910 Oct 19 06:52:20.745715 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 391/818] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:20 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:20.810608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:20.829164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:20.832406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:20.839614 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84d2e4f2-5dd2-469f-9fb4-47ac13f9589f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.463308 Oct 19 06:52:20.845590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:20.847887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:20.852194 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 428/819] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:20 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:20.861804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:20.868318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:20.868318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:20.868318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:20.868318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:20.868318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:20.930730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3b31c900-9a61-44e2-8631-c8b048fb9a19 req-f5c1180a-d525-449a-8611-c79bf88dee66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df415a60-fbd8-49a7-b5c6-9c31df661ff6", "tag": "a1017353-4223-41d8-8379-4e33f689a376"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:20.945133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3b31c900-9a61-44e2-8631-c8b048fb9a19 req-f5c1180a-d525-449a-8611-c79bf88dee66 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:20.945916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3b31c900-9a61-44e2-8631-c8b048fb9a19 req-f5c1180a-d525-449a-8611-c79bf88dee66 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:20.946562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3b31c900-9a61-44e2-8631-c8b048fb9a19 req-f5c1180a-d525-449a-8611-c79bf88dee66 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:20.967906 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3b31c900-9a61-44e2-8631-c8b048fb9a19 req-f5c1180a-d525-449a-8611-c79bf88dee66 service nova] Creating event network-changed:a1017353-4223-41d8-8379-4e33f689a376 for instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 on n-h1-861333-10 Oct 19 06:52:20.978956 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3b31c900-9a61-44e2-8631-c8b048fb9a19 req-f5c1180a-d525-449a-8611-c79bf88dee66 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052720 Oct 19 06:52:20.980858 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 429/820] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:52:21.001708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:21.003060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:21.013308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.014267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.017264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.019305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.026315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.026315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.271445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:21.293464 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-551321a8-54f5-4f06-8c0f-7f790070844a tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1464 microversion: 2.1 time: 0.453444 Oct 19 06:52:21.301402 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 392/821] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:20 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1464 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:21.309965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:21.313086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:21.331438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.332266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.332917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.333853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.334523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.335160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.432677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:21.442823 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b14f008-a0b5-4f3e-b8fb-5233a3d7faba tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1390 microversion: 2.1 time: 0.446916 Oct 19 06:52:21.460087 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 430/822] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:20 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1390 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:21.544401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:21.580094 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ceed740-d361-4f79-a37e-7f22780844dc tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1931 microversion: 2.75 time: 0.281840 Oct 19 06:52:21.582032 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 393/823] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:21 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1931 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:21.587544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:21.588458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:21.600017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.603425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.603998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.604900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.605634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.606595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.617397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:21.742894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-394f110f-646f-48fd-adfd-015b5b7118b2 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:21.749829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-394f110f-646f-48fd-adfd-015b5b7118b2 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Searching by: {'deleted': False, 'project_id': '24e881511318464eade20e7daff11c48'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:52:21.757850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-394f110f-646f-48fd-adfd-015b5b7118b2 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.758886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-394f110f-646f-48fd-adfd-015b5b7118b2 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.759557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-394f110f-646f-48fd-adfd-015b5b7118b2 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.760846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-394f110f-646f-48fd-adfd-015b5b7118b2 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.762490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-394f110f-646f-48fd-adfd-015b5b7118b2 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.763197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-394f110f-646f-48fd-adfd-015b5b7118b2 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.899907 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-394f110f-646f-48fd-adfd-015b5b7118b2 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.444471 Oct 19 06:52:21.901880 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 431/824] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:52:21 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:52:21.907707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:21.908529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:21.915203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.915894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.916530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.917436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:21.918085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:21.918656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:21.924340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:22.109932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:22.124913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:22.127104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:22.142792 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d89d215-32a1-4014-9dbb-e04b8c45fb52 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.559319 Oct 19 06:52:22.143670 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 394/825] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:21 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:22.150830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:22.159548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:22.173352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:22.174154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:22.174789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:22.175660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:22.177265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:22.179371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:22.534417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=20 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:22.583495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:22.593715 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3370c618-1e91-45d7-8047-e12135513295 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.690439 Oct 19 06:52:22.613184 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 432/826] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:21 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:22.618337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:22.622156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:22.639448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Searching by: {'deleted': False} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:52:22.639656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:22.641008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:22.642140 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1655623d-8b38-4849-9f08-e84afab98673 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.497352 Oct 19 06:52:22.650278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=48 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:22.650710 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 395/827] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:22 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:22.655270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:22.656031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:22.659029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:22.660140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:22.662677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:22.663386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:22.672432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-03e3981e-86cc-42ef-b2df-8374c6569c3f req-6299d018-29b3-4f6d-843f-55cbc44ec151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d5974e-c2aa-4e04-ad3b-c075c14ee327", "name": "network-vif-plugged", "status": "completed", "tag": "e402da3c-527f-4e8a-b89f-b1f07ce69474"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:22.714605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03e3981e-86cc-42ef-b2df-8374c6569c3f req-6299d018-29b3-4f6d-843f-55cbc44ec151 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:22.715099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03e3981e-86cc-42ef-b2df-8374c6569c3f req-6299d018-29b3-4f6d-843f-55cbc44ec151 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:22.715538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03e3981e-86cc-42ef-b2df-8374c6569c3f req-6299d018-29b3-4f6d-843f-55cbc44ec151 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:22.771889 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-03e3981e-86cc-42ef-b2df-8374c6569c3f req-6299d018-29b3-4f6d-843f-55cbc44ec151 service nova] Creating event network-vif-plugged:e402da3c-527f-4e8a-b89f-b1f07ce69474 for instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 on n-h1-861333-10 Oct 19 06:52:22.793552 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-03e3981e-86cc-42ef-b2df-8374c6569c3f req-6299d018-29b3-4f6d-843f-55cbc44ec151 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140436 Oct 19 06:52:22.794270 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 396/828] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:22.806637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:22.818052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:22.837554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:22.838774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:22.839399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:22.842031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:22.843842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:22.845989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:22.890858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:52:23.211314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:23.221817 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2eacfd4-db53-4868-8085-b2aea151e6ec tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1390 microversion: 2.1 time: 0.419408 Oct 19 06:52:23.226001 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 397/829] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:22 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1390 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:23.240820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:23.241712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:23.249587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:23.250447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:23.251101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:23.252886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:23.253544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:23.254317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:23.272803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:23.273288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:23.273738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:23.379302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:23.415140 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5f9ffc5-3ba5-4a4f-979c-3511390f9800 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1937 microversion: 2.75 time: 0.185681 Oct 19 06:52:23.417991 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 398/830] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:23 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1937 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:23.442380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:23.444694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:23.451640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:23.452280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:23.453481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:23.454415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:23.455091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:23.455601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:23.540317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:23.549452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:23.550916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:23.556521 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-172c4211-fc2c-499f-9192-6ad2360fa5cf tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.128237 Oct 19 06:52:23.557760 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 399/831] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:23 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:23.647411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:23.647411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:23.655294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:23.655878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:23.657574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:23.659356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:23.660595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:23.661674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.083073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:24.095482 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a5701a0-5327-4363-ac97-b27e38fb0d9d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.457308 Oct 19 06:52:24.096805 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 400/832] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:23 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:24.102807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:24.111400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:24.127181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.127942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.128725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.129845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.130647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.131249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.281138 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-abe4cd52-609e-4a37-8dc9-20feef2530a4 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 15676 microversion: 2.1 time: 1.666526 Oct 19 06:52:24.281751 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 433/833] 10.222.0.39 () {58 vars in 1171 bytes} [Wed Oct 19 06:52:22 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 15676 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:52:24.321813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:24.322469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:24.334173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.334678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.335124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.335845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.336537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.338079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.469977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:24.482828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:24.497443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:24.498569 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff70e727-a52f-4e70-80a3-bc269b38afb6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.400603 Oct 19 06:52:24.499470 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 401/834] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:24 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:24.504132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75549f20-6cf2-4b73-8def-a00829ec717e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:24.511011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75549f20-6cf2-4b73-8def-a00829ec717e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Searching by: {'deleted': False, 'project_id': '24e881511318464eade20e7daff11c48'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:52:24.525275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:24.526374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75549f20-6cf2-4b73-8def-a00829ec717e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.527394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75549f20-6cf2-4b73-8def-a00829ec717e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.528043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75549f20-6cf2-4b73-8def-a00829ec717e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.531722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75549f20-6cf2-4b73-8def-a00829ec717e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.531722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75549f20-6cf2-4b73-8def-a00829ec717e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.531722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75549f20-6cf2-4b73-8def-a00829ec717e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.545154 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca9c149b-6a60-4eb3-9d8a-eb131c8d3f2b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1390 microversion: 2.1 time: 0.245061 Oct 19 06:52:24.562013 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 434/835] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:24 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1390 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:24.566871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:24.567617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:24.593382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.603813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.604299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.605049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.605506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.605937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.720368 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75549f20-6cf2-4b73-8def-a00829ec717e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?tenant_id=1af903b4f61c4892b3a577b039737bf0" status: 200 len: 15 microversion: 2.1 time: 0.219570 Oct 19 06:52:24.721992 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 402/836] 10.222.0.39 () {58 vars in 1231 bytes} [Wed Oct 19 06:52:24 2022] GET /compute/v2.1/servers/detail?tenant_id=1af903b4f61c4892b3a577b039737bf0 => generated 15 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:52:24.741207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:24.742094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:24.749524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.750675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.751378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.752381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.753086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.753803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.766706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:24.860638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:24.903576 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e7dac0b-fafa-4370-ac6a-d975a7cd5596 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1937 microversion: 2.75 time: 0.340501 Oct 19 06:52:24.907969 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 435/837] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:24 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1937 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:24.926048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:24.936991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Searching by: {'tenant_id': '1af903b4f61c4892b3a577b039737bf0', 'deleted': False} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:52:24.942791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.943468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.953960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.955348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:24.959285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:24.960064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:24.997548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:25.013036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:25.014857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:25.036410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:52:25.054530 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c935bacb-8032-4ba0-ab84-c91faa91c97d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.310020 Oct 19 06:52:25.059019 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 403/838] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:24 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:25.123384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:25.124248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:25.143118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.145714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.146538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.147996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.148843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.155497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.257766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.258772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.259313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.471992 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-543f92f3-01ed-4c9c-a38d-a9f356b8b43f tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1af903b4f61c4892b3a577b039737bf0" status: 200 len: 4832 microversion: 2.1 time: 0.560819 Oct 19 06:52:25.472781 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 436/839] 10.222.0.39 () {58 vars in 1257 bytes} [Wed Oct 19 06:52:24 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1af903b4f61c4892b3a577b039737bf0 => generated 4832 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:25.499589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5db01697-7521-47ba-99bb-cdda259d473d tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:25.507612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5db01697-7521-47ba-99bb-cdda259d473d tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Searching by: {'tenant_id': '24e881511318464eade20e7daff11c48', 'deleted': False} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:52:25.513333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db01697-7521-47ba-99bb-cdda259d473d tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.513333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db01697-7521-47ba-99bb-cdda259d473d tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.513597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db01697-7521-47ba-99bb-cdda259d473d tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.514519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db01697-7521-47ba-99bb-cdda259d473d tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.514838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db01697-7521-47ba-99bb-cdda259d473d tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.515475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db01697-7521-47ba-99bb-cdda259d473d tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.558722 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5db01697-7521-47ba-99bb-cdda259d473d tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=24e881511318464eade20e7daff11c48" status: 200 len: 15 microversion: 2.1 time: 0.062766 Oct 19 06:52:25.568270 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 437/840] 10.222.0.39 () {58 vars in 1257 bytes} [Wed Oct 19 06:52:25 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=24e881511318464eade20e7daff11c48 => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:52:25.568270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:25.568871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:25.569919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:25.575740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.576273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.577000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.577708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.578202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.580841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.582030 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12309ced-b8ae-4435-8cb5-27140c410072 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1503 microversion: 2.1 time: 0.465282 Oct 19 06:52:25.582621 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 404/841] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:25 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1503 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:25.611749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:25.612651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:25.636619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.639052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.639710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.641641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.644400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.645239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.803067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:25.820546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:25.822245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:25.823772 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c8a44b1c-5701-4d62-8886-2fbd91be38fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.263344 Oct 19 06:52:25.824790 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 438/842] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:25 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:25.829875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0a0ac0c-69c7-4755-8df7-e0589994b8e5 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:25.837223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0a0ac0c-69c7-4755-8df7-e0589994b8e5 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011326 Oct 19 06:52:25.837739 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 439/843] 10.222.0.39 () {58 vars in 1189 bytes} [Wed Oct 19 06:52:25 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:52:25.871118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35de9328-7ea0-4d5a-a116-08ef86472030 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:25.876413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35de9328-7ea0-4d5a-a116-08ef86472030 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:25.894807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35de9328-7ea0-4d5a-a116-08ef86472030 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.895844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35de9328-7ea0-4d5a-a116-08ef86472030 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.896513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35de9328-7ea0-4d5a-a116-08ef86472030 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.897434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:25.898077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35de9328-7ea0-4d5a-a116-08ef86472030 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.898544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35de9328-7ea0-4d5a-a116-08ef86472030 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.898976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35de9328-7ea0-4d5a-a116-08ef86472030 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.910274 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5064b66-5730-4ca7-afc0-115d29c4d196 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1588 microversion: 2.1 time: 0.322189 Oct 19 06:52:25.911604 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 405/844] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:25 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1588 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:25.942594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:25.946333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:25.959200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.959689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.960251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:25.960937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:25.961388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:25.961995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.059087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] Lazy-loading 'services' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:26.087741 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ede6708-d896-4211-9eed-bd6ba3898459 tempest-ServersAdmin275Test-1403458972 tempest-ServersAdmin275Test-1403458972-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1922 microversion: 2.75 time: 0.156540 Oct 19 06:52:26.088657 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 406/845] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:25 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1922 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:26.093569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d947bbe1-ffbf-4572-b8e4-1104899793df tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:26.094079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d947bbe1-ffbf-4572-b8e4-1104899793df tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:26.101695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d947bbe1-ffbf-4572-b8e4-1104899793df tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.102818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d947bbe1-ffbf-4572-b8e4-1104899793df tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.103469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d947bbe1-ffbf-4572-b8e4-1104899793df tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.104399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d947bbe1-ffbf-4572-b8e4-1104899793df tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.105015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d947bbe1-ffbf-4572-b8e4-1104899793df tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.105613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d947bbe1-ffbf-4572-b8e4-1104899793df tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.227045 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d947bbe1-ffbf-4572-b8e4-1104899793df tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137188 Oct 19 06:52:26.230940 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 407/846] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 06:52:26 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:26.243659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:26.244807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:26.260587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.266519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.269759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.270777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.274195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.274956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.333023 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35de9328-7ea0-4d5a-a116-08ef86472030 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action" status: 202 len: 0 microversion: 2.1 time: 0.475777 Oct 19 06:52:26.334159 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 440/847] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:52:25 2022] POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:52:26.340082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:26.340844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:26.347591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.348290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.349916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.351005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.351654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.352268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.385524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:52:26.434656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:26.443848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:26.447602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:26.458012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:26.461095 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e2b1041-b591-4ded-8015-3a0a415ab003 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.229137 Oct 19 06:52:26.471757 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 408/848] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:26 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:26.481634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:26.482527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:26.490813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:26.492248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '1af903b4f61c4892b3a577b039737bf0'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:52:26.499856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.500396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.500956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.501553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.502388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.503516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.730983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:52:26.838661 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b320bdc-56cc-4132-a0fd-c04d9c305ccb tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "DELETE /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 204 len: 0 microversion: 2.75 time: 0.500450 Oct 19 06:52:26.838661 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 441/849] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 06:52:26 2022] DELETE /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 06:52:26.846757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:26.847475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:26.856482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.858074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.858532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.860091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.860597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.862201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.910938 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0df1b9c-b072-40b1-85cf-194d8c9395c5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.436960 Oct 19 06:52:26.918411 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 409/850] 10.222.0.39 () {58 vars in 1150 bytes} [Wed Oct 19 06:52:26 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:26.924416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:26.925104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:26.942358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.942940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.943394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:26.944153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:26.944627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:26.945062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:27.126426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.137149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.138598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.152868 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-220433f2-02b7-445b-9e96-23f341e1c68c tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1444 microversion: 2.75 time: 0.233185 Oct 19 06:52:27.168827 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 410/851] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:26 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1444 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:27.183350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:27.184372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:27.199499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:27.199499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:27.199499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:27.199499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:27.199499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:27.199499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:27.251455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.263731 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cad4ab3-97ad-4254-a1c5-3e848b3c0e52 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1478 microversion: 2.1 time: 0.425662 Oct 19 06:52:27.264752 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 442/852] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:26 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1478 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:27.473888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-843aabd5-f11d-4c88-9fd3-9a87287a577b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Action: 'create', calling method: .version_select at 0x7f6d64ffb940>, body: {"keypair": {"name": "tempest-keypair-1520390670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL86QNmX0lfIgVXiL07CddiFiNEldpcZ3WDdFXY6VaIWFLi8JHwT2sn0fgi+sk4beq+D0wB7Y07+ZGJw6vS0bfYcwZ4lq2evl7SWjMb4PPm8ctH4oQrpAueGLMI03yIJg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:27.509553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-843aabd5-f11d-4c88-9fd3-9a87287a577b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Getting quotas for project 61ba5522203f4750a7928f4b3156eb23. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:27.520072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-843aabd5-f11d-4c88-9fd3-9a87287a577b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Getting quotas for user 4ae4d0a0ad0046d9ae0582fa7612b257 and project 61ba5522203f4750a7928f4b3156eb23. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:27.528157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.539828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.541380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.543764 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67f39311-362d-497f-870b-74cb2798e07c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.373062 Oct 19 06:52:27.543886 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 411/853] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:27 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:27.549066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15c25e58-714e-4f50-9e91-9ca2599ccaeb tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:27.551353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15c25e58-714e-4f50-9e91-9ca2599ccaeb tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:27.557874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c25e58-714e-4f50-9e91-9ca2599ccaeb tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:27.558377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c25e58-714e-4f50-9e91-9ca2599ccaeb tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:27.559041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c25e58-714e-4f50-9e91-9ca2599ccaeb tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:27.564854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c25e58-714e-4f50-9e91-9ca2599ccaeb tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:27.572508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c25e58-714e-4f50-9e91-9ca2599ccaeb tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:27.573685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c25e58-714e-4f50-9e91-9ca2599ccaeb tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:27.659107 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-843aabd5-f11d-4c88-9fd3-9a87287a577b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.391854 Oct 19 06:52:27.659725 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 443/854] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 06:52:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:27.664262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d014c211-d24d-476b-bb16-ead0889cdc9f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '.version_select at 0x7f6d64db34c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:27.673017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d014c211-d24d-476b-bb16-ead0889cdc9f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:27.674910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d014c211-d24d-476b-bb16-ead0889cdc9f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:27.675394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d014c211-d24d-476b-bb16-ead0889cdc9f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:27.736633 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d014c211-d24d-476b-bb16-ead0889cdc9f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.075551 Oct 19 06:52:27.737610 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 444/855] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:52:27 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:27.754223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:27.754848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:27.782178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:27.790174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:27.790174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:27.790174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:27.790174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:27.790174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:27.958522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.970979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.973922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:27.991302 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ab169b9-97c2-4a19-b984-f8d302e61198 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1558 microversion: 2.91 time: 0.251230 Oct 19 06:52:27.992891 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 445/856] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:27 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1558 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:28.004761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d59d8b9-d2d4-4876-915e-adaa4b912068 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:28.005763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d59d8b9-d2d4-4876-915e-adaa4b912068 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:28.019220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d59d8b9-d2d4-4876-915e-adaa4b912068 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:28.021333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d59d8b9-d2d4-4876-915e-adaa4b912068 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:28.022346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d59d8b9-d2d4-4876-915e-adaa4b912068 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:28.027581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d59d8b9-d2d4-4876-915e-adaa4b912068 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:28.028292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d59d8b9-d2d4-4876-915e-adaa4b912068 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:28.028730 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15c25e58-714e-4f50-9e91-9ca2599ccaeb tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action" status: 202 len: 0 microversion: 2.1 time: 0.483646 Oct 19 06:52:28.041776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d59d8b9-d2d4-4876-915e-adaa4b912068 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:28.042107 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 412/857] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:52:27 2022] POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:52:28.049383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7b9fc6b-5f86-4164-bce7-81e033b933c1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:28.050826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7b9fc6b-5f86-4164-bce7-81e033b933c1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:28.061803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b9fc6b-5f86-4164-bce7-81e033b933c1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:28.068290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b9fc6b-5f86-4164-bce7-81e033b933c1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:28.069030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b9fc6b-5f86-4164-bce7-81e033b933c1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:28.071263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b9fc6b-5f86-4164-bce7-81e033b933c1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:28.072213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b9fc6b-5f86-4164-bce7-81e033b933c1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:28.072334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b9fc6b-5f86-4164-bce7-81e033b933c1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:28.333048 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d59d8b9-d2d4-4876-915e-adaa4b912068 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1631 microversion: 2.1 time: 0.338861 Oct 19 06:52:28.335582 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 446/858] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:27 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1631 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:28.370150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:28.370817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:28.378562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:28.379423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:28.380811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:28.381830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:28.382515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:28.383176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:28.466192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:28.481244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:28.483498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:28.494976 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-56af366d-1e9b-464c-92e3-18a87eb515f3 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1444 microversion: 2.75 time: 0.145280 Oct 19 06:52:28.495849 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 447/859] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:28 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:28.520389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f479a8e-ffb2-4336-be1e-6febb9787631 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Action: 'create', calling method: .version_select at 0x7f6d650c1550>, body: {"keypair": {"name": "tempest-keypair-184332789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUkjcSBRWSDqS/4e9XqOcHW3dJLe4YG4DQ8uQZaZySrMghgWIEb9OaibU/sRBwrsD7ofMDD+30OwK7b9r3oNLqH39apgb+1jZxkiqMEFH3GLZT7zLdOcg2DDWYq8KzQYQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:28.558070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6f479a8e-ffb2-4336-be1e-6febb9787631 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for project bdca3d9567f34867aa0d9d4489001792. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:28.570846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6f479a8e-ffb2-4336-be1e-6febb9787631 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for user f67e466b1aa04d2cbafdbd390c178215 and project bdca3d9567f34867aa0d9d4489001792. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:28.764429 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f479a8e-ffb2-4336-be1e-6febb9787631 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253470 Oct 19 06:52:28.772318 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 448/860] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 06:52:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:28.777418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:28.781986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:28.819028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:28.819556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:28.820027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:28.820790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:28.821240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:28.821681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:29.024493 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7b9fc6b-5f86-4164-bce7-81e033b933c1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1616 microversion: 2.1 time: 0.972837 Oct 19 06:52:29.040725 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 413/861] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:28 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1616 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:29.040725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:29.040725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:29.050111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:29.050715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:29.051227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:29.052846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:29.057775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:29.058345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:29.277046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:29.290753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:29.292182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:29.332744 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9f64b90-be2a-4034-af62-169d0ab8a460 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.302931 Oct 19 06:52:29.337724 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 414/862] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:29 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:29.353221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2b6238c-1919-484d-9289-d7cc0a6a9c0e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:29.364625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2b6238c-1919-484d-9289-d7cc0a6a9c0e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:29.381704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b6238c-1919-484d-9289-d7cc0a6a9c0e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:29.382217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b6238c-1919-484d-9289-d7cc0a6a9c0e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:29.386644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b6238c-1919-484d-9289-d7cc0a6a9c0e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:29.387424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b6238c-1919-484d-9289-d7cc0a6a9c0e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:29.387905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b6238c-1919-484d-9289-d7cc0a6a9c0e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:29.394016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b6238c-1919-484d-9289-d7cc0a6a9c0e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:29.431596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:29.440438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:29.446038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:29.447514 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1720b14d-4d35-462a-bf36-9f599d3e31c6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.674148 Oct 19 06:52:29.467386 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 449/863] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:28 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:29.467386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:29.467386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:29.506282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:29.506998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:29.512868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:29.513849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:29.514467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:29.515171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:29.952250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2b6238c-1919-484d-9289-d7cc0a6a9c0e tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1616 microversion: 2.1 time: 0.609953 Oct 19 06:52:29.953868 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 415/864] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:29 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1616 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:29.964270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-835b2d27-ae89-4d59-ade5-77ba06c6885b req-e2fc95f0-f5f4-4795-8fe9-22fd8c50d8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d5974e-c2aa-4e04-ad3b-c075c14ee327", "tag": "e402da3c-527f-4e8a-b89f-b1f07ce69474"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:29.972325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-835b2d27-ae89-4d59-ade5-77ba06c6885b req-e2fc95f0-f5f4-4795-8fe9-22fd8c50d8a3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:29.972944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-835b2d27-ae89-4d59-ade5-77ba06c6885b req-e2fc95f0-f5f4-4795-8fe9-22fd8c50d8a3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:29.973592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-835b2d27-ae89-4d59-ade5-77ba06c6885b req-e2fc95f0-f5f4-4795-8fe9-22fd8c50d8a3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:29.998999 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-835b2d27-ae89-4d59-ade5-77ba06c6885b req-e2fc95f0-f5f4-4795-8fe9-22fd8c50d8a3 service nova] Creating event network-changed:e402da3c-527f-4e8a-b89f-b1f07ce69474 for instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 on n-h1-861333-10 Oct 19 06:52:30.004097 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-835b2d27-ae89-4d59-ade5-77ba06c6885b req-e2fc95f0-f5f4-4795-8fe9-22fd8c50d8a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048559 Oct 19 06:52:30.010215 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 416/865] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:30.021138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:30.022165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:30.035601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.035601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.035601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.035601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.035601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.036705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.111536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.112856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.113461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.114079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lazy-loading 'fault' on Instance uuid df793908-dfec-4a31-a54a-1a639429d8af {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:30.181907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:30.193772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:30.200385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:30.207957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68286a193ef048c8997eb1fdb0ecfe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185c53532d5b4a1aa230c3b6e7372121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:30.214633 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-345f8a40-7485-4b8c-a04f-5daeda3be6ed tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1588 microversion: 2.1 time: 0.757963 Oct 19 06:52:30.237940 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 450/866] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:29 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1588 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:30.241190 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-facdff80-8aa4-44a9-9779-664787de6128 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 200 len: 1449 microversion: 2.75 time: 0.229105 Oct 19 06:52:30.252594 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 417/867] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:30 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 1449 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:30.254596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:30.270693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Searching by: {'host': 'n-h2-861333-10', 'deleted': False} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:52:30.276304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.277077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.277812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.278804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.282037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.282037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.365455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:30.366116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:30.378668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.380696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.381153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.381911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.382380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.391213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.435559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:30.502647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:52:30.590116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:30.603601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:30.610419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:30.635760 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75aae1d4-5144-4297-91b2-60d97385b3ac tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.274254 Oct 19 06:52:30.636384 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 418/868] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:30 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:30.669950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:30.679479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:30.697098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.697620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.698045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.698760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.699223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.699652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.710074 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-710230e6-6c74-4408-828b-238dace5e7b1 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers?host=n-h2-861333-10&all_tenants=1" status: 200 len: 1973 microversion: 2.1 time: 0.470523 Oct 19 06:52:30.726744 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 451/869] 10.222.0.39 () {58 vars in 1192 bytes} [Wed Oct 19 06:52:30 2022] GET /compute/v2.1/servers?host=n-h2-861333-10&all_tenants=1 => generated 1973 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:30.733256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-043d097c-29b4-4a7e-9c84-2ed0e2d76a13 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:30.764418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-043d097c-29b4-4a7e-9c84-2ed0e2d76a13 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:52:30.788588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043d097c-29b4-4a7e-9c84-2ed0e2d76a13 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.789068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043d097c-29b4-4a7e-9c84-2ed0e2d76a13 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.789518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043d097c-29b4-4a7e-9c84-2ed0e2d76a13 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.800867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043d097c-29b4-4a7e-9c84-2ed0e2d76a13 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.801734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043d097c-29b4-4a7e-9c84-2ed0e2d76a13 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.802200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043d097c-29b4-4a7e-9c84-2ed0e2d76a13 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.882747 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-043d097c-29b4-4a7e-9c84-2ed0e2d76a13 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.154505 Oct 19 06:52:30.894746 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 452/870] 10.222.0.39 () {58 vars in 1196 bytes} [Wed Oct 19 06:52:30 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:52:30.906898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e649c7c-f430-4570-8b61-b64856b51944 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:30.910868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e649c7c-f430-4570-8b61-b64856b51944 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:30.930414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:30.959856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e649c7c-f430-4570-8b61-b64856b51944 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.960385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e649c7c-f430-4570-8b61-b64856b51944 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.960825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e649c7c-f430-4570-8b61-b64856b51944 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:30.961545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e649c7c-f430-4570-8b61-b64856b51944 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:30.962009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e649c7c-f430-4570-8b61-b64856b51944 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:30.962442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e649c7c-f430-4570-8b61-b64856b51944 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:31.306001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:31.306001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:31.306001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:31.308585 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46848003-209d-457a-83e2-af9d4cf54735 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.658683 Oct 19 06:52:31.386101 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 419/871] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:30 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:31.386101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:31.386101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] [instance: df793908-dfec-4a31-a54a-1a639429d8af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:31.386101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:31.386101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:31.386101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:31.386101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:31.386101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:31.386101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:31.398033 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] HTTP exception thrown: Instance df793908-dfec-4a31-a54a-1a639429d8af could not be found. Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Request method failure captured: Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af HTTP/1.1 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT55Yplkp3lLvMR6gbbczt09ntetkEj50Mu8VMxnG8ESB-6bpqEDSrBDz8iGwGwScVDJBLGket2o4GAPXctJB31Ydlb9339QZdw_M3WNeZCuDaX6r_8Y5gtvUcqWPS2QB1b8tZ9PrMEnsZ6SeTGc5DLbnrYzlxsHHG28dEFnrjE8aIKY Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.75 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 185c53532d5b4a1aa230c3b6e7372121 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdmin275Test-1361566689 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/185c53532d5b4a1aa230c3b6e7372121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/185c53532d5b4a1aa230c3b6e7372121"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/185c53532d5b4a1aa230c3b6e7372121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_185c53532d5b4a1aa230c3b6e7372121", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdmin275Test-1361566689 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 185c53532d5b4a1aa230c3b6e7372121 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdmin275Test-1361566689 Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersAdmin275Test-1361566689-project Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 68286a193ef048c8997eb1fdb0ecfe7c Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdmin275Test-1361566689-project Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance df793908-dfec-4a31-a54a-1a639429d8af could not be found. Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'df793908-dfec-4a31-a54a-1a639429d8af'} Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df793908-dfec-4a31-a54a-1a639429d8af could not be found. Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df793908-dfec-4a31-a54a-1a639429d8af could not be found. Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:31.410987 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:31.415520 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:31.415520 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:31.415520 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:31.415520 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:52:31.415520 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:52:31.415520 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df793908-dfec-4a31-a54a-1a639429d8af could not be found. Oct 19 06:52:31.415520 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:31.415520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] Returning 404 to user: Instance df793908-dfec-4a31-a54a-1a639429d8af could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:52:31.415520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7858d686-14a6-4cca-a6d3-7308fdd59b10 tempest-ServersAdmin275Test-1361566689 tempest-ServersAdmin275Test-1361566689-project] 10.222.0.39 "GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af" status: 404 len: 111 microversion: 2.75 time: 0.080847 Oct 19 06:52:31.416716 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 420/872] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:31 2022] GET /compute/v2.1/servers/df793908-dfec-4a31-a54a-1a639429d8af => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:52:31.668282 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e649c7c-f430-4570-8b61-b64856b51944 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action" status: 202 len: 0 microversion: 2.1 time: 0.769603 Oct 19 06:52:31.672898 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 453/873] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:52:30 2022] POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:52:31.675935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:31.678728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:31.688133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:31.696926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:31.699683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:31.700218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:31.700661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:31.701373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:31.707495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:31.711115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:31.720958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:31.723421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:31.725082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:31.725990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:31.727761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:31.756878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:31.912937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:52:31.918745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:31.927349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:31.928701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:52:31.929497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:52:31.937900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:52:31.942480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:31.948670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:52:31.993088 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8697d452-b8ad-4a8c-85f7-494bc9c1b78e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.322011 Oct 19 06:52:31.998104 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 421/874] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:31 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:32.320394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:32.338748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:32.341219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:32.355634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:32.356164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:32.358131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:32.363437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:32.365603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:32.366254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:32.368546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:32.369039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:32.370517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:32.372578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:32.374424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:32.375945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:32.465835 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1defbe7b-5271-42e9-aa77-8863bd020855 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action" status: 202 len: 1067 microversion: 2.1 time: 0.791449 Oct 19 06:52:32.469373 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 454/875] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:52:31 2022] POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action => generated 1067 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 06:52:32.491249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:32.494204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:32.518174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:32.519734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:32.520970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:32.523927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:32.525135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:32.526672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:32.834853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:32.846777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:32.848310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:32.861372 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8977a99c-d92e-41d4-9ac1-fed06266bed6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.524955 Oct 19 06:52:32.881730 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 422/876] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:32 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:32.953589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ed2c4e52-360a-4e98-8b03-6d94f151f007 req-268ed4c7-6e99-4cce-88df-5db6fad9ef23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df415a60-fbd8-49a7-b5c6-9c31df661ff6", "name": "network-vif-plugged", "status": "completed", "tag": "a1017353-4223-41d8-8379-4e33f689a376"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:32.974213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ed2c4e52-360a-4e98-8b03-6d94f151f007 req-268ed4c7-6e99-4cce-88df-5db6fad9ef23 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:32.975001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ed2c4e52-360a-4e98-8b03-6d94f151f007 req-268ed4c7-6e99-4cce-88df-5db6fad9ef23 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:32.975612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ed2c4e52-360a-4e98-8b03-6d94f151f007 req-268ed4c7-6e99-4cce-88df-5db6fad9ef23 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:32.999031 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ed2c4e52-360a-4e98-8b03-6d94f151f007 req-268ed4c7-6e99-4cce-88df-5db6fad9ef23 service nova] Creating event network-vif-plugged:a1017353-4223-41d8-8379-4e33f689a376 for instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 on n-h1-861333-10 Oct 19 06:52:33.012027 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ed2c4e52-360a-4e98-8b03-6d94f151f007 req-268ed4c7-6e99-4cce-88df-5db6fad9ef23 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062580 Oct 19 06:52:33.012853 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 423/877] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:33.037708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:33.038743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:33.047498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:33.048394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:33.049095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:33.050079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:33.050727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:33.051353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:33.066986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:33.093363 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8d595bc-b186-4961-84c9-e2a5610fbee0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1471 microversion: 2.1 time: 0.604193 Oct 19 06:52:33.097315 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 455/878] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:32 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1471 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:33.304506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:33.321258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:33.324280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:33.347986 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04e6417a-92fe-42ab-88ae-82d94e729535 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.308595 Oct 19 06:52:33.350104 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 424/879] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:33 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:33.894338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:33.895857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:33.910243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:33.913107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:33.916250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:33.918099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:33.921247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:33.924637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:33.956270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:34.128660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:34.129601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:34.146036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:34.151439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:34.152044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:34.156718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:34.159745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:34.160879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:34.176983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:34.186276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:34.190074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:34.194882 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b5b1339-0fa1-407c-bc0e-6f03ed5177a1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1362 microversion: 2.25 time: 0.305538 Oct 19 06:52:34.198032 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 456/880] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:33 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:34.381929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:34.382917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:34.421116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:34.422004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:34.422206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:34.425961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:34.426422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:34.426876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:34.545330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:34.561488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:34.573482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:34.579045 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a99372ff-83df-4dfd-b504-4fb01d6bb939 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.200906 Oct 19 06:52:34.580058 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 457/881] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:34 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:52:34.585181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1747255401", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6805432d-d7b2-4601-9c06-569dd6a08436"}], "security_groups": [{"name": "tempest-securitygroup--2042823184"}], "key_name": "tempest-keypair-1520390670", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:34.712346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:34.720682 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a151af5-50be-47cc-91d6-8b97e065c287 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1471 microversion: 2.1 time: 0.600048 Oct 19 06:52:34.724971 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 425/882] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:34 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:34.847956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] validate_networks() for [('6805432d-d7b2-4601-9c06-569dd6a08436', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:52:35.232588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:35.232588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:35.250832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:35.251325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:35.251759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:35.252493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:35.252947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:35.253433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:35.753278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Getting quotas for project 61ba5522203f4750a7928f4b3156eb23. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:35.759273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Getting quotas for user 4ae4d0a0ad0046d9ae0582fa7612b257 and project 61ba5522203f4750a7928f4b3156eb23. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:35.774840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:52:35.779073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:52:35.779073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:52:35.779073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:52:35.779073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:52:35.792441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:35.806733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:35.807713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:35.808367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:35.810027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:35.811405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:35.812117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:35.813767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:35.815358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:35.819236 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e80d779-185a-47ff-a956-b963e0f910b1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1558 microversion: 2.25 time: 0.596380 Oct 19 06:52:35.823303 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 426/883] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:35 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1558 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:52:35.841600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:35.848705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:35.867936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:35.880532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:35.887756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:35.887756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:35.887756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:35.887756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:35.891608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Getting quotas for project 61ba5522203f4750a7928f4b3156eb23. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:35.899397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Getting quotas for user 4ae4d0a0ad0046d9ae0582fa7612b257 and project 61ba5522203f4750a7928f4b3156eb23. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:35.981570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:52:35.999209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:52:36.134656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:36.147784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:36.150036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:36.171208 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc1469a3-91c3-42fe-8c07-c0deaf8863ef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.346638 Oct 19 06:52:36.174930 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 427/884] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:35 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:36.194579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:36.195595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:36.220367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:36.220940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:36.221379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:36.222167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:36.222566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:36.222994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:36.271421 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbed9618-f0d4-474f-8ec9-03bc9091eeda tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.688707 Oct 19 06:52:36.272707 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 458/885] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:52:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:52:36.282110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:36.284031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:36.303566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:36.304693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:36.309296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:36.309296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:36.309296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:36.309296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:36.586048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:36.775431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid df415a60-fbd8-49a7-b5c6-9c31df661ff6 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:36.805944 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96ac14f7-b74e-4821-a77c-8e1af8b6a107 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 2053 microversion: 2.25 time: 0.531929 Oct 19 06:52:36.808503 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 459/886] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:36 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 2053 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:36.814537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed5c3673-a126-4198-9704-0b49dba6d651 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:36.815412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed5c3673-a126-4198-9704-0b49dba6d651 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:36.905151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed5c3673-a126-4198-9704-0b49dba6d651 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:36.913861 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed5c3673-a126-4198-9704-0b49dba6d651 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1278 microversion: 2.1 time: 0.102562 Oct 19 06:52:36.915018 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 460/887] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:36 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:36.929493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:36.930379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:36.938868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:36.939580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:36.940369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:36.941253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:36.941859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:36.942485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:37.193355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid df415a60-fbd8-49a7-b5c6-9c31df661ff6 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:37.211874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef375db3-e68e-4362-9788-db7b63cc7f8d tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 2053 microversion: 2.25 time: 0.295445 Oct 19 06:52:37.225191 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 461/888] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:36 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 2053 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:37.241460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:37.242401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:37.249936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:37.250887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:37.251502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:37.252583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:37.253208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:37.253791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:37.470608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:37.471087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:37.487480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:37.489669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:37.498508 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6a14b14-bde6-4c05-9d52-298353048f3c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1471 microversion: 2.1 time: 1.316710 Oct 19 06:52:37.499782 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c613b299-5d52-4dda-b071-dca27e412f1a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.272119 Oct 19 06:52:37.499964 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 428/889] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:36 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1471 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:37.501858 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 462/890] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:37 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:37.519967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d18edde-f344-4655-af28-be6d59b38f13 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:37.534349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d18edde-f344-4655-af28-be6d59b38f13 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:37.535124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d18edde-f344-4655-af28-be6d59b38f13 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:37.538963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d18edde-f344-4655-af28-be6d59b38f13 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:37.543866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d18edde-f344-4655-af28-be6d59b38f13 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:37.544620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d18edde-f344-4655-af28-be6d59b38f13 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:37.549282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d18edde-f344-4655-af28-be6d59b38f13 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:37.641974 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d18edde-f344-4655-af28-be6d59b38f13 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.138188 Oct 19 06:52:37.641974 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 429/891] 10.222.0.39 () {60 vars in 1217 bytes} [Wed Oct 19 06:52:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:52:37.654442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4268c643-4ac7-41c8-9bde-83e16092306c tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:37.654920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4268c643-4ac7-41c8-9bde-83e16092306c tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:37.664938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4268c643-4ac7-41c8-9bde-83e16092306c tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:37.665435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4268c643-4ac7-41c8-9bde-83e16092306c tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:37.668088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4268c643-4ac7-41c8-9bde-83e16092306c tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:37.677837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4268c643-4ac7-41c8-9bde-83e16092306c tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:37.678429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4268c643-4ac7-41c8-9bde-83e16092306c tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:37.678873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4268c643-4ac7-41c8-9bde-83e16092306c tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:37.941596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc536c37-fa51-4318-9d61-33d54da72986 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:37.942251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc536c37-fa51-4318-9d61-33d54da72986 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:37.960614 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4268c643-4ac7-41c8-9bde-83e16092306c tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6/action" status: 202 len: 0 microversion: 2.25 time: 0.310376 Oct 19 06:52:37.961448 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 463/892] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:52:37 2022] POST /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:37.980396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:37.985134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:38.014374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:38.019790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:38.022019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:38.026075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:38.029785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:38.033700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:38.149663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc536c37-fa51-4318-9d61-33d54da72986 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:38.159949 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc536c37-fa51-4318-9d61-33d54da72986 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1278 microversion: 2.1 time: 0.223518 Oct 19 06:52:38.178816 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 430/893] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:37 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:38.193686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1742710847", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "a7a2cd42-c826-4d50-96f4-6d6e6885e6b0"}], "security_groups": [{"name": "tempest-securitygroup--628369192"}], "key_name": "tempest-keypair-184332789", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:38.406851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid df415a60-fbd8-49a7-b5c6-9c31df661ff6 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:38.430722 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ce463c7-37bf-4872-9180-56b6fa49d604 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 2058 microversion: 2.25 time: 0.463783 Oct 19 06:52:38.458248 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 464/894] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:37 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 2058 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:38.508067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] validate_networks() for [('a7a2cd42-c826-4d50-96f4-6d6e6885e6b0', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:52:38.524834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:38.526318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:38.553499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:38.557441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:38.564783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:38.575342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:38.576424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:38.580842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:38.853080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:38.889186 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-044737db-3922-41f5-9a3b-c8fdb8319783 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1471 microversion: 2.1 time: 0.348648 Oct 19 06:52:38.889186 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 465/895] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:38 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:38.895536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:38.896298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:38.922966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:38.925205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:38.927171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:38.928457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:38.930125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:38.931274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:39.090456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:39.105541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:39.111339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:39.133441 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dd1a386-ab50-465f-acf6-e9f10c40c398 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.254197 Oct 19 06:52:39.158506 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 466/896] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:38 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:39.257074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:39.257074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:39.257074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:39.257074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:39.257074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:39.257074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:39.257074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:39.257074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:39.316774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:39.326551 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28c722fc-0134-4ee7-bc59-94dcd3c66586 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1330 microversion: 2.1 time: 0.129240 Oct 19 06:52:39.328759 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 467/897] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:39 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1330 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:39.462558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:39.463198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:39.475191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:39.475993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:39.476889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:39.488511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:39.495038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:39.495680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:39.713781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:52:39.714399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:52:39.714890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:52:39.719420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:52:39.720717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:52:39.747837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:39.748709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:39.751363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:39.752379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:39.753080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:39.753739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:39.770994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid df415a60-fbd8-49a7-b5c6-9c31df661ff6 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:39.796648 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83f4085b-6c4e-460f-8dd8-24d8c6489e05 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 2038 microversion: 2.25 time: 0.340967 Oct 19 06:52:39.799403 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 468/898] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:39 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 2038 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:39.815592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for project bdca3d9567f34867aa0d9d4489001792. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:39.824995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for user f67e466b1aa04d2cbafdbd390c178215 and project bdca3d9567f34867aa0d9d4489001792. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:39.831757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-10", "block_migration": "auto"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:39.834805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:39.855626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:39.856265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:39.856876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:39.857941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:39.864246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:39.864798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:39.866114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:52:39.868873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:52:39.935748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'flavor' on Instance uuid df415a60-fbd8-49a7-b5c6-9c31df661ff6 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:52:39.961469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Going to try to live migrate instance to n-h2-861333-10 {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 06:52:40.083326 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c5aa5e5-50b5-4b36-a72e-63b0a8d83ab1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.900782 Oct 19 06:52:40.087045 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 431/899] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:52:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:52:40.103785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:40.111216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:40.117977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:40.118709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:40.119349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:40.120753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:40.121404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:40.122594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:40.463152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:40.473138 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-035ac246-a6e3-4637-821e-3bed5f801027 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1471 microversion: 2.1 time: 0.384593 Oct 19 06:52:40.475389 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 432/900] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:40 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1471 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:40.480618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0738962d-4eae-4430-87ec-622810c92de9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:40.481350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0738962d-4eae-4430-87ec-622810c92de9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:40.641722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0738962d-4eae-4430-87ec-622810c92de9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:40.649468 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0738962d-4eae-4430-87ec-622810c92de9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1234 microversion: 2.1 time: 0.172784 Oct 19 06:52:40.650438 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 433/901] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:40 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1234 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:40.669136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:40.670048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:40.683464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:40.683464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:40.683464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:40.683464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:40.683464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:40.683464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:40.805191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:40.816378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:40.818840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:40.826180 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64b9ae8b-712a-418a-b2e7-96b7f7b414e0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.174329 Oct 19 06:52:40.827332 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 434/902] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:40 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:40.832443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:40.837730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:40.844795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:40.846141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:40.847776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:40.849552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:40.850234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:40.850878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:40.986384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:41.005803 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9807071f-3a0b-4ce3-8d51-ba92ed0a87d6 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1348 microversion: 2.1 time: 0.176577 Oct 19 06:52:41.013105 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 435/903] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:40 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1348 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:41.232146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Action: 'update', calling method: .version_select at 0x7f6d6513d550>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:41.237672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.238218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.238653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.253993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.256710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.256710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.267677 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] HTTP exception thrown: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Request method failure captured: Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-services/25618a88-3b5a-4bf7-aec0-05973e80a55f HTTP/1.1 Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 56 Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT564-PsgSMPQNAHqrfz79TBfNxpjW_DSA5SflAcjumwTniwYgux4Wte0NaM8zBo7nAixRZ4b_7WyvAv56_E-YRZ56JWTS17i8pL1qFPLUPudtESMBPVOWa9195drifAexvRn8DjdyAPpf9GSsXvKgZWmXO3FTR1HoVdMZXYRRtb5TgQ Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: de64fc5b4191496a9041c65ee12e075e Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1433529590 Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/de64fc5b4191496a9041c65ee12e075e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/de64fc5b4191496a9041c65ee12e075e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/de64fc5b4191496a9041c65ee12e075e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_de64fc5b4191496a9041c65ee12e075e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1433529590 Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: de64fc5b4191496a9041c65ee12e075e Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1433529590 Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 3e63e2626c0e4783aef7b21241fd2357 Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: exception: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '25618a88-3b5a-4bf7-aec0-05973e80a55f', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:52:41.269800 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Returning 404 to user: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-119e5ff8-309b-4b6e-baa5-a82d5c134b64 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/25618a88-3b5a-4bf7-aec0-05973e80a55f" status: 404 len: 110 microversion: 2.53 time: 0.256974 Oct 19 06:52:41.276751 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 436/904] 10.222.0.39 () {62 vars in 1309 bytes} [Wed Oct 19 06:52:41 2022] PUT /compute/v2.1/os-services/25618a88-3b5a-4bf7-aec0-05973e80a55f => generated 110 bytes in 263 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:52:41.286374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Action: 'update', calling method: .version_select at 0x7f6d64cfcf70>, body: {"status": "disabled"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:41.290523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.291044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.291478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.299974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.300545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.303975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.311504 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] HTTP exception thrown: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Request method failure captured: Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-services/25618a88-3b5a-4bf7-aec0-05973e80a55f HTTP/1.1 Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 22 Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT564-PsgSMPQNAHqrfz79TBfNxpjW_DSA5SflAcjumwTniwYgux4Wte0NaM8zBo7nAixRZ4b_7WyvAv56_E-YRZ56JWTS17i8pL1qFPLUPudtESMBPVOWa9195drifAexvRn8DjdyAPpf9GSsXvKgZWmXO3FTR1HoVdMZXYRRtb5TgQ Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: de64fc5b4191496a9041c65ee12e075e Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1433529590 Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/de64fc5b4191496a9041c65ee12e075e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/de64fc5b4191496a9041c65ee12e075e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/de64fc5b4191496a9041c65ee12e075e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_de64fc5b4191496a9041c65ee12e075e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1433529590 Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: de64fc5b4191496a9041c65ee12e075e Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1433529590 Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 3e63e2626c0e4783aef7b21241fd2357 Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: {"status": "disabled"} Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: exception: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '25618a88-3b5a-4bf7-aec0-05973e80a55f', 'body': {'status': 'disabled'}} Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:52:41.313792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.318737 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.321260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Returning 404 to user: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:52:41.322367 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5928f5f-c916-4079-9d36-1983eb4e7066 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/25618a88-3b5a-4bf7-aec0-05973e80a55f" status: 404 len: 110 microversion: 2.53 time: 0.039874 Oct 19 06:52:41.323144 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 437/905] 10.222.0.39 () {62 vars in 1309 bytes} [Wed Oct 19 06:52:41 2022] PUT /compute/v2.1/os-services/25618a88-3b5a-4bf7-aec0-05973e80a55f => generated 110 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:52:41.355796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Action: 'update', calling method: .version_select at 0x7f6d64bfc9d0>, body: {"status": "enabled"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:41.367358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.372876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.373635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.391465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.394469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.395521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.409521 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] HTTP exception thrown: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Request method failure captured: Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-services/25618a88-3b5a-4bf7-aec0-05973e80a55f HTTP/1.1 Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 21 Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT564-PsgSMPQNAHqrfz79TBfNxpjW_DSA5SflAcjumwTniwYgux4Wte0NaM8zBo7nAixRZ4b_7WyvAv56_E-YRZ56JWTS17i8pL1qFPLUPudtESMBPVOWa9195drifAexvRn8DjdyAPpf9GSsXvKgZWmXO3FTR1HoVdMZXYRRtb5TgQ Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: de64fc5b4191496a9041c65ee12e075e Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1433529590 Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/de64fc5b4191496a9041c65ee12e075e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/de64fc5b4191496a9041c65ee12e075e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/de64fc5b4191496a9041c65ee12e075e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_de64fc5b4191496a9041c65ee12e075e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1433529590 Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: de64fc5b4191496a9041c65ee12e075e Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1433529590 Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 3e63e2626c0e4783aef7b21241fd2357 Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: {"status": "enabled"} Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: exception: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '25618a88-3b5a-4bf7-aec0-05973e80a55f', 'body': {'status': 'enabled'}} Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:52:41.416651 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. Oct 19 06:52:41.420528 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:41.422793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Returning 404 to user: Service 25618a88-3b5a-4bf7-aec0-05973e80a55f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:52:41.424020 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57caa7e4-1f05-496f-ab71-8c5821a3c6b0 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/25618a88-3b5a-4bf7-aec0-05973e80a55f" status: 404 len: 110 microversion: 2.53 time: 0.093778 Oct 19 06:52:41.430150 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 438/906] 10.222.0.39 () {62 vars in 1309 bytes} [Wed Oct 19 06:52:41 2022] PUT /compute/v2.1/os-services/25618a88-3b5a-4bf7-aec0-05973e80a55f => generated 110 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:52:41.440865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f913c247-c59c-42d2-8a59-e97d1f5b1b8d tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:41.445049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f913c247-c59c-42d2-8a59-e97d1f5b1b8d tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.445761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f913c247-c59c-42d2-8a59-e97d1f5b1b8d tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.446398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f913c247-c59c-42d2-8a59-e97d1f5b1b8d tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.447338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f913c247-c59c-42d2-8a59-e97d1f5b1b8d tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.449050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f913c247-c59c-42d2-8a59-e97d1f5b1b8d tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.450295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f913c247-c59c-42d2-8a59-e97d1f5b1b8d tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.491057 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f913c247-c59c-42d2-8a59-e97d1f5b1b8d tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.059486 Oct 19 06:52:41.500659 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 439/907] 10.222.0.39 () {60 vars in 1178 bytes} [Wed Oct 19 06:52:41 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:41.506674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:41.509625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:41.511241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:41.515067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.518273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.519944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.522501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.522993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.528257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.774823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:41.785372 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ccac2c38-693f-44c6-bd78-08e43d259064 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1471 microversion: 2.1 time: 0.282411 Oct 19 06:52:41.786202 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 440/908] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:41 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:41.791638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2ab8bac-9707-48c5-9267-f62b730fb638 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:41.796926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2ab8bac-9707-48c5-9267-f62b730fb638 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.798331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2ab8bac-9707-48c5-9267-f62b730fb638 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.799141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2ab8bac-9707-48c5-9267-f62b730fb638 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.799992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2ab8bac-9707-48c5-9267-f62b730fb638 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.800582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2ab8bac-9707-48c5-9267-f62b730fb638 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.804926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2ab8bac-9707-48c5-9267-f62b730fb638 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.838029 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2ab8bac-9707-48c5-9267-f62b730fb638 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.050373 Oct 19 06:52:41.838902 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 441/909] 10.222.0.39 () {60 vars in 1211 bytes} [Wed Oct 19 06:52:41 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:41.851719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:41.853844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:41.861739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.862447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.865807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.865807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.865807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:41.865807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:41.975784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:41.986431 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb870a5d-b086-4d39-8b36-744eebc5a2c6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1238 microversion: 2.1 time: 0.143573 Oct 19 06:52:41.987969 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 442/910] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:41 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1238 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:41.992936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ba38eda-4691-4fab-a5c9-73720591e252 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:41.996679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ba38eda-4691-4fab-a5c9-73720591e252 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:41.997230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ba38eda-4691-4fab-a5c9-73720591e252 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.007292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ba38eda-4691-4fab-a5c9-73720591e252 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.008127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ba38eda-4691-4fab-a5c9-73720591e252 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.013503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ba38eda-4691-4fab-a5c9-73720591e252 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.014702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ba38eda-4691-4fab-a5c9-73720591e252 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.032418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:42.067275 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ba38eda-4691-4fab-a5c9-73720591e252 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.077560 Oct 19 06:52:42.069526 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 443/911] 10.222.0.39 () {60 vars in 1178 bytes} [Wed Oct 19 06:52:41 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:42.085445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:42.086736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:42.093665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.094289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.094849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.095628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.096188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.096780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.196617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:42.219248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:42.220823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:42.235914 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f3dfca2-7e09-4cbb-9ebb-c2e4325908e2 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.164568 Oct 19 06:52:42.237567 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 444/912] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:42 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:42.260260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:42.260260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:42.260260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.260260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.260260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.260260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.260260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.260260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.334383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:42.343171 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3bea9351-707e-41b4-85d7-4a71405b0cba tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1336 microversion: 2.1 time: 0.104499 Oct 19 06:52:42.356258 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 445/913] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:42 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1336 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:42.365313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a317bfe2-5730-4635-9ed6-20691517bc61 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:42.421934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a317bfe2-5730-4635-9ed6-20691517bc61 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.421934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a317bfe2-5730-4635-9ed6-20691517bc61 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.421934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a317bfe2-5730-4635-9ed6-20691517bc61 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.421934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a317bfe2-5730-4635-9ed6-20691517bc61 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.421934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a317bfe2-5730-4635-9ed6-20691517bc61 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.421934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a317bfe2-5730-4635-9ed6-20691517bc61 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.426864 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a317bfe2-5730-4635-9ed6-20691517bc61 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=n-d-861333-10&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.071733 Oct 19 06:52:42.427783 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 446/914] 10.222.0.39 () {60 vars in 1237 bytes} [Wed Oct 19 06:52:42 2022] GET /compute/v2.1/os-services?host=n-d-861333-10&binary=xxx => generated 16 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:42.444690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-309b0ea4-6c1f-46db-bfff-df852e5963cd tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:42.448162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-309b0ea4-6c1f-46db-bfff-df852e5963cd tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.448897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-309b0ea4-6c1f-46db-bfff-df852e5963cd tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.449399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-309b0ea4-6c1f-46db-bfff-df852e5963cd tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.450293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-309b0ea4-6c1f-46db-bfff-df852e5963cd tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.450759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-309b0ea4-6c1f-46db-bfff-df852e5963cd tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.451396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-309b0ea4-6c1f-46db-bfff-df852e5963cd tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.487779 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-309b0ea4-6c1f-46db-bfff-df852e5963cd tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.050347 Oct 19 06:52:42.489096 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 447/915] 10.222.0.39 () {60 vars in 1178 bytes} [Wed Oct 19 06:52:42 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:42.503125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c470af56-0b62-42e5-93b3-002750343686 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:42.507793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c470af56-0b62-42e5-93b3-002750343686 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.508655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c470af56-0b62-42e5-93b3-002750343686 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.509933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c470af56-0b62-42e5-93b3-002750343686 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.510935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c470af56-0b62-42e5-93b3-002750343686 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.512698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c470af56-0b62-42e5-93b3-002750343686 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.513331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c470af56-0b62-42e5-93b3-002750343686 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.544047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c470af56-0b62-42e5-93b3-002750343686 tempest-ServicesAdminNegativeV253TestJSON-1433529590 tempest-ServicesAdminNegativeV253TestJSON-1433529590-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.046295 Oct 19 06:52:42.545765 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 448/916] 10.222.0.39 () {60 vars in 1239 bytes} [Wed Oct 19 06:52:42 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:42.820715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b876e84-f99d-4468-98e7-89cd0d22410c tempest-ServicesAdminNegativeV253TestJSON-2109414310 tempest-ServicesAdminNegativeV253TestJSON-2109414310-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:42.840491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b876e84-f99d-4468-98e7-89cd0d22410c tempest-ServicesAdminNegativeV253TestJSON-2109414310 tempest-ServicesAdminNegativeV253TestJSON-2109414310-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a84f2fb1b83f4a4ca725413bd69bb224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706df025cb78487c92bccb43b1b46069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b876e84-f99d-4468-98e7-89cd0d22410c tempest-ServicesAdminNegativeV253TestJSON-2109414310 tempest-ServicesAdminNegativeV253TestJSON-2109414310-project] Request method failure captured: Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT562bbj2ZVkSVNTUgpyGYhDpKFZyQa55f_lyg4Sx0KsVgU6UzJHyvIj3DM9u6LFK-A38lv3Wbw8t_J8CakPXgNU0vagLpBHL7WnaPKBxXvSrXBN5LqBvBGygLD9fkH3NtnCzrTvGmS2jPBZmgxzIvooV1bLG3SnZOwOUsPT54iBqrLA Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 706df025cb78487c92bccb43b1b46069 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2109414310 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/706df025cb78487c92bccb43b1b46069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/706df025cb78487c92bccb43b1b46069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/706df025cb78487c92bccb43b1b46069"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_706df025cb78487c92bccb43b1b46069", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2109414310 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 706df025cb78487c92bccb43b1b46069 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2109414310 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2109414310-project Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: a84f2fb1b83f4a4ca725413bd69bb224 Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2109414310-project Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: action_args: {} Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:52:42.851543 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b876e84-f99d-4468-98e7-89cd0d22410c tempest-ServicesAdminNegativeV253TestJSON-2109414310 tempest-ServicesAdminNegativeV253TestJSON-2109414310-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b876e84-f99d-4468-98e7-89cd0d22410c tempest-ServicesAdminNegativeV253TestJSON-2109414310 tempest-ServicesAdminNegativeV253TestJSON-2109414310-project] 10.222.0.39 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.298497 Oct 19 06:52:42.865895 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 449/917] 10.222.0.39 () {60 vars in 1178 bytes} [Wed Oct 19 06:52:42 2022] GET /compute/v2.1/os-services => generated 112 bytes in 303 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:52:42.872895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:42.873707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:42.886790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.887312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.888671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:42.894201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:42.894201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:42.894201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:43.174796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:43.190335 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41e34c73-bb5f-4321-a26c-ebbf4ca494d7 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1471 microversion: 2.1 time: 0.318080 Oct 19 06:52:43.206980 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 450/918] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:42 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:43.206980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:43.206980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:43.220745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:43.223916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:43.225768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:43.227076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:43.227562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:43.228026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:43.386020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:43.398657 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-385a83a6-6bec-4d5a-89b6-7abd1ed904ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1286 microversion: 2.1 time: 0.198301 Oct 19 06:52:43.402240 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 451/919] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:43 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:43.407541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:43.408435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:43.420961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:43.427439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:43.427439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:43.427439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:43.427439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:43.427439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:43.568287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:43.594705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:43.598141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:43.613988 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-312686d8-1e0a-473d-b53b-a96e20509c4a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.209988 Oct 19 06:52:43.615066 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 452/920] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:43 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:43.620625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:43.621682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:43.631325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:43.632159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:43.640240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:43.640240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:43.640240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:43.640240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:44.027605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:44.035883 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5c379ba-4af0-4b97-85d7-c701457f6fc1 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.419506 Oct 19 06:52:44.038985 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 453/921] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:43 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:44.216641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:44.217298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:44.230854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:44.238889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:44.241360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:44.244164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:44.244164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:44.244164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:44.566171 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-706e229f-3de3-4cba-bef1-5a643c7cc1bd tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6/action" status: 202 len: 0 microversion: 2.25 time: 4.738118 Oct 19 06:52:44.570563 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 469/922] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:52:39 2022] POST /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6/action => generated 0 bytes in 4743 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:52:44.587334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:44.588936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:44.617067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:44.617867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:44.621086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:44.622328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:44.622814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:44.624927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:44.673873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:44.767933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:44.786936 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0574ca92-8890-40bf-939e-32eac708b7c6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1471 microversion: 2.1 time: 0.576648 Oct 19 06:52:44.789526 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 454/923] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:44 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1471 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:44.796142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:44.819401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:44.837365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:44.837365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:44.837365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:44.837726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:44.837968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:44.838596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:45.419062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:45.428934 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0cf3647e-67a0-44aa-864d-e9175a43376f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1294 microversion: 2.1 time: 0.851939 Oct 19 06:52:45.429521 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 470/924] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:44 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1294 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:45.439835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:45.451101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:45.458714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:45.463291 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f93bf580-bfd9-4eb6-b347-c52e5a78134e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.669267 Oct 19 06:52:45.464614 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 455/925] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:44 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:45.478905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:45.485031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:45.490495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:45.491363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:45.501242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:45.502047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:45.502743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:45.503738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:45.504473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:45.505135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:45.520045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:45.520583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:45.521028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:45.521747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:45.522211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:45.522642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:45.836570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:45.852845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:45.867568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:45.898277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:45.903612 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce42c49a-8fe9-4046-bb30-f1697911ec85 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.436977 Oct 19 06:52:45.921877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:45.922477 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 456/926] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:45 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:45.927552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:45.946942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:45.948623 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e96888f-cd42-45bf-90f0-38d67973f766 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.489807 Oct 19 06:52:45.951168 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 471/927] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:45 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:45.962745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:45.964085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:45.964745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:45.965624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:45.966239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:45.966821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:46.236905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:46.257978 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d202e287-16b8-4943-a516-0436d2f3feac tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1477 microversion: 2.1 time: 0.334171 Oct 19 06:52:46.268600 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 457/928] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:45 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:46.460586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:46.462249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:46.488594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:46.489803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:46.493154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:46.495441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:46.496207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:46.496705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:46.498282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:46.501199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:46.522427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:46.528585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:46.530428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:46.536162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:46.541222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:46.542031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:46.713183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:46.735830 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3de43f53-4390-4834-8958-f94a328cb8d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1292 microversion: 2.1 time: 0.280479 Oct 19 06:52:46.736621 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 472/929] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:46 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1292 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:46.861172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:46.875992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:46.877654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:46.879072 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0e46452-6289-41bc-ab1f-d038f6adf007 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.391226 Oct 19 06:52:46.898404 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 458/930] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:46 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:52:46.927106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:46.927725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:46.930008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=24 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:46.935007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:46.935890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:46.936446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:46.937228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:46.938226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:46.938665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:46.982313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:46.983412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:46.989530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:46.990052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:46.990532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:46.991935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:46.992445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:46.992884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:47.092665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:47.105461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:47.107186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:47.113077 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17ea14ef-abb3-45b5-a94e-0dd475dcd466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.134688 Oct 19 06:52:47.129076 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 459/931] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:46 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:52:47.171947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:47.180882 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af9827aa-50f7-4650-a13f-2bbfb47d99eb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.257315 Oct 19 06:52:47.201608 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 473/932] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:46 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:47.285242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:47.286217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:47.287055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7fd73611-9d80-45cd-8530-630d893a2a29 req-8247a3e8-f096-44da-8a90-1377d8bc3cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799680d2-af3c-44e4-a38f-8df88aecbca5", "tag": "7bc09432-f31f-4901-9c9c-8d446fa198c0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:47.295470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:47.296383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:47.299901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7fd73611-9d80-45cd-8530-630d893a2a29 req-8247a3e8-f096-44da-8a90-1377d8bc3cdc service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:47.315129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7fd73611-9d80-45cd-8530-630d893a2a29 req-8247a3e8-f096-44da-8a90-1377d8bc3cdc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:47.315129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7fd73611-9d80-45cd-8530-630d893a2a29 req-8247a3e8-f096-44da-8a90-1377d8bc3cdc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:47.315405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:47.315405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:47.315405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:47.315405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:47.340071 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7fd73611-9d80-45cd-8530-630d893a2a29 req-8247a3e8-f096-44da-8a90-1377d8bc3cdc service nova] Creating event network-changed:7bc09432-f31f-4901-9c9c-8d446fa198c0 for instance 799680d2-af3c-44e4-a38f-8df88aecbca5 on n-h1-861333-10 Oct 19 06:52:47.346338 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7fd73611-9d80-45cd-8530-630d893a2a29 req-8247a3e8-f096-44da-8a90-1377d8bc3cdc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063515 Oct 19 06:52:47.361606 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 474/933] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:47.650893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:47.662820 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00285849-d9a9-46a3-a56b-80a7c90d9f7f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1477 microversion: 2.1 time: 0.381644 Oct 19 06:52:47.679408 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 460/934] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:47 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:47.763835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:47.764994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:47.777678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:47.779667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:47.780416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:47.781903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:47.782579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:47.783212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:47.905961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:47.911926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:47.913100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:47.920933 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e429767-2026-4285-a058-f9a6e20d81eb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1292 microversion: 2.1 time: 0.161344 Oct 19 06:52:47.926867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 475/935] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:47 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1292 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:47.949025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:47.949782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:47.950389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:47.951937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:47.952599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:47.956057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:48.144298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:48.145060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:48.157648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:48.160533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:48.162947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:48.163959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:48.165580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:48.168902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:48.291696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:48.314218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:48.321267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:48.331808 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87ac5d0d-24b1-4890-b981-d264a69fcc1d tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.192768 Oct 19 06:52:48.335753 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 476/936] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:48 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:52:48.341885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:48.342759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:48.348994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:48.349844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:48.350489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:48.351583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:48.352299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:48.352939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:48.457021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:48.472783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:48.478718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:48.480006 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c4214e9-9c4b-4bda-8081-bddfcd846d80 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.574190 Oct 19 06:52:48.481097 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 461/937] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:47 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:48.686129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:48.686735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:48.697724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:48.698213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:48.705129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:48.706095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:48.706750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:48.707335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:48.733079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:48.746064 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dab2adff-1444-401a-a770-a856d41d34ac tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.408677 Oct 19 06:52:48.748784 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 477/938] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:48 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:48.956787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:48.957796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:48.977446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:48.978875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:48.979335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:48.983846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:48.984483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:48.984933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:49.718633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:49.719562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:49.728624 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25572427-7f26-4d33-99d7-eb778553d9e4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1477 microversion: 2.1 time: 1.046590 Oct 19 06:52:49.744240 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a79230f1-f819-439a-98f8-cdc3738e9c4e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1359 microversion: 2.1 time: 0.778706 Oct 19 06:52:49.744571 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 462/939] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:48 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1477 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:49.751275 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 478/940] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:48 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1359 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:49.752068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:49.752728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:49.760149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:49.760763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:49.764493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:49.765010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:49.765500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:49.766288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:49.766687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:49.767116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:49.778532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:49.779032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:49.790779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:49.791676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:49.792190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:49.792636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:49.795439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:49.963583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:49.976800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:49.981850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:50.008024 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b173e359-44a5-4003-b89a-8c4b2acd009e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.273834 Oct 19 06:52:50.011854 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 463/941] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:49 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:50.035355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:50.036805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:50.057075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:50.058627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:50.059232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:50.061920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:50.065123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:50.066867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:50.122834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:50.134383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:50.135927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:50.141788 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9664da4-a5b1-49a9-9fdd-a60506d79f45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.389771 Oct 19 06:52:50.142600 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 479/942] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:49 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:50.152324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-735b0cc9-6c57-4b58-af98-518c3bec9996 req-614aeae0-ead6-412c-82bf-1af833666e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da", "name": "network-vif-unplugged", "status": "completed", "tag": "acdc01a7-4d46-4006-821e-225a7f07253f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:50.175313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-735b0cc9-6c57-4b58-af98-518c3bec9996 req-614aeae0-ead6-412c-82bf-1af833666e1c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:50.179349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-735b0cc9-6c57-4b58-af98-518c3bec9996 req-614aeae0-ead6-412c-82bf-1af833666e1c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:50.179792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-735b0cc9-6c57-4b58-af98-518c3bec9996 req-614aeae0-ead6-412c-82bf-1af833666e1c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:50.197782 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-735b0cc9-6c57-4b58-af98-518c3bec9996 req-614aeae0-ead6-412c-82bf-1af833666e1c service nova] Creating event network-vif-unplugged:acdc01a7-4d46-4006-821e-225a7f07253f for instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da on n-h2-861333-10 Oct 19 06:52:50.221483 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-735b0cc9-6c57-4b58-af98-518c3bec9996 req-614aeae0-ead6-412c-82bf-1af833666e1c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072533 Oct 19 06:52:50.226172 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 480/943] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:50.234640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c1306d0e-8738-4c10-b6e7-08ef1727f741 req-cca32ef1-99e1-454d-9428-bfb199f48a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df415a60-fbd8-49a7-b5c6-9c31df661ff6", "name": "network-vif-unplugged", "status": "completed", "tag": "a1017353-4223-41d8-8379-4e33f689a376"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:50.252070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1306d0e-8738-4c10-b6e7-08ef1727f741 req-cca32ef1-99e1-454d-9428-bfb199f48a0d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:50.252862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1306d0e-8738-4c10-b6e7-08ef1727f741 req-cca32ef1-99e1-454d-9428-bfb199f48a0d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:50.253529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1306d0e-8738-4c10-b6e7-08ef1727f741 req-cca32ef1-99e1-454d-9428-bfb199f48a0d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:50.266294 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c1306d0e-8738-4c10-b6e7-08ef1727f741 req-cca32ef1-99e1-454d-9428-bfb199f48a0d service nova] Creating event network-vif-unplugged:a1017353-4223-41d8-8379-4e33f689a376 for instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 on n-h1-861333-10 Oct 19 06:52:50.274382 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c1306d0e-8738-4c10-b6e7-08ef1727f741 req-cca32ef1-99e1-454d-9428-bfb199f48a0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050788 Oct 19 06:52:50.276993 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 481/944] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:50.649023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:50.761923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:50.762839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:50.767233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:50.778140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:50.779007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:50.779783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:50.780692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:50.781353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:50.781950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:50.967099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:51.004603 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c655be3-f117-443f-8d45-4cbc3b940afa tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.985892 Oct 19 06:52:51.009118 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 464/945] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:50 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:51.030806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:51.034205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:51.048368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:51.058574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:51.058574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:51.058574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:51.058574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:51.058574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:51.290487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:51.313448 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-921e5b13-7e7b-46bd-ab2f-fe82746c37d4 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1477 microversion: 2.1 time: 0.555133 Oct 19 06:52:51.317352 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 482/946] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:50 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1477 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:51.329112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:51.340821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:51.374645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:51.375955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:51.376598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:51.377547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:51.381388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:51.382132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:51.523739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:51.533642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:51.535164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:51.541628 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e214f734-8d41-4c1e-980e-52088601c65e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.222715 Oct 19 06:52:51.542486 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 483/947] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:51 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:51.553980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:51.557457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:51.557457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:51.561939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:51.562385 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0712c20-e4a0-48d7-b7a3-7f205f5ef9ee tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1359 microversion: 2.1 time: 0.551927 Oct 19 06:52:51.563854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:51.564572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:51.565502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:51.566133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:51.566598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:51.589986 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 465/948] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:51 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1359 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:51.663737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-bb6a08f0-e5e3-4f21-a9a5-8aa47fb724e7 req-ceb06274-19bb-40e8-b68c-72974ce91b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d231a12d-b118-41ec-b9e2-f987bea670ba", "tag": "f66ec07e-1db7-450e-9282-9e31fda912b1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:51.688447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bb6a08f0-e5e3-4f21-a9a5-8aa47fb724e7 req-ceb06274-19bb-40e8-b68c-72974ce91b00 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:51.689131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bb6a08f0-e5e3-4f21-a9a5-8aa47fb724e7 req-ceb06274-19bb-40e8-b68c-72974ce91b00 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:51.689729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bb6a08f0-e5e3-4f21-a9a5-8aa47fb724e7 req-ceb06274-19bb-40e8-b68c-72974ce91b00 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:51.712832 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-bb6a08f0-e5e3-4f21-a9a5-8aa47fb724e7 req-ceb06274-19bb-40e8-b68c-72974ce91b00 service nova] Creating event network-changed:f66ec07e-1db7-450e-9282-9e31fda912b1 for instance d231a12d-b118-41ec-b9e2-f987bea670ba on n-h2-861333-10 Oct 19 06:52:51.718152 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-bb6a08f0-e5e3-4f21-a9a5-8aa47fb724e7 req-ceb06274-19bb-40e8-b68c-72974ce91b00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060630 Oct 19 06:52:51.721662 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 466/949] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:52:52.014209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:52.035590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:52.036903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:52.037357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:52.038834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:52.050290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:52.051000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:52.051603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:52.052762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:52.053387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:52.055896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:52.059812 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e32bfed8-4308-43db-8a93-e398b38d1c57 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.516036 Oct 19 06:52:52.060454 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 484/950] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:51 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:52.512774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:52.521228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=22 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:52.526347 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19007f67-0244-4b3f-9c6e-4daa47a5aa6b tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.494985 Oct 19 06:52:52.529793 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 467/951] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:52 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:52.537317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:52.545452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:52.557325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:52.557822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:52.558266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:52.558975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:52.559450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:52.559878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:52.578578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1757145946", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:52.680693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:52:52.871570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:52.884420 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-403e3ef7-d891-45ef-93b8-1ebcc0dfd92c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1477 microversion: 2.1 time: 0.352717 Oct 19 06:52:52.901754 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 468/952] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:52 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:52.910191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9c207986-185d-41e9-9e55-6d896901bd10 req-877e483a-407f-4c7a-9da6-4549a404cc84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df415a60-fbd8-49a7-b5c6-9c31df661ff6", "tag": "a1017353-4223-41d8-8379-4e33f689a376"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:52.920438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9c207986-185d-41e9-9e55-6d896901bd10 req-877e483a-407f-4c7a-9da6-4549a404cc84 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:52.921332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9c207986-185d-41e9-9e55-6d896901bd10 req-877e483a-407f-4c7a-9da6-4549a404cc84 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:52.921928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9c207986-185d-41e9-9e55-6d896901bd10 req-877e483a-407f-4c7a-9da6-4549a404cc84 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:52.936179 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9c207986-185d-41e9-9e55-6d896901bd10 req-877e483a-407f-4c7a-9da6-4549a404cc84 service nova] Creating event network-changed:a1017353-4223-41d8-8379-4e33f689a376 for instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 on n-h1-861333-10 Oct 19 06:52:52.942245 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9c207986-185d-41e9-9e55-6d896901bd10 req-877e483a-407f-4c7a-9da6-4549a404cc84 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038302 Oct 19 06:52:52.942947 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 469/953] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:52:52.958068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:52.958868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:52.965945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:52.967697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:52.967697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:52.967697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:52.968414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:52.968941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.041521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:53.051666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:53.054283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:53.061362 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5e0a03b-4212-46e1-9ce3-be4031673343 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.113758 Oct 19 06:52:53.062193 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 470/954] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:52 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:53.067539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:53.071611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:53.077819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.081495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.081495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.081495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.081495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.081495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.154838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:52:53.158172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:52:53.158886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:52:53.159785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:52:53.160468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:52:53.179876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.180876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.181662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.183106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.188866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.191991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.262882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Getting quotas for project 252036554fb7458c8d2d10692835508b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:52:53.272429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Getting quotas for user ac1a18f0edf54373b9c7766f02e7fe03 and project 252036554fb7458c8d2d10692835508b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:52:53.305717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:52:53.313295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:52:53.322729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:53.333091 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-005539c7-2914-4191-ac8d-d886bce3845b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1359 microversion: 2.1 time: 0.268360 Oct 19 06:52:53.335154 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 471/955] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:53 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:53.340205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:53.341111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:53.355899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.360785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.360785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.360785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.360785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.360785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.467943 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c15f2607-177e-4f75-b49b-6a2973f8a194 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263482 Oct 19 06:52:53.470902 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 485/956] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:52:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:52:53.487374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06fbaed6-19c6-459a-b86e-6821b66c3d65 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:53.489061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06fbaed6-19c6-459a-b86e-6821b66c3d65 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:53.587899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:53.597847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:53.599971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:53.601460 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a903e4e-25f7-4a65-88e0-8e08cce199fa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.265010 Oct 19 06:52:53.605594 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 472/957] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:53 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:53.614741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:53.615371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:53.631937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.632500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.632942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.633781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.634249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.634871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.708674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06fbaed6-19c6-459a-b86e-6821b66c3d65 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:53.739080 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06fbaed6-19c6-459a-b86e-6821b66c3d65 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1214 microversion: 2.1 time: 0.261140 Oct 19 06:52:53.743238 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 486/958] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:53 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:53.886776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:53.901955 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd8afb0a-ef4c-4f51-bec0-3b2367d2078a tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.293407 Oct 19 06:52:53.911098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:53.911700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:53.924386 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 473/959] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:53 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:53.935847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.935847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.935847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.935847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:53.935847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:53.935847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:53.991741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-94dc550f-3b35-4509-89f3-d84e53c59b06 req-aacdd86f-78d9-4972-8936-70f15b69a3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da", "name": "network-vif-plugged", "status": "completed", "tag": "acdc01a7-4d46-4006-821e-225a7f07253f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:54.006442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-94dc550f-3b35-4509-89f3-d84e53c59b06 req-aacdd86f-78d9-4972-8936-70f15b69a3ba service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:54.008798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-94dc550f-3b35-4509-89f3-d84e53c59b06 req-aacdd86f-78d9-4972-8936-70f15b69a3ba service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:54.008798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-94dc550f-3b35-4509-89f3-d84e53c59b06 req-aacdd86f-78d9-4972-8936-70f15b69a3ba service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:54.027249 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-94dc550f-3b35-4509-89f3-d84e53c59b06 req-aacdd86f-78d9-4972-8936-70f15b69a3ba service nova] Creating event network-vif-plugged:acdc01a7-4d46-4006-821e-225a7f07253f for instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da on n-h2-861333-10 Oct 19 06:52:54.036804 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-94dc550f-3b35-4509-89f3-d84e53c59b06 req-aacdd86f-78d9-4972-8936-70f15b69a3ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051795 Oct 19 06:52:54.038881 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 474/960] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:52:54.092082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:54.093888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:54.112914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:54.113417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:54.113868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:54.114603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:54.115209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:54.115884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:54.314166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:54.327717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:54.329430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:54.338751 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17c715a7-94e1-402f-aad0-b6ac9e95cf5b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.251286 Oct 19 06:52:54.339372 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 475/961] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:54 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:54.355849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:54.356808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:54.365362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:54.366034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:54.366816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:54.367816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:54.368408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:54.368847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:54.579452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:54.589940 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dfca6746-0fdd-4958-9efd-4862089170fd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1359 microversion: 2.1 time: 0.238031 Oct 19 06:52:54.597152 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 476/962] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:54 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:54.633433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:54.634536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:54.642748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:54.643662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:54.644373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:54.645575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:54.646372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:54.646969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:54.742230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:54.756393 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b24ffc9-659a-4756-9a8e-41a25b713659 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1477 microversion: 2.1 time: 0.848251 Oct 19 06:52:54.776789 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 487/963] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:53 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1477 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:54.786983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf0dbc51-0816-4c2c-b641-472634474fb4 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:54.788824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf0dbc51-0816-4c2c-b641-472634474fb4 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:54.832600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:54.841920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:54.843581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:54.847550 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02c53e96-748a-48b0-86b4-edce1cbb50f5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.218049 Oct 19 06:52:54.856777 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 477/964] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:54 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:52:54.884844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf0dbc51-0816-4c2c-b641-472634474fb4 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:54.898083 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf0dbc51-0816-4c2c-b641-472634474fb4 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1214 microversion: 2.1 time: 0.119571 Oct 19 06:52:54.899288 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 488/965] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:54 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:54.929966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:54.930874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:54.937749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:54.938790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:54.939362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:54.941241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:54.941764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:54.942195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:55.196429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:55.212321 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47b8b89f-2cb0-4ea7-ad0c-115bb48aabcc tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.280758 Oct 19 06:52:55.212321 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 478/966] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:54 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:55.371950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:55.372598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:55.384353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:55.384916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:55.388689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:55.388689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:55.388689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:55.388689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:55.535569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:55.547406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:55.548893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:55.555618 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c052ecaf-5da3-483e-bbe6-0605b1afaf16 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1553 microversion: 2.91 time: 0.188244 Oct 19 06:52:55.564166 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 489/967] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:55 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:55.615297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:55.615983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:55.627410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:55.628250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:55.629051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:55.630149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:55.630759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:55.631350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:55.795216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:55.797957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:55.819974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:55.822539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:55.823103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:55.824135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:55.825337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:55.826015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:55.877740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:55.886999 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-258a1675-ef0e-4638-8e18-c45fda0fd09b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1359 microversion: 2.1 time: 0.275549 Oct 19 06:52:55.907116 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 479/968] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:55 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:55.913312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:55.914482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:55.921312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:55.922684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:55.924462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:55.925768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:55.926691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:55.927382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:55.928023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:56.118688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:56.130506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:56.134870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:56.135501 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a53c025-da59-4441-8f07-de91b02af637 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.227218 Oct 19 06:52:56.157922 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 480/969] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:55 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:56.163477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:56.164370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:56.171783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:56.172544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:56.173165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:56.174073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:56.174680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:56.175259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:56.207127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:56.217585 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8233bf96-0328-4520-9d5c-37854dc2ca87 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1477 microversion: 2.1 time: 0.432998 Oct 19 06:52:56.225092 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 490/970] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:55 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1477 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:56.231549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:56.236221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:56.250525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:56.251449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:56.254047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:56.254047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:56.254047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:56.254047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:56.254971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:56.262871 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9cbac51-89dd-4557-be15-a3115ff27664 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1210 microversion: 2.1 time: 0.103500 Oct 19 06:52:56.263812 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 481/971] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:56 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:56.534715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:56.538228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:56.555295 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7ec2e08-e0b1-49ac-a688-2e0d0194c895 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.328896 Oct 19 06:52:56.556965 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 491/972] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:56 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:56.587380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:56.588636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:56.595931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:56.596702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:56.597140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:56.598085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:56.598576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:56.599144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:56.604406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:52:56.695211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:56.725266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:56.729681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:56.738287 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-405e4896-5497-4c42-af7b-87a2150840c9 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1535 microversion: 2.91 time: 0.155325 Oct 19 06:52:56.739364 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 482/973] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:56 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1535 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:56.916420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:56.917035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:56.924262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:56.925004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:56.925608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:56.926487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:56.927105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:56.927696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.117005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.124913 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95d150e7-a7ba-4adf-a781-c8ab3e34837c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1359 microversion: 2.1 time: 0.212261 Oct 19 06:52:57.140375 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 492/974] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:56 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:57.165674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:57.166064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:57.172438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.172944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.173388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.174104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.174565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.175003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.252496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:57.253102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:57.259919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.266152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.269320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.269467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.269950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.270391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.353509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.365079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.367257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.369049 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a607a57c-62ec-4a10-afbe-542704bec828 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.208541 Oct 19 06:52:57.370701 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 483/975] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:57 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:57.377744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:57.378362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:57.385064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.385726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.386385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.387232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.388206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.389165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.474750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.485462 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2eebddcb-a3a2-43ac-b473-d9f8cda3c518 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1266 microversion: 2.1 time: 0.113069 Oct 19 06:52:57.488552 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 484/976] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:57 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:57.539241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8e0ada32-1dee-43c7-9e3d-ad7be85f540b req-c7b3cfc7-da1f-4948-a12d-0d1e5fef92a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d231a12d-b118-41ec-b9e2-f987bea670ba", "name": "network-vif-plugged", "status": "completed", "tag": "f66ec07e-1db7-450e-9282-9e31fda912b1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:57.551477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8e0ada32-1dee-43c7-9e3d-ad7be85f540b req-c7b3cfc7-da1f-4948-a12d-0d1e5fef92a2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.552369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8e0ada32-1dee-43c7-9e3d-ad7be85f540b req-c7b3cfc7-da1f-4948-a12d-0d1e5fef92a2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.552905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8e0ada32-1dee-43c7-9e3d-ad7be85f540b req-c7b3cfc7-da1f-4948-a12d-0d1e5fef92a2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.566005 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8e0ada32-1dee-43c7-9e3d-ad7be85f540b req-c7b3cfc7-da1f-4948-a12d-0d1e5fef92a2 service nova] Creating event network-vif-plugged:f66ec07e-1db7-450e-9282-9e31fda912b1 for instance d231a12d-b118-41ec-b9e2-f987bea670ba on n-h2-861333-10 Oct 19 06:52:57.571753 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8e0ada32-1dee-43c7-9e3d-ad7be85f540b req-c7b3cfc7-da1f-4948-a12d-0d1e5fef92a2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036855 Oct 19 06:52:57.572840 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 485/977] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:52:57.583686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:57.584508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:57.594940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.596239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.596990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.598073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.598708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.600189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.618709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.629174 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-568b15d9-9b49-4c69-8a9b-164ff422d9f1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1463 microversion: 2.1 time: 0.379544 Oct 19 06:52:57.629853 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 493/978] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:57 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1463 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:57.653759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:57.654502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:57.660841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.661659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.662514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.663240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.663705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.664335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.766454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.779792 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81ad256d-29eb-4291-8eac-50888fd63461 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.201317 Oct 19 06:52:57.792220 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 486/979] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:57 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:57.792220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:57.792220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:57.798761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.799258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.799701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.800455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.801073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.801518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.884615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.893911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.896154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.909800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:57.927720 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-80c04c62-d484-41ea-a595-3f9be8394234 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1535 microversion: 2.91 time: 0.128041 Oct 19 06:52:57.927720 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 487/980] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:57 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1535 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:57.928031 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8737b8ec-8e04-4309-abec-beecc7d22507 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1463 microversion: 2.1 time: 0.270318 Oct 19 06:52:57.928031 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 494/981] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:57 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1463 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:57.943541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:52:57.946335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:57.952436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.952930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.953401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:57.954101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:57.954565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:57.954997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.035655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:52:58.036077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:52:58.036568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:52:58.036972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:52:58.037378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:52:58.147215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:58.147818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:58.154099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.154667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.155043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.155758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.156243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.156679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.273648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:58.286844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.287344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.287781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.288750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.288944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.291703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.323390 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbac4223-a776-44e6-b7a0-2905f46365a6 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action" status: 202 len: 1067 microversion: 2.1 time: 0.384185 Oct 19 06:52:58.332145 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 488/982] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:52:57 2022] POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action => generated 1067 bytes in 387 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 06:52:58.349098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:58.354034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:58.356069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.356903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.357354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.358320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.358781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.359932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.470128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:58.477907 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4f0aa32-4006-4900-9fcd-c621697260d7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1359 microversion: 2.1 time: 0.334739 Oct 19 06:52:58.478411 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 495/983] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:58 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1359 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:58.482867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:58.483765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:58.490154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.490649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.491231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.492132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.492789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.493230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.503340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:58.511602 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4ed3e19-30d8-44cd-a764-6ab6a1613e72 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.166797 Oct 19 06:52:58.512065 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 489/984] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:58 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:58.516835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:58.517581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:58.524170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.524829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.525496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.526399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.527011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.527708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.612744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:58.626120 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16a0aa38-138f-4185-b7eb-b294b2cc1659 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1266 microversion: 2.1 time: 0.112674 Oct 19 06:52:58.627762 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 490/985] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:58 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:58.680353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:58.689996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:58.699147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:58.699147 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44e80615-045b-4c02-9713-8be20e145c91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.213463 Oct 19 06:52:58.699147 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 496/986] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:58 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:58.804695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:58.805308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:58.812314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.812836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.813566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.813962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.814991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.815668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.939308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:58.945448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:58.952004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.954778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.957195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:58.959149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:58.960536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:58.962513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:59.121875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:59.136817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:59.138270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:59.151853 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09e731eb-f959-475f-b34d-8b16481d897b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1535 microversion: 2.91 time: 0.216801 Oct 19 06:52:59.176485 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 497/987] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:58 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1535 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:52:59.276075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:59.295141 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba2db350-2a59-45d1-be6d-30ff79bb1529 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.493899 Oct 19 06:52:59.310298 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 491/988] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:58 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:52:59.502725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:59.503347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:59.512947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:59.517001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:59.517001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:59.517001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:59.520457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:59.521169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:59.534889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:59.536138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:59.545257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:59.548434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:59.551317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:59.551317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:59.551317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:59.551317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:59.766729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:59.776492 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-422eb1c0-2dc7-4ff1-b18f-272c70336e6b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1541 microversion: 2.1 time: 0.276823 Oct 19 06:52:59.777078 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 498/989] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:59 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1541 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:59.787511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:59.790382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:59.804091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:59.804632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:59.805124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:59.805873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:59.806504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:59.807496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:59.815864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:59.824723 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db675463-69b2-4052-9059-55ad13b27753 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.293647 Oct 19 06:52:59.825834 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 492/990] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:59 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:59.830893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:52:59.831816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:52:59.856793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:59.857258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:59.857899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:59.859068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:52:59.861155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:52:59.861953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:52:59.951839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:52:59.960973 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab0ede9b-4435-4b07-ba61-ab1572dcfa18 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1272 microversion: 2.1 time: 0.181047 Oct 19 06:52:59.965313 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 499/991] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:52:59 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:52:59.972738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-96ee1076-ac0a-405d-89b4-0e9f2afd2556 req-cca80a30-1c73-4e34-a303-59a904637902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799680d2-af3c-44e4-a38f-8df88aecbca5", "name": "network-vif-plugged", "status": "completed", "tag": "7bc09432-f31f-4901-9c9c-8d446fa198c0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:00.002073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-96ee1076-ac0a-405d-89b4-0e9f2afd2556 req-cca80a30-1c73-4e34-a303-59a904637902 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.002800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-96ee1076-ac0a-405d-89b4-0e9f2afd2556 req-cca80a30-1c73-4e34-a303-59a904637902 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.003388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-96ee1076-ac0a-405d-89b4-0e9f2afd2556 req-cca80a30-1c73-4e34-a303-59a904637902 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.023056 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-96ee1076-ac0a-405d-89b4-0e9f2afd2556 req-cca80a30-1c73-4e34-a303-59a904637902 service nova] Creating event network-vif-plugged:7bc09432-f31f-4901-9c9c-8d446fa198c0 for instance 799680d2-af3c-44e4-a38f-8df88aecbca5 on n-h1-861333-10 Oct 19 06:53:00.030474 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-96ee1076-ac0a-405d-89b4-0e9f2afd2556 req-cca80a30-1c73-4e34-a303-59a904637902 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062497 Oct 19 06:53:00.037727 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 500/992] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:00.049868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea95068f-a2fd-4672-9fcb-5fdafaa0f075 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:00.051860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea95068f-a2fd-4672-9fcb-5fdafaa0f075 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:00.090403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea95068f-a2fd-4672-9fcb-5fdafaa0f075 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.093304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea95068f-a2fd-4672-9fcb-5fdafaa0f075 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.093304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea95068f-a2fd-4672-9fcb-5fdafaa0f075 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.094812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea95068f-a2fd-4672-9fcb-5fdafaa0f075 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.098669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea95068f-a2fd-4672-9fcb-5fdafaa0f075 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.099351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea95068f-a2fd-4672-9fcb-5fdafaa0f075 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.208205 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea95068f-a2fd-4672-9fcb-5fdafaa0f075 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166705 Oct 19 06:53:00.218313 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 501/993] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 06:53:00 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:00.226168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:00.228143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:00.235985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.237848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.238812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.241276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.241978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.242958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.249718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.261366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.262816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.264010 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23819fdb-ac64-429b-ba7f-0511a7e88068 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1568 microversion: 2.25 time: 0.437020 Oct 19 06:53:00.264621 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 493/994] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:52:59 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1568 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:00.322418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:00.323020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:00.330073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.330727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.331313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.332204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.332809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.333406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.409043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.418690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.420182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.426333 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2425f861-67c9-40d7-a284-42e5362649dd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1478 microversion: 2.91 time: 0.208298 Oct 19 06:53:00.427448 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 502/995] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:00 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1478 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:00.459410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-861333-10"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:00.462151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:00.468065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.468644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.473127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.473127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.473127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.473127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.511093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-861333-10". {{(pid=127567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 06:53:00.672369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.680042 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60c67b5d-c4b3-4709-a551-5ad453232633 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.361278 Oct 19 06:53:00.680656 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 494/996] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:00 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:00.725442 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a976b69-4f89-4b90-800a-db67c52e9d33 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c/action" status: 202 len: 0 microversion: 2.91 time: 0.269767 Oct 19 06:53:00.726607 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 503/997] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:53:00 2022] POST /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 06:53:00.735572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:00.736292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:00.744591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.746261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.748287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.749047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.750912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.751590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.847821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:00.848685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:00.862862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.862862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.863037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.863150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.863150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:00.863150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:00.863150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:00.867705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.869573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:00.877031 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0cd5182-e216-4123-acbd-433c47c09b44 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1486 microversion: 2.91 time: 0.146153 Oct 19 06:53:00.878239 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 495/998] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:00 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1486 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:00.992702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:00.993323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:01.000827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.001322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.001940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.008069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.008069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.008069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.237511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:01.245529 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b377f0f-7bb1-4744-8d7d-bf7eddcc3fe0 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.401951 Oct 19 06:53:01.246129 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 504/999] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:00 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:01.292432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:01.293058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:01.305085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.312645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.312645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.312645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.312645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.312645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.633427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:01.648284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:01.649937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:01.651282 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee5a561c-131a-4066-b25e-43f058a69f43 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1543 microversion: 2.25 time: 0.362635 Oct 19 06:53:01.654744 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 505/1000] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:01 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1543 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:53:01.691199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6889491b-b9fa-4cc3-91ad-51ba3e636041 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '.version_select at 0x7f6d650c15e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:01.695070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6889491b-b9fa-4cc3-91ad-51ba3e636041 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.695933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6889491b-b9fa-4cc3-91ad-51ba3e636041 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.696697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6889491b-b9fa-4cc3-91ad-51ba3e636041 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.709378 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6889491b-b9fa-4cc3-91ad-51ba3e636041 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.25 time: 0.023026 Oct 19 06:53:01.710838 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 506/1001] 10.222.0.39 () {60 vars in 1184 bytes} [Wed Oct 19 06:53:01 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:01.716633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:01.724665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:01.747758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.748295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.760508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.760508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.760508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.760508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.814096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:01.830151 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3ef3321-191c-42f1-8ad1-009a5c41f8bd tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1314 microversion: 2.1 time: 0.841157 Oct 19 06:53:01.841123 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 496/1002] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:00 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:01.858846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:01.859856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:01.871623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.872744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.873462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.876288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.876945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.878184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.903506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:01.939788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:01.948258 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-817d7b08-9288-4698-adc6-f41a4caa428f tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1404 microversion: 2.1 time: 0.236040 Oct 19 06:53:01.949295 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 507/1003] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:01 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:01.955182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:01.956094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:01.962844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.963749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.965065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:01.966008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:01.966749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:01.967251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:02.094189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:02.098992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:02.104936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:02.107290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:02.115307 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-916dad32-3637-4de1-8f9a-28f2e8549f85 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1486 microversion: 2.91 time: 0.164749 Oct 19 06:53:02.118331 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 508/1004] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:01 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1486 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:02.123580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid df415a60-fbd8-49a7-b5c6-9c31df661ff6 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:02.147132 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6992cf51-ccce-4982-ad65-dfca31a33f25 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 2038 microversion: 2.25 time: 0.303331 Oct 19 06:53:02.147964 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 497/1005] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:01 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 2038 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:02.199891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-25391695-0cb0-42b1-a49d-842afe2ee582 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Action: 'create', calling method: .version_select at 0x7f6d64b3cb80>, body: {"keypair": {"name": "tempest-keypair-1797815594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ/G+0Y/DqW+XMf7UBMdJbWoP8N3qJWzr9ain1VHjY5U5awmB5CSfxyyNu0Rwd31QXCPQzks+gOqlW3+qJST3SarIeKYARXVkl+NVEtkKpdmKbG6Byv85V69zAr+0fwCg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:02.245813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-25391695-0cb0-42b1-a49d-842afe2ee582 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:53:02.251928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-25391695-0cb0-42b1-a49d-842afe2ee582 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for user 641a9af15ca24743baa3049fa9ad2e68 and project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:53:02.271997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:02.272729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:02.283694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:02.284360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:02.285207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:02.287323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:02.287884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:02.290741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:02.487402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:02.495294 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85f4a507-3f11-407a-a341-dac7c6fc3459 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.227401 Oct 19 06:53:02.495862 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 498/1006] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:02 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:02.500425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b3d37a7c-ef17-472c-897c-de2ec0af725a req-8802f3b6-2188-4582-9a55-276305df5744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d231a12d-b118-41ec-b9e2-f987bea670ba", "tag": "f66ec07e-1db7-450e-9282-9e31fda912b1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:02.509585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3d37a7c-ef17-472c-897c-de2ec0af725a req-8802f3b6-2188-4582-9a55-276305df5744 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:02.510057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3d37a7c-ef17-472c-897c-de2ec0af725a req-8802f3b6-2188-4582-9a55-276305df5744 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:02.510482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3d37a7c-ef17-472c-897c-de2ec0af725a req-8802f3b6-2188-4582-9a55-276305df5744 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:02.522317 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b3d37a7c-ef17-472c-897c-de2ec0af725a req-8802f3b6-2188-4582-9a55-276305df5744 service nova] Creating event network-changed:f66ec07e-1db7-450e-9282-9e31fda912b1 for instance d231a12d-b118-41ec-b9e2-f987bea670ba on n-h2-861333-10 Oct 19 06:53:02.527265 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b3d37a7c-ef17-472c-897c-de2ec0af725a req-8802f3b6-2188-4582-9a55-276305df5744 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030139 Oct 19 06:53:02.528201 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 499/1007] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:02.545396 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-25391695-0cb0-42b1-a49d-842afe2ee582 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.360755 Oct 19 06:53:02.549916 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 509/1008] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 06:53:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 365 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 06:53:02.560827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a0dcab14-82a3-47e7-b069-f484c947534d req-20f99579-a3d4-4235-8356-913294a15da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746ca76b-0323-4723-b70d-521be1acde08", "tag": "ff47ddd9-0ab0-4a55-a084-843137cbd042"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:02.573495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a0dcab14-82a3-47e7-b069-f484c947534d req-20f99579-a3d4-4235-8356-913294a15da1 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:02.576243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a0dcab14-82a3-47e7-b069-f484c947534d req-20f99579-a3d4-4235-8356-913294a15da1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:02.576243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a0dcab14-82a3-47e7-b069-f484c947534d req-20f99579-a3d4-4235-8356-913294a15da1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:02.597188 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a0dcab14-82a3-47e7-b069-f484c947534d req-20f99579-a3d4-4235-8356-913294a15da1 service nova] Creating event network-changed:ff47ddd9-0ab0-4a55-a084-843137cbd042 for instance 746ca76b-0323-4723-b70d-521be1acde08 on n-h1-861333-10 Oct 19 06:53:02.605522 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a0dcab14-82a3-47e7-b069-f484c947534d req-20f99579-a3d4-4235-8356-913294a15da1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049619 Oct 19 06:53:02.606142 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 500/1009] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:02.856975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:02.857590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:02.867107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:02.867931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:02.868633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:02.869582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:02.870259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:02.870915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:02.974561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:02.975977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:02.985263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:02.987798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:02.988566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:02.989572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:02.990296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:02.990946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:03.184558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:03.193587 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f71e305e-a3b2-4816-9928-5ba165d5cbf3 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1592 microversion: 2.1 time: 0.223704 Oct 19 06:53:03.201032 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 501/1010] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:02 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1592 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:03.213215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:03.213215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:03.214448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:03.245459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:03.249669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:03.253924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:03.255791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:03.256753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:03.258377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:03.259202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:03.262549 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1fc1da7-59ec-4ebd-9abe-f813b5621514 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1314 microversion: 2.1 time: 0.409376 Oct 19 06:53:03.273246 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 510/1011] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:02 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:03.304677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef4dbb1e-1e97-4739-b09f-c7a95da3c6d8 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:03.305089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef4dbb1e-1e97-4739-b09f-c7a95da3c6d8 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:03.312683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4dbb1e-1e97-4739-b09f-c7a95da3c6d8 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:03.317323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4dbb1e-1e97-4739-b09f-c7a95da3c6d8 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:03.319807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4dbb1e-1e97-4739-b09f-c7a95da3c6d8 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:03.321225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4dbb1e-1e97-4739-b09f-c7a95da3c6d8 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:03.322949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4dbb1e-1e97-4739-b09f-c7a95da3c6d8 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:03.327836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4dbb1e-1e97-4739-b09f-c7a95da3c6d8 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:03.483109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:03.510304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:03.517980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:03.527651 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04b4096d-e241-4cad-bdbe-9aafedc74855 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.325229 Oct 19 06:53:03.528722 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 502/1012] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:03 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:03.541879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef4dbb1e-1e97-4739-b09f-c7a95da3c6d8 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.266609 Oct 19 06:53:03.542778 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 511/1013] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 06:53:03 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5/os-interface => generated 285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:03.547618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:03.550069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:03.556998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:03.559023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:03.559023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:03.559789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:03.560605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:03.561503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:03.944722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:03.953936 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73d0f615-0026-459a-bf36-31322a5c6dc1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.422334 Oct 19 06:53:03.954809 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 503/1014] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:03 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:04.291204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:04.293899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:04.293899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:04.301167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:04.301929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:04.302938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:04.304386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:04.305014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:04.305647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:04.471051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:04.490999 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36ae5992-32e5-44d6-b25c-7f2bf22d5b01 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1314 microversion: 2.1 time: 0.205046 Oct 19 06:53:04.491998 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 512/1015] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:04 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:04.566844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:04.568928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:04.574654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:04.575226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:04.575666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:04.576509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:04.576959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:04.577378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:04.670928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:04.686322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:04.686322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:04.691736 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15729012-f6fd-40df-a593-d5976f45a264 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.128749 Oct 19 06:53:04.692342 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 504/1016] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:04 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:04.978377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:04.978974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:04.997469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:04.997469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:04.997469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:04.997469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:04.997992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:04.998149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:05.300050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:05.301186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:05.322120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:05.324235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:05.326341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:05.331493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:05.333831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:05.336205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:05.524417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:05.537699 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78e461d9-d79b-45a2-9ecd-4bf860ba90fe tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.563720 Oct 19 06:53:05.540919 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 513/1017] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:04 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:05.556778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a0ae0b08-7c3e-44a0-a96c-c234fbf37632 req-6897cadd-0030-4e09-9e14-82dd78239986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799680d2-af3c-44e4-a38f-8df88aecbca5", "tag": "7bc09432-f31f-4901-9c9c-8d446fa198c0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:05.576544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a0ae0b08-7c3e-44a0-a96c-c234fbf37632 req-6897cadd-0030-4e09-9e14-82dd78239986 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:05.584018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a0ae0b08-7c3e-44a0-a96c-c234fbf37632 req-6897cadd-0030-4e09-9e14-82dd78239986 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:05.584815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a0ae0b08-7c3e-44a0-a96c-c234fbf37632 req-6897cadd-0030-4e09-9e14-82dd78239986 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:05.604794 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a0ae0b08-7c3e-44a0-a96c-c234fbf37632 req-6897cadd-0030-4e09-9e14-82dd78239986 service nova] Creating event network-changed:7bc09432-f31f-4901-9c9c-8d446fa198c0 for instance 799680d2-af3c-44e4-a38f-8df88aecbca5 on n-h1-861333-10 Oct 19 06:53:05.619156 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a0ae0b08-7c3e-44a0-a96c-c234fbf37632 req-6897cadd-0030-4e09-9e14-82dd78239986 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075099 Oct 19 06:53:05.620164 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 514/1018] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:05.629791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:05.630511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:05.651620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:05.652553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:05.653176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:05.654054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:05.654660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:05.655240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:05.684845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:05.700780 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-acf9b5df-ef3a-4482-b7a2-7fe3757cac11 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1592 microversion: 2.1 time: 0.406734 Oct 19 06:53:05.704977 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 505/1019] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:05 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1592 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:05.932345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89c02ee5-192c-41f4-a1a1-8873abbd6139 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:05.947641 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89c02ee5-192c-41f4-a1a1-8873abbd6139 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.241331 Oct 19 06:53:05.948662 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 506/1020] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:05.956065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:05.961631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:05.976063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:05.976821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:05.978125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:05.979609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:05.980637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:05.985429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:06.048178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:06.063693 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ec302f6-637b-4af0-a3b9-bd2849008cee tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1314 microversion: 2.1 time: 0.441681 Oct 19 06:53:06.064584 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 515/1021] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:05 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:06.068374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:06.077191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-068903d9-eedc-4d9c-be46-8227e15d14ff tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.079766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:06.082234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:06.088896 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e96a7560-92f7-48ab-b680-9fba61c22d10 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.138951 Oct 19 06:53:06.090063 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 507/1022] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:05 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:06.119319 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-068903d9-eedc-4d9c-be46-8227e15d14ff tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 3081 microversion: 2.1 time: 0.052197 Oct 19 06:53:06.132015 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 516/1023] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors => generated 3081 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:06.137822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2482b837-45d6-4a22-a582-7eb7a6a6d5e2 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.147184 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2482b837-45d6-4a22-a582-7eb7a6a6d5e2 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013272 Oct 19 06:53:06.148444 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 508/1024] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:06.161970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3969812e-6f2a-4347-9f57-bacfbb483397 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.171301 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3969812e-6f2a-4347-9f57-bacfbb483397 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013403 Oct 19 06:53:06.173613 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 517/1025] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:06.204292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5536699a-0a04-442f-9ed1-3fbe85c59c3e tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.258192 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5536699a-0a04-442f-9ed1-3fbe85c59c3e tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.064857 Oct 19 06:53:06.263320 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 509/1026] 10.222.0.39 () {58 vars in 1165 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:06.281017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b294e0ab-5e95-4ddd-b6b0-35b0c7b72115 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.294910 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b294e0ab-5e95-4ddd-b6b0-35b0c7b72115 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017139 Oct 19 06:53:06.303711 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 518/1027] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:06.309418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95736053-f847-4e2a-acee-ba54a91b3cf8 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.366840 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95736053-f847-4e2a-acee-ba54a91b3cf8 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.059083 Oct 19 06:53:06.367498 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 510/1028] 10.222.0.39 () {58 vars in 1169 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:06.384212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61661d26-6f0a-48b9-9097-5a92286a6d44 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.413245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61661d26-6f0a-48b9-9097-5a92286a6d44 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.032324 Oct 19 06:53:06.426716 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 519/1029] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:06.431933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20d89636-5409-4a74-ba42-cdbd897d50f5 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.445473 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20d89636-5409-4a74-ba42-cdbd897d50f5 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017547 Oct 19 06:53:06.447417 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 511/1030] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:06.465546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd28c5d1-ddf2-4d21-9af7-6923c87d62fb tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.519097 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd28c5d1-ddf2-4d21-9af7-6923c87d62fb tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.059197 Oct 19 06:53:06.537129 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 520/1031] 10.222.0.39 () {58 vars in 1167 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:06.564475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.565446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:06.585306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:06.586127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:06.589002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:06.590079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:06.603818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:06.604634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:06.632429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20e756fa-f8b2-4a75-95cc-78b4dca68410 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.644488 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20e756fa-f8b2-4a75-95cc-78b4dca68410 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017873 Oct 19 06:53:06.657506 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 521/1032] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:06.664751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc887fc9-fa87-4807-9578-5843ab26e0f8 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.718077 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc887fc9-fa87-4807-9578-5843ab26e0f8 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.044600 Oct 19 06:53:06.720449 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 522/1033] 10.222.0.39 () {58 vars in 1144 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:06.728701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-205245d7-6a77-46b4-8b47-56a71a6b31ac tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.768707 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-205245d7-6a77-46b4-8b47-56a71a6b31ac tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046298 Oct 19 06:53:06.769466 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 523/1034] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:06.783240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4028d87c-229a-4694-b9da-a6542717a0ec tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.863638 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4028d87c-229a-4694-b9da-a6542717a0ec tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.085372 Oct 19 06:53:06.874233 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 524/1035] 10.222.0.39 () {58 vars in 1148 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:06.876368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:06.876858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:06.889401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:06.891333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:06.892552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:06.894162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:06.895155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:06.895909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:06.979621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:53:06.981298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:06.991562 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92f99333-2bce-4a33-88f2-edd1cfe49d63 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.431186 Oct 19 06:53:06.995785 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 512/1036] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:07.000812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-162e587a-fa1b-4bff-b1fd-3c49cda13820 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:07.030449 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-162e587a-fa1b-4bff-b1fd-3c49cda13820 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.032211 Oct 19 06:53:07.030449 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 513/1037] 10.222.0.39 () {58 vars in 1140 bytes} [Wed Oct 19 06:53:06 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:07.043558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fdccfd6-994f-40a0-8bfc-02d2433fb891 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:07.066399 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fdccfd6-994f-40a0-8bfc-02d2433fb891 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026905 Oct 19 06:53:07.067129 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 514/1038] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:53:07.080249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b308d148-a166-44ec-8d43-a187a35a4c81 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:07.172333 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b308d148-a166-44ec-8d43-a187a35a4c81 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.094888 Oct 19 06:53:07.173654 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 515/1039] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:53:07 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:07.194385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:07.195091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:07.202172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:07.202658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:07.203170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:07.204529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:07.204969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:07.220895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:07.451533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:07.461461 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33f288cb-1566-45ad-8a81-4509ae3ace5b tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1314 microversion: 2.1 time: 0.271664 Oct 19 06:53:07.463064 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 516/1040] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:07 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:07.483979 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1593c3e-ad6f-4f9c-be00-c8c1caad970f tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "DELETE /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 204 len: 0 microversion: 2.1 time: 0.615470 Oct 19 06:53:07.486763 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 525/1041] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:53:06 2022] DELETE /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:53:07.495583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:07.495583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:07.495984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-330a8ae2-fefc-42da-ab3f-0e93d3853de5 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:07.503086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:07.504273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:07.505581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:07.506773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:07.507349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:07.507850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:07.526101 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-330a8ae2-fefc-42da-ab3f-0e93d3853de5 tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.037763 Oct 19 06:53:07.529931 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 526/1042] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:53:07 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:07.532740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-864959064", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b05059e7-85f2-4cad-a60f-f98042236a76"}], "security_groups": [{"name": "tempest-securitygroup--1622218963"}], "key_name": "tempest-keypair-1797815594", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:07.605192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:07.617049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:07.618908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:07.630594 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18c28a11-46cd-4f22-aa17-63d2a7b62953 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.166312 Oct 19 06:53:07.631756 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 517/1043] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:07 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:07.637872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:07.638949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:07.645965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:07.646732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:07.647242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:07.648020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:07.648582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:07.649080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:07.784955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] validate_networks() for [('b05059e7-85f2-4cad-a60f-f98042236a76', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:53:07.888259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:07.908913 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-503e49b8-13d3-4186-bfd8-47a1cbd36858 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1713 microversion: 2.1 time: 0.275749 Oct 19 06:53:07.910273 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 518/1044] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:07 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1713 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:07.920338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e927325b-8f9d-4052-9d56-9cef9858bcce tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:07.930909 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e927325b-8f9d-4052-9d56-9cef9858bcce tempest-FlavorsV2TestJSON-659276012 tempest-FlavorsV2TestJSON-659276012-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019316 Oct 19 06:53:07.934351 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 519/1045] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:08.021039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:08.022830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:08.034856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.038702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.038702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:08.039945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.041073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.042292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:08.280765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:08.289726 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4aa40e9-0f60-428a-b309-87650a082e68 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.277245 Oct 19 06:53:08.304129 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 520/1046] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:08 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:08.487431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:08.488068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:08.490062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:08.501685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.501975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:53:08.502195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.502672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:08.503336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:53:08.503469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.503824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.504252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:08.504788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:53:08.505521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:53:08.505978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:53:08.518608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.520214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.521671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:08.522692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.523380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.524094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:08.573927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:53:08.590748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for user 641a9af15ca24743baa3049fa9ad2e68 and project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:53:08.623689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:53:08.631034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:53:08.752658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:08.761387 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84f015e6-1acf-4729-a1af-915e72a3ac2e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1314 microversion: 2.1 time: 0.278447 Oct 19 06:53:08.762677 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 521/1047] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:08 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:08.768035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:08.769029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:08.775356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.776075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.776721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:08.777561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.778284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.778991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:08.807001 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c600330c-fbcd-46d9-8e31-f939b02db536 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.278322 Oct 19 06:53:08.809163 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 527/1048] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:53:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 06:53:08.867616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-acb3e518-0325-47f5-918f-b40614059255 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:08.868889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-acb3e518-0325-47f5-918f-b40614059255 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:08.919264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:08.929657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:08.931388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:08.938744 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-49eb6fcf-6cc2-456a-90a9-83220bd45f72 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.174806 Oct 19 06:53:08.954045 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 522/1049] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:08 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:08.965097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:08.967168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:08.985067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.985739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.987205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:08.989498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:08.990870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:08.992559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:09.033710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-acb3e518-0325-47f5-918f-b40614059255 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:09.045147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-acb3e518-0325-47f5-918f-b40614059255 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:09.049466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-acb3e518-0325-47f5-918f-b40614059255 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:09.050818 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-acb3e518-0325-47f5-918f-b40614059255 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1285 microversion: 2.25 time: 0.225616 Oct 19 06:53:09.066153 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 528/1050] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:08 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:09.218604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:09.234138 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab87cf8a-3616-4a18-9aba-402a7b44b03c tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1713 microversion: 2.1 time: 0.274894 Oct 19 06:53:09.234138 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 523/1051] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:08 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1713 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:09.322243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:09.323665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:09.331771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:09.333105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:09.333105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:09.333639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:09.334375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:09.334816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:09.786342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:09.786627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:09.811342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:09.811850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:09.812321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:09.813059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:09.813847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:09.814524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:09.824182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:09.944502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:09.957545 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9089a8c-bbac-4d99-93c1-2b6704513d6f tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.641948 Oct 19 06:53:09.958144 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 529/1052] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:09 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:09.968427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-67e8f5e3-9812-44f4-a449-8d74921d2212 req-c896eae3-d466-4a9e-afa9-3d0888430cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746ca76b-0323-4723-b70d-521be1acde08", "name": "network-vif-plugged", "status": "completed", "tag": "ff47ddd9-0ab0-4a55-a084-843137cbd042"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:09.990188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67e8f5e3-9812-44f4-a449-8d74921d2212 req-c896eae3-d466-4a9e-afa9-3d0888430cc7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:09.990665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67e8f5e3-9812-44f4-a449-8d74921d2212 req-c896eae3-d466-4a9e-afa9-3d0888430cc7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:09.991234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67e8f5e3-9812-44f4-a449-8d74921d2212 req-c896eae3-d466-4a9e-afa9-3d0888430cc7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:10.006195 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-67e8f5e3-9812-44f4-a449-8d74921d2212 req-c896eae3-d466-4a9e-afa9-3d0888430cc7 service nova] Creating event network-vif-plugged:ff47ddd9-0ab0-4a55-a084-843137cbd042 for instance 746ca76b-0323-4723-b70d-521be1acde08 on n-h1-861333-10 Oct 19 06:53:10.011911 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-67e8f5e3-9812-44f4-a449-8d74921d2212 req-c896eae3-d466-4a9e-afa9-3d0888430cc7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052555 Oct 19 06:53:10.017409 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 530/1053] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:10.024258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:10.030405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:10.034716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:10.035310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:10.035822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:10.036577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:10.037292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:10.039464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:10.050434 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b55a767a-e5fa-4624-a8d8-9d8cd5ad98d2 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1314 microversion: 2.1 time: 0.269115 Oct 19 06:53:10.055955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:10.078850 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 524/1054] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:09 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:10.095859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd8b884a-08dc-4947-ab24-7a3e11ac2c19 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:10.099532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd8b884a-08dc-4947-ab24-7a3e11ac2c19 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:10.225280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:10.231284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd8b884a-08dc-4947-ab24-7a3e11ac2c19 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:10.242713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:10.246530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:10.247064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd8b884a-08dc-4947-ab24-7a3e11ac2c19 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:10.253617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd8b884a-08dc-4947-ab24-7a3e11ac2c19 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:10.256400 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd8b884a-08dc-4947-ab24-7a3e11ac2c19 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1285 microversion: 2.25 time: 0.168473 Oct 19 06:53:10.257746 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 525/1055] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:10 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:10.284258 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-881469b9-a25c-4f1a-b977-f11a397dfd7b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.256332 Oct 19 06:53:10.284258 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 531/1056] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:10 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:10.284552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:10.284552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:10.302860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:10.305278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:10.305740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:10.307714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:10.309456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:10.309976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:10.445124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:10.461275 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-031a3eb1-d46f-4992-862e-37135865215b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1645 microversion: 2.1 time: 0.201159 Oct 19 06:53:10.481379 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 526/1057] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:10 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1645 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:10.826981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2568187d-7a4d-4b2f-88b9-b1c33e8c9336 req-b57c4354-c33a-478e-8b22-d31dd1360e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d5974e-c2aa-4e04-ad3b-c075c14ee327", "name": "network-vif-deleted", "tag": "e402da3c-527f-4e8a-b89f-b1f07ce69474"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:10.844601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2568187d-7a4d-4b2f-88b9-b1c33e8c9336 req-b57c4354-c33a-478e-8b22-d31dd1360e16 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:10.845412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2568187d-7a4d-4b2f-88b9-b1c33e8c9336 req-b57c4354-c33a-478e-8b22-d31dd1360e16 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:10.846380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2568187d-7a4d-4b2f-88b9-b1c33e8c9336 req-b57c4354-c33a-478e-8b22-d31dd1360e16 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:10.863437 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2568187d-7a4d-4b2f-88b9-b1c33e8c9336 req-b57c4354-c33a-478e-8b22-d31dd1360e16 service nova] Creating event network-vif-deleted:e402da3c-527f-4e8a-b89f-b1f07ce69474 for instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 on n-h1-861333-10 Oct 19 06:53:10.870886 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2568187d-7a4d-4b2f-88b9-b1c33e8c9336 req-b57c4354-c33a-478e-8b22-d31dd1360e16 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047708 Oct 19 06:53:10.876095 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 532/1058] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:10.992156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:10.993161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:11.001220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.002380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.003041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.004236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.004921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.017419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.078915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:11.079694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:11.091681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.092222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.092676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.095919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.096381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.096849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.274214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:11.288093 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4066a800-53ab-47a5-b02e-5414a40cec97 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.300760 Oct 19 06:53:11.300647 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 527/1059] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:10 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:11.312526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:11.313588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:11.321589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.322087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.322550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.323493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.323960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.324471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.375946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:11.385535 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d30d702-2714-4de0-bb4c-25f482592e52 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1314 microversion: 2.1 time: 0.311483 Oct 19 06:53:11.402225 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 533/1060] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:11 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:11.411729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:11.412423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:11.424452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.425301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.426032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.434100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.437122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.438622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.448724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:11.462171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:11.463633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:11.464795 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-167744cb-ee1e-46b2-9513-74b114aefd2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1281 microversion: 2.25 time: 0.162851 Oct 19 06:53:11.482471 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 528/1061] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:11 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:11.495066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:11.496002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:11.504177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.511636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.512448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.519805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.519805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.519805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.593446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:11.602221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:11.603135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:11.603793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lazy-loading 'fault' on Instance uuid 04d5974e-c2aa-4e04-ad3b-c075c14ee327 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:11.612556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:11.627872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:11.630668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:11.639954 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dac1cbb7-5d2d-40ae-b416-00f29c73057b tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.241692 Oct 19 06:53:11.641385 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 534/1062] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:11 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:11.716968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:11.733835 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5343a5c-535c-4484-8deb-3483529932e6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1354 microversion: 2.1 time: 0.242092 Oct 19 06:53:11.747629 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 529/1063] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:11 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:11.899620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c24748e-5281-4647-b92b-617aa97becbf tempest-FlavorsV2NegativeTest-736155895 tempest-FlavorsV2NegativeTest-736155895-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:11.908415 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c24748e-5281-4647-b92b-617aa97becbf tempest-FlavorsV2NegativeTest-736155895 tempest-FlavorsV2NegativeTest-736155895-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.239292 Oct 19 06:53:11.909886 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 535/1064] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:53:12.315568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:12.316215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:12.330020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:12.333924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:12.333924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:12.333924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:12.340277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:12.340897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:12.415648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:12.416323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:12.428994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:12.429741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:12.430385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:12.431101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:12.431650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:12.432149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:12.681303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:12.711150 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c803f2e-bd71-4d0d-a5f8-cd6a52957a82 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.400017 Oct 19 06:53:12.713812 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 530/1065] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:12 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:12.727275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:12.729411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:12.751778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:12.752812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:12.756708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:12.757739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:12.758424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:12.759151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:12.874717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:12.874717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:12.874717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:12.875652 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b6f379f-5d99-420f-89fa-7e224678d915 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1345 microversion: 2.25 time: 0.159128 Oct 19 06:53:12.892220 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 531/1066] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:12 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:12.892220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:12.892220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:12.892220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:12.892682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:12.892834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:12.893833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:12.894727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:12.895702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:12.986653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:13.009210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:13.010931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:13.017896 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ade6a75-c4bb-49d0-abe8-e60e5de94c0c tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.139758 Oct 19 06:53:13.018483 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 532/1067] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:12 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:13.037821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:13.039632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:13.055766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.058898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.061690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.061690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.061690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.061690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.162127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.165050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.168540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.169027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lazy-loading 'fault' on Instance uuid 04d5974e-c2aa-4e04-ad3b-c075c14ee327 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:13.217747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:13.229522 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd18e4ce-bc74-4b71-a171-3bfcf7e1ec5e tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1463 microversion: 2.1 time: 0.821754 Oct 19 06:53:13.230959 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 536/1068] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:12 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1463 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:13.278576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bedc34dad443bbbd646b8ff2f5ed26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20a486a1684575950a9e9566635cc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:13.297917 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d4cd4c5-5bc3-4b17-8a61-f6cfd0548bc9 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 200 len: 1354 microversion: 2.1 time: 0.277778 Oct 19 06:53:13.298639 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 533/1069] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:13 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 1354 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:13.403170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72094961-8532-405d-be2d-1ade608f5e8a tempest-FlavorsV2NegativeTest-736155895 tempest-FlavorsV2NegativeTest-736155895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-492367173", "imageRef": "17ddda02-34a1-444b-b543-117bac378386", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:13.516436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-72094961-8532-405d-be2d-1ade608f5e8a tempest-FlavorsV2NegativeTest-736155895 tempest-FlavorsV2NegativeTest-736155895-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:53:13.545525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e28e751-b64b-451a-b593-c2d61439aba1 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Calling method '.version_select at 0x7f6d64a4c700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:13.569511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e751-b64b-451a-b593-c2d61439aba1 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.570006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e751-b64b-451a-b593-c2d61439aba1 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.576172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e751-b64b-451a-b593-c2d61439aba1 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.618742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e751-b64b-451a-b593-c2d61439aba1 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.619662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e751-b64b-451a-b593-c2d61439aba1 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.621038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e751-b64b-451a-b593-c2d61439aba1 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.667222 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e28e751-b64b-451a-b593-c2d61439aba1 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/252036554fb7458c8d2d10692835508b?start=2022-10-18T06%3A53%3A13.247337&end=2022-10-20T06%3A53%3A13.247337" status: 200 len: 695 microversion: 2.1 time: 0.415114 Oct 19 06:53:13.667823 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 537/1070] 10.222.0.39 () {58 vars in 1412 bytes} [Wed Oct 19 06:53:13 2022] GET /compute/v2.1/os-simple-tenant-usage/252036554fb7458c8d2d10692835508b?start=2022-10-18T06%3A53%3A13.247337&end=2022-10-20T06%3A53%3A13.247337 => generated 695 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:13.685004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc57524a-b290-4e2b-90e2-e487ccaeb1d0 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '.version_select at 0x7f6d64a4caf0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:13.697269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc57524a-b290-4e2b-90e2-e487ccaeb1d0 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.697767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc57524a-b290-4e2b-90e2-e487ccaeb1d0 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.698208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc57524a-b290-4e2b-90e2-e487ccaeb1d0 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.716206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc57524a-b290-4e2b-90e2-e487ccaeb1d0 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.716984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc57524a-b290-4e2b-90e2-e487ccaeb1d0 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.717613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc57524a-b290-4e2b-90e2-e487ccaeb1d0 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.738228 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc57524a-b290-4e2b-90e2-e487ccaeb1d0 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/252036554fb7458c8d2d10692835508b?start=2022-10-18T06%3A53%3A13.247337&end=2022-10-20T06%3A53%3A13.247337" status: 200 len: 695 microversion: 2.1 time: 0.056950 Oct 19 06:53:13.739054 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 538/1071] 10.222.0.39 () {58 vars in 1412 bytes} [Wed Oct 19 06:53:13 2022] GET /compute/v2.1/os-simple-tenant-usage/252036554fb7458c8d2d10692835508b?start=2022-10-18T06%3A53%3A13.247337&end=2022-10-20T06%3A53%3A13.247337 => generated 695 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:13.757855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec5e750b-a05a-4ed5-9880-e3fbe6b715b3 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Calling method '.version_select at 0x7f6d64f9c280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:13.776482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec5e750b-a05a-4ed5-9880-e3fbe6b715b3 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.777882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec5e750b-a05a-4ed5-9880-e3fbe6b715b3 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.778633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec5e750b-a05a-4ed5-9880-e3fbe6b715b3 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.814727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec5e750b-a05a-4ed5-9880-e3fbe6b715b3 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.816970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec5e750b-a05a-4ed5-9880-e3fbe6b715b3 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.818401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec5e750b-a05a-4ed5-9880-e3fbe6b715b3 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.869695 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-72094961-8532-405d-be2d-1ade608f5e8a tempest-FlavorsV2NegativeTest-736155895 tempest-FlavorsV2NegativeTest-736155895-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72094961-8532-405d-be2d-1ade608f5e8a tempest-FlavorsV2NegativeTest-736155895 tempest-FlavorsV2NegativeTest-736155895-project] Request method failure captured: Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 142 Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57XP8dZhOapf710hILXdLTCDIZSu7SwDXcCG72iBgRitKl8shb-WuFsaSlv3XmaWHA63GSFTH30140ykMBaRRH36Wa8jiUzd1GwZUCdRtslmG6jyowO_7SrqSUj1HHvUZLRCrKtZGd696dTfARUTX7G7Na8HIij9PpDcsg6oyWo7lo Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8a7c8b8826744aaa9b3c7b4161ce4e4c Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsV2NegativeTest-736155895 Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8a7c8b8826744aaa9b3c7b4161ce4e4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a7c8b8826744aaa9b3c7b4161ce4e4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a7c8b8826744aaa9b3c7b4161ce4e4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8a7c8b8826744aaa9b3c7b4161ce4e4c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsV2NegativeTest-736155895 Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8a7c8b8826744aaa9b3c7b4161ce4e4c Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-736155895 Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FlavorsV2NegativeTest-736155895-project Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 9f9877ef6c4f4cac87857822ed7bc9ee Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsV2NegativeTest-736155895-project Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-492367173", "imageRef": "17ddda02-34a1-444b-b543-117bac378386", "flavorRef": "452"}} Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: exception: Flavor's memory is too small for requested image. Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-492367173', 'imageRef': '17ddda02-34a1-444b-b543-117bac378386', 'flavorRef': '452'}}} Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:53:13.871868 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72094961-8532-405d-be2d-1ade608f5e8a tempest-FlavorsV2NegativeTest-736155895 tempest-FlavorsV2NegativeTest-736155895-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72094961-8532-405d-be2d-1ade608f5e8a tempest-FlavorsV2NegativeTest-736155895 tempest-FlavorsV2NegativeTest-736155895-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.474315 Oct 19 06:53:13.877775 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 534/1072] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:53:13 2022] POST /compute/v2.1/servers => generated 93 bytes in 476 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:53:13.882078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:13.882709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:13.894682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.895837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.896706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.898328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.898856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.899596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.902987 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec5e750b-a05a-4ed5-9880-e3fbe6b715b3 tempest-TenantUsagesTestJSON-1056399076 tempest-TenantUsagesTestJSON-1056399076-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T06%3A53%3A13.247337&end=2022-10-20T06%3A53%3A13.247337&detailed=1" status: 200 len: 11364 microversion: 2.1 time: 0.148866 Oct 19 06:53:13.922098 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 539/1073] 10.222.0.39 () {58 vars in 1335 bytes} [Wed Oct 19 06:53:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T06%3A53%3A13.247337&end=2022-10-20T06%3A53%3A13.247337&detailed=1 => generated 11364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 06:53:13.929725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:13.930356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:13.955353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.958046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.958046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:13.960687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:13.961428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:13.962081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.109883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:14.112434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:14.124192 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4499af4e-ff70-4db0-b067-8195aa7c69f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.248322 Oct 19 06:53:14.124192 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 535/1074] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:13 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:14.130270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:14.132356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:14.135689 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cada33e4-cb64-4d1d-8ec3-68fcac927c56 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1343 microversion: 2.25 time: 0.212516 Oct 19 06:53:14.138474 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 540/1075] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:13 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:14.146536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:14.147152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:14.164801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.169623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.169623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.169623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.169623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.169623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.177619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:14.179659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:14.193868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.196515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.197047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.197729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.198192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.198715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.249414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:53:14.327843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:14.331700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:14.337613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:14.339631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:14.351010 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6288ab1b-0dc6-4881-aa3b-bbbac6fd1e89 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.210191 Oct 19 06:53:14.351979 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 541/1076] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:14 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:14.357016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:14.358201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:14.375725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.375725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.375725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.375725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.375725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.375725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.391245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] HTTP exception thrown: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Request method failure captured: Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 HTTP/1.1 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT55Ews1nSCeps-U6U3jc2id8FBFi75WAAW_D2z-cg53csQScv2kSXa7gJ37hC4iwss_cNuLlaGxG6r8jQbIhfgMA8ulSW1bxhX2Ty_5k826NHfuMZo5z2VWTvjhmrQITG3JH8ptYBvj1mIb5-iAklh6UgzOZ6cyyODlXwRxQHxWcw0g Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c20a486a1684575950a9e9566635cc1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 98bedc34dad443bbbd646b8ff2f5ed26 Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '04d5974e-c2aa-4e04-ad3b-c075c14ee327'} Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:14.394049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.398675 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:14.398675 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.398675 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:14.398675 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:14.398675 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:14.398675 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:14.398675 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:14.398675 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:14.398675 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.400961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Returning 404 to user: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:14.402300 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e881a90-3f57-4665-88aa-56d23eb589a1 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 404 len: 111 microversion: 2.1 time: 0.049101 Oct 19 06:53:14.403188 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 542/1077] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:14 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:53:14.412292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:14.415266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:14.420023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.420700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.421404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.422938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.424149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.424649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.439932 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] HTTP exception thrown: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Request method failure captured: Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f HTTP/1.1 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT55Ews1nSCeps-U6U3jc2id8FBFi75WAAW_D2z-cg53csQScv2kSXa7gJ37hC4iwss_cNuLlaGxG6r8jQbIhfgMA8ulSW1bxhX2Ty_5k826NHfuMZo5z2VWTvjhmrQITG3JH8ptYBvj1mIb5-iAklh6UgzOZ6cyyODlXwRxQHxWcw0g Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c20a486a1684575950a9e9566635cc1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 98bedc34dad443bbbd646b8ff2f5ed26 Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'fe37e8c6-900b-4c99-bc7c-2511c6d8108f'} Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:14.441620 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Returning 404 to user: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9a81999-fe5f-42df-ab12-3a0eb56d10d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 404 len: 111 microversion: 2.1 time: 0.035371 Oct 19 06:53:14.445395 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 543/1078] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:53:14 2022] DELETE /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:53:14.452002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:14.452651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:14.458686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.459165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.459602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.460336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.460787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.461228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.475385 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] HTTP exception thrown: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Request method failure captured: Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f HTTP/1.1 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT55Ews1nSCeps-U6U3jc2id8FBFi75WAAW_D2z-cg53csQScv2kSXa7gJ37hC4iwss_cNuLlaGxG6r8jQbIhfgMA8ulSW1bxhX2Ty_5k826NHfuMZo5z2VWTvjhmrQITG3JH8ptYBvj1mIb5-iAklh6UgzOZ6cyyODlXwRxQHxWcw0g Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c20a486a1684575950a9e9566635cc1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 98bedc34dad443bbbd646b8ff2f5ed26 Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'fe37e8c6-900b-4c99-bc7c-2511c6d8108f'} Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.476938 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Returning 404 to user: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:14.480826 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-090200eb-43fa-4adc-a604-68bca1912516 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 404 len: 111 microversion: 2.1 time: 0.029951 Oct 19 06:53:14.482375 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 544/1079] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:14 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:53:14.487737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac0ecc66-b912-42b4-bf5e-12c3f3f311d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '.version_select at 0x7f6d64e5f550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:14.501352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:14.598360 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac0ecc66-b912-42b4-bf5e-12c3f3f311d6 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864135909" status: 202 len: 0 microversion: 2.1 time: 0.114915 Oct 19 06:53:14.604725 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 545/1080] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 06:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864135909 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:53:14.726839 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6295a0d6-c456-4b3a-9af4-e65732601e7f tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "DELETE /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 204 len: 0 microversion: 2.1 time: 0.586236 Oct 19 06:53:14.728374 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 536/1081] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:53:14 2022] DELETE /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:53:14.737488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:14.738404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:14.746501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.754639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.756773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.758061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:14.761656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:14.762418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:14.991148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:15.011020 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-601fd94c-41ba-4269-a5d7-56dd6c24928d tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1469 microversion: 2.1 time: 0.277848 Oct 19 06:53:15.012196 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 546/1082] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:14 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:15.153449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:15.154835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:15.164726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:15.165242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:15.165393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:15.166055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:15.166707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:15.167583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:15.168269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:15.169024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:15.175550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:15.185642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:15.186321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:15.193486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:15.193719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:15.196265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:15.385417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:15.397873 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20b18125-319b-4d85-993e-72e738542892 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.250449 Oct 19 06:53:15.399527 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 537/1083] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:15 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:15.407176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:15.408067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:15.415678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:15.416729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:15.417474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:15.418610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:15.419285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:15.420514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:15.524344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:15.540825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:15.542421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:15.551848 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63b74b1e-77a8-468b-9810-466b1f3682b5 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.150655 Oct 19 06:53:15.552645 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 538/1084] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:15 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:15.619784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:15.642532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:15.654749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:15.657463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b2bf586-183c-4107-9715-576c936ddbb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1411 microversion: 2.25 time: 0.496870 Oct 19 06:53:15.661951 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 547/1085] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:15 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1411 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:53:15.990345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a81f20f-e301-460b-84dc-8c3168a934c4 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.038573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.039132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:16.045876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.046398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.046970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.047674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.048156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.048592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.066411 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a81f20f-e301-460b-84dc-8c3168a934c4 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1066405721" status: 202 len: 0 microversion: 2.1 time: 0.079698 Oct 19 06:53:16.067061 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 539/1086] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:53:15 2022] DELETE /compute/v2.1/flavors/1066405721 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:53:16.075101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8a33042-f4a9-4f5c-a4a6-a5f1627603f8 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.096879 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8a33042-f4a9-4f5c-a4a6-a5f1627603f8 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.025413 Oct 19 06:53:16.097454 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 540/1087] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:53:16 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:16.116010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-493a2d14-de1d-4f57-b756-9d6e23987491 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.214061 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-493a2d14-de1d-4f57-b756-9d6e23987491 tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1245314497" status: 202 len: 0 microversion: 2.1 time: 0.101837 Oct 19 06:53:16.214954 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 541/1088] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:53:16 2022] DELETE /compute/v2.1/flavors/1245314497 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 06:53:16.223496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba7af99a-becc-40fc-9d79-8a47c09ceb9d tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.244853 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba7af99a-becc-40fc-9d79-8a47c09ceb9d tempest-ServersWithSpecificFlavorTestJSON-264054781 tempest-ServersWithSpecificFlavorTestJSON-264054781-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025016 Oct 19 06:53:16.245695 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 542/1089] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:53:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:16.276558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.276942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:16.284153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.286636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.286636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.286636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.286636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.287215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.301877 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] HTTP exception thrown: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Request method failure captured: Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 HTTP/1.1 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT55Ews1nSCeps-U6U3jc2id8FBFi75WAAW_D2z-cg53csQScv2kSXa7gJ37hC4iwss_cNuLlaGxG6r8jQbIhfgMA8ulSW1bxhX2Ty_5k826NHfuMZo5z2VWTvjhmrQITG3JH8ptYBvj1mIb5-iAklh6UgzOZ6cyyODlXwRxQHxWcw0g Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c20a486a1684575950a9e9566635cc1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 98bedc34dad443bbbd646b8ff2f5ed26 Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '04d5974e-c2aa-4e04-ad3b-c075c14ee327'} Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:16.303492 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Returning 404 to user: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-671772e4-3027-4d08-8990-651e5f32fafd tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "DELETE /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 404 len: 111 microversion: 2.1 time: 0.034282 Oct 19 06:53:16.311688 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 543/1090] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:53:16 2022] DELETE /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:53:16.314693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.314875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: 04d5974e-c2aa-4e04-ad3b-c075c14ee327] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:16.321624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.322359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.322806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.323548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.324008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.324648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.339732 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] HTTP exception thrown: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Request method failure captured: Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 HTTP/1.1 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT55Ews1nSCeps-U6U3jc2id8FBFi75WAAW_D2z-cg53csQScv2kSXa7gJ37hC4iwss_cNuLlaGxG6r8jQbIhfgMA8ulSW1bxhX2Ty_5k826NHfuMZo5z2VWTvjhmrQITG3JH8ptYBvj1mIb5-iAklh6UgzOZ6cyyODlXwRxQHxWcw0g Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c20a486a1684575950a9e9566635cc1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 98bedc34dad443bbbd646b8ff2f5ed26 Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '04d5974e-c2aa-4e04-ad3b-c075c14ee327'} Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.341579 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.346119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:16.346119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.346119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.346119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:16.346119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:16.346119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:16.346119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:16.346119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. Oct 19 06:53:16.346119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.346758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:16.347627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Returning 404 to user: Instance 04d5974e-c2aa-4e04-ad3b-c075c14ee327 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:16.348526 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e47db092-6c0d-4804-9e4a-843be14f3fb8 tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327" status: 404 len: 111 microversion: 2.1 time: 0.038969 Oct 19 06:53:16.349086 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 544/1091] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:16 2022] GET /compute/v2.1/servers/04d5974e-c2aa-4e04-ad3b-c075c14ee327 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:53:16.357880 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d1d981e-6952-4402-ad05-ff430ceb63e6 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1469 microversion: 2.1 time: 0.321558 Oct 19 06:53:16.360382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.361060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:16.367551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.368402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.368779 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 548/1092] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:16 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1469 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:16.369345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.370207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.370904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.371478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.386691 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] HTTP exception thrown: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Request method failure captured: Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f HTTP/1.1 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT55Ews1nSCeps-U6U3jc2id8FBFi75WAAW_D2z-cg53csQScv2kSXa7gJ37hC4iwss_cNuLlaGxG6r8jQbIhfgMA8ulSW1bxhX2Ty_5k826NHfuMZo5z2VWTvjhmrQITG3JH8ptYBvj1mIb5-iAklh6UgzOZ6cyyODlXwRxQHxWcw0g Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c20a486a1684575950a9e9566635cc1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 98bedc34dad443bbbd646b8ff2f5ed26 Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'fe37e8c6-900b-4c99-bc7c-2511c6d8108f'} Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:16.391609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Returning 404 to user: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afd7a0d1-ac1c-4f0f-b9be-32087379172b tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 404 len: 111 microversion: 2.1 time: 0.034941 Oct 19 06:53:16.395942 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 545/1093] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:53:16 2022] DELETE /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:53:16.402675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.403860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] [instance: fe37e8c6-900b-4c99-bc7c-2511c6d8108f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:16.410184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.410857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.411471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.412319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.413100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.413634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.426414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.427028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:16.430365 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] HTTP exception thrown: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Request method failure captured: Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f HTTP/1.1 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT55Ews1nSCeps-U6U3jc2id8FBFi75WAAW_D2z-cg53csQScv2kSXa7gJ37hC4iwss_cNuLlaGxG6r8jQbIhfgMA8ulSW1bxhX2Ty_5k826NHfuMZo5z2VWTvjhmrQITG3JH8ptYBvj1mIb5-iAklh6UgzOZ6cyyODlXwRxQHxWcw0g Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c20a486a1684575950a9e9566635cc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c20a486a1684575950a9e9566635cc1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 5c20a486a1684575950a9e9566635cc1 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 98bedc34dad443bbbd646b8ff2f5ed26 Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1060034926-project Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'fe37e8c6-900b-4c99-bc7c-2511c6d8108f'} Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.432409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:16.441322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] Returning 404 to user: Instance fe37e8c6-900b-4c99-bc7c-2511c6d8108f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:16.442026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.442117 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc2dbd2f-a648-402c-a0cc-35a7b43bef3d tempest-ServersWithSpecificFlavorTestJSON-1060034926 tempest-ServersWithSpecificFlavorTestJSON-1060034926-project] 10.222.0.39 "GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f" status: 404 len: 111 microversion: 2.1 time: 0.035980 Oct 19 06:53:16.442215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.442215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.442367 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 549/1094] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:16 2022] GET /compute/v2.1/servers/fe37e8c6-900b-4c99-bc7c-2511c6d8108f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:53:16.442448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.442448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.442448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.454688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:16.584535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.585339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:16.591699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.592537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.593535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.594803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.595520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.596046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.710173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:16.728253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:16.732849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:16.739579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f42505c7-5d2e-4f0f-a058-85ba46796277 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.160556 Oct 19 06:53:16.740199 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 550/1095] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:16 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:53:16.745209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:16.745809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:16.752429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.756325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.756325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.756325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:16.756325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:16.756325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:16.911618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:16.924605 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a622ff6-9ff2-43ac-9f15-46dda5e7010d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.502639 Oct 19 06:53:16.925833 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 546/1096] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:16 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:17.136196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:17.146689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:17.148893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:17.150689 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c22d34e-9211-479d-910a-44bd9a5c7473 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1411 microversion: 2.25 time: 0.409180 Oct 19 06:53:17.157330 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 551/1097] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:16 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1411 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:17.168798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0275e627-be07-4fb3-b35a-393345a60726 req-190c74c5-f45e-40c3-900b-767f35ed6daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746ca76b-0323-4723-b70d-521be1acde08", "name": "network-vif-deleted", "tag": "ff47ddd9-0ab0-4a55-a084-843137cbd042"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:17.188951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0275e627-be07-4fb3-b35a-393345a60726 req-190c74c5-f45e-40c3-900b-767f35ed6daf service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:17.189489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0275e627-be07-4fb3-b35a-393345a60726 req-190c74c5-f45e-40c3-900b-767f35ed6daf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:17.189935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0275e627-be07-4fb3-b35a-393345a60726 req-190c74c5-f45e-40c3-900b-767f35ed6daf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:17.214974 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0275e627-be07-4fb3-b35a-393345a60726 req-190c74c5-f45e-40c3-900b-767f35ed6daf service nova] Creating event network-vif-deleted:ff47ddd9-0ab0-4a55-a084-843137cbd042 for instance 746ca76b-0323-4723-b70d-521be1acde08 on n-h1-861333-10 Oct 19 06:53:17.222363 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0275e627-be07-4fb3-b35a-393345a60726 req-190c74c5-f45e-40c3-900b-767f35ed6daf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057294 Oct 19 06:53:17.223586 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 547/1098] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:17.380825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:17.381593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:17.389529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:17.390105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:17.391157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:17.392195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:17.392850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:17.393367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:17.479911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1a18f0edf54373b9c7766f02e7fe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252036554fb7458c8d2d10692835508b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:17.489918 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1bfeb22b-d9a1-4a4c-95c7-f2c36b9a0a94 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 200 len: 1299 microversion: 2.1 time: 0.112979 Oct 19 06:53:17.495586 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 552/1099] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:17 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:17.546446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-481b9e2d-1a0b-40ab-bb84-27a807a6fe01 req-60a55873-921a-4d66-8a3d-3712eb6658c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5705ad-60bd-4c15-969f-bb26a8fd5b60", "tag": "11026df4-02a2-4f24-8043-6c02c90c96a3"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:17.557583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-481b9e2d-1a0b-40ab-bb84-27a807a6fe01 req-60a55873-921a-4d66-8a3d-3712eb6658c7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:17.558328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-481b9e2d-1a0b-40ab-bb84-27a807a6fe01 req-60a55873-921a-4d66-8a3d-3712eb6658c7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:17.558989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-481b9e2d-1a0b-40ab-bb84-27a807a6fe01 req-60a55873-921a-4d66-8a3d-3712eb6658c7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:17.581268 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-481b9e2d-1a0b-40ab-bb84-27a807a6fe01 req-60a55873-921a-4d66-8a3d-3712eb6658c7 service nova] Creating event network-changed:11026df4-02a2-4f24-8043-6c02c90c96a3 for instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 on n-h1-861333-10 Oct 19 06:53:17.581462 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-481b9e2d-1a0b-40ab-bb84-27a807a6fe01 req-60a55873-921a-4d66-8a3d-3712eb6658c7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041199 Oct 19 06:53:17.582668 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 548/1100] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:17.776260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:17.777036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:17.783450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:17.783924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:17.784402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:17.785112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:17.785641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:17.786072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:17.949514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:17.950221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:17.957745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:17.958327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:17.958686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:17.959392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:17.959854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:17.960315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:18.092264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:18.101183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:18.102700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:18.113286 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbe2b7d4-f897-49f7-bf43-6b787db5f7cd tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.341217 Oct 19 06:53:18.113997 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 553/1101] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:17 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:18.147265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:18.155055 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4d2058b-2b3d-4d35-bb2a-a02c201cc866 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.209940 Oct 19 06:53:18.155628 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 549/1102] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:17 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:18.178921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:18.179518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:18.185551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:18.186032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:18.186465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:18.187154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:18.188279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:18.189201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:18.459173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:18.472300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:18.474146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:18.476069 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b031a95e-2358-4305-b333-001d1a2d50fc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1411 microversion: 2.25 time: 0.301049 Oct 19 06:53:18.476663 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 554/1103] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:18 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1411 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:18.513648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:18.514355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] [instance: 746ca76b-0323-4723-b70d-521be1acde08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:18.521265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:18.521898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:18.522507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:18.523395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:18.523862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:18.524322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:18.539520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] HTTP exception thrown: Instance 746ca76b-0323-4723-b70d-521be1acde08 could not be found. Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Request method failure captured: Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 HTTP/1.1 Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57CXxz5zugqXd_ZJhFwafVENTwTzOm3eaJ0VjDJRZV-xV5xqZBgg5dg3KeCRSWnCYnpb7OxJ2RwwAfXCHiRCpMhxpisK52pav11pnaF9Y1muJuKE1HDIXvzRqfXAoY-KW7gAqao5y1bzYimLZnKcBvZDNh9qJV8KnpplYrOnz9Fnno Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 252036554fb7458c8d2d10692835508b Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TenantUsagesTestJSON-43536916 Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252036554fb7458c8d2d10692835508b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252036554fb7458c8d2d10692835508b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252036554fb7458c8d2d10692835508b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252036554fb7458c8d2d10692835508b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TenantUsagesTestJSON-43536916 Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 252036554fb7458c8d2d10692835508b Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TenantUsagesTestJSON-43536916 Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TenantUsagesTestJSON-43536916-project Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: ac1a18f0edf54373b9c7766f02e7fe03 Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TenantUsagesTestJSON-43536916-project Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 746ca76b-0323-4723-b70d-521be1acde08 could not be found. Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '746ca76b-0323-4723-b70d-521be1acde08'} Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746ca76b-0323-4723-b70d-521be1acde08 could not be found. Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746ca76b-0323-4723-b70d-521be1acde08 could not be found. Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:18.541216 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:18.546009 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:18.546009 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:18.546009 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:18.546009 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:18.546009 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:18.546009 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746ca76b-0323-4723-b70d-521be1acde08 could not be found. Oct 19 06:53:18.546009 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:18.546009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] Returning 404 to user: Instance 746ca76b-0323-4723-b70d-521be1acde08 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:18.546009 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb5ca8ff-4a1b-4ab0-b922-2829c7ff5576 tempest-TenantUsagesTestJSON-43536916 tempest-TenantUsagesTestJSON-43536916-project] 10.222.0.39 "GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08" status: 404 len: 111 microversion: 2.1 time: 0.035012 Oct 19 06:53:18.549598 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 550/1104] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:18 2022] GET /compute/v2.1/servers/746ca76b-0323-4723-b70d-521be1acde08 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:53:19.144399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:19.146643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:19.157323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:19.163297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:19.168432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:19.169098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:19.171471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:19.172163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:19.181971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:19.183322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:19.190766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:19.191221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:19.191664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:19.192802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:19.208189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:19.219030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:19.219822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:19.343264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:19.354565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:19.359149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:19.379454 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89a66ed3-5f51-4f4e-b351-1262f6209aef tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.240678 Oct 19 06:53:19.379959 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 555/1105] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:19 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:19.476863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:19.485281 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-adac9fd2-85f0-455d-8692-d5a9b860e8e2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.310906 Oct 19 06:53:19.494365 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 551/1106] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:19 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:19.503494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:19.504549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:19.511618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:19.512251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:19.512954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:19.513861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:19.514420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:19.515044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:19.795809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:19.805330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:19.807055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:19.808336 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-325a1baf-633f-4cdb-9198-bbd948cc0e20 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1411 microversion: 2.25 time: 0.310283 Oct 19 06:53:19.809487 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 556/1107] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:19 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1411 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:20.413190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:20.413802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:20.417806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:20.430960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:20.431462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:20.431907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:20.432648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:20.433109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:20.433539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:20.513671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:20.515017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:20.526213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:20.531270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:20.531270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:20.531270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:20.531270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:20.531270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:20.547609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:20.565777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:20.569498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:20.595253 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87474c3a-da81-43f6-87a0-0fa39b5bb05a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.183973 Oct 19 06:53:20.596578 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 552/1108] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:20 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:20.784536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:20.805877 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db9ed871-80e5-42ce-b151-d29ea78129d2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.296200 Oct 19 06:53:20.806509 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 557/1109] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:20 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:20.835402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:20.837061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:20.850057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:20.850815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:20.851454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:20.852420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:20.853092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:20.853990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:21.013798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:21.022867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:21.025140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:21.026361 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf61dd5f-616a-4f16-91fb-dc8338b23720 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1411 microversion: 2.25 time: 0.195345 Oct 19 06:53:21.027045 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 553/1110] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:20 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1411 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:21.628877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:21.630718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:21.661227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:21.664966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:21.665739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:21.666763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:21.670017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:21.670770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:21.760634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:21.770777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:21.776161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:21.784249 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f61ecaa7-4ef2-4676-9110-b908d4f16d6e tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1544 microversion: 2.91 time: 0.159882 Oct 19 06:53:21.785632 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 558/1111] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:21 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1544 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:21.830939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:21.831636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:21.839711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:21.842291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:21.842291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:21.842291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:21.842809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:21.843342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:22.061145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:22.062030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:22.069310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:22.069993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:22.070593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:22.071464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:22.072080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:22.072704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:22.198571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:22.217203 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-570f14c1-1e1d-4a6d-95f6-3e5885d70a02 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.390696 Oct 19 06:53:22.219046 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 554/1112] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:21 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:22.464962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:22.478358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:22.480212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:22.482662 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f5950df-12ec-490d-8b3d-4fe23af52579 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1411 microversion: 2.25 time: 0.425825 Oct 19 06:53:22.484081 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 559/1113] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:22 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1411 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:22.815128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:22.815829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:22.823031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:22.823510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:22.824194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:22.824900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:22.825354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:22.825778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:22.907053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:22.920313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:22.921881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:22.923989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:22.929006 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e031227-8bb4-474c-8a54-3fa61163ccad tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1531 microversion: 2.91 time: 0.118332 Oct 19 06:53:22.930218 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 555/1114] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:22 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1531 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:22.960083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:22.961002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:22.967856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:22.968712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:22.969409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:22.972261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:22.972261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:22.972261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:23.101880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] Lazy-loading 'services' on Instance uuid 6e036b18-232a-4e33-9790-c4f8b72c337c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:23.127416 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7a9d2ea-940e-414e-a5a2-cfec9b35d798 tempest-UnshelveToHostMultiNodesTest-2071170128 tempest-UnshelveToHostMultiNodesTest-2071170128-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1938 microversion: 2.91 time: 0.170996 Oct 19 06:53:23.128728 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 560/1115] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:22 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1938 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:23.179692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:23.181603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:23.190519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:23.191033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:23.191478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:23.192228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:23.192688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:23.193117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:23.233287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:53:23.243887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:23.244543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:23.253316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:23.254001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:23.254689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:23.255561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:23.256197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:23.256805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:23.555861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:23.559686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:23.569026 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7d2e79f-4a71-4d40-a4da-4d2c54fc17f5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.330093 Oct 19 06:53:23.606723 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 561/1116] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:23 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:23.612010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:23.618367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:23.645059 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69e8f5da-7f29-4a67-bf46-eb854bf2f466 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 204 len: 0 microversion: 2.91 time: 0.473020 Oct 19 06:53:23.646317 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 556/1117] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 06:53:23 2022] DELETE /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 06:53:23.655213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:23.658272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:23.658398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:23.658523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:23.658637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:23.658729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:23.658729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:23.659104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:23.677756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:23.678491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:23.679875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:23.682232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:23.683719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:23.686266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:23.814897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:23.972074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:23.988500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:23.994243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:24.045648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:24.046502 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef33d774-0939-4107-a49f-eb806135d795 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.394428 Oct 19 06:53:24.050095 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 557/1118] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:23 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:53:24.060709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:24.071703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:24.075246 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6230fb2-17af-40f0-853a-2ab62546adf1 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1411 microversion: 2.25 time: 0.470581 Oct 19 06:53:24.079783 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 562/1119] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:23 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1411 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:24.343621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2fce0492-5ec0-44b8-a164-12aa0c797684 req-9f40fbab-6dfc-43ce-a110-423af2836dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5705ad-60bd-4c15-969f-bb26a8fd5b60", "name": "network-vif-plugged", "status": "completed", "tag": "11026df4-02a2-4f24-8043-6c02c90c96a3"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:24.360187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2fce0492-5ec0-44b8-a164-12aa0c797684 req-9f40fbab-6dfc-43ce-a110-423af2836dc4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:24.369179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2fce0492-5ec0-44b8-a164-12aa0c797684 req-9f40fbab-6dfc-43ce-a110-423af2836dc4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:24.369798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2fce0492-5ec0-44b8-a164-12aa0c797684 req-9f40fbab-6dfc-43ce-a110-423af2836dc4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:24.387897 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2fce0492-5ec0-44b8-a164-12aa0c797684 req-9f40fbab-6dfc-43ce-a110-423af2836dc4 service nova] Creating event network-vif-plugged:11026df4-02a2-4f24-8043-6c02c90c96a3 for instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 on n-h1-861333-10 Oct 19 06:53:24.400783 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2fce0492-5ec0-44b8-a164-12aa0c797684 req-9f40fbab-6dfc-43ce-a110-423af2836dc4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061147 Oct 19 06:53:24.402079 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 558/1120] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:24.592274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:24.593182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:24.605742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:24.608826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:24.608826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:24.610937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:24.616882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:24.617541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:24.871189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:24.879497 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a518a50-e130-4f03-800f-e9774fda0294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.291200 Oct 19 06:53:24.895128 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 563/1121] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:24 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:25.081093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:25.081794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:25.093293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:25.093821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:25.094256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:25.095135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:25.095662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:25.096054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:25.111176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:25.111788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:25.127524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:25.128013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:25.128488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:25.129199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:25.129652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:25.137137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:25.332145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:25.345090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:25.358227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:25.368214 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8691483e-77e0-4b1d-8568-03b5175ef1b0 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.293101 Oct 19 06:53:25.370576 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 559/1122] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:25 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:25.684087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:25.698089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:25.700092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:25.701853 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a71d3cf-bbd0-40dc-a22a-eadf53d2e971 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1411 microversion: 2.25 time: 0.595981 Oct 19 06:53:25.706526 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 564/1123] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:25 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1411 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:25.902705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:25.903432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:25.911112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:25.916335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:25.917133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:25.930890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:25.930890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:25.930890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:26.345538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:26.365601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ffc367f-02fe-4871-ab2f-04f3ee59c6dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1472 microversion: 2.1 time: 0.466098 Oct 19 06:53:26.368122 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 560/1124] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:25 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1472 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:26.399137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:26.399766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:26.406254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:26.407284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:26.409212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:26.409934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:26.410397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:26.410835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:26.553167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:26.563898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:26.570195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:26.585370 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d051531-5baa-48c0-a3f6-024d30a5c72a tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1537 microversion: 2.91 time: 0.190246 Oct 19 06:53:26.586781 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 565/1125] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:26 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1537 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:26.735900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:26.737098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:26.749136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:26.750988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:26.756820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:26.756820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:26.757901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:26.759388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:27.051483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:27.069391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:27.071844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:27.073870 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b029b901-0008-4144-a39b-6dd8483fc9e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1608 microversion: 2.25 time: 0.345517 Oct 19 06:53:27.092860 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 561/1126] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:26 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1608 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:27.131394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b29147cb-88e7-42d3-a28f-9a75e0b6a138 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:27.131394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b29147cb-88e7-42d3-a28f-9a75e0b6a138 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:27.145609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b29147cb-88e7-42d3-a28f-9a75e0b6a138 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:27.146611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b29147cb-88e7-42d3-a28f-9a75e0b6a138 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:27.149292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b29147cb-88e7-42d3-a28f-9a75e0b6a138 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:27.153221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b29147cb-88e7-42d3-a28f-9a75e0b6a138 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:27.154787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b29147cb-88e7-42d3-a28f-9a75e0b6a138 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:27.156674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b29147cb-88e7-42d3-a28f-9a75e0b6a138 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:27.573981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1051302594", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:27.603971 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b29147cb-88e7-42d3-a28f-9a75e0b6a138 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.484091 Oct 19 06:53:27.613066 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 566/1127] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Oct 19 06:53:27 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-interface => generated 285 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:53:27.619391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:27.620355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:27.635346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:27.636962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:27.637581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:27.639270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:27.642479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:27.643529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:27.701035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] validate_networks() for [('e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:53:28.460409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:28.464937 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1495ab2a-fa7f-46d1-aaef-b47b79593e1e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1478 microversion: 2.1 time: 0.850456 Oct 19 06:53:28.465637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 567/1128] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:27 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1478 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:28.472152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:28.473647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:28.483763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:28.484907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:28.485693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:28.486472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:28.486998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:28.487535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:28.534133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:28.534699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:28.535391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:28.536197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lazy-loading 'fault' on Instance uuid 6e036b18-232a-4e33-9790-c4f8b72c337c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:28.739052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:28.767372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:28.775949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510f17bc292043c69098a1b6e86a1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac8c7e383444e50ab768e71e5f01646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:28.804591 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f4dccfd-ce2d-4b6f-aaf4-918889d9bd69 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 200 len: 1542 microversion: 2.91 time: 0.335269 Oct 19 06:53:28.805212 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 568/1129] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:28 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 1542 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:53:29.090457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:53:29.091613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:53:29.096064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:53:29.097556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:53:29.098256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:53:29.112254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:29.113165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:29.113947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:29.115121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:29.115795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:29.116626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:29.142328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:53:29.149394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for user f5b2575fb29940ab95fc8bb9dd177dd9 and project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:53:29.168090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:53:29.171997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:53:29.384021 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d48f61ea-09b3-4010-ac1b-50d2db09af91 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.018615 Oct 19 06:53:29.393883 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 562/1130] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:53:29.406084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9bffdbef-a131-4bc2-9743-bad2468a4179 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:29.410161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9bffdbef-a131-4bc2-9743-bad2468a4179 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:29.491672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:29.492482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:29.519745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:29.523027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:29.525681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:29.530896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:29.535654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:29.536234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:30.009134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9bffdbef-a131-4bc2-9743-bad2468a4179 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:30.020869 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9bffdbef-a131-4bc2-9743-bad2468a4179 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1208 microversion: 2.1 time: 0.615455 Oct 19 06:53:30.023710 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 569/1131] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:29 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1208 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:30.060158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:30.060158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] [instance: 6e036b18-232a-4e33-9790-c4f8b72c337c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:30.071098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:30.073663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:30.074376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:30.075336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:30.076861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:30.079027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:30.095324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:30.106788 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-604fdcf5-a38a-4634-9375-46d4691ba7dd tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1478 microversion: 2.1 time: 0.616614 Oct 19 06:53:30.107702 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 563/1132] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:29 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1478 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:30.111993 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] HTTP exception thrown: Instance 6e036b18-232a-4e33-9790-c4f8b72c337c could not be found. Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Request method failure captured: Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c HTTP/1.1 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT546kSPrnEEkfV5y6EB6NAGDPAyut_3BSZVDO738jNop9sGEAbT2egraz9LjOmdISK5xGyIBZIFBk3drcTzZb5dic1CNTrWZLT_yansUNzGhy72lFlMOQwR0UqysdBmAl-hK_MvNGcvyKmII7odmaziwyF3SZNf_0bi-L2UM_oh9G_U Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.91 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0ac8c7e383444e50ab768e71e5f01646 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1820611043 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0ac8c7e383444e50ab768e71e5f01646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0ac8c7e383444e50ab768e71e5f01646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0ac8c7e383444e50ab768e71e5f01646"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0ac8c7e383444e50ab768e71e5f01646", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1820611043 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0ac8c7e383444e50ab768e71e5f01646 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1820611043 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-UnshelveToHostMultiNodesTest-1820611043-project Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 510f17bc292043c69098a1b6e86a1964 Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1820611043-project Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 6e036b18-232a-4e33-9790-c4f8b72c337c could not be found. Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '6e036b18-232a-4e33-9790-c4f8b72c337c'} Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e036b18-232a-4e33-9790-c4f8b72c337c could not be found. Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e036b18-232a-4e33-9790-c4f8b72c337c could not be found. Oct 19 06:53:30.119407 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e036b18-232a-4e33-9790-c4f8b72c337c could not be found. Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] Returning 404 to user: Instance 6e036b18-232a-4e33-9790-c4f8b72c337c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88d4bb8e-f11c-4f71-958d-c6dadb196369 tempest-UnshelveToHostMultiNodesTest-1820611043 tempest-UnshelveToHostMultiNodesTest-1820611043-project] 10.222.0.39 "GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c" status: 404 len: 111 microversion: 2.91 time: 0.076059 Oct 19 06:53:30.123879 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 570/1133] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:53:30 2022] GET /compute/v2.1/servers/6e036b18-232a-4e33-9790-c4f8b72c337c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:53:31.047742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d326983c-1887-43a5-8327-6d545cacbf51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:31.047742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d326983c-1887-43a5-8327-6d545cacbf51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:31.111199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-164c20fc-f425-42e7-892a-e257883a553b req-d18962ad-3859-450a-9d23-9c2b891c0857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5705ad-60bd-4c15-969f-bb26a8fd5b60", "tag": "11026df4-02a2-4f24-8043-6c02c90c96a3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:31.130927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-164c20fc-f425-42e7-892a-e257883a553b req-d18962ad-3859-450a-9d23-9c2b891c0857 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:31.134694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-164c20fc-f425-42e7-892a-e257883a553b req-d18962ad-3859-450a-9d23-9c2b891c0857 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:31.143722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-164c20fc-f425-42e7-892a-e257883a553b req-d18962ad-3859-450a-9d23-9c2b891c0857 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:31.144990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d326983c-1887-43a5-8327-6d545cacbf51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:31.152824 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d326983c-1887-43a5-8327-6d545cacbf51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1208 microversion: 2.1 time: 0.109825 Oct 19 06:53:31.153429 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 564/1134] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:31 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1208 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:31.160940 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-164c20fc-f425-42e7-892a-e257883a553b req-d18962ad-3859-450a-9d23-9c2b891c0857 service nova] Creating event network-changed:11026df4-02a2-4f24-8043-6c02c90c96a3 for instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 on n-h1-861333-10 Oct 19 06:53:31.166741 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-164c20fc-f425-42e7-892a-e257883a553b req-d18962ad-3859-450a-9d23-9c2b891c0857 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060297 Oct 19 06:53:31.178109 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 571/1135] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:53:31.182487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:31.183475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:31.192422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:31.192934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:31.193369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:31.194104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:31.194589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:31.195038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:31.862263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:31.864903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:31.877253 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3a4060f-273d-4063-be66-87a255a94c90 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1478 microversion: 2.1 time: 0.699916 Oct 19 06:53:31.888768 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 565/1136] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:31 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1478 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:32.180393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:32.185225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:32.199238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:32.199982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:32.201210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:32.202114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:32.202773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:32.204323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:32.410982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:32.418917 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c379c6bf-4965-44bf-a604-c2ad5a096b0e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1260 microversion: 2.1 time: 0.242669 Oct 19 06:53:32.423598 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 572/1137] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:32 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:32.908390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:32.925403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:32.959484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:32.961303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:32.962501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:32.963201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:32.963675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:32.964172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:33.437087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b9f97513-a320-46c2-a220-07272b45d58b req-29802079-0902-4816-af29-69a2e7f823fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da", "name": "network-vif-plugged", "status": "completed", "tag": "acdc01a7-4d46-4006-821e-225a7f07253f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:33.462316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b9f97513-a320-46c2-a220-07272b45d58b req-29802079-0902-4816-af29-69a2e7f823fb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:33.462797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b9f97513-a320-46c2-a220-07272b45d58b req-29802079-0902-4816-af29-69a2e7f823fb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:33.466174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b9f97513-a320-46c2-a220-07272b45d58b req-29802079-0902-4816-af29-69a2e7f823fb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:33.503038 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b9f97513-a320-46c2-a220-07272b45d58b req-29802079-0902-4816-af29-69a2e7f823fb service nova] Creating event network-vif-plugged:acdc01a7-4d46-4006-821e-225a7f07253f for instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da on n-h2-861333-10 Oct 19 06:53:33.517819 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b9f97513-a320-46c2-a220-07272b45d58b req-29802079-0902-4816-af29-69a2e7f823fb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080978 Oct 19 06:53:33.518873 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 573/1138] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:53:33.529826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:33.532521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:33.546381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:33.547598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:33.549339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:33.550258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:33.553878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:33.554562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:33.705770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:33.713580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:33.727396 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14cae1b5-45de-409a-a466-e9b40b3d194b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1478 microversion: 2.1 time: 0.828663 Oct 19 06:53:33.733883 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 566/1139] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:32 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1478 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:33.752530 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23b58e15-4451-42b0-aac2-8ca616fa6b84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1278 microversion: 2.1 time: 0.232327 Oct 19 06:53:33.764131 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 574/1140] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:33 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1278 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:34.756047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:34.757064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:34.772478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:34.772974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:34.775933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:34.779049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:34.780975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:34.782716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:34.785014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:34.785719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:34.806389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:34.806885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:34.808097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:34.811311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:34.814846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:34.815301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:35.225597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:35.238398 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0e98ca4-70f1-452e-9150-9e3a6551ee1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1308 microversion: 2.1 time: 0.458408 Oct 19 06:53:35.240446 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 575/1141] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:34 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:35.298958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:35.313662 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6ce97f1-e2ea-4851-b357-a0af4e96d34b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1478 microversion: 2.1 time: 0.557211 Oct 19 06:53:35.314720 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 567/1142] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:34 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1478 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:36.268651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:36.269089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:36.279168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:36.281025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:36.281466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:36.282199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:36.282657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:36.285774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:36.341726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:36.343019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:36.350832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:36.351759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:36.356500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:36.356500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:36.356500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:36.356500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:36.695937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:36.716813 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e514d55-42a9-4686-9ec0-2d58bd821ed3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1308 microversion: 2.1 time: 0.449065 Oct 19 06:53:36.716962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:36.717233 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 576/1143] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:36 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:36.731795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-90565d6e-008e-49d6-a20e-73c8e8eec509 req-fed19ff0-af8b-4211-a368-95db1126b07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5584f2a-692a-4897-b1af-adeb2bdcbf4c", "tag": "dda422b3-ebf6-4a1e-af02-8af8b5ee4816"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:36.744688 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a05d776-853b-4762-b08b-d083ca715c51 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1463 microversion: 2.1 time: 0.406749 Oct 19 06:53:36.745493 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 568/1144] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:36 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1463 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:36.749462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-90565d6e-008e-49d6-a20e-73c8e8eec509 req-fed19ff0-af8b-4211-a368-95db1126b07d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:36.750852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-90565d6e-008e-49d6-a20e-73c8e8eec509 req-fed19ff0-af8b-4211-a368-95db1126b07d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:36.751300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-90565d6e-008e-49d6-a20e-73c8e8eec509 req-fed19ff0-af8b-4211-a368-95db1126b07d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:36.787314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4cd31284-48ab-4a11-a63c-47fe21a7d302 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:36.789933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4cd31284-48ab-4a11-a63c-47fe21a7d302 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:36.798709 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-90565d6e-008e-49d6-a20e-73c8e8eec509 req-fed19ff0-af8b-4211-a368-95db1126b07d service nova] Creating event network-changed:dda422b3-ebf6-4a1e-af02-8af8b5ee4816 for instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c on n-h1-861333-10 Oct 19 06:53:36.801793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cd31284-48ab-4a11-a63c-47fe21a7d302 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:36.802288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cd31284-48ab-4a11-a63c-47fe21a7d302 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:36.804655 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-90565d6e-008e-49d6-a20e-73c8e8eec509 req-fed19ff0-af8b-4211-a368-95db1126b07d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087098 Oct 19 06:53:36.805096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cd31284-48ab-4a11-a63c-47fe21a7d302 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:36.806403 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 577/1145] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:36.806543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cd31284-48ab-4a11-a63c-47fe21a7d302 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:36.807042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cd31284-48ab-4a11-a63c-47fe21a7d302 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:36.808847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cd31284-48ab-4a11-a63c-47fe21a7d302 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.179678 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4cd31284-48ab-4a11-a63c-47fe21a7d302 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action" status: 202 len: 0 microversion: 2.1 time: 0.401108 Oct 19 06:53:37.183311 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 569/1146] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:53:36 2022] POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:53:37.190434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:37.190434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:37.196785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:37.197248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:37.198069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.199164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:37.199795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:37.200413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.238534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:37.239042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:37.239482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.239941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lazy-loading 'fault' on Instance uuid d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:37.394475 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1e76993-99d6-4977-b8a1-58e1c4b68aac tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1599 microversion: 2.1 time: 0.209559 Oct 19 06:53:37.395813 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 578/1147] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:37 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:37.423088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60bcf119-9f33-4d4a-b14d-3eef1a59df4a tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:37.425386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60bcf119-9f33-4d4a-b14d-3eef1a59df4a tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:37.431857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60bcf119-9f33-4d4a-b14d-3eef1a59df4a tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:37.438248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60bcf119-9f33-4d4a-b14d-3eef1a59df4a tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:37.438248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60bcf119-9f33-4d4a-b14d-3eef1a59df4a tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.438248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60bcf119-9f33-4d4a-b14d-3eef1a59df4a tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:37.438248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60bcf119-9f33-4d4a-b14d-3eef1a59df4a tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:37.438248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60bcf119-9f33-4d4a-b14d-3eef1a59df4a tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.733742 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60bcf119-9f33-4d4a-b14d-3eef1a59df4a tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action" status: 202 len: 0 microversion: 2.1 time: 0.314412 Oct 19 06:53:37.735515 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 570/1148] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:53:37 2022] POST /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:53:37.740945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:37.749106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:37.749515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0fca120-cabe-4249-acc8-032b111d4337 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:37.749515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0fca120-cabe-4249-acc8-032b111d4337 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:37.749515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0fca120-cabe-4249-acc8-032b111d4337 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:37.749892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0fca120-cabe-4249-acc8-032b111d4337 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:37.751137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0fca120-cabe-4249-acc8-032b111d4337 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.751728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:37.752238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0fca120-cabe-4249-acc8-032b111d4337 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:37.752846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0fca120-cabe-4249-acc8-032b111d4337 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:37.753117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:37.753641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.753827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0fca120-cabe-4249-acc8-032b111d4337 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.754474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:37.755025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:37.755565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:37.973613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0fca120-cabe-4249-acc8-032b111d4337 tempest-ServersAdminTestJSON-405364305 tempest-ServersAdminTestJSON-405364305-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1616 microversion: 2.1 time: 0.234139 Oct 19 06:53:37.988545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:37.989728 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 571/1149] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:37 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1616 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:38.002280 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cac0082e-7390-4010-b104-17b2a10bdbb7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1308 microversion: 2.1 time: 0.269209 Oct 19 06:53:38.016443 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 579/1150] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:37 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:38.016748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:38.016748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:38.019365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.020228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.020908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.021619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.022073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.022493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.048221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:53:38.328992 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81a0bef7-7be8-4fd8-9bdc-904fe66271d5 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "DELETE /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 204 len: 0 microversion: 2.1 time: 0.330444 Oct 19 06:53:38.330003 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 572/1151] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:53:37 2022] DELETE /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:53:38.338106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:38.338384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:38.347785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.348385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.349052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.349967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.350619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.351239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.576454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:38.608671 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-238e3c3a-2693-45ad-b2a9-b854f4a4c6b2 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1470 microversion: 2.1 time: 0.274593 Oct 19 06:53:38.616604 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 580/1152] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:38 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1470 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:38.771989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5778d8d3-ce7a-4bad-bf30-3c6161b4587f tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Calling method '.version_select at 0x7f6d6500c700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:38.775553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5778d8d3-ce7a-4bad-bf30-3c6161b4587f tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.776039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5778d8d3-ce7a-4bad-bf30-3c6161b4587f tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.776509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5778d8d3-ce7a-4bad-bf30-3c6161b4587f tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.777231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5778d8d3-ce7a-4bad-bf30-3c6161b4587f tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.777731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5778d8d3-ce7a-4bad-bf30-3c6161b4587f tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.778151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5778d8d3-ce7a-4bad-bf30-3c6161b4587f tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.809289 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5778d8d3-ce7a-4bad-bf30-3c6161b4587f tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.233895 Oct 19 06:53:38.810468 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 573/1153] 10.222.0.39 () {58 vars in 1128 bytes} [Wed Oct 19 06:53:38 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:53:38.831402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c80d616c-1e81-4fbb-824a-399213cb7c95 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Calling method '.version_select at 0x7f6d64ffb1f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:38.835825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d616c-1e81-4fbb-824a-399213cb7c95 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.837166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d616c-1e81-4fbb-824a-399213cb7c95 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.837776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d616c-1e81-4fbb-824a-399213cb7c95 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.838957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d616c-1e81-4fbb-824a-399213cb7c95 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.839487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d616c-1e81-4fbb-824a-399213cb7c95 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.840541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d616c-1e81-4fbb-824a-399213cb7c95 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.885575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f17b969-36e7-4986-a11e-838516307adb tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:38.886738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f17b969-36e7-4986-a11e-838516307adb tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:38.899120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f17b969-36e7-4986-a11e-838516307adb tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.900385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f17b969-36e7-4986-a11e-838516307adb tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.900987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f17b969-36e7-4986-a11e-838516307adb tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.901243 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c80d616c-1e81-4fbb-824a-399213cb7c95 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.082427 Oct 19 06:53:38.901882 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 581/1154] 10.222.0.39 () {58 vars in 1139 bytes} [Wed Oct 19 06:53:38 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:53:38.902338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f17b969-36e7-4986-a11e-838516307adb tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.903033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f17b969-36e7-4986-a11e-838516307adb tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.903510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f17b969-36e7-4986-a11e-838516307adb tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.923485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d588d89f-71ef-464c-93d5-6eb0f67d57fd tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Calling method '.version_select at 0x7f6d64e1e310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:38.932952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d588d89f-71ef-464c-93d5-6eb0f67d57fd tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.933457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d588d89f-71ef-464c-93d5-6eb0f67d57fd tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.937036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d588d89f-71ef-464c-93d5-6eb0f67d57fd tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:38.938596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d588d89f-71ef-464c-93d5-6eb0f67d57fd tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:38.940292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d588d89f-71ef-464c-93d5-6eb0f67d57fd tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:38.940872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d588d89f-71ef-464c-93d5-6eb0f67d57fd tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.022137 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d588d89f-71ef-464c-93d5-6eb0f67d57fd tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.107331 Oct 19 06:53:39.032659 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 582/1155] 10.222.0.39 () {58 vars in 1145 bytes} [Wed Oct 19 06:53:38 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:53:39.042969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.046495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:39.056663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:39.058135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.058633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.059072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.059775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.060258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.067105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.111943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:39.207659 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f17b969-36e7-4986-a11e-838516307adb tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1812 microversion: 2.1 time: 0.328249 Oct 19 06:53:39.211534 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 574/1156] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:38 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1812 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:39.216373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54067d92-1ced-436e-9b36-7f5db6a71085 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Calling method '.version_select at 0x7f6d6500cee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.220461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54067d92-1ced-436e-9b36-7f5db6a71085 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.221160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54067d92-1ced-436e-9b36-7f5db6a71085 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.221658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54067d92-1ced-436e-9b36-7f5db6a71085 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.222391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54067d92-1ced-436e-9b36-7f5db6a71085 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.222843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54067d92-1ced-436e-9b36-7f5db6a71085 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.226785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54067d92-1ced-436e-9b36-7f5db6a71085 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.287761 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54067d92-1ced-436e-9b36-7f5db6a71085 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.074848 Oct 19 06:53:39.297642 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 575/1157] 10.222.0.39 () {58 vars in 1128 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.309846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-624eb7f8-6cfe-453c-8201-40e6ea2dc106 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.316129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-624eb7f8-6cfe-453c-8201-40e6ea2dc106 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.316970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-624eb7f8-6cfe-453c-8201-40e6ea2dc106 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.317171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-624eb7f8-6cfe-453c-8201-40e6ea2dc106 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.317987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-624eb7f8-6cfe-453c-8201-40e6ea2dc106 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.318729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-624eb7f8-6cfe-453c-8201-40e6ea2dc106 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.318913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-624eb7f8-6cfe-453c-8201-40e6ea2dc106 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.335092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:39.351714 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-624eb7f8-6cfe-453c-8201-40e6ea2dc106 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.047607 Oct 19 06:53:39.351714 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 576/1158] 10.222.0.39 () {58 vars in 1176 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.351956 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7b21e34-fec3-4451-89c7-c51b4f5d5bfe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1308 microversion: 2.1 time: 0.314415 Oct 19 06:53:39.351956 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 583/1159] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:39.368422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be8061c4-7544-4b73-b74a-cfc74fda186b tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Calling method '.version_select at 0x7f6d65272550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.372412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be8061c4-7544-4b73-b74a-cfc74fda186b tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.372982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be8061c4-7544-4b73-b74a-cfc74fda186b tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.373507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be8061c4-7544-4b73-b74a-cfc74fda186b tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.374362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be8061c4-7544-4b73-b74a-cfc74fda186b tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.374889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be8061c4-7544-4b73-b74a-cfc74fda186b tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.375962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be8061c4-7544-4b73-b74a-cfc74fda186b tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.408006 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be8061c4-7544-4b73-b74a-cfc74fda186b tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.059710 Oct 19 06:53:39.415581 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 577/1160] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.420571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-950d1160-aa1f-45a6-a49d-7493573e4322 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Calling method '.version_select at 0x7f6d64710b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.423754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-950d1160-aa1f-45a6-a49d-7493573e4322 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.424379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-950d1160-aa1f-45a6-a49d-7493573e4322 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.424885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-950d1160-aa1f-45a6-a49d-7493573e4322 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.425874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-950d1160-aa1f-45a6-a49d-7493573e4322 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.426338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-950d1160-aa1f-45a6-a49d-7493573e4322 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.426770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-950d1160-aa1f-45a6-a49d-7493573e4322 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.455767 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-950d1160-aa1f-45a6-a49d-7493573e4322 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.038918 Oct 19 06:53:39.462217 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 578/1161] 10.222.0.39 () {58 vars in 1128 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.467817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12b08ca4-e966-4669-abd0-8705846e8d7e tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Calling method '.version_select at 0x7f6d64800670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.475340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b08ca4-e966-4669-abd0-8705846e8d7e tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.475834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b08ca4-e966-4669-abd0-8705846e8d7e tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.477044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b08ca4-e966-4669-abd0-8705846e8d7e tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.511785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b08ca4-e966-4669-abd0-8705846e8d7e tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.511785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b08ca4-e966-4669-abd0-8705846e8d7e tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.511785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b08ca4-e966-4669-abd0-8705846e8d7e tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.535249 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12b08ca4-e966-4669-abd0-8705846e8d7e tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-h1-861333-10" status: 200 len: 867 microversion: 2.1 time: 0.071922 Oct 19 06:53:39.540930 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 579/1162] 10.222.0.39 () {58 vars in 1173 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-hosts/n-h1-861333-10 => generated 867 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.546054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-852e8bb2-3775-4029-9c84-141c28aca195 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Calling method '.version_select at 0x7f6d647b9040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.553564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-852e8bb2-3775-4029-9c84-141c28aca195 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.554541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-852e8bb2-3775-4029-9c84-141c28aca195 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.554989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-852e8bb2-3775-4029-9c84-141c28aca195 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.559737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67c684a8-0b26-4a56-a4f7-63a2aa34750f tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.564433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67c684a8-0b26-4a56-a4f7-63a2aa34750f tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.567424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67c684a8-0b26-4a56-a4f7-63a2aa34750f tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.568558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67c684a8-0b26-4a56-a4f7-63a2aa34750f tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.570952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-852e8bb2-3775-4029-9c84-141c28aca195 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.571393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67c684a8-0b26-4a56-a4f7-63a2aa34750f tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.571638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-852e8bb2-3775-4029-9c84-141c28aca195 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.572090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-852e8bb2-3775-4029-9c84-141c28aca195 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.573879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67c684a8-0b26-4a56-a4f7-63a2aa34750f tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.575175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67c684a8-0b26-4a56-a4f7-63a2aa34750f tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.606400 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-852e8bb2-3775-4029-9c84-141c28aca195 tempest-HostsAdminTestJSON-697276806 tempest-HostsAdminTestJSON-697276806-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-h2-861333-10" status: 200 len: 735 microversion: 2.1 time: 0.064100 Oct 19 06:53:39.613415 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 580/1163] 10.222.0.39 () {58 vars in 1173 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-hosts/n-h2-861333-10 => generated 735 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.634855 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67c684a8-0b26-4a56-a4f7-63a2aa34750f tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.284100 Oct 19 06:53:39.639356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.640344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:39.642280 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 584/1164] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-services => generated 949 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.652604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.655169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.655960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f1185fe-68fb-433e-ba0a-29c3d7afdac0 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.659285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.660330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.661022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.661730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.665385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f1185fe-68fb-433e-ba0a-29c3d7afdac0 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.665955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f1185fe-68fb-433e-ba0a-29c3d7afdac0 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.666408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f1185fe-68fb-433e-ba0a-29c3d7afdac0 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.667900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f1185fe-68fb-433e-ba0a-29c3d7afdac0 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.668391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f1185fe-68fb-433e-ba0a-29c3d7afdac0 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.674256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f1185fe-68fb-433e-ba0a-29c3d7afdac0 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.685206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:39.722804 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f1185fe-68fb-433e-ba0a-29c3d7afdac0 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.060478 Oct 19 06:53:39.723485 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 585/1165] 10.222.0.39 () {58 vars in 1170 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.730511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f70deaa-0bf4-4c6a-ac46-4d724a9f197a tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.747712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f70deaa-0bf4-4c6a-ac46-4d724a9f197a tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.754238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f70deaa-0bf4-4c6a-ac46-4d724a9f197a tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.754926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f70deaa-0bf4-4c6a-ac46-4d724a9f197a tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.756134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f70deaa-0bf4-4c6a-ac46-4d724a9f197a tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.756897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f70deaa-0bf4-4c6a-ac46-4d724a9f197a tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.757505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f70deaa-0bf4-4c6a-ac46-4d724a9f197a tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.821147 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f70deaa-0bf4-4c6a-ac46-4d724a9f197a tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.094509 Oct 19 06:53:39.831269 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 586/1166] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-services => generated 949 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.837087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63740694-52e2-4c8b-8708-251b233806e4 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.841818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63740694-52e2-4c8b-8708-251b233806e4 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.842316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63740694-52e2-4c8b-8708-251b233806e4 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.842754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63740694-52e2-4c8b-8708-251b233806e4 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.843757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63740694-52e2-4c8b-8708-251b233806e4 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.844786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63740694-52e2-4c8b-8708-251b233806e4 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.845876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63740694-52e2-4c8b-8708-251b233806e4 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.882740 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63740694-52e2-4c8b-8708-251b233806e4 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=n-d-861333-10&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.050061 Oct 19 06:53:39.883636 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 587/1167] 10.222.0.39 () {58 vars in 1196 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-services?host=n-d-861333-10&binary=xxx => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:53:39.898492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-608a6b1a-ab91-4e17-a81b-6fb3f26d469b tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.903771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608a6b1a-ab91-4e17-a81b-6fb3f26d469b tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.904498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608a6b1a-ab91-4e17-a81b-6fb3f26d469b tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.913486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608a6b1a-ab91-4e17-a81b-6fb3f26d469b tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.913486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608a6b1a-ab91-4e17-a81b-6fb3f26d469b tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.913486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608a6b1a-ab91-4e17-a81b-6fb3f26d469b tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.913486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608a6b1a-ab91-4e17-a81b-6fb3f26d469b tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.935977 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-608a6b1a-ab91-4e17-a81b-6fb3f26d469b tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.043025 Oct 19 06:53:39.936865 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 588/1168] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-services => generated 949 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:39.954630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d49ee01d-aefd-409b-ab9c-23cef5727b73 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:39.959544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49ee01d-aefd-409b-ab9c-23cef5727b73 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.960040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49ee01d-aefd-409b-ab9c-23cef5727b73 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.960608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49ee01d-aefd-409b-ab9c-23cef5727b73 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.961449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49ee01d-aefd-409b-ab9c-23cef5727b73 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:39.962083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49ee01d-aefd-409b-ab9c-23cef5727b73 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:39.962526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49ee01d-aefd-409b-ab9c-23cef5727b73 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:39.995068 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d49ee01d-aefd-409b-ab9c-23cef5727b73 tempest-ServicesAdminNegativeTestJSON-323697329 tempest-ServicesAdminNegativeTestJSON-323697329-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.048409 Oct 19 06:53:39.996387 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 589/1169] 10.222.0.39 () {58 vars in 1198 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:53:40.017839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:40.027220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:40.057817 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54ca9219-d7b4-4359-8306-4173f7f4618e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1470 microversion: 2.1 time: 0.421582 Oct 19 06:53:40.059213 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 581/1170] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:39 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1470 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:40.249547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4c255cd-b067-4961-9c16-111ef6e43519 tempest-ServicesAdminNegativeTestJSON-1376243946 tempest-ServicesAdminNegativeTestJSON-1376243946-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:40.249547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4c255cd-b067-4961-9c16-111ef6e43519 tempest-ServicesAdminNegativeTestJSON-1376243946 tempest-ServicesAdminNegativeTestJSON-1376243946-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fc6d55e02733491ca8a19624ce410cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a0fc53e861487ab14ee4f566c0686e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4c255cd-b067-4961-9c16-111ef6e43519 tempest-ServicesAdminNegativeTestJSON-1376243946 tempest-ServicesAdminNegativeTestJSON-1376243946-project] Request method failure captured: Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT57xyE9zNuvq-9UJ13zQZ8uJVxCMOdmgQRJ5tO89JA6RtqM5p--onk-1DFui7boGvoX6TL_7KjaE64hiOjM0zodi8LS-6ZbqNQ4fneG9h9VyMwfVSG7v33b2vVte3w3dyaEImXCo0NfQLFsxTMjyUjvLIbOn1ev95qBJGp3e_0eHf_4 Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 10a0fc53e861487ab14ee4f566c0686e Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1376243946 Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/10a0fc53e861487ab14ee4f566c0686e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/10a0fc53e861487ab14ee4f566c0686e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/10a0fc53e861487ab14ee4f566c0686e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_10a0fc53e861487ab14ee4f566c0686e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1376243946 Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 10a0fc53e861487ab14ee4f566c0686e Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1376243946 Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServicesAdminNegativeTestJSON-1376243946-project Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc6d55e02733491ca8a19624ce410cd7 Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1376243946-project Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: action_args: {} Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 06:53:40.262791 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:40.267623 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:40.267623 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:40.267623 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:40.267623 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:40.267623 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:40.267623 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 06:53:40.267623 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 06:53:40.267623 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 06:53:40.267623 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:40.270581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4c255cd-b067-4961-9c16-111ef6e43519 tempest-ServicesAdminNegativeTestJSON-1376243946 tempest-ServicesAdminNegativeTestJSON-1376243946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:40.272239 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4c255cd-b067-4961-9c16-111ef6e43519 tempest-ServicesAdminNegativeTestJSON-1376243946 tempest-ServicesAdminNegativeTestJSON-1376243946-project] 10.222.0.39 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.266948 Oct 19 06:53:40.277178 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 590/1171] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:40 2022] GET /compute/v2.1/os-services => generated 112 bytes in 273 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:53:40.383003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:40.385280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:40.392826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:40.423404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:40.424738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:40.426704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:40.427681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:40.429254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:40.430444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:40.612146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:40.625758 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18526449-7d4c-4f78-a72a-ff74e1a8c67d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1308 microversion: 2.1 time: 0.252939 Oct 19 06:53:40.626357 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 582/1172] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:40 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:41.083470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:41.084735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:41.093312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.094175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.094813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:41.095775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.096502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.097215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:41.117149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:41.127680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:41.132620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Searching by: {'deleted': False, 'project_id': '61ba5522203f4750a7928f4b3156eb23'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:53:41.147139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.147875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.148630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:41.151301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.152409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.155242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:41.157896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:41.322882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:41.333982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:53:41.339498 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40c35244-b0da-4fe2-bfdd-f2afc616f31b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1428 microversion: 2.1 time: 0.261951 Oct 19 06:53:41.354366 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 591/1173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:41 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1428 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:41.370834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3cc2d08c-a18e-4f21-b31f-23f1aa990d99 req-15e8f3fd-ab38-41bd-a4bd-5ce61f87ab5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98efe809-4d62-40f1-80ef-41c1acd916ea", "name": "network-vif-deleted", "tag": "bb98edc1-752f-4396-84de-fa36b5c95e05"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:41.411006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3cc2d08c-a18e-4f21-b31f-23f1aa990d99 req-15e8f3fd-ab38-41bd-a4bd-5ce61f87ab5b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.414091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3cc2d08c-a18e-4f21-b31f-23f1aa990d99 req-15e8f3fd-ab38-41bd-a4bd-5ce61f87ab5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.416072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3cc2d08c-a18e-4f21-b31f-23f1aa990d99 req-15e8f3fd-ab38-41bd-a4bd-5ce61f87ab5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:41.443497 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3cc2d08c-a18e-4f21-b31f-23f1aa990d99 req-15e8f3fd-ab38-41bd-a4bd-5ce61f87ab5b service nova] Creating event network-vif-deleted:bb98edc1-752f-4396-84de-fa36b5c95e05 for instance 98efe809-4d62-40f1-80ef-41c1acd916ea on n-h2-861333-10 Oct 19 06:53:41.458825 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3cc2d08c-a18e-4f21-b31f-23f1aa990d99 req-15e8f3fd-ab38-41bd-a4bd-5ce61f87ab5b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096184 Oct 19 06:53:41.460227 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 592/1174] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:41.497209 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13979c90-922a-4618-9e04-07cd0dd45e77 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.384748 Oct 19 06:53:41.498502 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 583/1175] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 06:53:41 2022] GET /compute/v2.1/servers => generated 340 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:41.512914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:41.530927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:41.530927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Searching by: {'deleted': False, 'project_id': '61ba5522203f4750a7928f4b3156eb23'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:53:41.542886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.543376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.543817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:41.556610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.563276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.563276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:41.616365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:53:41.650100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:41.650728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:41.663799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.663922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.664389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:41.675483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.676094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.676641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:41.759501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:41.782787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:41.782787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:41.782787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:42.086560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:42.111704 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de06c166-7d69-4da1-bc40-4338698b4acb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1308 microversion: 2.1 time: 0.465687 Oct 19 06:53:42.115847 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 584/1176] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:41 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1308 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:42.153047 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12ee0bdb-6119-4c18-af82-9e14cfae2d90 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1714 microversion: 2.1 time: 0.644866 Oct 19 06:53:42.154564 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 593/1177] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:53:41 2022] GET /compute/v2.1/servers/detail => generated 1714 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:42.191661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2152d6e9-ceea-456a-a2fc-9dac61f8ba4c tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:42.240051 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2152d6e9-ceea-456a-a2fc-9dac61f8ba4c tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.060729 Oct 19 06:53:42.245789 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 585/1178] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:53:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:42.368186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:42.372760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:42.388009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:42.391896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:42.394382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:42.395394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:42.396835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:42.398505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:42.448633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:42.449999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:42.450460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:42.451094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lazy-loading 'fault' on Instance uuid 98efe809-4d62-40f1-80ef-41c1acd916ea {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:42.515586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:42.533710 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b90b6d58-793e-4b51-93ac-c17bb2579884 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 200 len: 1304 microversion: 2.1 time: 0.170671 Oct 19 06:53:42.534459 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 594/1179] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:42 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:42.623399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:42.624002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:42.633653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:42.634193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:42.635500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:42.636853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:42.637526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:42.638252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:42.678259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:53:42.846050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-67e4619a-79f7-4fcc-be89-7fc96771b507 req-d44a58b7-9868-446f-913d-2e7ea1189922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5584f2a-692a-4897-b1af-adeb2bdcbf4c", "name": "network-vif-plugged", "status": "completed", "tag": "dda422b3-ebf6-4a1e-af02-8af8b5ee4816"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:42.867064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67e4619a-79f7-4fcc-be89-7fc96771b507 req-d44a58b7-9868-446f-913d-2e7ea1189922 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:42.868076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67e4619a-79f7-4fcc-be89-7fc96771b507 req-d44a58b7-9868-446f-913d-2e7ea1189922 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:42.869353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67e4619a-79f7-4fcc-be89-7fc96771b507 req-d44a58b7-9868-446f-913d-2e7ea1189922 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:42.901042 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-67e4619a-79f7-4fcc-be89-7fc96771b507 req-d44a58b7-9868-446f-913d-2e7ea1189922 service nova] Creating event network-vif-plugged:dda422b3-ebf6-4a1e-af02-8af8b5ee4816 for instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c on n-h1-861333-10 Oct 19 06:53:42.916609 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-67e4619a-79f7-4fcc-be89-7fc96771b507 req-d44a58b7-9868-446f-913d-2e7ea1189922 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076211 Oct 19 06:53:42.918370 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 595/1180] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:43.147003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:43.150886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:43.154125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:43.154710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:43.155119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:43.155895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:43.156999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:43.157653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:43.260062 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f81f0182-4ccc-4be4-a7ee-d5793b4d13f5 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "DELETE /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 204 len: 0 microversion: 2.1 time: 0.641547 Oct 19 06:53:43.263770 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 586/1181] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:53:42 2022] DELETE /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:53:43.271801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:43.272785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:43.290999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:43.292413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:43.295974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:43.303331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:43.303922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:43.307735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:43.357189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:43.372362 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11d3aa5e-2456-424c-b24f-385e8f8dbaf3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1308 microversion: 2.1 time: 0.235699 Oct 19 06:53:43.372362 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 596/1182] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:43 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1308 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:43.558800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:43.559416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: 98efe809-4d62-40f1-80ef-41c1acd916ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:43.572173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:43.572676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:43.573314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:43.574034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:43.574929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:43.575526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:43.593621 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] HTTP exception thrown: Instance 98efe809-4d62-40f1-80ef-41c1acd916ea could not be found. Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Request method failure captured: Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea HTTP/1.1 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT552HJYYsnnJYLafIcs2Uv688QHCr7rXdznEoZXGk_8jLPEaxij16Z2WWSF1qzGDESdub3hCQ7KhLgQVQQtPrpJDnydr55X2gfOBT_0-Kn2l02JsGtSA6slXjEOCD9fKsIcKTnznYfSrZH9fWvISNfeziT2wcGsDM7BKZASuEW1TjTk Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 1af903b4f61c4892b3a577b039737bf0 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminTestJSON-1924079681 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1af903b4f61c4892b3a577b039737bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1af903b4f61c4892b3a577b039737bf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1af903b4f61c4892b3a577b039737bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1af903b4f61c4892b3a577b039737bf0", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminTestJSON-1924079681 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 1af903b4f61c4892b3a577b039737bf0 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminTestJSON-1924079681 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersAdminTestJSON-1924079681-project Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 90be7740f30e48b5b7575fa74719f4e2 Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminTestJSON-1924079681-project Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 98efe809-4d62-40f1-80ef-41c1acd916ea could not be found. Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '98efe809-4d62-40f1-80ef-41c1acd916ea'} Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98efe809-4d62-40f1-80ef-41c1acd916ea could not be found. Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98efe809-4d62-40f1-80ef-41c1acd916ea could not be found. Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:43.595541 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:43.600078 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:43.600078 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:43.600078 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:43.600078 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:43.600078 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:43.600078 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98efe809-4d62-40f1-80ef-41c1acd916ea could not be found. Oct 19 06:53:43.600078 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:53:43.601512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Returning 404 to user: Instance 98efe809-4d62-40f1-80ef-41c1acd916ea could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:43.602381 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb16558d-40ec-43ce-9afd-dfef01d98a5b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea" status: 404 len: 111 microversion: 2.1 time: 0.048113 Oct 19 06:53:43.602940 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 597/1183] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:43 2022] GET /compute/v2.1/servers/98efe809-4d62-40f1-80ef-41c1acd916ea => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:53:43.617069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:43.617686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:43.630412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:43.632422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:43.639892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:43.645768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:43.645768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:43.645768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:43.719735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:53:43.796486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:43.807574 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fab80106-986d-4ca7-a066-0c3c5999b36d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1717 microversion: 2.1 time: 0.542098 Oct 19 06:53:43.820163 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 587/1184] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:43 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1717 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:44.123864 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a96ba9e-d21b-42a0-9b14-c379b60bb294 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 204 len: 0 microversion: 2.1 time: 0.515515 Oct 19 06:53:44.125881 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 598/1185] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:53:43 2022] DELETE /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 06:53:44.134269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:44.134883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:44.141798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:44.142287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:44.142718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:44.143418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:44.143866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:44.144316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:44.245367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a2a50cf-f225-4e28-ae4b-720987bbc506 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "639dd16a-0736-4279-8a79-6fcdaa270042", "device": "/dev/xvdb"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:44.249122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a2a50cf-f225-4e28-ae4b-720987bbc506 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:44.258862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a2a50cf-f225-4e28-ae4b-720987bbc506 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:44.259633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a2a50cf-f225-4e28-ae4b-720987bbc506 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:44.260357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a2a50cf-f225-4e28-ae4b-720987bbc506 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:44.261382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a2a50cf-f225-4e28-ae4b-720987bbc506 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:44.262189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a2a50cf-f225-4e28-ae4b-720987bbc506 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:44.264388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a2a50cf-f225-4e28-ae4b-720987bbc506 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:44.666017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:44.676302 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8489e9e1-a8a7-41e1-957b-5af8e0e34d53 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1469 microversion: 2.1 time: 0.545837 Oct 19 06:53:44.677465 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 588/1186] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:44 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1469 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:44.685151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:44.688134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:44.698454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:44.699186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:44.700290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:44.701165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:44.702015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:44.702601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:44.945528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:44.956553 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-40ae7103-9c19-4839-8fe7-3259782a7f0f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1308 microversion: 2.1 time: 0.277534 Oct 19 06:53:44.957435 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 589/1187] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:44 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:44.970363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:44.971634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:44.979969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:44.983995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:44.983995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:44.983995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:44.983995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:44.983995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:45.244307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:45.263724 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43a38509-d29f-4a34-99fe-9b2897b52504 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1717 microversion: 2.1 time: 0.304825 Oct 19 06:53:45.277630 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 590/1188] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:44 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1717 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:45.705790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:45.706598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:45.721711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:45.725007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:45.725603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:45.726248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:45.728720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:45.729174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:45.945657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:45.955326 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-986ca49f-5733-4344-b9d7-6cd887a3e64b tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1469 microversion: 2.1 time: 0.255305 Oct 19 06:53:45.959901 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 591/1189] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:45 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1469 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:45.989625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:45.989625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:45.994939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:45.996527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:45.997332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:45.998416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:45.999565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:46.001438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:46.169673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:46.181701 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a63c5e7-2d22-4efa-a687-7e229acf3f52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1489 microversion: 2.1 time: 0.205902 Oct 19 06:53:46.189689 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 592/1190] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:45 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1489 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:46.205330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c457d8c1-1a21-4234-9579-368a84e0196f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:46.207937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c457d8c1-1a21-4234-9579-368a84e0196f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:46.215611 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a2a50cf-f225-4e28-ae4b-720987bbc506 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "POST /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.976141 Oct 19 06:53:46.220310 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 599/1191] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 06:53:44 2022] POST /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments => generated 194 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:46.243223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c457d8c1-1a21-4234-9579-368a84e0196f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:46.243731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c457d8c1-1a21-4234-9579-368a84e0196f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:46.244363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c457d8c1-1a21-4234-9579-368a84e0196f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:46.247036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c457d8c1-1a21-4234-9579-368a84e0196f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:46.248694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c457d8c1-1a21-4234-9579-368a84e0196f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:46.252328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c457d8c1-1a21-4234-9579-368a84e0196f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:46.299125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:46.299125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:46.321530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:46.323966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:46.330769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:46.336834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:46.338631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:46.339110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:46.675646 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c457d8c1-1a21-4234-9579-368a84e0196f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c/action" status: 202 len: 0 microversion: 2.1 time: 0.474462 Oct 19 06:53:46.679888 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 593/1192] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:53:46 2022] POST /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 06:53:46.687434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:46.693541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:46.719756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:46.719756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:46.719756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:46.720561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:46.721152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:46.722480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:46.764688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:46.773704 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0bd034c0-9035-4780-9ee0-6f84161e6cdb tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1717 microversion: 2.1 time: 0.486690 Oct 19 06:53:46.774279 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 600/1193] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:46 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1717 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:46.964926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:46.976250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c115bc9-5702-4583-936a-3ef0275b6afb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1494 microversion: 2.1 time: 0.294565 Oct 19 06:53:46.989006 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 594/1194] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:46 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1494 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:47.005868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:47.009456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:47.024560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:47.026487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:47.027636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:47.029899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:47.030553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:47.031754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:47.145445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:47.148031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:47.159538 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3713b332-80f8-408c-b6d1-c0ef5046480e tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1427 microversion: 2.1 time: 0.166709 Oct 19 06:53:47.161374 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 595/1195] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:46 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:47.289449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-8564820", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:47.409788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:53:47.466174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3ac9418b-4ae0-4750-9a80-be86f82214ce req-5e83df29-79b7-4ec5-9da5-9306e85e2ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d5afde-b404-4a25-96cc-a1b35ee53ca0", "name": "network-vif-deleted", "tag": "ac44155c-d8ed-4b6d-920f-dea43c5484b6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:47.522530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3ac9418b-4ae0-4750-9a80-be86f82214ce req-5e83df29-79b7-4ec5-9da5-9306e85e2ee2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:47.523013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3ac9418b-4ae0-4750-9a80-be86f82214ce req-5e83df29-79b7-4ec5-9da5-9306e85e2ee2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:47.529290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3ac9418b-4ae0-4750-9a80-be86f82214ce req-5e83df29-79b7-4ec5-9da5-9306e85e2ee2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:47.573058 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3ac9418b-4ae0-4750-9a80-be86f82214ce req-5e83df29-79b7-4ec5-9da5-9306e85e2ee2 service nova] Creating event network-vif-deleted:ac44155c-d8ed-4b6d-920f-dea43c5484b6 for instance c0d5afde-b404-4a25-96cc-a1b35ee53ca0 on n-h2-861333-10 Oct 19 06:53:47.591606 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3ac9418b-4ae0-4750-9a80-be86f82214ce req-5e83df29-79b7-4ec5-9da5-9306e85e2ee2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131974 Oct 19 06:53:47.595627 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 596/1196] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:53:47.811719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:47.829162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:47.864210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:47.864838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:47.868939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:47.873323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:47.873901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:47.877902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:48.027479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:48.037226 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8fe9f4a2-6723-47d1-9e02-6c4db6104f9d tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1649 microversion: 2.1 time: 0.241131 Oct 19 06:53:48.047912 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 597/1197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:47 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1649 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:48.047912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:48.047912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:48.054022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:48.054549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:48.054999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:48.055725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:48.056290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:48.056743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:48.421710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:48.452372 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46c3bfec-c3f6-4062-948a-203efbe8f8f3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 200 len: 1474 microversion: 2.1 time: 0.397609 Oct 19 06:53:48.452372 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 598/1198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:48 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 1474 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:48.463829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:48.466235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:48.497177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:48.501761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:48.506479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:48.507660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:48.508661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:48.513976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:48.547409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:53:48.548328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:53:48.549878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:53:48.551967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:53:48.552591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:53:48.592890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:48.593713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:48.594484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:48.596508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:48.604334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:48.604334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:48.640583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:48.640583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:48.640583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:48.640583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lazy-loading 'fault' on Instance uuid c0d5afde-b404-4a25-96cc-a1b35ee53ca0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:48.674017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:53:48.688646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for user 631a2a90a44a40b2bd751a4feaf69d0f and project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:53:48.725835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:48.734646 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf76d8e5-2bf7-44a3-a1ae-ec74ec8046cc tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 200 len: 1304 microversion: 2.1 time: 0.292635 Oct 19 06:53:48.739711 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 599/1199] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:48 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 1304 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:48.760368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-592742dc-6151-4cc4-a8ae-b6a9d6f09400 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-789648145"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:48.765513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:53:48.769972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-592742dc-6151-4cc4-a8ae-b6a9d6f09400 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:48.774150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:53:48.798897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592742dc-6151-4cc4-a8ae-b6a9d6f09400 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:48.799725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592742dc-6151-4cc4-a8ae-b6a9d6f09400 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:48.800377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592742dc-6151-4cc4-a8ae-b6a9d6f09400 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:48.808948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592742dc-6151-4cc4-a8ae-b6a9d6f09400 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:48.809601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592742dc-6151-4cc4-a8ae-b6a9d6f09400 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:48.810149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592742dc-6151-4cc4-a8ae-b6a9d6f09400 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:49.008642 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79b4e82a-7edc-429f-a7db-ab5c1451028f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.022428 Oct 19 06:53:49.009722 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 601/1200] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:53:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:53:49.044465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35957fa3-5d0a-4e40-b323-727aeaf14871 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:49.045442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35957fa3-5d0a-4e40-b323-727aeaf14871 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:49.253854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35957fa3-5d0a-4e40-b323-727aeaf14871 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:49.275530 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35957fa3-5d0a-4e40-b323-727aeaf14871 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1210 microversion: 2.1 time: 0.258006 Oct 19 06:53:49.277400 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 602/1201] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:49 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1210 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:49.303449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:49.304178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:49.325346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:49.326172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:49.326909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:49.327800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:49.328498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:49.329106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:49.368693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:49.369747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:49.370341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:49.370965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lazy-loading 'fault' on Instance uuid 799680d2-af3c-44e4-a38f-8df88aecbca5 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:49.462531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae4d0a0ad0046d9ae0582fa7612b257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ba5522203f4750a7928f4b3156eb23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:49.475566 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6cf280b1-1fc4-4f9a-8c5c-59d88a9a7297 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 200 len: 1368 microversion: 2.1 time: 0.196420 Oct 19 06:53:49.477929 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 603/1202] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:49 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:49.624806 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-592742dc-6151-4cc4-a8ae-b6a9d6f09400 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c/action" status: 202 len: 0 microversion: 2.1 time: 0.869856 Oct 19 06:53:49.627666 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 600/1203] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:53:48 2022] POST /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c/action => generated 0 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 06:53:49.640214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-de05442c-bf8a-4ad4-bbaf-ac5de70a8afd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d649390d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:49.653014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0084eccd-10eb-4296-b805-95b4f30e5f93 req-2e81107b-3911-48c7-95cf-5001fcce4520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799680d2-af3c-44e4-a38f-8df88aecbca5", "name": "network-vif-deleted", "tag": "7bc09432-f31f-4901-9c9c-8d446fa198c0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:49.676456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0084eccd-10eb-4296-b805-95b4f30e5f93 req-2e81107b-3911-48c7-95cf-5001fcce4520 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:49.681471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0084eccd-10eb-4296-b805-95b4f30e5f93 req-2e81107b-3911-48c7-95cf-5001fcce4520 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:49.682219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0084eccd-10eb-4296-b805-95b4f30e5f93 req-2e81107b-3911-48c7-95cf-5001fcce4520 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:49.726086 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0084eccd-10eb-4296-b805-95b4f30e5f93 req-2e81107b-3911-48c7-95cf-5001fcce4520 service nova] Creating event network-vif-deleted:7bc09432-f31f-4901-9c9c-8d446fa198c0 for instance 799680d2-af3c-44e4-a38f-8df88aecbca5 on n-h1-861333-10 Oct 19 06:53:49.750424 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0084eccd-10eb-4296-b805-95b4f30e5f93 req-2e81107b-3911-48c7-95cf-5001fcce4520 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105477 Oct 19 06:53:49.755880 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-de05442c-bf8a-4ad4-bbaf-ac5de70a8afd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.120241 Oct 19 06:53:49.760488 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 604/1205] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:49 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:49.760671 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 601/1205] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:49.769562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:49.770261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: c0d5afde-b404-4a25-96cc-a1b35ee53ca0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:49.809544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:49.810055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:49.810493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:49.811244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:49.811690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:49.812354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:49.832014 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] HTTP exception thrown: Instance c0d5afde-b404-4a25-96cc-a1b35ee53ca0 could not be found. Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Request method failure captured: Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 HTTP/1.1 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT552HJYYsnnJYLafIcs2Uv688QHCr7rXdznEoZXGk_8jLPEaxij16Z2WWSF1qzGDESdub3hCQ7KhLgQVQQtPrpJDnydr55X2gfOBT_0-Kn2l02JsGtSA6slXjEOCD9fKsIcKTnznYfSrZH9fWvISNfeziT2wcGsDM7BKZASuEW1TjTk Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 1af903b4f61c4892b3a577b039737bf0 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminTestJSON-1924079681 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1af903b4f61c4892b3a577b039737bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1af903b4f61c4892b3a577b039737bf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1af903b4f61c4892b3a577b039737bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1af903b4f61c4892b3a577b039737bf0", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminTestJSON-1924079681 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 1af903b4f61c4892b3a577b039737bf0 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminTestJSON-1924079681 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersAdminTestJSON-1924079681-project Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 90be7740f30e48b5b7575fa74719f4e2 Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminTestJSON-1924079681-project Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance c0d5afde-b404-4a25-96cc-a1b35ee53ca0 could not be found. Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'c0d5afde-b404-4a25-96cc-a1b35ee53ca0'} Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d5afde-b404-4a25-96cc-a1b35ee53ca0 could not be found. Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d5afde-b404-4a25-96cc-a1b35ee53ca0 could not be found. Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:49.843699 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:49.848998 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:49.848998 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:49.848998 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:49.848998 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:49.848998 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:49.848998 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d5afde-b404-4a25-96cc-a1b35ee53ca0 could not be found. Oct 19 06:53:49.848998 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:49.850671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Returning 404 to user: Instance c0d5afde-b404-4a25-96cc-a1b35ee53ca0 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:49.851706 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d43c3c9-786a-4032-b959-5cfacbe81ac3 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0" status: 404 len: 111 microversion: 2.1 time: 0.087214 Oct 19 06:53:49.852496 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 602/1206] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:49 2022] GET /compute/v2.1/servers/c0d5afde-b404-4a25-96cc-a1b35ee53ca0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:53:49.861832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:49.862457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:49.880781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:49.881288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:49.881735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:49.882479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:49.882943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:49.883376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:49.947008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:49.979754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:53:50.300307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-530c885f-841f-46ba-9f39-04e408a3987e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:50.300931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-530c885f-841f-46ba-9f39-04e408a3987e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:50.427711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-530c885f-841f-46ba-9f39-04e408a3987e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:50.450306 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-530c885f-841f-46ba-9f39-04e408a3987e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1210 microversion: 2.1 time: 0.153093 Oct 19 06:53:50.452532 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 603/1207] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:50 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:50.505934 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff90b708-a29c-4fc9-96c8-50a2df21e72d tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 204 len: 0 microversion: 2.1 time: 0.648820 Oct 19 06:53:50.507237 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 605/1208] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:53:49 2022] DELETE /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:53:50.507789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:50.508508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] [instance: 799680d2-af3c-44e4-a38f-8df88aecbca5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:50.516528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:50.517383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:50.521017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:50.523920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:50.524287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:50.530077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:50.531356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:50.533716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:50.552668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:50.558234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:50.560026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:50.561059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:50.561769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:50.562306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:50.595596 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] HTTP exception thrown: Instance 799680d2-af3c-44e4-a38f-8df88aecbca5 could not be found. Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Request method failure captured: Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 HTTP/1.1 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT56q4vBo7DNIvqOcnjQ7so0ZHBfBhZoLrrL87-SLoldjP8WyioxTgZpVoyotcBpl8if6R_HqpULdGm34fPzqSYcoFIlEtNv9mF7P8HF23EGIMhzOYAD8Qy8_aQf1k2VCMPnI5R6jpxQ5d_EL1OGgRC1AbHltdvKjMU3VXHUkXvNKkzg Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 61ba5522203f4750a7928f4b3156eb23 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestManualDisk-534456392 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/61ba5522203f4750a7928f4b3156eb23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61ba5522203f4750a7928f4b3156eb23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61ba5522203f4750a7928f4b3156eb23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_61ba5522203f4750a7928f4b3156eb23", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestManualDisk-534456392 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 61ba5522203f4750a7928f4b3156eb23 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestManualDisk-534456392 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestManualDisk-534456392-project Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 4ae4d0a0ad0046d9ae0582fa7612b257 Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestManualDisk-534456392-project Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 799680d2-af3c-44e4-a38f-8df88aecbca5 could not be found. Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '799680d2-af3c-44e4-a38f-8df88aecbca5'} Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799680d2-af3c-44e4-a38f-8df88aecbca5 could not be found. Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799680d2-af3c-44e4-a38f-8df88aecbca5 could not be found. Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:50.597254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:50.602779 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:50.602779 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:50.602779 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:50.602779 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:50.602779 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:50.602779 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799680d2-af3c-44e4-a38f-8df88aecbca5 could not be found. Oct 19 06:53:50.602779 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:50.602779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Returning 404 to user: Instance 799680d2-af3c-44e4-a38f-8df88aecbca5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:50.603869 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39934906-6ca5-45a6-a31b-99fb30803d06 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5" status: 404 len: 111 microversion: 2.1 time: 0.106965 Oct 19 06:53:50.611495 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 604/1209] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:50 2022] GET /compute/v2.1/servers/799680d2-af3c-44e4-a38f-8df88aecbca5 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:53:50.619188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a69b1eb-6a6e-45ab-ba75-10b397c360c9 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] Calling method '.version_select at 0x7f6d64729c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:50.728334 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a69b1eb-6a6e-45ab-ba75-10b397c360c9 tempest-ServersTestManualDisk-534456392 tempest-ServersTestManualDisk-534456392-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520390670" status: 202 len: 0 microversion: 2.1 time: 0.115599 Oct 19 06:53:50.730061 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 605/1210] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 06:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520390670 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:53:50.775147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cbc846e-c1ca-4ede-99bd-976491d38b71 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d646d4160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:50.853601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cbc846e-c1ca-4ede-99bd-976491d38b71 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.084578 Oct 19 06:53:50.857856 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 606/1211] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:50 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:50.979730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:50.995886 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fce9e989-b123-433a-8663-0885731bd03c tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1469 microversion: 2.1 time: 0.484174 Oct 19 06:53:51.001871 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 606/1212] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:50 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1469 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:51.178489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d787d98-c7e2-4b0b-b067-43ad22f9e35d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Action: 'create', calling method: .version_select at 0x7f6d64628700>, body: {"keypair": {"name": "tempest-keypair-2006411450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJPcTTbJAt7TrZLgoix3+hQriRs7l9lkQ/ci/TnIHBSsOVOcM64GDluccnpPvQiW7U0YQUMIPjY9qCOu8bCuRCbsQipaMFZLn0KpYoSjLWjxnGuNEdz6vQCC4jZT+2Grg=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:51.203462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:51.213738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8d787d98-c7e2-4b0b-b067-43ad22f9e35d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Getting quotas for project 012922c902b44fc1bb1975dfa27ff074. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:53:51.223323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8d787d98-c7e2-4b0b-b067-43ad22f9e35d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Getting quotas for user 44e6b0b4228744ecab5536aa08d9495d and project 012922c902b44fc1bb1975dfa27ff074. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:53:51.377284 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d787d98-c7e2-4b0b-b067-43ad22f9e35d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.477448 Oct 19 06:53:51.378531 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 607/1213] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 06:53:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:51.479039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:51.480558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:51.494590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:51.498151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:51.505613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:51.507774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:51.509085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:51.511088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:51.726552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:51.740270 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86cf28f0-afa9-404a-806d-2a975a47262b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1214 microversion: 2.1 time: 0.263474 Oct 19 06:53:51.742526 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 607/1214] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:51 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:51.872924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-326af2c5-42b0-40ae-b20a-aecd3def0bdd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64604d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:51.973408 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-326af2c5-42b0-40ae-b20a-aecd3def0bdd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.104018 Oct 19 06:53:51.974707 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 608/1215] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:51 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:52.026765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:52.028186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:52.039135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:52.041879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:52.045092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:52.047376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:52.049291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:52.049921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:52.513064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:52.524811 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4923329e-3021-432b-8260-7a1057751301 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1469 microversion: 2.1 time: 0.502128 Oct 19 06:53:52.525434 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 608/1216] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:52 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1469 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:52.768832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:52.769937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:52.785732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:52.787974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:52.789110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:52.791905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:52.792834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:52.795796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:52.990260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d93c0402-84c9-404d-a612-7708d3747985 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d648fc550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:53.086515 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d93c0402-84c9-404d-a612-7708d3747985 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.096479 Oct 19 06:53:53.088862 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 609/1217] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:52 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:53.442927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:53.460244 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3ef5a37-7e51-46c5-aa71-461a7adb1014 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1262 microversion: 2.1 time: 0.697233 Oct 19 06:53:53.478243 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 609/1218] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:52 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1262 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:53.551387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:53.552375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:53.562087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:53.564872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:53.565503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:53.566885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:53.570372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:53.571059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:53.744355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:53.775387 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4ea24ca-f922-4a4f-9535-8277fa06e225 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1427 microversion: 2.1 time: 0.230082 Oct 19 06:53:53.791378 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 610/1219] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:53 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1427 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:54.012611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ca75bdde-6eb4-4291-b841-10c347083602 req-6ebe63ee-e33b-47ce-8167-24fd0583f07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da", "name": "network-vif-deleted", "tag": "acdc01a7-4d46-4006-821e-225a7f07253f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:54.034273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ca75bdde-6eb4-4291-b841-10c347083602 req-6ebe63ee-e33b-47ce-8167-24fd0583f07b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:54.036720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ca75bdde-6eb4-4291-b841-10c347083602 req-6ebe63ee-e33b-47ce-8167-24fd0583f07b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:54.037408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ca75bdde-6eb4-4291-b841-10c347083602 req-6ebe63ee-e33b-47ce-8167-24fd0583f07b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:54.097726 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ca75bdde-6eb4-4291-b841-10c347083602 req-6ebe63ee-e33b-47ce-8167-24fd0583f07b service nova] Creating event network-vif-deleted:acdc01a7-4d46-4006-821e-225a7f07253f for instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da on n-h2-861333-10 Oct 19 06:53:54.103351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed630cf0-aeb3-4880-b1b4-815d551559c6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64885430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:54.107465 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ca75bdde-6eb4-4291-b841-10c347083602 req-6ebe63ee-e33b-47ce-8167-24fd0583f07b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098467 Oct 19 06:53:54.108076 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 610/1220] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:54.241336 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed630cf0-aeb3-4880-b1b4-815d551559c6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.142228 Oct 19 06:53:54.245124 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 611/1221] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:54 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:54.489986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:54.490700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:54.512377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:54.519672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:54.520239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:54.525257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:54.525824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:54.526384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:54.807355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:54.808278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:54.826435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:54.832127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:54.832870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:54.837231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:54.838454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:54.839819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:54.950755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:54.952559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:54.953130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:54.954126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lazy-loading 'fault' on Instance uuid d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:53:55.098550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:55.110544 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a53839f-90e7-465b-b22a-d0ee84efb873 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1268 microversion: 2.1 time: 0.622343 Oct 19 06:53:55.111190 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 611/1222] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:54 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1268 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:55.133597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be7740f30e48b5b7575fa74719f4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af903b4f61c4892b3a577b039737bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:55.143847 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e0ebb52-1587-4edc-8150-0aa7bebebee1 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 200 len: 1303 microversion: 2.1 time: 0.341522 Oct 19 06:53:55.152195 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 612/1223] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:54 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 1303 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:55.263835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c235362d-ba71-4c03-b24d-bf0a255593ef tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64628940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:55.380569 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c235362d-ba71-4c03-b24d-bf0a255593ef tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.120983 Oct 19 06:53:55.388868 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 612/1224] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:55 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:56.138167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:56.138746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:56.143475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:56.170495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:56.171000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:56.171453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:56.178774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:56.179544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] [instance: d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:56.191170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:56.191666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:56.192196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:56.193083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:56.193263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:56.194752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:56.195918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:56.196406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:56.198685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:56.230863 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] HTTP exception thrown: Instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da could not be found. Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Request method failure captured: Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da HTTP/1.1 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT552HJYYsnnJYLafIcs2Uv688QHCr7rXdznEoZXGk_8jLPEaxij16Z2WWSF1qzGDESdub3hCQ7KhLgQVQQtPrpJDnydr55X2gfOBT_0-Kn2l02JsGtSA6slXjEOCD9fKsIcKTnznYfSrZH9fWvISNfeziT2wcGsDM7BKZASuEW1TjTk Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 1af903b4f61c4892b3a577b039737bf0 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminTestJSON-1924079681 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1af903b4f61c4892b3a577b039737bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1af903b4f61c4892b3a577b039737bf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1af903b4f61c4892b3a577b039737bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1af903b4f61c4892b3a577b039737bf0", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminTestJSON-1924079681 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 1af903b4f61c4892b3a577b039737bf0 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminTestJSON-1924079681 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersAdminTestJSON-1924079681-project Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 90be7740f30e48b5b7575fa74719f4e2 Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminTestJSON-1924079681-project Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da could not be found. Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'd356d0c5-cbb4-4ccb-92b7-03d6d26fc0da'} Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da could not be found. Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da could not be found. Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:53:56.233954 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:56.239077 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:53:56.239077 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:53:56.239077 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:53:56.239077 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:53:56.239077 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:53:56.239077 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da could not be found. Oct 19 06:53:56.239077 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:53:56.244281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] Returning 404 to user: Instance d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:53:56.247618 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9233c54d-5035-4337-a3b8-fe97003f1324 tempest-ServersAdminTestJSON-1924079681 tempest-ServersAdminTestJSON-1924079681-project] 10.222.0.39 "GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da" status: 404 len: 111 microversion: 2.1 time: 0.073018 Oct 19 06:53:56.251654 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 613/1225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:56 2022] GET /compute/v2.1/servers/d356d0c5-cbb4-4ccb-92b7-03d6d26fc0da => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:53:56.398013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbb5b800-3523-4da8-9162-1ea3b25c5d09 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64739160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:56.468512 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbb5b800-3523-4da8-9162-1ea3b25c5d09 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.074689 Oct 19 06:53:56.470023 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 614/1226] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:56 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:56.831204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:56.842273 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-374f4d68-9de3-41b5-bf73-f869d1b342e3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1268 microversion: 2.1 time: 0.705735 Oct 19 06:53:56.849133 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 613/1227] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:56 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1268 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:57.486654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2fa3acd7-31a3-4c48-84cd-5050ab05a9bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d646280d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:57.573793 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2fa3acd7-31a3-4c48-84cd-5050ab05a9bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.075833 Oct 19 06:53:57.577044 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 615/1228] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:57 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:57.869036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:57.870485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:57.896548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:57.900752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:57.901226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:57.902699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:57.903170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:57.909847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:58.429160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:53:58.445392 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70addc81-1f43-4122-b76b-b74b71aa019c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1268 microversion: 2.1 time: 0.579854 Oct 19 06:53:58.447432 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 614/1229] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:57 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1268 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:53:58.464857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-bd078cf7-63ec-4500-807c-86b37c7b5687 req-3ed826db-8340-41cf-84c1-7a9ab0fb54dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5584f2a-692a-4897-b1af-adeb2bdcbf4c", "name": "network-vif-plugged", "status": "completed", "tag": "dda422b3-ebf6-4a1e-af02-8af8b5ee4816"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:53:58.479107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bd078cf7-63ec-4500-807c-86b37c7b5687 req-3ed826db-8340-41cf-84c1-7a9ab0fb54dd service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:58.479583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bd078cf7-63ec-4500-807c-86b37c7b5687 req-3ed826db-8340-41cf-84c1-7a9ab0fb54dd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:58.480055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bd078cf7-63ec-4500-807c-86b37c7b5687 req-3ed826db-8340-41cf-84c1-7a9ab0fb54dd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:58.520972 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-bd078cf7-63ec-4500-807c-86b37c7b5687 req-3ed826db-8340-41cf-84c1-7a9ab0fb54dd service nova] Creating event network-vif-plugged:dda422b3-ebf6-4a1e-af02-8af8b5ee4816 for instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c on n-h1-861333-10 Oct 19 06:53:58.564919 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-bd078cf7-63ec-4500-807c-86b37c7b5687 req-3ed826db-8340-41cf-84c1-7a9ab0fb54dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117042 Oct 19 06:53:58.565433 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 616/1230] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:53:58.593541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa729198-ea82-494a-9662-bee7ad58ef72 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64939af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:58.649564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=20 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:58.684396 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa729198-ea82-494a-9662-bee7ad58ef72 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.094104 Oct 19 06:53:58.688419 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 615/1231] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:58 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:53:59.473842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:59.474547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:53:59.486830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:59.502453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:59.509081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:59.509081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:53:59.512327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:53:59.512981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:53:59.702203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c8204bc9-4636-40c6-a08a-bf30f69f2fea tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d648fc280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:53:59.721573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:53:59.830864 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c8204bc9-4636-40c6-a08a-bf30f69f2fea tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.133006 Oct 19 06:53:59.831762 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 616/1232] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:53:59 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:00.720448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:00.729570 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a43b336a-f781-4742-b7a9-ae68982952b0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 1.262235 Oct 19 06:54:00.739422 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 617/1233] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:53:59 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:00.847647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-369a5c85-d58e-47fa-9d5f-9341524fc69d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d6491be50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:00.921029 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-369a5c85-d58e-47fa-9d5f-9341524fc69d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.077771 Oct 19 06:54:00.922143 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 617/1234] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:00 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:01.388048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1633528932", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "f4729bae-509d-4b40-930f-90da9da6d096"}], "security_groups": [{"name": "tempest-securitygroup--1393928194"}], "key_name": "tempest-keypair-2006411450", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:01.433263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:01.688208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] validate_networks() for [('f4729bae-509d-4b40-930f-90da9da6d096', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:54:01.762029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:01.762663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:01.772083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:01.772608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:01.773053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:01.773787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:01.774247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:01.774695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:02.162416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:02.337734 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-761e245b-a369-4bfd-942c-60b62453a87e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 0.413936 Oct 19 06:54:02.337734 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 618/1235] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:01 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:02.337734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cda0a0d3-d2f7-46e7-a126-15628a2a594b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64965550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:02.337734 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cda0a0d3-d2f7-46e7-a126-15628a2a594b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.087560 Oct 19 06:54:02.337734 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 619/1236] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:02 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:02.799899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-243e95b9-be8a-45b4-836d-8f9dcbf132d5 req-2fbaec64-2886-4cfe-9ef0-ab113c0361a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1879dd80-bc43-4b3b-bf52-85a4745444fa", "tag": "4a79685b-a244-4153-b0c2-b8a3f4fe3abc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:02.826353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-243e95b9-be8a-45b4-836d-8f9dcbf132d5 req-2fbaec64-2886-4cfe-9ef0-ab113c0361a4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:02.829362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-243e95b9-be8a-45b4-836d-8f9dcbf132d5 req-2fbaec64-2886-4cfe-9ef0-ab113c0361a4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:02.831725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-243e95b9-be8a-45b4-836d-8f9dcbf132d5 req-2fbaec64-2886-4cfe-9ef0-ab113c0361a4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:02.893090 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-243e95b9-be8a-45b4-836d-8f9dcbf132d5 req-2fbaec64-2886-4cfe-9ef0-ab113c0361a4 service nova] Creating event network-changed:4a79685b-a244-4153-b0c2-b8a3f4fe3abc for instance 1879dd80-bc43-4b3b-bf52-85a4745444fa on n-h2-861333-10 Oct 19 06:54:02.903423 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-243e95b9-be8a-45b4-836d-8f9dcbf132d5 req-2fbaec64-2886-4cfe-9ef0-ab113c0361a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107145 Oct 19 06:54:02.905280 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 620/1237] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:54:03.348453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e56cb224-1c19-41e1-9de0-3522214b9848 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64965700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:03.426183 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e56cb224-1c19-41e1-9de0-3522214b9848 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.088707 Oct 19 06:54:03.426731 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 621/1238] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:03 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:03.433839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:03.441373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:03.451578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:03.452078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:03.452551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:03.453299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:03.453758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:03.454191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:03.638657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:54:03.639045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:54:03.639311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:54:03.644097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:54:03.644664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:54:03.665753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:03.669365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:03.669929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:03.670771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:03.674511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:03.675190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:03.719703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Getting quotas for project 012922c902b44fc1bb1975dfa27ff074. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:54:03.732185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Getting quotas for user 44e6b0b4228744ecab5536aa08d9495d and project 012922c902b44fc1bb1975dfa27ff074. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:54:03.766848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:54:03.769437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:54:03.818899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:03.945012 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc343596-976c-4e9b-aa4e-db490d45dab0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.561584 Oct 19 06:54:03.957117 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 618/1239] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:54:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:54:03.978156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-241852b4-a1dc-4f9c-afe8-824905cb9061 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:03.982677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:03.984545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-241852b4-a1dc-4f9c-afe8-824905cb9061 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:04.002373 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9f67692-8736-462b-9a0c-14129824da19 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 0.569411 Oct 19 06:54:04.004553 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 622/1240] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:03 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:04.170196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-241852b4-a1dc-4f9c-afe8-824905cb9061 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:04.180737 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-241852b4-a1dc-4f9c-afe8-824905cb9061 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1242 microversion: 2.1 time: 0.218946 Oct 19 06:54:04.181395 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 619/1241] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:03 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:04.443649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95e34a08-7233-4377-8184-ca386afb7bb8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d648ca9d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:04.494031 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95e34a08-7233-4377-8184-ca386afb7bb8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.055073 Oct 19 06:54:04.494745 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 623/1242] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:04 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:04.501811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:04.502535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:04.510680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:04.511229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:04.511667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:04.512602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:04.513229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:04.513660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:04.663049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:54:04.677694 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2b6eff2-9893-41ba-b97e-04229bcc5689 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 2346 microversion: 2.25 time: 0.180707 Oct 19 06:54:04.692237 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 620/1243] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:04 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 2346 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:54:04.704559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1c0e7a4-ab79-4418-aace-9787b2032e74 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:04.708168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7a4-ab79-4418-aace-9787b2032e74 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:04.708659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7a4-ab79-4418-aace-9787b2032e74 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:04.711560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7a4-ab79-4418-aace-9787b2032e74 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:04.711560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7a4-ab79-4418-aace-9787b2032e74 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:04.711560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7a4-ab79-4418-aace-9787b2032e74 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:04.711560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7a4-ab79-4418-aace-9787b2032e74 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:04.756052 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1c0e7a4-ab79-4418-aace-9787b2032e74 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.055684 Oct 19 06:54:04.756661 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 624/1244] 10.222.0.39 () {60 vars in 1217 bytes} [Wed Oct 19 06:54:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:54:05.038590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:05.039342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:05.065492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:05.069654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:05.073590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:05.074828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:05.076680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:05.079783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:05.218466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf7242af-212c-4768-94ed-18eef50de09f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:05.221172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf7242af-212c-4768-94ed-18eef50de09f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:05.303177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf7242af-212c-4768-94ed-18eef50de09f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:05.317853 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf7242af-212c-4768-94ed-18eef50de09f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1242 microversion: 2.1 time: 0.114614 Oct 19 06:54:05.320606 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 625/1245] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:05 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:05.518174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-129f02d5-037e-4b21-b1b1-497cdeaa4cd6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d648dcdc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:05.528889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:05.551565 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9674fd2a-f196-46bd-88d8-29b5348e0c08 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 0.521910 Oct 19 06:54:05.568134 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 621/1246] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:05 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:05.618915 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-129f02d5-037e-4b21-b1b1-497cdeaa4cd6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.106064 Oct 19 06:54:05.619587 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 626/1247] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:05 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:06.345726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:06.347001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:06.358262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:06.358753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:06.359196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:06.360974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:06.361351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:06.361946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:06.451370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:06.461523 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e95b1b2-7b64-4aaf-a8c2-182f2b7a88c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1246 microversion: 2.1 time: 0.121056 Oct 19 06:54:06.469483 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 622/1248] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:06 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:06.587777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:06.588447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:06.611526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:06.612052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:06.614571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:06.630039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:06.630039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:06.630039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:06.635266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7955bd44-6d36-4458-9117-15f2c0a1e0e4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d6460f5e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:06.738612 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7955bd44-6d36-4458-9117-15f2c0a1e0e4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.107352 Oct 19 06:54:06.740554 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 623/1249] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:06 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:07.148850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-800901e9-6af2-4c4b-a8e1-0f82d50adb1c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:07.149780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-800901e9-6af2-4c4b-a8e1-0f82d50adb1c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:07.162633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800901e9-6af2-4c4b-a8e1-0f82d50adb1c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:07.164650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800901e9-6af2-4c4b-a8e1-0f82d50adb1c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:07.165192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800901e9-6af2-4c4b-a8e1-0f82d50adb1c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:07.174944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800901e9-6af2-4c4b-a8e1-0f82d50adb1c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:07.174944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800901e9-6af2-4c4b-a8e1-0f82d50adb1c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:07.174944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-800901e9-6af2-4c4b-a8e1-0f82d50adb1c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:07.892760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:07.909569 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3eab1c4-84c2-4794-b7c8-9c66774d6821 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 1.330524 Oct 19 06:54:07.914615 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 627/1250] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:06 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:07.942244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:07.945505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:07.996059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:08.001142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:08.008328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:08.014773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:08.017039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:08.022004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:08.328978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:08.376825 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a2ce899-5dfd-41ff-95d0-7f4c5374493f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1294 microversion: 2.1 time: 0.457396 Oct 19 06:54:08.376825 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 628/1251] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:07 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1294 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:08.421236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db3f9445-1683-49a5-ade5-caa286a5334e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64916670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:08.488340 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-800901e9-6af2-4c4b-a8e1-0f82d50adb1c tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1858 microversion: 2.1 time: 1.339380 Oct 19 06:54:08.489779 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 624/1252] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:07 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1858 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:08.509037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c06212b0-18f2-4552-ad87-71431cdc0f7b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7502242-0bfd-4e75-8cdf-2d4a2a805ad1", "device": "/dev/xvdb"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:08.513425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c06212b0-18f2-4552-ad87-71431cdc0f7b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:08.536180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06212b0-18f2-4552-ad87-71431cdc0f7b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:08.536967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06212b0-18f2-4552-ad87-71431cdc0f7b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:08.543483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06212b0-18f2-4552-ad87-71431cdc0f7b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:08.543483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06212b0-18f2-4552-ad87-71431cdc0f7b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:08.543483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06212b0-18f2-4552-ad87-71431cdc0f7b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:08.543483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06212b0-18f2-4552-ad87-71431cdc0f7b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:08.549893 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db3f9445-1683-49a5-ade5-caa286a5334e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.174998 Oct 19 06:54:08.551117 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 629/1253] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:08 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:08.581622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-861333-10", "block_migration": true, "disk_over_commit": false}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:08.592259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:08.636991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:08.637745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:08.638391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:08.644286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:08.645129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:08.645778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:08.707747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lazy-loading 'flavor' on Instance uuid d231a12d-b118-41ec-b9e2-f987bea670ba {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:54:08.753395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Going to try to live migrate instance to n-h1-861333-10 {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 06:54:08.814610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:08.941359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:09.957119 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c06212b0-18f2-4552-ad87-71431cdc0f7b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "POST /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.465369 Oct 19 06:54:09.960255 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 625/1254] 10.222.0.39 () {62 vars in 1364 bytes} [Wed Oct 19 06:54:08 2022] POST /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments => generated 194 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:54:09.987724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:09.991247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:10.021825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:10.022501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:10.023199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:10.031209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:10.032791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:10.041163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:10.791525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:10.802056 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2935db92-3784-404d-a68d-9cae817d35af tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 0.843028 Oct 19 06:54:10.803316 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 626/1255] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:09 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:10.811168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:10.811168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:10.817170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:10.817990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:10.818658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:10.819543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:10.820884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:10.821566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:10.976861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:10.992460 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3f5a045-5796-4090-b6d8-94c64aefb31a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1300 microversion: 2.1 time: 0.186746 Oct 19 06:54:10.993182 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 627/1256] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:10 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1300 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:11.010386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3abdd003-380b-4976-90cb-aab8dd21c031 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64596e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:11.126197 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3abdd003-380b-4976-90cb-aab8dd21c031 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.128906 Oct 19 06:54:11.129784 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 628/1257] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:10 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:11.832942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:11.833876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:11.854860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:11.855641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:11.873448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:11.878890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:11.879987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:11.881026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:12.631257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:12.640446 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8479f92c-fb6f-4588-a2e0-5858079c03c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 0.815079 Oct 19 06:54:12.661510 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 629/1258] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:11 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:12.669424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:12.673461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:12.705329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:12.705837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:12.706273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:12.706993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:12.707445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:12.707875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:13.023097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:13.032227 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4880b95b-4c77-4fce-b4fb-fc299a056aa3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 0.368700 Oct 19 06:54:13.036739 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 630/1259] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:12 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:13.075037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-314249d4-561d-48f3-bc71-9a5bb27cb7e1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d645d3e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:13.152272 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-314249d4-561d-48f3-bc71-9a5bb27cb7e1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.110884 Oct 19 06:54:13.153180 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 631/1260] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:13 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:13.669487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:13.670168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:13.680272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:13.680833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:13.690961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:13.691907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:13.692521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:13.692974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:13.705683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:13.934333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:13.943174 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ea3f6e3-ff03-4179-9658-f4ab179bd30a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 0.278080 Oct 19 06:54:13.945104 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 632/1261] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:13 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:14.059388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:14.060564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:14.068383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:14.069271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:14.070201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:14.071164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:14.071839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:14.072773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:14.179895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:14.574643 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e25b06a6-0cee-4948-a127-6e9ef3e47fa6 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/action" status: 202 len: 0 microversion: 2.1 time: 6.022079 Oct 19 06:54:14.575908 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 630/1262] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:54:08 2022] POST /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/action => generated 0 bytes in 6024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:54:14.578735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:14.594460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-837c05f0-fdeb-46ed-b085-5467b16b96e6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d648a49d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:14.617011 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbb36621-aae3-4faa-8fca-8015eafb74a4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 0.561652 Oct 19 06:54:14.620025 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 633/1263] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:14 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:14.633812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:14.636444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:14.653891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:14.678064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:14.681070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:14.686862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:14.688661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:14.694054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:14.719951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:14.737024 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-837c05f0-fdeb-46ed-b085-5467b16b96e6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.155224 Oct 19 06:54:14.746372 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 631/1264] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:14 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:14.970793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:14.972364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:14.995439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:14.997457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:14.999975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:15.004149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:15.004149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:15.009067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:15.285905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:15.298046 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0098add7-23eb-410b-a358-317c25821ff9 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.674139 Oct 19 06:54:15.303486 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 634/1265] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:14 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:15.313980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:15.648057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:15.649044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:15.659975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:15.664711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:15.667249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:15.669799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:15.674520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:15.677267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:15.856872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:15.876049 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52136130-6cbc-4ca6-a77c-674023719a22 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 0.909583 Oct 19 06:54:15.879575 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 632/1266] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:14 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:15.897371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32bd2f75-970a-4992-846c-c860a51642c5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d648a4f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:16.001478 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32bd2f75-970a-4992-846c-c860a51642c5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.118754 Oct 19 06:54:16.010490 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 633/1267] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:15 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:16.326464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:16.327096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:16.341790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:16.344688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:16.349255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:16.350372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:16.358788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:16.359274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:17.673771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:17.686742 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e541315f-c37f-4e6b-9b7c-f8ebc0b6d89e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 1.364254 Oct 19 06:54:17.697185 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 634/1268] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:16 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:17.706458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7941a376-a659-4ec7-b048-d652279289a2 req-ae853abf-c167-49bc-99a9-1904c55348d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c7927e-9e6e-4edc-acb0-6fc27121aafd", "tag": "95a34e28-71ae-49ac-8e7a-3699806f8abd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:17.754626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7941a376-a659-4ec7-b048-d652279289a2 req-ae853abf-c167-49bc-99a9-1904c55348d0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:17.755130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7941a376-a659-4ec7-b048-d652279289a2 req-ae853abf-c167-49bc-99a9-1904c55348d0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:17.755574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7941a376-a659-4ec7-b048-d652279289a2 req-ae853abf-c167-49bc-99a9-1904c55348d0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:17.797080 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7941a376-a659-4ec7-b048-d652279289a2 req-ae853abf-c167-49bc-99a9-1904c55348d0 service nova] Creating event network-changed:95a34e28-71ae-49ac-8e7a-3699806f8abd for instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd on n-h1-861333-10 Oct 19 06:54:17.819889 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7941a376-a659-4ec7-b048-d652279289a2 req-ae853abf-c167-49bc-99a9-1904c55348d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118207 Oct 19 06:54:17.829145 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 635/1269] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:17.830206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:17.835541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:17.837336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:17.841816 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-731f5c52-ee4c-45fd-b51e-32eeffc870d1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 2.198267 Oct 19 06:54:17.855139 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 635/1270] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:15 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:17.858715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:17.859221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:17.863464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d006d38b-7f17-4ae7-b125-54190ce3ca9e req-5c115c46-7a09-4cd4-af28-94430ebad7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1879dd80-bc43-4b3b-bf52-85a4745444fa", "name": "network-vif-plugged", "status": "completed", "tag": "4a79685b-a244-4153-b0c2-b8a3f4fe3abc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:17.868536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:17.869606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:17.871989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:17.872660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:17.887318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d006d38b-7f17-4ae7-b125-54190ce3ca9e req-5c115c46-7a09-4cd4-af28-94430ebad7f4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:17.888088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d006d38b-7f17-4ae7-b125-54190ce3ca9e req-5c115c46-7a09-4cd4-af28-94430ebad7f4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:17.889824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d006d38b-7f17-4ae7-b125-54190ce3ca9e req-5c115c46-7a09-4cd4-af28-94430ebad7f4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:17.909229 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d006d38b-7f17-4ae7-b125-54190ce3ca9e req-5c115c46-7a09-4cd4-af28-94430ebad7f4 service nova] Creating event network-vif-plugged:4a79685b-a244-4153-b0c2-b8a3f4fe3abc for instance 1879dd80-bc43-4b3b-bf52-85a4745444fa on n-h2-861333-10 Oct 19 06:54:17.938173 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d006d38b-7f17-4ae7-b125-54190ce3ca9e req-5c115c46-7a09-4cd4-af28-94430ebad7f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084315 Oct 19 06:54:17.939531 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 636/1271] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:17.950069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0508a209-54c2-4d65-b5c5-5c38459bf739 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64d21940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:18.096808 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0508a209-54c2-4d65-b5c5-5c38459bf739 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.155671 Oct 19 06:54:18.097881 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 637/1272] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:17 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:18.669329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:18.692559 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95c6ec1c-a982-4a82-b91a-5c212fba76f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1310 microversion: 2.1 time: 0.855784 Oct 19 06:54:18.694801 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 636/1273] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:17 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1310 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:18.724303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:18.724664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:18.753196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:18.753714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:18.754162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:18.762296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:18.762798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:18.764242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:18.884973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:18.884973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:18.918054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:18.918889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:18.919532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:18.920524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:18.921367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:18.922049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:20.057982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:20.067794 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-807b26e8-7b33-4a2b-867d-57f5da072108 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 1.193765 Oct 19 06:54:20.073283 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 637/1274] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:18 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:20.079374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fdc8e3d2-1180-489d-a47e-9740b3a1820a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d649053a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:20.187384 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fdc8e3d2-1180-489d-a47e-9740b3a1820a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.112681 Oct 19 06:54:20.188520 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 638/1275] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:20 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:20.199030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:20.208017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:20.224647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:20.225894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:20.226590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:20.227584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:20.229058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:20.230272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:20.255106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:20.265025 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-86a02caf-5f3e-476f-b5a4-0c12a7b38a2e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 1.546112 Oct 19 06:54:20.266297 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 638/1276] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:18 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:20.590418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:20.609115 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e4accb2-35c4-4e9d-a405-8fddd0bd71bf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1460 microversion: 2.1 time: 0.418575 Oct 19 06:54:20.625829 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 639/1277] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:20 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1460 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:21.043774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6f3779c-2668-4c75-ab06-e38d2f50d604 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:21.044423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6f3779c-2668-4c75-ab06-e38d2f50d604 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:21.052612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f3779c-2668-4c75-ab06-e38d2f50d604 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:21.059950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f3779c-2668-4c75-ab06-e38d2f50d604 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:21.060562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f3779c-2668-4c75-ab06-e38d2f50d604 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:21.064608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f3779c-2668-4c75-ab06-e38d2f50d604 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:21.065116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f3779c-2668-4c75-ab06-e38d2f50d604 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:21.065569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f3779c-2668-4c75-ab06-e38d2f50d604 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:21.097182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:21.097843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:21.114175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:21.121771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:21.122286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:21.128181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:21.128640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:21.135415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:21.991829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:22.014223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7eef17d-749e-4960-862c-9e5fe0210df8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 0.921953 Oct 19 06:54:22.020191 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 640/1278] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:21 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:22.037728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55eb7b48-73ac-4a44-a70a-3f6457a09209 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d648a49d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:22.134185 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55eb7b48-73ac-4a44-a70a-3f6457a09209 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.109810 Oct 19 06:54:22.135614 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 641/1279] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:22 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:22.154694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:22.157850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:22.205168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:22.205943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:22.207173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:22.213892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:22.214080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:22.214409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:22.899840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:22.919411 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6576dc5-85bf-4c0c-96d4-b7b2e1849368 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.778477 Oct 19 06:54:22.942419 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 642/1280] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:22 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:23.049778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:23.050685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:23.082279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:23.084938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:23.085720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:23.101444 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6f3779c-2668-4c75-ab06-e38d2f50d604 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1613 microversion: 2.1 time: 2.468825 Oct 19 06:54:23.103302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:23.103800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:23.104312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:23.106782 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 639/1281] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:20 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1613 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:23.146293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:23.146293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:23.159633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:23.161512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:23.162156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:23.163046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:23.164629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:23.165794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:23.235425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '015a9e0e3237439d83ab05470bcc14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493dfc15cb08458ba24012ec7f0949e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:23.236585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] flavor_id is None. Assuming migration. {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 06:54:23.238466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 06:54:23.811319 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-876af18f-c124-4530-9eda-68e0c2fc4f14 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa/action" status: 202 len: 0 microversion: 2.1 time: 0.679211 Oct 19 06:54:23.815753 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 640/1282] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:54:23 2022] POST /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:54:23.832593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e65d21b2-ef22-4416-b208-8fbd3d8c11a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64571700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:23.892578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:23.915008 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd9f1506-6ea8-42df-b89f-88f0150a3d65 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 0.871223 Oct 19 06:54:23.916459 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 643/1283] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:23 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:23.922877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:23.923810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:23.959451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:23.962614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:23.963484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:23.965239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:23.970958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:23.971875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f21a40dd-61c6-4667-bf9e-95b1f5bc9b24 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1469 microversion: 2.1 time: 0.614414 Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 644/1284] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:23 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1469 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:24.583313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:24.590874 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e65d21b2-ef22-4416-b208-8fbd3d8c11a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.773552 Oct 19 06:54:24.593167 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 641/1285] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:23 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:24.938925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:24.939821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:24.951921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:24.952485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:24.956394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:24.956394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:24.956394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:24.956394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:24.975437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:24.989692 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75deb481-8b95-4d58-abe8-317ff46336e2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.451854 Oct 19 06:54:24.995255 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 645/1286] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:24 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:25.196136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1081843695", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "77fecbf9-0d41-4410-ad8b-4a1893b4dd94"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:25.310936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] validate_networks() for [('77fecbf9-0d41-4410-ad8b-4a1893b4dd94', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:54:25.648166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:25.660481 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9cf2d982-1bc2-4346-81c4-533696c77df6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 0.725523 Oct 19 06:54:25.678863 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 642/1287] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:24 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:25.689064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:25.689874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:25.698985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:25.712078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:25.712909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:25.715652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:25.716195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:25.718533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:26.151173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:26.163311 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-194c0db1-ba2f-48ec-a9c5-cc4d9c08c2cd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1469 microversion: 2.1 time: 0.483070 Oct 19 06:54:26.164662 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 643/1288] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:25 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:26.194435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b87e2e3e-461c-45da-be2f-44e3e1b5483b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d6460a160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:26.305564 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b87e2e3e-461c-45da-be2f-44e3e1b5483b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1411 microversion: 2.1 time: 0.139305 Oct 19 06:54:26.306175 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 644/1289] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:26 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1411 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:26.322151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:26.322757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:26.360878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:26.361639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:26.362074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:26.362802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:26.378560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:26.378560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:26.473960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:27.019596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:27.038660 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e5f7fe0-a86f-466e-94eb-5d27a9f09f01 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.719319 Oct 19 06:54:27.040827 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 645/1290] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:26 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:27.055174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:27.059412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:27.084693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:27.085315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:27.085768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:27.086504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:27.092411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:27.093030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:27.740029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:27.760625 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b8c90e7-bac3-44ea-b237-ed0842cba9d3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 0.718320 Oct 19 06:54:27.761970 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 646/1291] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:27 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:27.795789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:27.796452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:27.807254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:27.807753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:27.824998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:27.825982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:27.826485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:27.826931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:28.146341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:28.163932 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27d2796d-1db8-40f4-8ba9-4d98eede388f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1469 microversion: 2.1 time: 0.389473 Oct 19 06:54:28.168623 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 647/1292] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:27 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1469 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:28.174393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa71cd43-d925-45f4-83b6-b5b422c617df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d645e3700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:28.200302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:54:28.200813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:54:28.203162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:54:28.203162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:54:28.203162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:54:28.217220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=49 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:28.259341 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa71cd43-d925-45f4-83b6-b5b422c617df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1420 microversion: 2.1 time: 0.089357 Oct 19 06:54:28.261415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:28.272708 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 648/1293] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:28 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:28.284244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:28.284244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:28.288183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:28.291499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:28.293496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:28.301792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:28.302477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:28.303356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:28.303854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:28.307743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:28.308591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:28.309075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:28.311009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:28.356984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Getting quotas for project 4248165058874e81a53cbcd2f194a649. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:54:28.378089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Getting quotas for user 6598d68715524f40aa57fb25b378fb17 and project 4248165058874e81a53cbcd2f194a649. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:54:28.394011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:54:28.396919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:54:28.525002 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c7d976a-d64b-4624-b624-dc4723e5957f tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.528363 Oct 19 06:54:28.527546 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 646/1294] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:54:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:54:28.537087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0017944b-74fb-4c10-9356-c9c59a335e1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64914ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:28.568657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:28.582677 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-592e4cd0-effa-450d-8951-63d4ea750780 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.304494 Oct 19 06:54:28.597394 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 649/1295] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:28 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:28.640468 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0017944b-74fb-4c10-9356-c9c59a335e1e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 200 len: 1420 microversion: 2.1 time: 0.110347 Oct 19 06:54:28.644023 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 647/1296] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:54:28 2022] GET /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:28.664836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c69b49a6-a3ca-4ba3-b79d-ce037be1def2 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:28.666182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c69b49a6-a3ca-4ba3-b79d-ce037be1def2 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:28.748095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-906651992", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "a41d894c-52b0-4b0d-8cab-72c2814699a7"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:28.869786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c69b49a6-a3ca-4ba3-b79d-ce037be1def2 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:28.889245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c69b49a6-a3ca-4ba3-b79d-ce037be1def2 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1224 microversion: 2.1 time: 0.229867 Oct 19 06:54:28.889875 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 648/1297] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:28 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1224 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:28.893991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] validate_networks() for [('a41d894c-52b0-4b0d-8cab-72c2814699a7', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:54:28.931056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-acc41797-2194-4d46-9fe6-3ce159b71acc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64aa2d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:29.895002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:54:29.895906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:54:29.896625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:54:29.897230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:54:29.897836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:54:29.917431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:29.918232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:29.924755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:29.924755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:29.924755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:29.924755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:29.961637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Getting quotas for project 9ded99a8f4204d6985060451b881d84f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:54:29.994658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Getting quotas for user 4ee94c5c732c4e579ec3e85f3018641b and project 9ded99a8f4204d6985060451b881d84f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:54:30.060420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:54:30.077541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:54:30.319553 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-652e66d9-73ba-4208-b394-556ade589cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720871 Oct 19 06:54:30.333919 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 650/1298] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:54:30.384244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:30.385322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:30.462604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:30.469157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:30.470411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:30.475588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:30.476362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:30.479180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:31.067651 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-acc41797-2194-4d46-9fe6-3ce159b71acc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 204 len: 0 microversion: 2.1 time: 2.170570 Oct 19 06:54:31.069066 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 649/1299] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:28 2022] DELETE /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 0 bytes in 2178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:54:31.076139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:31.076970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:31.107165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:31.107846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:31.110002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:31.111850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:31.114500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:31.115254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:31.470351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:31.481308 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b12d92d0-2305-4a4c-afba-53436f969927 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1469 microversion: 2.1 time: 0.411016 Oct 19 06:54:31.482868 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 650/1300] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:31 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1469 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:31.498609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1b6dbcf4-0c6f-432a-98be-6c9d795c9990 req-ddfb2b0f-0ef4-4e43-9a7e-8526715650e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c7927e-9e6e-4edc-acb0-6fc27121aafd", "name": "network-vif-plugged", "status": "completed", "tag": "95a34e28-71ae-49ac-8e7a-3699806f8abd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:31.527930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1b6dbcf4-0c6f-432a-98be-6c9d795c9990 req-ddfb2b0f-0ef4-4e43-9a7e-8526715650e2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:31.533648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1b6dbcf4-0c6f-432a-98be-6c9d795c9990 req-ddfb2b0f-0ef4-4e43-9a7e-8526715650e2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:31.538278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1b6dbcf4-0c6f-432a-98be-6c9d795c9990 req-ddfb2b0f-0ef4-4e43-9a7e-8526715650e2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:31.614015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:31.615820 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1b6dbcf4-0c6f-432a-98be-6c9d795c9990 req-ddfb2b0f-0ef4-4e43-9a7e-8526715650e2 service nova] Creating event network-vif-plugged:95a34e28-71ae-49ac-8e7a-3699806f8abd for instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd on n-h1-861333-10 Oct 19 06:54:31.624787 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf44eeae-b90f-4ea5-bd8e-71df457e9c8c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 1.289332 Oct 19 06:54:31.642042 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 651/1301] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:30 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:31.643494 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1b6dbcf4-0c6f-432a-98be-6c9d795c9990 req-ddfb2b0f-0ef4-4e43-9a7e-8526715650e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153377 Oct 19 06:54:31.646925 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 651/1302] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:31.683190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:31.689036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:31.707208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:31.707925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:31.709323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:31.714871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:31.716725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:31.717740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:31.720242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:31.720932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:31.758247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:31.758752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:31.766963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:31.768039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:31.770434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:31.773320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:32.167212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:32.190018 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc3998ad-1c55-4bba-8abd-504e92406fcd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.524965 Oct 19 06:54:32.190970 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 652/1303] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:31 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:32.219755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:32.219755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:32.238717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:32.239460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:32.241225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:32.242145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:32.242788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:32.243228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:32.325925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:54:32.393949 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-226da707-b5dc-4f67-a1d3-4eb48b922960 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 2424 microversion: 2.25 time: 0.746633 Oct 19 06:54:32.416834 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 652/1304] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:31 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 2424 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:54:32.429350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ddc0812-519b-4164-9045-ad998cd63025 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:32.437980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ddc0812-519b-4164-9045-ad998cd63025 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:32.485088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:32.498365 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19d58602-2e03-421c-92f8-232a70125b3a tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1276 microversion: 2.1 time: 0.299941 Oct 19 06:54:32.502347 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 653/1305] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:32 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1276 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:32.511799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:32.517224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:32.540564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:32.545469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:32.547547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:32.553989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:32.556239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:32.561501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:32.624154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ddc0812-519b-4164-9045-ad998cd63025 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:32.639331 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ddc0812-519b-4164-9045-ad998cd63025 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1217 microversion: 2.1 time: 0.214182 Oct 19 06:54:32.639914 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 653/1306] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:32 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:32.678538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-10", "block_migration": "auto"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:32.693060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:32.705415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:54:32.716191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:32.716996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:32.732219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:32.738001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:32.739860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:32.740351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:32.832366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'flavor' on Instance uuid 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:54:32.862505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:32.902006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Going to try to live migrate instance to n-h2-861333-10 {{(pid=127568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 06:54:33.287509 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c950a43d-6c34-4f93-9149-bf9b75039a07 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 204 len: 0 microversion: 2.1 time: 0.783078 Oct 19 06:54:33.306160 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 654/1307] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:54:32 2022] DELETE /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:54:33.316585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:33.317417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:33.367606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:33.372003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:33.372891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:33.376924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:33.377411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:33.383086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:34.340858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:34.357983 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-edc5074c-40cc-4a0a-94ac-e6854e400a2c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1469 microversion: 2.1 time: 1.062844 Oct 19 06:54:34.381202 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 655/1308] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:33 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1469 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:34.398988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:34.405542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:34.425681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:34.431075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:34.432392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:34.438839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:34.445491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:34.446210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:34.958065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:34.976441 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-202efaa7-8900-44d8-b8a3-6834da8dff7f tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1368 microversion: 2.1 time: 0.591119 Oct 19 06:54:34.977938 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 656/1309] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:34 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1368 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:34.984942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:34.989314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:35.005610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:35.006478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:35.007105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:35.008056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:35.011084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:35.011735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:36.331358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:36.340665 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fadfa239-484e-4790-ab94-cfdf40f2ae18 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 1.361551 Oct 19 06:54:36.356984 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 657/1310] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:34 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:36.372998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:36.374217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:36.399553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:36.401738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:36.402692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:36.404809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:36.412554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:36.413391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:36.746285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:36.759011 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2325527-5796-41bd-bd0b-da5197f7834d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1324 microversion: 2.1 time: 0.399639 Oct 19 06:54:36.768133 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 658/1311] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:36 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:36.774156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:36.775640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:36.799281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:36.801429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:36.803212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:36.804661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:36.806891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:36.810070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:37.043163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:37.076529 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d8eb064-ffdf-4efc-9513-2e3782d52826 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1275 microversion: 2.1 time: 0.308789 Oct 19 06:54:37.084083 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 659/1312] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:36 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1275 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:37.112156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1189110362", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:37.249938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] validate_networks() for [('e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:54:38.321860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:38.885324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:39.164544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:54:39.168874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:54:39.168874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:54:39.168874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:54:39.168874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:54:39.179791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:39.180829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:39.181379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:39.182285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:39.182878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:39.184017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:39.253165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:54:39.268642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for user f5b2575fb29940ab95fc8bb9dd177dd9 and project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:54:39.303946 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-548db2c1-afff-4806-bb82-e82bbfbb96f2 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/action" status: 202 len: 0 microversion: 2.25 time: 6.651149 Oct 19 06:54:39.303946 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 654/1313] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:54:32 2022] POST /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/action => generated 0 bytes in 6653 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:54:39.303946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7ef22cc6-9113-4763-a875-9f38afaf628d req-d78cbcc3-ac82-459a-98ba-42f0f99d0798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5584f2a-692a-4897-b1af-adeb2bdcbf4c", "name": "network-vif-unplugged", "status": "completed", "tag": "dda422b3-ebf6-4a1e-af02-8af8b5ee4816"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:39.304649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:54:39.307271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:54:39.333836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=78 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:39.336458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7ef22cc6-9113-4763-a875-9f38afaf628d req-d78cbcc3-ac82-459a-98ba-42f0f99d0798 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:39.337524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7ef22cc6-9113-4763-a875-9f38afaf628d req-d78cbcc3-ac82-459a-98ba-42f0f99d0798 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:39.338878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7ef22cc6-9113-4763-a875-9f38afaf628d req-d78cbcc3-ac82-459a-98ba-42f0f99d0798 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:39.401439 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7ef22cc6-9113-4763-a875-9f38afaf628d req-d78cbcc3-ac82-459a-98ba-42f0f99d0798 service nova] Creating event network-vif-unplugged:dda422b3-ebf6-4a1e-af02-8af8b5ee4816 for instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c on n-h1-861333-10 Oct 19 06:54:39.426736 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7ef22cc6-9113-4763-a875-9f38afaf628d req-d78cbcc3-ac82-459a-98ba-42f0f99d0798 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132112 Oct 19 06:54:39.459449 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 655/1314] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:39.510921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:39.513057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:39.524963 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5290331-2d18-4aed-9675-7d9d8ad566d8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.432950 Oct 19 06:54:39.538235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:39.539282 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 660/1315] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:54:39.543282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:39.549129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:39.551075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:39.551890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:39.552670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:39.553032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:39.553292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:39.589769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:39.590494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:39.591153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:39.593410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:39.595336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:39.596494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:39.931107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:40.148003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:40.168738 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45f57871-96c6-4a7c-88b4-97061a27d41e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1474 microversion: 2.1 time: 0.696020 Oct 19 06:54:40.168738 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 656/1316] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:39 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1474 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:40.198487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:40.203346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:40.253174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:40.258150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:40.258647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:40.259410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:40.264833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:40.267959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:40.483886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:40.493023 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd144ef2-0437-4018-b146-258253322a72 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1558 microversion: 2.1 time: 0.952364 Oct 19 06:54:40.493911 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 661/1317] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:39 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1558 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:40.530393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:40.532591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:40.558107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:40.560532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:40.564376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:40.566288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:40.567021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:40.572720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:40.678320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:40.689465 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ec91960-baf6-434c-9812-bb88982c2c10 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.522980 Oct 19 06:54:40.694038 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 657/1318] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:40 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:40.699505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:40.701457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:40.709356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:40.713781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:40.713781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:40.713781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:40.713781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:40.713781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:40.886021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:40.900989 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c24d59a9-5f78-4338-8be8-f33cdf610bfa tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1317 microversion: 2.1 time: 0.199352 Oct 19 06:54:40.901776 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 658/1319] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:40 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:40.912290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5b31d434-ad12-4400-be40-c069565295ad req-eef5cf24-ff59-4230-8e29-6decee8860f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5584f2a-692a-4897-b1af-adeb2bdcbf4c", "name": "network-vif-deleted", "tag": "dda422b3-ebf6-4a1e-af02-8af8b5ee4816"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:40.933308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5b31d434-ad12-4400-be40-c069565295ad req-eef5cf24-ff59-4230-8e29-6decee8860f8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:40.933308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5b31d434-ad12-4400-be40-c069565295ad req-eef5cf24-ff59-4230-8e29-6decee8860f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:40.933308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5b31d434-ad12-4400-be40-c069565295ad req-eef5cf24-ff59-4230-8e29-6decee8860f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:40.941332 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5b31d434-ad12-4400-be40-c069565295ad req-eef5cf24-ff59-4230-8e29-6decee8860f8 service nova] Creating event network-vif-deleted:dda422b3-ebf6-4a1e-af02-8af8b5ee4816 for instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c on n-h1-861333-10 Oct 19 06:54:40.960382 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5b31d434-ad12-4400-be40-c069565295ad req-eef5cf24-ff59-4230-8e29-6decee8860f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056843 Oct 19 06:54:40.960999 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 659/1320] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:40.966376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e6c82027-e294-4e4c-b105-43740f7ef8f7 req-5820d21d-42ca-49b6-9c14-1534b3cab8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c", "tag": "151f65d0-8d84-4554-afad-3126bb1f00fb"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:40.983552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e6c82027-e294-4e4c-b105-43740f7ef8f7 req-5820d21d-42ca-49b6-9c14-1534b3cab8e6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:40.984420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e6c82027-e294-4e4c-b105-43740f7ef8f7 req-5820d21d-42ca-49b6-9c14-1534b3cab8e6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:40.985128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e6c82027-e294-4e4c-b105-43740f7ef8f7 req-5820d21d-42ca-49b6-9c14-1534b3cab8e6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.007376 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e6c82027-e294-4e4c-b105-43740f7ef8f7 req-5820d21d-42ca-49b6-9c14-1534b3cab8e6 service nova] Creating event network-changed:151f65d0-8d84-4554-afad-3126bb1f00fb for instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c on n-h2-861333-10 Oct 19 06:54:41.013061 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e6c82027-e294-4e4c-b105-43740f7ef8f7 req-5820d21d-42ca-49b6-9c14-1534b3cab8e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050482 Oct 19 06:54:41.013923 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 660/1321] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:41.025676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:41.026667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:41.034795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:41.035578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.036260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.036707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.037449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.037910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.038334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.053104 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8dc0fbb-d0be-4259-b13c-2e7526a772b9 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1324 microversion: 2.1 time: 0.557724 Oct 19 06:54:41.064760 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 662/1322] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:40 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1324 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:41.064760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5373675d-c56e-4ea7-a3a8-8f2157a6cb92 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:41.064760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5373675d-c56e-4ea7-a3a8-8f2157a6cb92 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:41.128464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5373675d-c56e-4ea7-a3a8-8f2157a6cb92 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:41.136343 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5373675d-c56e-4ea7-a3a8-8f2157a6cb92 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1208 microversion: 2.1 time: 0.079560 Oct 19 06:54:41.137671 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 663/1323] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:41 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:41.143179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7233128-0684-48c7-a739-b420346fb062 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:41.143671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7233128-0684-48c7-a739-b420346fb062 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:41.158048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7233128-0684-48c7-a739-b420346fb062 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.158950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7233128-0684-48c7-a739-b420346fb062 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.159648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7233128-0684-48c7-a739-b420346fb062 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.160677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7233128-0684-48c7-a739-b420346fb062 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.161474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7233128-0684-48c7-a739-b420346fb062 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.162141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7233128-0684-48c7-a739-b420346fb062 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.201131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:41.211118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:41.212620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:41.213799 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a8c3b44-b781-48a4-9b08-c8119d39e12f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.192908 Oct 19 06:54:41.219438 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 661/1324] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:41 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:54:41.222035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:41.222657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:41.231848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.231848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.231848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.231848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.231848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.231848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.298027 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7233128-0684-48c7-a739-b420346fb062 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158437 Oct 19 06:54:41.298746 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 664/1325] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 06:54:41 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:41.423960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:41.435247 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c744aaa0-404a-4c5a-8e04-57a3e638b447 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1474 microversion: 2.1 time: 0.219626 Oct 19 06:54:41.444587 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 662/1326] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:41 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1474 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:41.729917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:41.730644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:41.741770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.747053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.747877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.748894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.749725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.750544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.936210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:41.938352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:41.946272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.947029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.947900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:41.949368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:41.949989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:41.951605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:42.363204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:42.389042 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba29e90e-57bd-4d20-b0c7-f697ba4c3978 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.662879 Oct 19 06:54:42.395600 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 665/1327] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:41 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:42.402521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:42.408459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:42.417969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:42.420210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:42.424744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:42.436773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:42.437520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:42.438657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:42.482095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:42.494681 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-430e0900-9357-436c-b7db-73f3aad1765c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1317 microversion: 2.1 time: 0.565908 Oct 19 06:54:42.495601 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 663/1328] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:41 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:42.510878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:42.511664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:42.530694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:42.531900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:42.533638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:42.535162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:42.539325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:42.540375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:42.596435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:42.640037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:42.742255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:42.757226 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69905b2e-4473-47d5-89c5-69ce5581b039 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1260 microversion: 2.1 time: 0.257428 Oct 19 06:54:42.757881 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 664/1329] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:42 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:42.773585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:42.774072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:42.790233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:42.790870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:42.791524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:42.792643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:42.794594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:42.796521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:43.471944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:43.478804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:43.479249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:43.480612 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8efe8ac-e891-473b-843e-9cf91c814bb4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.721778 Oct 19 06:54:43.489877 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 665/1330] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:42 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:54:43.502531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:43.503434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:43.514038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:43.521416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:43.522105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:43.523046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:43.523716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:43.524364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:43.694062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:43.716229 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33095ea6-f3a2-4a14-bd6b-2787492d6daf tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1324 microversion: 2.1 time: 1.316391 Oct 19 06:54:43.726482 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 666/1331] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:42 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1324 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:43.757995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5fb1275a-9278-479a-a8b9-8ea3e6cb58b5 req-892997fb-6275-4a84-bd6d-54456ce244fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c92b51c-7d82-44ed-81ff-fefbab541406", "tag": "a0b47758-23a8-44ef-84c0-617e5de683a7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:43.789717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5fb1275a-9278-479a-a8b9-8ea3e6cb58b5 req-892997fb-6275-4a84-bd6d-54456ce244fe service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:43.798628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5fb1275a-9278-479a-a8b9-8ea3e6cb58b5 req-892997fb-6275-4a84-bd6d-54456ce244fe service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:43.799209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5fb1275a-9278-479a-a8b9-8ea3e6cb58b5 req-892997fb-6275-4a84-bd6d-54456ce244fe service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:43.823845 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5fb1275a-9278-479a-a8b9-8ea3e6cb58b5 req-892997fb-6275-4a84-bd6d-54456ce244fe service nova] Creating event network-changed:a0b47758-23a8-44ef-84c0-617e5de683a7 for instance 4c92b51c-7d82-44ed-81ff-fefbab541406 on n-h2-861333-10 Oct 19 06:54:43.843056 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5fb1275a-9278-479a-a8b9-8ea3e6cb58b5 req-892997fb-6275-4a84-bd6d-54456ce244fe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113403 Oct 19 06:54:43.844877 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 667/1332] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:43.856165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:43.857187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:43.871919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:43.872738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:43.879414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:43.879414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:43.879414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:43.879414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:43.954224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:44.013742 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c543299c-d4ff-4ffc-9755-61297c7389d4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1474 microversion: 2.1 time: 0.522351 Oct 19 06:54:44.014687 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 666/1333] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:43 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1474 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:44.039348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:44.039348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:44.042997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:44.043518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:44.044027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:44.044997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:44.045491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:44.045857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:44.319542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:44.330633 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b0d14a0-7de5-4d76-a582-a388b6d4d0ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1317 microversion: 2.1 time: 0.312974 Oct 19 06:54:44.335648 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 667/1334] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:44 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:44.342580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:44.343185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:44.362886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:44.363382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:44.363822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:44.364584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:44.369693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:44.369938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:44.452128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:44.464245 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0225f61d-b982-4437-91ab-6e17c3b67be6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1266 microversion: 2.1 time: 0.126697 Oct 19 06:54:44.465275 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 668/1335] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:44 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:44.484078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:44.498382 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0969813-3cb6-4a4f-8492-6cc8ed076be0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.651431 Oct 19 06:54:44.499046 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 668/1336] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:43 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:44.528778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:44.529496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:44.539650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:44.542037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:44.545251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:44.552339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:44.552339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:44.552339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:44.646082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-fb8f0e53-d65d-40e9-874c-51e07e16c67b req-6081fde7-6a91-4b49-ac84-11d11442216c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c", "name": "network-vif-plugged", "status": "completed", "tag": "151f65d0-8d84-4554-afad-3126bb1f00fb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:44.658765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fb8f0e53-d65d-40e9-874c-51e07e16c67b req-6081fde7-6a91-4b49-ac84-11d11442216c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:44.659259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fb8f0e53-d65d-40e9-874c-51e07e16c67b req-6081fde7-6a91-4b49-ac84-11d11442216c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:44.659701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fb8f0e53-d65d-40e9-874c-51e07e16c67b req-6081fde7-6a91-4b49-ac84-11d11442216c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:44.676738 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-fb8f0e53-d65d-40e9-874c-51e07e16c67b req-6081fde7-6a91-4b49-ac84-11d11442216c service nova] Creating event network-vif-plugged:151f65d0-8d84-4554-afad-3126bb1f00fb for instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c on n-h2-861333-10 Oct 19 06:54:44.683025 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-fb8f0e53-d65d-40e9-874c-51e07e16c67b req-6081fde7-6a91-4b49-ac84-11d11442216c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040560 Oct 19 06:54:44.687273 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 669/1337] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:44.755050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:44.756360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:44.772975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:44.774478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:44.775268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:44.776195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:44.776837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:44.777430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:45.136952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:45.154068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:45.155559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:45.165883 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc1e12ae-6ef1-4747-85cf-878540689b0e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.642228 Oct 19 06:54:45.190206 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 669/1338] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:44 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:54:45.194801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:45.195427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:45.215385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:45.215841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:45.216467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:45.217188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:45.217642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:45.218073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:45.507728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:45.525105 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5951de8a-a523-436d-a486-fb2cad4346c5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1324 microversion: 2.1 time: 0.780238 Oct 19 06:54:45.526188 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 670/1339] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:44 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1324 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:45.537120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:45.542320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:45.555330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:45.556749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:45.560920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:45.561950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:45.562645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:45.563858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:45.682817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:45.693808 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f740cdd3-db49-4418-9116-6c80af99d90c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1474 microversion: 2.1 time: 0.515614 Oct 19 06:54:45.694428 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 670/1340] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:45 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1474 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:45.731781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:45.732511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:45.755553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:45.756056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:45.756520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:45.765281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:45.770191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:45.779191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:46.167830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:46.179211 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35b52e04-83a1-426e-8fa2-fd1144252718 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1317 microversion: 2.1 time: 0.650267 Oct 19 06:54:46.184094 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 671/1341] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:45 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:46.195474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:46.198519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:46.227498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:46.231236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:46.232083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:46.233493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:46.237527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:46.238209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:46.482920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:46.492466 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4702233-de4f-4c79-a083-9fe2de1a70b4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1308 microversion: 2.1 time: 0.777234 Oct 19 06:54:46.493046 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 671/1342] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:45 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1308 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:46.515168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5933f941-59d4-4473-bfd1-3877bb9695da req-5a4c5ce5-dff3-4f97-997a-ba7fcb5b4a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d231a12d-b118-41ec-b9e2-f987bea670ba", "name": "network-vif-unplugged", "status": "completed", "tag": "f66ec07e-1db7-450e-9282-9e31fda912b1"}, {"name": "network-changed", "server_uuid": "05c7927e-9e6e-4edc-acb0-6fc27121aafd", "tag": "95a34e28-71ae-49ac-8e7a-3699806f8abd"}, {"name": "network-changed", "server_uuid": "d231a12d-b118-41ec-b9e2-f987bea670ba", "tag": "f66ec07e-1db7-450e-9282-9e31fda912b1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:46.557806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5933f941-59d4-4473-bfd1-3877bb9695da req-5a4c5ce5-dff3-4f97-997a-ba7fcb5b4a73 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:46.559335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5933f941-59d4-4473-bfd1-3877bb9695da req-5a4c5ce5-dff3-4f97-997a-ba7fcb5b4a73 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:46.561027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5933f941-59d4-4473-bfd1-3877bb9695da req-5a4c5ce5-dff3-4f97-997a-ba7fcb5b4a73 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:46.611285 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5933f941-59d4-4473-bfd1-3877bb9695da req-5a4c5ce5-dff3-4f97-997a-ba7fcb5b4a73 service nova] Creating event network-vif-unplugged:f66ec07e-1db7-450e-9282-9e31fda912b1 for instance d231a12d-b118-41ec-b9e2-f987bea670ba on n-h2-861333-10 Oct 19 06:54:46.611810 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5933f941-59d4-4473-bfd1-3877bb9695da req-5a4c5ce5-dff3-4f97-997a-ba7fcb5b4a73 service nova] Creating event network-changed:95a34e28-71ae-49ac-8e7a-3699806f8abd for instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd on n-h1-861333-10 Oct 19 06:54:46.612639 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5933f941-59d4-4473-bfd1-3877bb9695da req-5a4c5ce5-dff3-4f97-997a-ba7fcb5b4a73 service nova] Creating event network-changed:f66ec07e-1db7-450e-9282-9e31fda912b1 for instance d231a12d-b118-41ec-b9e2-f987bea670ba on n-h2-861333-10 Oct 19 06:54:46.642354 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5933f941-59d4-4473-bfd1-3877bb9695da req-5a4c5ce5-dff3-4f97-997a-ba7fcb5b4a73 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.144872 Oct 19 06:54:46.646812 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 672/1343] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:46.668318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:46.669574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:46.682404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:46.691528 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88495c69-39b5-4858-b554-860a5997845c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.506115 Oct 19 06:54:46.693531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:46.698424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:46.699085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:46.699917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:46.702091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:46.703486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:46.718234 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 672/1344] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:46 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:46.731138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:46.736016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:46.743783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:46.747825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:46.752702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:46.753692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:46.754358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:46.754956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:47.225884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:47.246741 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c4322c5-5f52-4f30-8b19-408b19c36f2b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1324 microversion: 2.1 time: 0.526742 Oct 19 06:54:47.247240 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 673/1345] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:46 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:47.257605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:47.258282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:47.289901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:47.291190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:47.294197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:47.296966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:47.298138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:47.303114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:47.314145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:47.628875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:47.644404 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c916eee4-eb6e-4a65-9fd4-fa87e045b1e1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1474 microversion: 2.1 time: 0.396042 Oct 19 06:54:47.645002 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 674/1346] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:47 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1474 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:47.652822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:47.653686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:47.671145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:47.676056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:47.676802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:47.677739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:47.678630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:47.679228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:47.924348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:47.937174 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9503fda1-f496-44a7-bd81-c588c7ae614c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1507 microversion: 2.1 time: 0.291097 Oct 19 06:54:47.960612 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 675/1347] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:47 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1507 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:47.966488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:47.968074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:47.981893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:47.982963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:47.983870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:47.985399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:47.985982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:47.986730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.256515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:48.273333 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ecd92315-36d6-4d54-8d53-23bd02b70318 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1308 microversion: 2.1 time: 0.306028 Oct 19 06:54:48.273333 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 676/1348] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:47 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:48.274274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:48.275537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:48.278150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:48.283219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.283976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.285445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.286371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.287061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.287729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.292197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:48.293887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:48.295182 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3690e245-781d-4290-9f94-284ca9b649cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 1.646773 Oct 19 06:54:48.312335 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 673/1349] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:46 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:54:48.312335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:48.312335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:48.323934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.324465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.324903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.325622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.326077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.328896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.486851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:48.500707 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81d9d19d-1c6b-4cd6-af1e-8a19281b1f8d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.229692 Oct 19 06:54:48.501884 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 677/1350] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:48 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:48.507722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:48.512295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:48.522949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.523426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.534352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.535183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.535667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.536127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.742179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:48.757804 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afbe136e-f6a8-46fa-b597-9f92754164d8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1324 microversion: 2.1 time: 0.254375 Oct 19 06:54:48.775211 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 678/1351] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:48 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:48.782460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:48.782460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:48.788128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.788832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.789894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.790706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.792548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.792966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.838494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:48.850105 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a5ace84-62de-49eb-9f6f-90da1efd8541 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1507 microversion: 2.1 time: 0.550947 Oct 19 06:54:48.851365 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 674/1352] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:48 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:48.880393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:48.886301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:48.905230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.905761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.908786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:48.913817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:48.914321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:48.914773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.103780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:49.113395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c425515d-fd9a-46c9-8d5d-caaa7e06af7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1474 microversion: 2.1 time: 0.336883 Oct 19 06:54:49.124818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:54:49.125934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:54:49.126564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:54:49.127323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:54:49.127896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:54:49.130586 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 679/1353] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:48 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1474 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:49.135927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b239a195-ac6c-453f-8064-e9f9e93eaafd req-06e5d8a4-5737-4080-a71f-1045fe8d74ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e405aee-9ae5-4c1c-a013-11fb09e48684", "tag": "28594c96-ab77-4afe-9c36-c33388040c61"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:49.146452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:49.148735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b239a195-ac6c-453f-8064-e9f9e93eaafd req-06e5d8a4-5737-4080-a71f-1045fe8d74ca service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.149290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b239a195-ac6c-453f-8064-e9f9e93eaafd req-06e5d8a4-5737-4080-a71f-1045fe8d74ca service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.149936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b239a195-ac6c-453f-8064-e9f9e93eaafd req-06e5d8a4-5737-4080-a71f-1045fe8d74ca service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.173474 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b239a195-ac6c-453f-8064-e9f9e93eaafd req-06e5d8a4-5737-4080-a71f-1045fe8d74ca service nova] Creating event network-changed:28594c96-ab77-4afe-9c36-c33388040c61 for instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 on n-h1-861333-10 Oct 19 06:54:49.173642 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b239a195-ac6c-453f-8064-e9f9e93eaafd req-06e5d8a4-5737-4080-a71f-1045fe8d74ca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041647 Oct 19 06:54:49.174398 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 680/1354] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:49.302352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:49.305123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:49.321072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:49.330711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.331488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.332458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.333373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.336603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.337264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.465116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:49.511911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:49.514728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.516814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.520178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.522191 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ab41aa1-da5f-4a9b-8364-3e1f8f1c3fa0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1308 microversion: 2.1 time: 0.229847 Oct 19 06:54:49.523526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.526225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.528294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.529208 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 681/1355] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:49 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1308 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:49.534773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:49.544955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:49.554240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.555847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.556548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.557521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.558229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.559690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.589473 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dfaa0b2d-4845-4f97-8ae1-1b716479a6da tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "POST /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c/action" status: 202 len: 1109 microversion: 2.1 time: 0.712785 Oct 19 06:54:49.590681 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 675/1356] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:54:48 2022] POST /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c/action => generated 1109 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 06:54:49.613573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7fc16ad3-6c7c-47da-b72c-6f62d7fbfeff req-5d6819d4-fd16-49a8-9d21-a11189ada87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c92b51c-7d82-44ed-81ff-fefbab541406", "name": "network-vif-plugged", "status": "completed", "tag": "a0b47758-23a8-44ef-84c0-617e5de683a7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:49.646422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7fc16ad3-6c7c-47da-b72c-6f62d7fbfeff req-5d6819d4-fd16-49a8-9d21-a11189ada87d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.646958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7fc16ad3-6c7c-47da-b72c-6f62d7fbfeff req-5d6819d4-fd16-49a8-9d21-a11189ada87d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.647362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7fc16ad3-6c7c-47da-b72c-6f62d7fbfeff req-5d6819d4-fd16-49a8-9d21-a11189ada87d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.678382 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7fc16ad3-6c7c-47da-b72c-6f62d7fbfeff req-5d6819d4-fd16-49a8-9d21-a11189ada87d service nova] Creating event network-vif-plugged:a0b47758-23a8-44ef-84c0-617e5de683a7 for instance 4c92b51c-7d82-44ed-81ff-fefbab541406 on n-h2-861333-10 Oct 19 06:54:49.684785 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7fc16ad3-6c7c-47da-b72c-6f62d7fbfeff req-5d6819d4-fd16-49a8-9d21-a11189ada87d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089908 Oct 19 06:54:49.685981 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 676/1357] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:49.695161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:49.696140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:49.702901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.704194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.704982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.705909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.706527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.707325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.791355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:49.802096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:49.816370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:49.818014 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1732dca0-a986-42e6-bbfc-4d46f484b6d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.287609 Oct 19 06:54:49.818770 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 682/1358] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:49 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:54:49.823426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:49.824021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:49.839534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.840039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.840520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:49.844783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:49.844783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:49.844783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:50.105076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:50.118481 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-80936047-abb3-4496-b62f-eda7e12dc2f7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.428504 Oct 19 06:54:50.121673 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 677/1359] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:49 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:50.134331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:50.136288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:50.151354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:50.153881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:50.154508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:50.155393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:50.160408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:50.164018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:50.174969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:50.184942 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-25612e2b-4c25-48e8-bd1d-fe78c08cc3b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.364975 Oct 19 06:54:50.186019 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 683/1360] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:49 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:50.191141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:50.191922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:50.197973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:50.202372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:50.202372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:50.202372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:50.202372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:50.202372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:50.396629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:50.405590 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c4add4e-b635-4cf7-8a38-201e5ae5bbf6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1474 microversion: 2.1 time: 0.218390 Oct 19 06:54:50.408033 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 684/1361] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:50 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1474 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:50.445875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:50.454201 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af313676-42ec-4300-8dcd-6e2f96aed188 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1324 microversion: 2.1 time: 0.329678 Oct 19 06:54:50.454764 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 678/1362] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:50 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:50.546641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:50.548480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:50.560601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:50.561377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:50.561818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:50.562757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:50.563922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:50.564384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:50.714483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:50.728253 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-444e0cc1-ad5b-4468-9dc8-37cd53a1c95f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1308 microversion: 2.1 time: 0.184235 Oct 19 06:54:50.729479 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 685/1363] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:50 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:50.845422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:50.846098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:50.855943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:50.856978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:50.857645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:50.858358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:50.858813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:50.859238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.012321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:51.024919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:51.026872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:51.028343 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a08c3b9e-81e8-4ecd-ac79-016fc42130bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.187569 Oct 19 06:54:51.028906 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 679/1364] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:50 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:54:51.145121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:51.145735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:51.147649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:51.153098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.153590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.154027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.154766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.155254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.155685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.217909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:51.218529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:51.226230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.227581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.228237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.316185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.316185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.316185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.316185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:51.564954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:51.587847 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-803f0cde-0821-4a43-8edf-ad3d8d352659 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.376658 Oct 19 06:54:51.589027 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 680/1365] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:51 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:51.597645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:51.600820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:51.613839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.615381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:51.616428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.618323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.619220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.621800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.622489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.634549 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d330f2bf-8122-4faf-981f-281091e50e5c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.492043 Oct 19 06:54:51.635159 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 686/1366] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:51 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:51.647636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:51.654158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:51.666084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.666594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.667048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.669643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.671874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.672697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.958970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:51.966636 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f96a6d7-8d57-4367-8f32-38e644e001e4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1324 microversion: 2.1 time: 0.330444 Oct 19 06:54:51.967205 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 687/1367] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:51 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:51.975762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:51.976400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:51.991433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.991930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.992429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:51.993163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:51.993912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:51.994016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:52.012492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:52.028143 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d54a9dd-968e-42d2-8524-8f893f18a02a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1474 microversion: 2.1 time: 0.437466 Oct 19 06:54:52.030465 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 681/1368] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:51 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1474 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:52.059970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:52.060844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:52.070083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:52.070944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:52.071599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:52.072662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:52.073364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:52.073999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:52.220185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:52.239447 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36e400ac-2772-4f61-9865-b2201118ac9b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1308 microversion: 2.1 time: 0.271191 Oct 19 06:54:52.241917 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 688/1369] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:51 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:52.611997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:52.612901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:52.630095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:52.630756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:52.631016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:52.631760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:52.632253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:52.640089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:52.666982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:52.676945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:52.678621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:52.680037 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71c3cafe-31d7-4854-809f-b75b2a733d8d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.624076 Oct 19 06:54:52.681130 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 682/1370] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:52 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:54:52.686149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:52.687142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:52.694004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:52.694684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:52.695287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:52.696445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:52.696874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:52.697468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:52.935838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:52.947702 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd22be21-9a2e-4a7d-834d-d87660ac8577 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.340710 Oct 19 06:54:52.948536 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 689/1371] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:52 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:52.979191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:53.002200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:53.002826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:53.008893 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b0ba7cf-42da-4c9a-86a8-cc2e7bbb3bf8 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.326425 Oct 19 06:54:53.014667 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 683/1372] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:52 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:53.027729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:53.028963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:53.031431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:53.035788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:53.035788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:53.035788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:53.062454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:53.063846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:53.070837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:53.071329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:53.071764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:53.089138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:53.094609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:53.095392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:53.253446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:53.261781 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06ab334a-3f06-4664-9a23-ad63704211c0 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1521 microversion: 2.1 time: 0.273598 Oct 19 06:54:53.269053 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 690/1373] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:52 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:53.300290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:53.300966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:53.308790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:53.309471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:53.314747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:53.315764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:53.316539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:53.317137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:53.337320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:53.501274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:53.514075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:53.520354 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-423619e8-eb9f-4e1b-81b0-7008f5accfbf tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1308 microversion: 2.1 time: 0.249322 Oct 19 06:54:53.527226 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 691/1374] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:53 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1308 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:53.528875 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20b43d70-db54-4090-8ecf-58d5b68db976 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1473 microversion: 2.1 time: 0.468493 Oct 19 06:54:53.530595 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 684/1375] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:53 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1473 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:54:53.535817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10939172-a45a-45dc-8434-f4db45065efe tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Action: 'create', calling method: .version_select at 0x7f6d648cab80>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:53.712363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:53.713090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:53.723175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:53.724653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:53.725899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:53.729191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:53.729827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:53.730718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:54.168324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:54.178363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:54.179815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:54.187039 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e440279-57ae-446a-8b26-cc0e1e0293d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.479474 Oct 19 06:54:54.188685 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 685/1376] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:53 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:54:54.197363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:54.202312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:54.215897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:54.217938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:54.218436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:54.222935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:54.223582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:54.224045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:54.552708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:54.570363 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ef4bf98-0fd7-4d7b-a7a5-c7879c6dbf02 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.379180 Oct 19 06:54:54.572778 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 686/1377] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:54 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:54.583424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-bf7d0d63-c090-498a-91d1-a9b2506424a4 req-a6d4ef72-b38d-4d63-a2cb-5186e7e86b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1879dd80-bc43-4b3b-bf52-85a4745444fa", "name": "network-vif-unplugged", "status": "completed", "tag": "4a79685b-a244-4153-b0c2-b8a3f4fe3abc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:54.637200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bf7d0d63-c090-498a-91d1-a9b2506424a4 req-a6d4ef72-b38d-4d63-a2cb-5186e7e86b29 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:54.638917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bf7d0d63-c090-498a-91d1-a9b2506424a4 req-a6d4ef72-b38d-4d63-a2cb-5186e7e86b29 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:54.639382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bf7d0d63-c090-498a-91d1-a9b2506424a4 req-a6d4ef72-b38d-4d63-a2cb-5186e7e86b29 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:54.668284 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-bf7d0d63-c090-498a-91d1-a9b2506424a4 req-a6d4ef72-b38d-4d63-a2cb-5186e7e86b29 service nova] Creating event network-vif-unplugged:4a79685b-a244-4153-b0c2-b8a3f4fe3abc for instance 1879dd80-bc43-4b3b-bf52-85a4745444fa on n-h1-861333-10 Oct 19 06:54:54.688984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-bf7d0d63-c090-498a-91d1-a9b2506424a4 req-a6d4ef72-b38d-4d63-a2cb-5186e7e86b29 service nova] Instance 1879dd80-bc43-4b3b-bf52-85a4745444fa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:54:54.703053 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-bf7d0d63-c090-498a-91d1-a9b2506424a4 req-a6d4ef72-b38d-4d63-a2cb-5186e7e86b29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128511 Oct 19 06:54:54.706423 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 687/1378] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:54.710602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:54.711156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:54.718406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:54.718980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:54.719301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:54.720275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:54.720741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:54.721181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:55.262995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:55.289038 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eac208b1-6cd7-41d4-acf2-e35607dcc86d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.583171 Oct 19 06:54:55.289642 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 688/1379] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:54 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:55.334528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-81a29e5c-91bc-449c-afa4-14c68daa5a56 req-e246d963-1afa-458c-9f47-a7de2e4e7a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e405aee-9ae5-4c1c-a013-11fb09e48684", "name": "network-vif-plugged", "status": "completed", "tag": "28594c96-ab77-4afe-9c36-c33388040c61"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:55.348588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-81a29e5c-91bc-449c-afa4-14c68daa5a56 req-e246d963-1afa-458c-9f47-a7de2e4e7a63 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:55.349074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-81a29e5c-91bc-449c-afa4-14c68daa5a56 req-e246d963-1afa-458c-9f47-a7de2e4e7a63 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:55.349512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-81a29e5c-91bc-449c-afa4-14c68daa5a56 req-e246d963-1afa-458c-9f47-a7de2e4e7a63 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:55.378151 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-81a29e5c-91bc-449c-afa4-14c68daa5a56 req-e246d963-1afa-458c-9f47-a7de2e4e7a63 service nova] Creating event network-vif-plugged:28594c96-ab77-4afe-9c36-c33388040c61 for instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 on n-h1-861333-10 Oct 19 06:54:55.393703 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-81a29e5c-91bc-449c-afa4-14c68daa5a56 req-e246d963-1afa-458c-9f47-a7de2e4e7a63 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079184 Oct 19 06:54:55.394757 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 689/1380] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:55.416450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:55.417167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:55.439781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:55.440263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:55.441933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:55.442675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:55.443760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:55.444271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:55.763940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:55.780356 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-553a0a42-1bb0-4e95-9291-9450b97d9531 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1308 microversion: 2.1 time: 0.382985 Oct 19 06:54:55.781631 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 690/1381] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:55 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:55.792785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:55.793417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:55.805054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:55.805549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:55.808505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:55.810394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:55.810890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:55.811330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:56.081638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:56.092114 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf061ba1-85a0-4c67-83e0-1325652897a2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1473 microversion: 2.1 time: 0.309612 Oct 19 06:54:56.095834 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 691/1382] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:55 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1473 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:56.104978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:56.105868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:56.113185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:56.113889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:56.114996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:56.115883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:56.116524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:56.117104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:56.270570 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10939172-a45a-45dc-8434-f4db45065efe tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.740455 Oct 19 06:54:56.271589 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 692/1383] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 06:54:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:56.276362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:56.277215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:56.292056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:56.292685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:56.294155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:56.295138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:56.297938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:56.298647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:56.383405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:56.396772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:56.398228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:56.399429 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bebe0653-cd27-4495-a90b-a61ec5e1b94b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.302371 Oct 19 06:54:56.408983 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 692/1384] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:56 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:54:56.408983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:56.408983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:56.418190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:56.418190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:56.418459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:56.419558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:56.423672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:56.423672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:56.494547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:56.505288 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca08a007-1972-45d0-89b7-79c9e5cb9abe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.232311 Oct 19 06:54:56.505869 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 693/1385] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:56 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:56.524185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1893752539", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "77fecbf9-0d41-4410-ad8b-4a1893b4dd94"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:56.603126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] validate_networks() for [('77fecbf9-0d41-4410-ad8b-4a1893b4dd94', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:54:57.033284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:57.042066 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0188451a-a104-48bf-9244-10a086a94350 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.638382 Oct 19 06:54:57.042934 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 693/1386] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:56 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:57.044666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:54:57.045239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:54:57.045722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:54:57.046303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:54:57.046724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:54:57.049746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:57.050616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:57.057690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.057994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.058168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.058803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.058935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.059448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.059856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.060349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.060479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.060775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.061301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.061945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.078762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Getting quotas for project 4248165058874e81a53cbcd2f194a649. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:54:57.085909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Getting quotas for user 6598d68715524f40aa57fb25b378fb17 and project 4248165058874e81a53cbcd2f194a649. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:54:57.106001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:54:57.106001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:54:57.246693 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afebf771-908a-4074-8643-13f35f50faeb tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732000 Oct 19 06:54:57.247753 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 694/1387] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:54:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:54:57.266034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:57.274333 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e85b2d93-3816-4050-b5cb-7552ef56195d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1308 microversion: 2.1 time: 0.230125 Oct 19 06:54:57.294097 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 694/1388] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:57 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:57.305188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:57.305812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:57.328995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.330783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.331400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.333484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.334470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.337045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.351356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5036b31d-faa1-4533-850d-59d81873dd56 req-78f42193-12c6-416f-b8a1-5968ed126775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1879dd80-bc43-4b3b-bf52-85a4745444fa", "tag": "4a79685b-a244-4153-b0c2-b8a3f4fe3abc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:57.381885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5036b31d-faa1-4533-850d-59d81873dd56 req-78f42193-12c6-416f-b8a1-5968ed126775 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.383551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5036b31d-faa1-4533-850d-59d81873dd56 req-78f42193-12c6-416f-b8a1-5968ed126775 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.384251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5036b31d-faa1-4533-850d-59d81873dd56 req-78f42193-12c6-416f-b8a1-5968ed126775 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.409839 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5036b31d-faa1-4533-850d-59d81873dd56 req-78f42193-12c6-416f-b8a1-5968ed126775 service nova] Creating event network-changed:4a79685b-a244-4153-b0c2-b8a3f4fe3abc for instance 1879dd80-bc43-4b3b-bf52-85a4745444fa on n-h1-861333-10 Oct 19 06:54:57.427739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-5036b31d-faa1-4533-850d-59d81873dd56 req-78f42193-12c6-416f-b8a1-5968ed126775 service nova] Instance 1879dd80-bc43-4b3b-bf52-85a4745444fa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:54:57.443455 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5036b31d-faa1-4533-850d-59d81873dd56 req-78f42193-12c6-416f-b8a1-5968ed126775 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193836 Oct 19 06:54:57.444499 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 695/1389] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:54:57.450024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29fdc9f1-b382-42d3-b5b5-40b2c7c35019 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:57.450736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29fdc9f1-b382-42d3-b5b5-40b2c7c35019 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:57.508271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29fdc9f1-b382-42d3-b5b5-40b2c7c35019 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:57.517448 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29fdc9f1-b382-42d3-b5b5-40b2c7c35019 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1224 microversion: 2.1 time: 0.071484 Oct 19 06:54:57.519288 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 696/1390] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:57 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1224 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:57.526443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:57.527182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:57.536251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.536997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.537588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.538024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.538504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.538943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.726127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:57.739683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:57.741533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:57.743508 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e11672ec-95a4-49fb-b3fd-93c3f157e4df tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.223053 Oct 19 06:54:57.745413 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 697/1391] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:57 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:54:57.751882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:57.752771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:57.761516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.762633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.763587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.764304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:57.764978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:57.765574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:57.867616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:57.881037 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-574d3fa2-44ae-472b-8513-69ce03fac526 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1471 microversion: 2.1 time: 0.585491 Oct 19 06:54:57.881934 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 695/1392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:57 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1471 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:57.989571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:57.998258 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-358645ff-3db8-43bd-82a5-4880eb9d56d8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.251550 Oct 19 06:54:57.999002 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 698/1393] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:57 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:58.066399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:58.069484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:58.082056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:58.082805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:58.083419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:58.084371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:58.084994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:58.085456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:58.322922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:58.323895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:58.331553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:58.340069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:58.340883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:58.343282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:58.344819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:58.345747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:58.356581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:58.366462 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3fe0133-e57d-42e2-ac08-3e53138ac2f0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.303613 Oct 19 06:54:58.369404 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 696/1394] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:58 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:58.512546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:58.521660 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31a44b02-a500-424e-9fdd-d0b3b0b9c1d1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1488 microversion: 2.1 time: 0.203866 Oct 19 06:54:58.527667 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 699/1395] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:58 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1488 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:58.547720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1c8ee54-9ed7-4ecd-9d08-56013ed7d9df tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:58.548370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1c8ee54-9ed7-4ecd-9d08-56013ed7d9df tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:58.563802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-706b5b18-5091-4c54-828b-525b9999306d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:54:58.570408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-706b5b18-5091-4c54-828b-525b9999306d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:58.571488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-706b5b18-5091-4c54-828b-525b9999306d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:58.572253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-706b5b18-5091-4c54-828b-525b9999306d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:58.612177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1c8ee54-9ed7-4ecd-9d08-56013ed7d9df tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:58.621440 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1c8ee54-9ed7-4ecd-9d08-56013ed7d9df tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1224 microversion: 2.1 time: 0.079202 Oct 19 06:54:58.622464 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 697/1396] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:58 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:58.682395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-706b5b18-5091-4c54-828b-525b9999306d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Going to try to stop instance {{(pid=127567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 06:54:58.775801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:58.776928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:58.786969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:58.787843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:58.788490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:58.789417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:58.790030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:58.790614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:58.932607 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-706b5b18-5091-4c54-828b-525b9999306d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684/action" status: 202 len: 0 microversion: 2.1 time: 0.374580 Oct 19 06:54:58.933991 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 700/1397] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:54:58 2022] POST /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:54:58.962268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:58.964685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:58.978581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:58.978581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:58.978581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:58.979577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:58.980224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:58.981340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:59.069101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:59.077140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:54:59.081698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:59.083587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:59.085061 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73d12704-2dbb-4ce0-bfb9-026424e47a05 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.314060 Oct 19 06:54:59.087509 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 698/1398] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:54:58 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:54:59.091501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:59.092301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:59.098668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:59.099355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:59.099979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:59.101006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:59.101753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:59.102341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:59.294442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:59.307948 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66db7334-9f15-4bdf-8cf3-ea0f20f8df99 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1471 microversion: 2.1 time: 0.370445 Oct 19 06:54:59.321464 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 701/1399] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:58 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1471 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:59.321464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:59.321464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:59.350015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:59.350883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:59.351594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:59.352588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:59.355005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:59.357489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:59.421208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:59.429463 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-557025e6-590f-4746-b825-4a20cdf65001 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.342694 Oct 19 06:54:59.444650 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 699/1400] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:59 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:59.452318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:59.452980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:59.460198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:59.460698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:59.461188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:59.462205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:59.462669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:59.463094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:59.772949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:59.793712 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c576e256-b9c0-493d-b0c6-518aaf3b4d0e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.482846 Oct 19 06:54:59.808708 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 702/1401] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:59 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:54:59.821692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:54:59.822323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:54:59.846293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:59.846803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:59.847253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:59.850112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:54:59.850529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:54:59.851772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:54:59.912680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:54:59.932137 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c071e31-0189-4013-9b94-b9a6030ed27f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1715 microversion: 2.1 time: 0.477829 Oct 19 06:54:59.937428 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 700/1402] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:59 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1715 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:00.033512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:00.041675 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76f019db-706f-4380-aa10-09c4ee18a775 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1276 microversion: 2.1 time: 0.246297 Oct 19 06:55:00.045218 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 703/1403] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:54:59 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:00.119441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:00.120870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:00.139102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.139607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.140049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:00.140813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.153355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.154225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:00.331345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:00.331888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:00.342015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.342606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.343056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:00.343786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.345613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.349161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:00.570540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:00.583556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:00.586950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:00.589728 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d099c35e-1b10-43de-9d85-d2d245443127 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.478920 Oct 19 06:55:00.594198 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 701/1404] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:00 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:00.602326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:00.608379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:00.619702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:00.621539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.622241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.624275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:00.624275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.624275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.627089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:00.829344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:00.844783 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aae7cacf-06bd-4b8c-96a5-11a66fc47316 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1468 microversion: 2.1 time: 0.517385 Oct 19 06:55:00.846722 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 704/1405] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:00 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1468 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:00.856665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:00.859000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:00.860696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:00.861007 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33cc1a89-66e2-4882-8e7b-ffd819515928 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.265562 Oct 19 06:55:00.866201 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 702/1406] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:00 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:00.878617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.879287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.880058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:00.880601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e11bb502-1d56-4f2f-841b-9b712c52918c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:00.881155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e11bb502-1d56-4f2f-841b-9b712c52918c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:00.885552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.885552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.885552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:00.891114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11bb502-1d56-4f2f-841b-9b712c52918c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.892816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11bb502-1d56-4f2f-841b-9b712c52918c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.893425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11bb502-1d56-4f2f-841b-9b712c52918c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:00.894331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11bb502-1d56-4f2f-841b-9b712c52918c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:00.894950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11bb502-1d56-4f2f-841b-9b712c52918c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:00.896444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11bb502-1d56-4f2f-841b-9b712c52918c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.137970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:01.148645 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-798180ff-287e-47e8-848b-8ecc2d030cf8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.299792 Oct 19 06:55:01.150581 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 705/1407] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:00 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:01.156525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:01.157134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:01.163460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.165467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.165467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.165467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.165753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.165959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.245461 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e11bb502-1d56-4f2f-841b-9b712c52918c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa/action" status: 204 len: 0 microversion: 2.1 time: 0.377858 Oct 19 06:55:01.246837 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 703/1408] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:00 2022] POST /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa/action => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:55:01.255268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:01.256873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:01.265119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.265978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.266703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.267642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.268506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.269167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.399833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:01.405212 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4301494f-b8dc-4a21-ba10-8736d369c0e6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1705 microversion: 2.1 time: 0.252817 Oct 19 06:55:01.410501 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 706/1409] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:01 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1705 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:01.423910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8ca308a7-da3c-4167-a300-a3d5254e4583 req-a542d50a-e578-4f43-b419-10fd3eb810e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5705ad-60bd-4c15-969f-bb26a8fd5b60", "name": "network-vif-unplugged", "status": "completed", "tag": "11026df4-02a2-4f24-8043-6c02c90c96a3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:01.449553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:01.458959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8ca308a7-da3c-4167-a300-a3d5254e4583 req-a542d50a-e578-4f43-b419-10fd3eb810e7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.463172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8ca308a7-da3c-4167-a300-a3d5254e4583 req-a542d50a-e578-4f43-b419-10fd3eb810e7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.465813 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b3ec22d-4f5f-4cac-bd61-499ae801f558 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1282 microversion: 2.1 time: 0.213080 Oct 19 06:55:01.466158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8ca308a7-da3c-4167-a300-a3d5254e4583 req-a542d50a-e578-4f43-b419-10fd3eb810e7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.468055 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 704/1410] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:01 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:01.483945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:01.485551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:01.494713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.495154 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8ca308a7-da3c-4167-a300-a3d5254e4583 req-a542d50a-e578-4f43-b419-10fd3eb810e7 service nova] Creating event network-vif-unplugged:11026df4-02a2-4f24-8043-6c02c90c96a3 for instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 on n-h1-861333-10 Oct 19 06:55:01.500372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.501178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.502136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.502814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.504647 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8ca308a7-da3c-4167-a300-a3d5254e4583 req-a542d50a-e578-4f43-b419-10fd3eb810e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092842 Oct 19 06:55:01.505374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.507188 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 707/1411] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:01.516503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7e3d567-03ef-4cca-b4fd-0faa63d9175f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '.version_select at 0x7f6d649a65e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:01.532625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7e3d567-03ef-4cca-b4fd-0faa63d9175f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.534857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7e3d567-03ef-4cca-b4fd-0faa63d9175f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.537324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7e3d567-03ef-4cca-b4fd-0faa63d9175f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.557417 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7e3d567-03ef-4cca-b4fd-0faa63d9175f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 2740 microversion: 2.1 time: 0.047110 Oct 19 06:55:01.561565 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 708/1412] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:55:01 2022] GET /compute/v2.1/os-migrations => generated 2740 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:01.575428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98c4567c-e024-4d0b-9503-0b114d473e3f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:01.576187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98c4567c-e024-4d0b-9503-0b114d473e3f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:01.583213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98c4567c-e024-4d0b-9503-0b114d473e3f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.583707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98c4567c-e024-4d0b-9503-0b114d473e3f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.584360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98c4567c-e024-4d0b-9503-0b114d473e3f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.585501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98c4567c-e024-4d0b-9503-0b114d473e3f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.586132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98c4567c-e024-4d0b-9503-0b114d473e3f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.587012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98c4567c-e024-4d0b-9503-0b114d473e3f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.784885 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98c4567c-e024-4d0b-9503-0b114d473e3f tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1858 microversion: 2.1 time: 0.212968 Oct 19 06:55:01.790491 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 709/1413] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:01 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1858 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:01.795325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:01.795993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:01.811223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.811724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.817641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.817641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.817641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.817641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.919554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:01.927353 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c244500-f00b-4ef5-b50f-aec77f855f26 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1468 microversion: 2.1 time: 0.457963 Oct 19 06:55:01.927943 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 705/1414] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:01 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1468 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:01.949431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-146174b4-a407-4dcc-848b-7b38d711d096 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:01.954589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-146174b4-a407-4dcc-848b-7b38d711d096 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:01.973651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-146174b4-a407-4dcc-848b-7b38d711d096 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.974336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-146174b4-a407-4dcc-848b-7b38d711d096 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.974942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-146174b4-a407-4dcc-848b-7b38d711d096 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:01.979203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-146174b4-a407-4dcc-848b-7b38d711d096 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:01.979706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-146174b4-a407-4dcc-848b-7b38d711d096 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:01.980188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-146174b4-a407-4dcc-848b-7b38d711d096 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:02.154599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:02.174703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:02.178177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:02.192347 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cdecd9b-b358-44be-9e62-5003392183ac tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.390411 Oct 19 06:55:02.192347 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 710/1415] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:01 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:02.196023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:02.206162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:02.222539 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-146174b4-a407-4dcc-848b-7b38d711d096 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1858 microversion: 2.1 time: 0.275270 Oct 19 06:55:02.230968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:02.237028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:02.237929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:02.241193 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 706/1416] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:01 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1858 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:02.244980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:02.245662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:02.252132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:02.252864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:02.252864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:02.259166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:02.259950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:02.260588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:02.264319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:02.265126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:02.267082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:02.308142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:02.647663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:02.660348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:02.662534 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67c6bc10-b686-4a0d-b876-da068bd7eaa9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.417433 Oct 19 06:55:02.663210 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 707/1417] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:02 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:02.684823 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cba4aef3-df5c-4c42-b05a-865139969346 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.497939 Oct 19 06:55:02.700945 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 711/1418] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:02 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:02.701255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:02.701255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:02.701437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:02.701437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:02.721542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:02.721966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:02.722420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:02.723149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:02.723616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:02.724050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:02.724537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:02.725162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:02.725608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:02.729981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:02.730490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:02.732344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:02.964451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lazy-loading 'services' on Instance uuid d231a12d-b118-41ec-b9e2-f987bea670ba {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:55:03.134412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:03.143221 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ce6582c-5d86-4c51-bee9-373d28740bce tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1324 microversion: 2.1 time: 0.455759 Oct 19 06:55:03.144518 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 712/1419] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:02 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1324 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:03.151402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9363f633-fd3c-435a-baf7-d3fa9f05fd41 req-4a6d4531-05fc-4933-a2c3-adc2254af9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1879dd80-bc43-4b3b-bf52-85a4745444fa", "name": "network-vif-plugged", "status": "completed", "tag": "4a79685b-a244-4153-b0c2-b8a3f4fe3abc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:03.177796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9363f633-fd3c-435a-baf7-d3fa9f05fd41 req-4a6d4531-05fc-4933-a2c3-adc2254af9f3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.179196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9363f633-fd3c-435a-baf7-d3fa9f05fd41 req-4a6d4531-05fc-4933-a2c3-adc2254af9f3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.179815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9363f633-fd3c-435a-baf7-d3fa9f05fd41 req-4a6d4531-05fc-4933-a2c3-adc2254af9f3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:03.231872 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9363f633-fd3c-435a-baf7-d3fa9f05fd41 req-4a6d4531-05fc-4933-a2c3-adc2254af9f3 service nova] Creating event network-vif-plugged:4a79685b-a244-4153-b0c2-b8a3f4fe3abc for instance 1879dd80-bc43-4b3b-bf52-85a4745444fa on n-h1-861333-10 Oct 19 06:55:03.249946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-9363f633-fd3c-435a-baf7-d3fa9f05fd41 req-4a6d4531-05fc-4933-a2c3-adc2254af9f3 service nova] Instance 1879dd80-bc43-4b3b-bf52-85a4745444fa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:55:03.286768 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9363f633-fd3c-435a-baf7-d3fa9f05fd41 req-4a6d4531-05fc-4933-a2c3-adc2254af9f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139689 Oct 19 06:55:03.289487 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 713/1420] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:03.318999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:03.318999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:03.333994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.333994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.333994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:03.333994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.333994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.333994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:03.504633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:03.513069 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3acad0f-409a-44d1-9a5b-4f968ed5ca45 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1468 microversion: 2.1 time: 0.222282 Oct 19 06:55:03.513649 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 714/1421] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:03 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1468 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:03.522545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:03.523210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:03.529379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.529869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.530310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:03.531014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.531496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.532334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:03.736396 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf1189d9-d1db-4a34-b2de-cbd6717e2673 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments/639dd16a-0736-4279-8a79-6fcdaa270042" status: 202 len: 0 microversion: 2.1 time: 1.071132 Oct 19 06:55:03.738007 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 708/1422] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 06:55:02 2022] DELETE /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments/639dd16a-0736-4279-8a79-6fcdaa270042 => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:55:03.746884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ec228136-c501-4fa2-8e4a-0139fba78e4d req-af8f7308-20ed-41ad-aec4-34f0cc36f085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5705ad-60bd-4c15-969f-bb26a8fd5b60", "tag": "11026df4-02a2-4f24-8043-6c02c90c96a3"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:03.776672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:03.777391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec228136-c501-4fa2-8e4a-0139fba78e4d req-af8f7308-20ed-41ad-aec4-34f0cc36f085 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.778182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec228136-c501-4fa2-8e4a-0139fba78e4d req-af8f7308-20ed-41ad-aec4-34f0cc36f085 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.778919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec228136-c501-4fa2-8e4a-0139fba78e4d req-af8f7308-20ed-41ad-aec4-34f0cc36f085 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:03.786242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:03.791900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:03.795135 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f467d7ed-2651-4eb3-a8c9-5e1a4dbb1ca3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.280331 Oct 19 06:55:03.795291 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ec228136-c501-4fa2-8e4a-0139fba78e4d req-af8f7308-20ed-41ad-aec4-34f0cc36f085 service nova] Creating event network-changed:11026df4-02a2-4f24-8043-6c02c90c96a3 for instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 on n-h1-861333-10 Oct 19 06:55:03.812191 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 715/1423] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:03 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:03.812445 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ec228136-c501-4fa2-8e4a-0139fba78e4d req-af8f7308-20ed-41ad-aec4-34f0cc36f085 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061565 Oct 19 06:55:03.812445 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 709/1424] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:03.812654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:03.812654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:03.813418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:03.813418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:03.820700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.820700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.820700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:03.821310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.821879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.822402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:03.855470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.864955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.864955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:03.864955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:03.864955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:03.865844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:04.144041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:04.169113 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7d99c57-5082-44f6-b32b-59f2caed4c30 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.365639 Oct 19 06:55:04.170308 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 716/1425] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:03 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:04.175764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ad420b1-e975-430c-9841-9424cc3634fb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:04.191126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ad420b1-e975-430c-9841-9424cc3634fb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:04.198784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ad420b1-e975-430c-9841-9424cc3634fb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:04.199287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ad420b1-e975-430c-9841-9424cc3634fb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:04.199730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ad420b1-e975-430c-9841-9424cc3634fb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:04.200477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ad420b1-e975-430c-9841-9424cc3634fb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:04.200981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ad420b1-e975-430c-9841-9424cc3634fb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:04.201378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ad420b1-e975-430c-9841-9424cc3634fb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:04.294670 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ad420b1-e975-430c-9841-9424cc3634fb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118797 Oct 19 06:55:04.298330 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 717/1426] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:04 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:04.303327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:04.303961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:04.312451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:04.313497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:04.313958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:04.314669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:04.315136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:04.315567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:04.507563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:04.525805 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-318a1b6b-61d6-48cf-bc09-d57f9a53be70 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.716204 Oct 19 06:55:04.528835 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 710/1427] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:03 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:04.532289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:04.540468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a780e334-b281-497f-b107-a2b6ca850cf9 req-712a6eb4-b451-4c22-b0a8-fac89377844d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27358012-f191-4870-84f2-ef8ef5e7dbd5", "tag": "55412562-3af3-4588-a0dc-badea3ef1b9b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:04.541293 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce7a5121-2f85-422d-9be7-9bd1c2f845a4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1324 microversion: 2.1 time: 0.241725 Oct 19 06:55:04.552124 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 718/1428] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:04 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:04.552124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:04.552124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:04.554835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:04.555350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:04.555795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:04.557410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:04.558035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:04.559082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:04.588692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a780e334-b281-497f-b107-a2b6ca850cf9 req-712a6eb4-b451-4c22-b0a8-fac89377844d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:04.594358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a780e334-b281-497f-b107-a2b6ca850cf9 req-712a6eb4-b451-4c22-b0a8-fac89377844d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:04.605809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a780e334-b281-497f-b107-a2b6ca850cf9 req-712a6eb4-b451-4c22-b0a8-fac89377844d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:04.623648 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a780e334-b281-497f-b107-a2b6ca850cf9 req-712a6eb4-b451-4c22-b0a8-fac89377844d service nova] Creating event network-changed:55412562-3af3-4588-a0dc-badea3ef1b9b for instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 on n-h1-861333-10 Oct 19 06:55:04.630087 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a780e334-b281-497f-b107-a2b6ca850cf9 req-712a6eb4-b451-4c22-b0a8-fac89377844d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097296 Oct 19 06:55:04.630783 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 711/1429] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:04.829498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:04.831283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:04.840755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:04.842005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:04.842629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:04.843771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:04.844520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:04.845112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:05.089116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:05.100142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0e64b22-7806-48a9-991b-ce7d4041765b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1468 microversion: 2.1 time: 0.555342 Oct 19 06:55:05.101374 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 719/1430] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:04 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1468 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:05.115548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:05.127009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:05.129120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:05.130526 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-302290ac-1bae-40c6-bf9d-639b2a4bb8bd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.306162 Oct 19 06:55:05.132037 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 712/1431] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:04 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:05.202872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:05.204454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:05.219797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:05.220531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:05.221148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:05.222026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:05.222795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:05.223404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:05.337423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c8b29685-d235-4773-8817-c177df1610c4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Action: 'create', calling method: .version_select at 0x7f6d64aae550>, body: {"keypair": {"name": "tempest-keypair-1326300680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHb8EyFRuL1lvTubQMDa2+94CDv/6HDmxFKvHTP3cZorRLgkrKPhtVxetSDbaC1yLhk5ej9SRTnQpa/iPVMWPlfcBJkQ1i+9+/AV1NeHmCMZhB7d4LMYLUfswsYyQyitw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:05.361496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c8b29685-d235-4773-8817-c177df1610c4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Getting quotas for project 6178cc497ec0483e9fa05a6b1fe83da2. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:55:05.372587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c8b29685-d235-4773-8817-c177df1610c4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Getting quotas for user f372b893598646b1b7dc0fc37650ebff and project 6178cc497ec0483e9fa05a6b1fe83da2. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:55:05.394673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:05.457551 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c8b29685-d235-4773-8817-c177df1610c4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.329516 Oct 19 06:55:05.458173 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 720/1432] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 06:55:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:55:05.462768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:05.464266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7647006e-9da6-4479-a1d8-10f0e83db6b5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:05.467453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7647006e-9da6-4479-a1d8-10f0e83db6b5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:05.471558 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d97dcc38-f152-42f0-b654-06005ea4cf9c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.274744 Oct 19 06:55:05.473030 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 713/1433] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:05 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:05.476862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7647006e-9da6-4479-a1d8-10f0e83db6b5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:05.477700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7647006e-9da6-4479-a1d8-10f0e83db6b5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:05.478386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7647006e-9da6-4479-a1d8-10f0e83db6b5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:05.479483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7647006e-9da6-4479-a1d8-10f0e83db6b5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:05.480175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7647006e-9da6-4479-a1d8-10f0e83db6b5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:05.480776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7647006e-9da6-4479-a1d8-10f0e83db6b5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:05.514831 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7647006e-9da6-4479-a1d8-10f0e83db6b5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054994 Oct 19 06:55:05.515416 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 721/1434] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:05 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:05.550698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:05.551413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:05.557703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:05.558301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:05.558808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:05.559591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:05.560037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:05.560559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:05.569954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:05.570928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:05.577286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:05.577955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:05.578715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:05.579553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:05.580144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:05.580890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:05.776455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:05.788200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:05.791806 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83c3e405-d363-45ab-8622-56fdc9f4c65b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1324 microversion: 2.1 time: 0.225630 Oct 19 06:55:05.792987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:05.805312 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 722/1435] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:05 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:05.809438 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7657cf0d-9ae1-45a3-b735-0276db89a508 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.263355 Oct 19 06:55:05.810045 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 714/1436] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:05 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:06.128662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:06.129235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:06.135396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.135884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.136364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.137062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.137530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.137964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.164082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:06.165416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:06.172501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.173124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.173802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.174581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.175120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.175607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.309041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:06.319591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:06.323787 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-475a0901-89a3-4009-b807-a01d4460d1bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1460 microversion: 2.1 time: 0.199153 Oct 19 06:55:06.324559 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 723/1437] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:06 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1460 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:06.330374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:06.333888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:06.333888 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4468e43-cbb5-4f63-8bac-19ebfb62a0c0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.174709 Oct 19 06:55:06.333888 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 715/1438] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:06 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:06.347316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52b73af0-a6d9-4291-b1ac-076eb8eef2fc tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:06.347915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52b73af0-a6d9-4291-b1ac-076eb8eef2fc tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:06.354143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52b73af0-a6d9-4291-b1ac-076eb8eef2fc tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.354629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52b73af0-a6d9-4291-b1ac-076eb8eef2fc tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.355065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52b73af0-a6d9-4291-b1ac-076eb8eef2fc tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.355763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52b73af0-a6d9-4291-b1ac-076eb8eef2fc tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.356244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52b73af0-a6d9-4291-b1ac-076eb8eef2fc tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.356668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52b73af0-a6d9-4291-b1ac-076eb8eef2fc tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.497065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:06.498182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:06.508323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.509036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.509645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.510658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.512222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.512822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.514395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52b73af0-a6d9-4291-b1ac-076eb8eef2fc tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1613 microversion: 2.1 time: 0.171283 Oct 19 06:55:06.515663 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 724/1439] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:06 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1613 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:06.533658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0c30ec2-bd78-4b2a-9e64-b3ae02c52f75 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:06.536808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0c30ec2-bd78-4b2a-9e64-b3ae02c52f75 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:06.542818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0c30ec2-bd78-4b2a-9e64-b3ae02c52f75 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.543309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0c30ec2-bd78-4b2a-9e64-b3ae02c52f75 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.543751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0c30ec2-bd78-4b2a-9e64-b3ae02c52f75 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.544487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0c30ec2-bd78-4b2a-9e64-b3ae02c52f75 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.544948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0c30ec2-bd78-4b2a-9e64-b3ae02c52f75 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.545374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0c30ec2-bd78-4b2a-9e64-b3ae02c52f75 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.576500 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0c30ec2-bd78-4b2a-9e64-b3ae02c52f75 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046913 Oct 19 06:55:06.577293 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 725/1440] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:06 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:55:06.581948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c9c6e15-e724-4601-9093-800ac694fad9 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '.version_select at 0x7f6d64a4c280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:06.588994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9c6e15-e724-4601-9093-800ac694fad9 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.588994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9c6e15-e724-4601-9093-800ac694fad9 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.588994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9c6e15-e724-4601-9093-800ac694fad9 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.598884 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c9c6e15-e724-4601-9093-800ac694fad9 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 2739 microversion: 2.1 time: 0.020726 Oct 19 06:55:06.610594 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 726/1441] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:55:06 2022] GET /compute/v2.1/os-migrations => generated 2739 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:06.690073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:06.699154 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5715a27a-8012-4002-8dfe-ea0dad08a866 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.206375 Oct 19 06:55:06.699862 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 716/1442] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:06 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:06.746387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2125297796", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:06.802003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:55:06.817665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:06.818615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:06.828287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.829124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.829904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:06.831948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:06.832658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:06.833295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.049226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:55:07.049786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:55:07.050416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:55:07.050968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:55:07.051628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:55:07.062405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.063577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.063721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:07.064426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.065579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.066269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.067009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.074718 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b3ff294-762f-4b73-96f2-c9f64aa74110 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1324 microversion: 2.1 time: 0.262020 Oct 19 06:55:07.075612 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 717/1443] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:06 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:07.076051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:07.081209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:07.086889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:07.088380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.089220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.090411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.091418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.091967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:55:07.092196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.092785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.098119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for user 631a2a90a44a40b2bd751a4feaf69d0f and project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:55:07.114338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:55:07.117345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:55:07.252030 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5d18db1-50fe-46c6-8a42-cb313e5b8012 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509301 Oct 19 06:55:07.253293 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 727/1444] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:55:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:55:07.271968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f53a9aa-1878-40ad-83e8-08741b474c5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:07.272674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f53a9aa-1878-40ad-83e8-08741b474c5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:07.320442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:07.329939 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7892cb35-c12a-4977-96dd-bc28522975c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.253190 Oct 19 06:55:07.345045 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 718/1445] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:07 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:07.359478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f53a9aa-1878-40ad-83e8-08741b474c5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:07.362013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:07.362882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:07.367764 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f53a9aa-1878-40ad-83e8-08741b474c5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1213 microversion: 2.1 time: 0.105349 Oct 19 06:55:07.370559 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 728/1446] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:07 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:07.375027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.375629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.376072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.381380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.381380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.381380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.590171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-687b91ad-cbd1-40d9-b203-e5704cb0a6b3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:07.592714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-687b91ad-cbd1-40d9-b203-e5704cb0a6b3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:07.600129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-687b91ad-cbd1-40d9-b203-e5704cb0a6b3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.600772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-687b91ad-cbd1-40d9-b203-e5704cb0a6b3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.601609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-687b91ad-cbd1-40d9-b203-e5704cb0a6b3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.602512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-687b91ad-cbd1-40d9-b203-e5704cb0a6b3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.602988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-687b91ad-cbd1-40d9-b203-e5704cb0a6b3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.603435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-687b91ad-cbd1-40d9-b203-e5704cb0a6b3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.632435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:07.648352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:07.650269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:07.651150 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-687b91ad-cbd1-40d9-b203-e5704cb0a6b3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065243 Oct 19 06:55:07.651486 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-687aa907-21a9-4db7-913a-42a53d00f955 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.294017 Oct 19 06:55:07.652082 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 719/1447] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:07 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:07.660240 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 729/1448] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:07 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:55:07.744203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:07.745417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:07.753286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.754081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.755297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.757459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:07.758120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:07.758935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:07.978268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:07.994497 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a917b0a-c0f4-4799-a0ae-af6f03956fec tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.247181 Oct 19 06:55:07.994497 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 720/1449] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:07 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:08.102652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:08.104279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:08.113359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.114683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.115408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.116691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.118381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.119271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.291063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1096678690", "imageRef": "e125b8e5-2b32-4767-bbfe-bec5a3a74b07", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ffd066b8-d8a8-49c9-b427-a95b1b52cb4a"}], "security_groups": [{"name": "tempest-securitygroup--2146671995"}], "key_name": "tempest-keypair-1326300680", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:08.305753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:08.315513 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4eb9c496-76f0-4036-9ef3-ab9d35d659f8 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1324 microversion: 2.1 time: 0.219914 Oct 19 06:55:08.316767 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 730/1450] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:08 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:08.356673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:08.358642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:08.364235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.364812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.365257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.366124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.366804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.367244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.440558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] validate_networks() for [('ffd066b8-d8a8-49c9-b427-a95b1b52cb4a', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:55:08.519120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:08.523281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:08.529794 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afffcf3b-5c05-4c7c-a0e0-b55ac19362ff tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.177402 Oct 19 06:55:08.530537 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 731/1451] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:08 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:08.537196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:08.537992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:08.550195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.551564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.552189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.553120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.553757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.554800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.617391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:08.625113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:08.632934 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc36abf2-6e04-453f-8f9d-7ee24a788d8d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1217 microversion: 2.1 time: 0.099907 Oct 19 06:55:08.653929 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 732/1452] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:08 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:08.671042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3a6f219-59c0-4aee-9649-bc7cdb60a653 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:08.674216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3a6f219-59c0-4aee-9649-bc7cdb60a653 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:08.681310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3a6f219-59c0-4aee-9649-bc7cdb60a653 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.682010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3a6f219-59c0-4aee-9649-bc7cdb60a653 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.682443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3a6f219-59c0-4aee-9649-bc7cdb60a653 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.683425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3a6f219-59c0-4aee-9649-bc7cdb60a653 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.684029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3a6f219-59c0-4aee-9649-bc7cdb60a653 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.684487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3a6f219-59c0-4aee-9649-bc7cdb60a653 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.718232 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3a6f219-59c0-4aee-9649-bc7cdb60a653 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051212 Oct 19 06:55:08.718790 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 733/1453] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:08 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:55:08.723378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:08.724306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:08.730236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.738144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.738144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.738144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.738144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.738144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.964446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:08.974227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:55:08.974651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:55:08.974973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:08.975179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:55:08.975828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:55:08.976334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:55:08.976477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:08.977606 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ec91d1c-a6de-4f4e-b749-e05e6c85a34e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.257703 Oct 19 06:55:08.978166 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 734/1454] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:08 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:08.986289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.986770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.987208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:08.988217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:08.988697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:08.989148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.006572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Getting quotas for project 6178cc497ec0483e9fa05a6b1fe83da2. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:55:09.010867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:09.011693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:09.012234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Getting quotas for user f372b893598646b1b7dc0fc37650ebff and project 6178cc497ec0483e9fa05a6b1fe83da2. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:55:09.018784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.020348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.020986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.021996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.022788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.023540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.025987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:55:09.028419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e125b8e5-2b32-4767-bbfe-bec5a3a74b07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:55:09.159702 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-86f8760d-9c33-4e21-824b-35277527f61b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.872897 Oct 19 06:55:09.171403 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 721/1455] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:55:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:55:09.173110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6113219e-3e32-4dd7-b02e-037e6a9639cf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:09.173709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6113219e-3e32-4dd7-b02e-037e6a9639cf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:09.183202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:09.194988 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3da890f-4122-457b-8b42-7028888575e8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.188049 Oct 19 06:55:09.199565 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 735/1456] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:09 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:09.249181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6113219e-3e32-4dd7-b02e-037e6a9639cf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:09.259250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6113219e-3e32-4dd7-b02e-037e6a9639cf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1246 microversion: 2.1 time: 0.091138 Oct 19 06:55:09.259850 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 722/1457] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:09 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:09.340464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:09.341080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:09.347228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.347763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.348212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.349070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.351828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.352410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.491223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:09.498883 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85462532-60d8-41f0-aea3-6e245f8d3c16 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1324 microversion: 2.1 time: 0.162414 Oct 19 06:55:09.499453 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 736/1458] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:09 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1324 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:09.554636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:09.555256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:09.562162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.562585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.563054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.563768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.564310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.564814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.664190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:09.665245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:09.671823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.673020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.673459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.674284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.674922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.675351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.704148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:09.712190 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-168b05d9-169d-47fd-8451-724eb926284d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.161489 Oct 19 06:55:09.712861 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 723/1459] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:09 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:09.732458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2291daa-0cf9-4fde-9b88-76260ecb6d14 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:09.735479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b2291daa-0cf9-4fde-9b88-76260ecb6d14 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:09.744393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2291daa-0cf9-4fde-9b88-76260ecb6d14 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.744925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2291daa-0cf9-4fde-9b88-76260ecb6d14 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.745340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2291daa-0cf9-4fde-9b88-76260ecb6d14 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.750854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2291daa-0cf9-4fde-9b88-76260ecb6d14 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:09.750854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2291daa-0cf9-4fde-9b88-76260ecb6d14 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:09.750854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2291daa-0cf9-4fde-9b88-76260ecb6d14 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:09.751981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:09.766391 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2a3205a-458f-4215-89e3-0beef132b8f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1265 microversion: 2.1 time: 0.107661 Oct 19 06:55:09.767161 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 737/1460] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:09 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:09.779548 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b2291daa-0cf9-4fde-9b88-76260ecb6d14 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051113 Oct 19 06:55:09.780524 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 724/1461] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:09 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:55:10.002712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:10.003381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:10.009600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.010092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.010536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.011240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.011697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.012633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.227642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:10.228458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:10.235547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:10.239420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.240136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.240816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.241377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.241832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.242253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.247324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:10.249258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:10.250969 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1c4ccdf-ccc2-4b1c-abdc-c8b0f8dced45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.251623 Oct 19 06:55:10.252093 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 738/1462] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:09 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:10.283566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b0a9ddc-df89-4484-96ae-f3887b3bedf8 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:10.294633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b0a9ddc-df89-4484-96ae-f3887b3bedf8 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:10.376075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b0a9ddc-df89-4484-96ae-f3887b3bedf8 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:10.388265 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b0a9ddc-df89-4484-96ae-f3887b3bedf8 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1246 microversion: 2.1 time: 0.107934 Oct 19 06:55:10.392042 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 739/1463] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:10 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:10.499594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e71d8874-9deb-4213-8b1a-df466f7294b5 req-313aa7e3-b596-48ae-8d95-f1cd8c743bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27358012-f191-4870-84f2-ef8ef5e7dbd5", "name": "network-vif-plugged", "status": "completed", "tag": "55412562-3af3-4588-a0dc-badea3ef1b9b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:10.512900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e71d8874-9deb-4213-8b1a-df466f7294b5 req-313aa7e3-b596-48ae-8d95-f1cd8c743bbe service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.513679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e71d8874-9deb-4213-8b1a-df466f7294b5 req-313aa7e3-b596-48ae-8d95-f1cd8c743bbe service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.514290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e71d8874-9deb-4213-8b1a-df466f7294b5 req-313aa7e3-b596-48ae-8d95-f1cd8c743bbe service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.528074 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e71d8874-9deb-4213-8b1a-df466f7294b5 req-313aa7e3-b596-48ae-8d95-f1cd8c743bbe service nova] Creating event network-vif-plugged:55412562-3af3-4588-a0dc-badea3ef1b9b for instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 on n-h1-861333-10 Oct 19 06:55:10.533914 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e71d8874-9deb-4213-8b1a-df466f7294b5 req-313aa7e3-b596-48ae-8d95-f1cd8c743bbe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106651 Oct 19 06:55:10.535091 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 740/1464] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:55:10.540573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:10.541463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:10.562544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.563862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.564507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.565474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.566156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.567411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.687248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:10.692432 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-390e3f2e-7be3-4c81-9a9c-f4f04b364557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.469421 Oct 19 06:55:10.695418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 725/1465] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:10 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:10.736574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:10.737589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:10.754897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.755707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.758095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:10.758750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.759563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.761281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.761971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.767479 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7968c65-7fe0-42ec-81a7-8868d5508dc7 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1324 microversion: 2.1 time: 0.230973 Oct 19 06:55:10.768054 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 741/1466] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:10 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:10.793648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:10.795089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:10.805469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.806250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.806871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.808075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:10.808742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:10.809331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:10.886578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:10.897612 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-316a2608-83c1-4c02-8655-b63cfc0d99b9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1271 microversion: 2.1 time: 0.111868 Oct 19 06:55:10.899273 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 742/1467] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:10 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:11.033765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:11.042788 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-159a5c2c-2cc5-4b2d-b97b-595f3e48ddd4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.311027 Oct 19 06:55:11.043802 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 726/1468] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:10 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:11.283850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:11.285161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:11.315041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:11.321538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:11.322087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:11.325088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:11.325573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:11.326264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:11.417554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:11.419323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:11.440741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:11.452828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:11.452828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:11.452828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:11.452828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:11.452828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:11.618539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:11.634779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:11.636312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:11.638276 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da232d77-c216-4a6e-bff2-a5682a8205e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.363297 Oct 19 06:55:11.638843 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 743/1469] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:11 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:11.643232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:11.653203 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72a419d7-3351-4166-b195-a75e7aa81e32 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1242 microversion: 2.1 time: 0.240246 Oct 19 06:55:11.653789 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 727/1470] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:11 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1242 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:11.725143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:11.730547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:11.738889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:11.741425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:11.743041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:11.744727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:11.745920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:11.746439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:11.793088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:11.795395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:11.811363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:11.814516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:11.814971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:11.817318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:11.818019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:11.818467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:11.987037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:11.996705 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e401365-227f-4c55-8628-eebe09dfecc5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.278790 Oct 19 06:55:11.997534 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 744/1471] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:11 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:12.003738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:12.004389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:12.011068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:12.011863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:12.012350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:12.013236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:12.013731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:12.014164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:12.104611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:12.117076 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4086c9e8-5281-4ab7-91fd-57b79e45636e tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1324 microversion: 2.1 time: 0.329926 Oct 19 06:55:12.118912 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 728/1472] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:11 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:12.131112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:12.132128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:12.138523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:12.139313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:12.140032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:12.141119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:12.148478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:12.153402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:12.274817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:12.285808 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba33ddee-c8cd-4126-9faf-2b3d41cf1b4c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1313 microversion: 2.1 time: 0.285608 Oct 19 06:55:12.285808 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 745/1473] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:11 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:12.441203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:12.459897 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c04db6b3-1a8e-4c3d-8505-c510ea597d12 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.338522 Oct 19 06:55:12.462010 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 729/1474] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:12 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:12.667348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:12.669172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:12.680795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:12.682881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:12.683642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:12.684173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:12.684624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:12.685342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:12.685819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:12.686238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:12.697273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:12.698250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:12.699238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:12.701807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:12.701807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:12.701807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:12.868091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:12.877809 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f861e2ba-3945-4e71-8466-44e800edcb44 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1298 microversion: 2.1 time: 0.202977 Oct 19 06:55:12.879403 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 730/1475] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:12 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1298 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:12.923529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:12.936201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:12.937661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:12.938881 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8cf3cde6-ac87-4df9-8aa3-7ab0bc7b98ff tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.275423 Oct 19 06:55:12.939444 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 746/1476] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:12 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:13.025093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1b50269c-cc65-477d-8c34-dc1d01827b94 req-cc20804a-1711-4dff-94ae-ad8470f6856e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf886d10-4fa6-4a13-a48e-d0e90d602b8f", "tag": "6f00e575-44f1-4568-8060-a0deaaa1aadb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:13.027068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:13.027707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:13.038826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1b50269c-cc65-477d-8c34-dc1d01827b94 req-cc20804a-1711-4dff-94ae-ad8470f6856e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.039049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.039614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.039981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1b50269c-cc65-477d-8c34-dc1d01827b94 req-cc20804a-1711-4dff-94ae-ad8470f6856e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.040177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.050339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1b50269c-cc65-477d-8c34-dc1d01827b94 req-cc20804a-1711-4dff-94ae-ad8470f6856e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.050493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.050493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.050493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.052604 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1b50269c-cc65-477d-8c34-dc1d01827b94 req-cc20804a-1711-4dff-94ae-ad8470f6856e service nova] Creating event network-changed:6f00e575-44f1-4568-8060-a0deaaa1aadb for instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f on n-h2-861333-10 Oct 19 06:55:13.057952 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1b50269c-cc65-477d-8c34-dc1d01827b94 req-cc20804a-1711-4dff-94ae-ad8470f6856e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038147 Oct 19 06:55:13.059154 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 747/1477] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:55:13.148550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:13.149544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:13.163163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.163900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.165258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.166907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.168387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.170450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.548692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:13.580815 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c516a768-0789-434e-aeae-1bf329b7b798 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 200 len: 1520 microversion: 2.1 time: 0.435142 Oct 19 06:55:13.594185 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 748/1478] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:13 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:13.610947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:13.610947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:13.626510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.627025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.627474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.628233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.630378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.631099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.682027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:13.697311 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-860ad84e-f1db-4eb5-a4c6-8d74d7d12d92 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.679434 Oct 19 06:55:13.702883 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 731/1479] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:13 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:13.703876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:13.712522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:13.719988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.720531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.720970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.721677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.722130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.722558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.879948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:13.889972 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73922027-09fc-4dc2-8620-96cdfa12ea4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1313 microversion: 2.1 time: 0.287484 Oct 19 06:55:13.901804 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 749/1480] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:13 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:13.914991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Action: 'action', calling method: .version_select at 0x7f6d6653b5e0>, body: {"addFloatingIp": {"address": "172.25.6.111"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:13.918057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:13.926709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.927087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.927589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:13.928351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:13.928812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:13.929241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:14.039655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "refresh_cache-4c92b51c-7d82-44ed-81ff-fefbab541406" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:55:14.040160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquired lock "refresh_cache-4c92b51c-7d82-44ed-81ff-fefbab541406" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:55:14.203241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:14.222002 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3991c23d-9048-4983-8034-a420eaaf8be9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.522079 Oct 19 06:55:14.238410 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 732/1481] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:13 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:14.246695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:14.247333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:14.253848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:14.254613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:14.255264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:14.256170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:14.256780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:14.257359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:14.262300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:14.582773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:14.608885 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4dcf9186-3700-4c5d-88d3-f133622a75db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1304 microversion: 2.1 time: 0.365901 Oct 19 06:55:14.609731 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 733/1482] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:14 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1304 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:14.628895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:14.629803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:14.645134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:14.660279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:14.660279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:14.660279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:14.660279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:14.660279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:15.422714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:15.440712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:15.443447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:15.448094 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0060cdeb-9988-479c-a005-7d5f12b5d4aa tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.836073 Oct 19 06:55:15.448960 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 734/1483] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:14 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:15.460943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:15.461812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:15.476342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:15.481148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:15.481788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:15.484389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:15.485593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:15.489179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:16.310662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:16.325269 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef390ae7-0d5f-412d-be84-7e5e56a490bf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.873775 Oct 19 06:55:16.326051 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 735/1484] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:15 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:16.340097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:16.341063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:16.357662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:16.364943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:16.367642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:16.370349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:16.373143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:16.373811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:16.753529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:16.762663 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aeba9f25-8b67-4b1e-8af1-13b3c2a9def9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1313 microversion: 2.1 time: 0.434389 Oct 19 06:55:16.780956 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 736/1485] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:16 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:16.787930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:16.788851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:16.795653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:16.806845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:16.806845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:16.806845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:16.806845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:16.806845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:17.007952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:17.024093 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0da3011-ec8e-4691-beb9-a3b5b1aec1ee tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.241045 Oct 19 06:55:17.028418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 737/1486] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:16 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:17.038604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:17.039709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:17.060570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:17.061221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:17.061781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:17.068787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:17.069612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:17.070367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:17.148484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:17.361937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:17.382267 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34a8b603-6e8f-4a70-9961-899efbfc3ea9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1372 microversion: 2.1 time: 0.352331 Oct 19 06:55:17.389694 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 738/1487] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:17 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1372 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:17.407272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:17.410584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:17.426049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:17.435657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:17.437213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:17.439554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:17.441374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:17.446278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:17.699519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:17.710544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:17.712076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:17.719718 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4754eb0-9ae7-4cf8-a150-7a07fe01fd4f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1814 microversion: 2.25 time: 0.326475 Oct 19 06:55:17.742465 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 739/1488] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:17 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1814 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:17.747822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af2b9c6f-6163-4a5b-bd4e-5e2713fbcd96 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a32e05a0-dee1-41a2-a56e-931e5114575a"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:17.751030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af2b9c6f-6163-4a5b-bd4e-5e2713fbcd96 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:17.782620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2b9c6f-6163-4a5b-bd4e-5e2713fbcd96 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:17.786619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2b9c6f-6163-4a5b-bd4e-5e2713fbcd96 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:17.787623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2b9c6f-6163-4a5b-bd4e-5e2713fbcd96 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:17.788677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2b9c6f-6163-4a5b-bd4e-5e2713fbcd96 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:17.789337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2b9c6f-6163-4a5b-bd4e-5e2713fbcd96 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:17.789978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2b9c6f-6163-4a5b-bd4e-5e2713fbcd96 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:18.141765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 06:55:18.170862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:18.997191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:19.255467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:19.462902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Updating instance_info_cache with network_info: [{"id": "a0b47758-23a8-44ef-84c0-617e5de683a7", "address": "fa:16:3e:3c:4e:05", "network": {"id": "77fecbf9-0d41-4410-ad8b-4a1893b4dd94", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1796361494-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4248165058874e81a53cbcd2f194a649", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0b47758-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 06:55:19.553373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Releasing lock "refresh_cache-4c92b51c-7d82-44ed-81ff-fefbab541406" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:55:19.556455 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-350335f2-cd27-43e6-a3b5-e07e7ff45c2c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "POST /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406/action" status: 202 len: 0 microversion: 2.1 time: 5.646111 Oct 19 06:55:19.561711 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 750/1489] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:13 2022] POST /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406/action => generated 0 bytes in 5653 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 06:55:19.568338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:19.569154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:19.582117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:19.582781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:19.583353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:19.584691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:19.585672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:19.586343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:19.966064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:19.978552 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62b6c7c4-1b46-4ec5-afb4-94eda2352ac7 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.413221 Oct 19 06:55:19.985637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 751/1490] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:19 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:20.011818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:20.014143 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af2b9c6f-6163-4a5b-bd4e-5e2713fbcd96 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "POST /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.270232 Oct 19 06:55:20.015411 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 740/1491] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 06:55:17 2022] POST /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments => generated 194 bytes in 2272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:20.017277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:20.027871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:20.028960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:20.040675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.041174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.041683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.060209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.060209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.060209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.064636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.065427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.066074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.066999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.068076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.069498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.381056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:20.559624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:20.579330 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e0c78bb-ae3b-40b4-82e5-124070bf1f14 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.561859 Oct 19 06:55:20.581157 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 741/1492] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:20 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:20.608474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3b5e985f-9092-40fc-8ae1-997d3b40876d req-db406059-e8b0-48a2-89f5-6a358752d0da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c92b51c-7d82-44ed-81ff-fefbab541406", "tag": "a0b47758-23a8-44ef-84c0-617e5de683a7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:20.612895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:20.622244 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15fb727b-2ee6-4f95-947f-e47a86ae4d10 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1313 microversion: 2.1 time: 0.634497 Oct 19 06:55:20.627699 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 752/1493] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:19 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:20.640347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b5e985f-9092-40fc-8ae1-997d3b40876d req-db406059-e8b0-48a2-89f5-6a358752d0da service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.640347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b5e985f-9092-40fc-8ae1-997d3b40876d req-db406059-e8b0-48a2-89f5-6a358752d0da service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.640347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b5e985f-9092-40fc-8ae1-997d3b40876d req-db406059-e8b0-48a2-89f5-6a358752d0da service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.665005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:20.665005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:20.665613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3b5e985f-9092-40fc-8ae1-997d3b40876d req-db406059-e8b0-48a2-89f5-6a358752d0da service nova] Creating event network-changed:a0b47758-23a8-44ef-84c0-617e5de683a7 for instance 4c92b51c-7d82-44ed-81ff-fefbab541406 on n-h2-861333-10 Oct 19 06:55:20.681425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.682028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.682573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.683566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.689136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.690276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.692351 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3b5e985f-9092-40fc-8ae1-997d3b40876d req-db406059-e8b0-48a2-89f5-6a358752d0da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107605 Oct 19 06:55:20.693476 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 742/1494] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:20.703586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:20.704637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:20.707636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:20.733290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.738417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.741954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.744156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.748232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.748995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.890172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:20.902646 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6456412c-10b9-4b5c-87cd-808488e5f79b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1372 microversion: 2.1 time: 0.257981 Oct 19 06:55:20.910557 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 753/1495] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:20 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1372 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:20.916041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.111"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:20.923128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:20.937325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.939640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.939640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.939640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:20.939640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:20.940396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:20.970884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "refresh_cache-27358012-f191-4870-84f2-ef8ef5e7dbd5" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:55:20.971586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquired lock "refresh_cache-27358012-f191-4870-84f2-ef8ef5e7dbd5" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:55:21.114108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:21.130695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:21.132607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:21.135465 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03ff059f-a196-4bfd-bce6-c0ba7971c31e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1804 microversion: 2.25 time: 0.438813 Oct 19 06:55:21.140475 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 743/1496] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:20 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1804 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:21.149437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:21.152251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:21.169220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:21.169989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:21.170607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:21.173427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:21.174111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:21.177406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:21.629116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:21.642377 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5fb06a8-ab02-4b4f-8a1b-7267c92adef5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.498857 Oct 19 06:55:21.657263 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 744/1497] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:21 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:21.667720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f304ace-3df9-428d-9d52-f7882206a312 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '.version_select at 0x7f6d64c5fa60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:21.671665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f304ace-3df9-428d-9d52-f7882206a312 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:21.672460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f304ace-3df9-428d-9d52-f7882206a312 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:21.673350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f304ace-3df9-428d-9d52-f7882206a312 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:21.686069 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f304ace-3df9-428d-9d52-f7882206a312 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 3232 microversion: 2.25 time: 0.027365 Oct 19 06:55:21.687727 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 745/1498] 10.222.0.39 () {60 vars in 1184 bytes} [Wed Oct 19 06:55:21 2022] GET /compute/v2.1/os-migrations => generated 3232 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:21.693090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:21.700002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:21.714506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:21.715287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:21.718210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:21.719196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:21.721555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:21.722186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:22.213574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5602ceb-bb17-4f35-b3eb-764b0fe44f25 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.536334 Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 746/1499] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:21 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:22.252200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:22.502988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:22.515400 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24779468-5d75-4069-b9aa-c86dd67693e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1313 microversion: 2.1 time: 0.282267 Oct 19 06:55:22.515400 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 747/1500] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:22 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:22.517537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:22.518418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:22.536508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:22.537401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:22.538335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:22.539443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:22.544973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:22.545788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:22.889075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:55:22.925250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-167de7cb-476c-4c91-875e-a1ea2965160a tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 2424 microversion: 2.25 time: 0.411889 Oct 19 06:55:22.926141 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 748/1501] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:22 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 2424 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:22.933526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4b4949df-2fd8-496d-b284-6e6ced7cf5e0 req-3bf6bc1b-3864-4c8b-8900-de446f47f1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf886d10-4fa6-4a13-a48e-d0e90d602b8f", "name": "network-vif-plugged", "status": "completed", "tag": "6f00e575-44f1-4568-8060-a0deaaa1aadb"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:22.970137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4b4949df-2fd8-496d-b284-6e6ced7cf5e0 req-3bf6bc1b-3864-4c8b-8900-de446f47f1bb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:22.972245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4b4949df-2fd8-496d-b284-6e6ced7cf5e0 req-3bf6bc1b-3864-4c8b-8900-de446f47f1bb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:22.974137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4b4949df-2fd8-496d-b284-6e6ced7cf5e0 req-3bf6bc1b-3864-4c8b-8900-de446f47f1bb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:23.009562 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4b4949df-2fd8-496d-b284-6e6ced7cf5e0 req-3bf6bc1b-3864-4c8b-8900-de446f47f1bb service nova] Creating event network-vif-plugged:6f00e575-44f1-4568-8060-a0deaaa1aadb for instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f on n-h2-861333-10 Oct 19 06:55:23.014798 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4b4949df-2fd8-496d-b284-6e6ced7cf5e0 req-3bf6bc1b-3864-4c8b-8900-de446f47f1bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087121 Oct 19 06:55:23.020900 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 749/1502] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:23.033750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:23.034673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:23.049844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:23.050450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:23.050777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:23.051562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:23.051955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:23.052420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:23.062973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:23.368826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:23.385071 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08ab656c-574f-4a3b-bc44-47bd6891bcac tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1372 microversion: 2.1 time: 0.367986 Oct 19 06:55:23.401016 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 750/1503] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:23 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1372 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:23.420293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:23.421648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:23.428438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:23.429222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:23.429876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:23.430764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:23.431442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:23.432094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:23.720907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:23.729103 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b8a9b9e-522e-4e9d-b3ee-2d00e3eb25b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1514 microversion: 2.1 time: 0.326647 Oct 19 06:55:23.729697 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 751/1504] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:23 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:23.736433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-65de925e-4d2d-4dd9-a96c-ce00809548ac req-d78217c2-14dc-42eb-9568-429b7b108d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9", "tag": "351b1d84-abf0-486b-a0c3-f11e51a4d4ef"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:23.781993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-65de925e-4d2d-4dd9-a96c-ce00809548ac req-d78217c2-14dc-42eb-9568-429b7b108d9f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:23.783994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-65de925e-4d2d-4dd9-a96c-ce00809548ac req-d78217c2-14dc-42eb-9568-429b7b108d9f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:23.785061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-65de925e-4d2d-4dd9-a96c-ce00809548ac req-d78217c2-14dc-42eb-9568-429b7b108d9f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:23.874043 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-65de925e-4d2d-4dd9-a96c-ce00809548ac req-d78217c2-14dc-42eb-9568-429b7b108d9f service nova] Creating event network-changed:351b1d84-abf0-486b-a0c3-f11e51a4d4ef for instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 on n-h1-861333-10 Oct 19 06:55:23.897744 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-65de925e-4d2d-4dd9-a96c-ce00809548ac req-d78217c2-14dc-42eb-9568-429b7b108d9f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164426 Oct 19 06:55:23.901422 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 752/1505] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:23.915077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:23.915077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:23.965431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:23.966026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:23.966496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:23.977951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:23.977951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:23.977951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:24.386864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:55:24.428863 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f09719d4-efe6-4e66-b515-3ce7cc3b7fa7 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 2424 microversion: 2.25 time: 0.521094 Oct 19 06:55:24.429767 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 753/1506] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:55:23 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 2424 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:55:24.436344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:24.437075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:24.474692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:24.475354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:24.476142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:24.479257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:24.480038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:24.480619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:24.886152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:24.903236 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0572088-7ec9-4151-a395-fc5499c6fa51 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.470018 Oct 19 06:55:24.904910 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 754/1507] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:24 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:24.917752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:24.919962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:24.934034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:24.935526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:24.936766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:24.938301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:24.939875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:24.941040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:25.295069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:25.303849 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87e980f9-131d-499f-9101-a6e5597d0048 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1313 microversion: 2.1 time: 0.397125 Oct 19 06:55:25.306048 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 755/1508] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:24 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:25.313629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:25.322083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:25.336977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:25.341626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:25.342363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:25.343341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:25.344010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:25.348185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:25.725411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:25.749836 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2312ca67-b2d8-41b0-ab11-c565919b9201 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1372 microversion: 2.1 time: 0.442219 Oct 19 06:55:25.756824 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 756/1509] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:25 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1372 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:25.785633 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.network.neutron [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] re-assign floating IP 172.25.6.111 from instance 4c92b51c-7d82-44ed-81ff-fefbab541406 Oct 19 06:55:25.786373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:25.787644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:25.794536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:25.795245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:25.795942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:25.796990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:25.798182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:25.798810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:25.875078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 06:55:26.133485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lazy-loading 'services' on Instance uuid 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:55:26.427674 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4aee23c-c02f-4122-8b3c-10c52b1e1bb0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments/d7502242-0bfd-4e75-8cdf-2d4a2a805ad1" status: 202 len: 0 microversion: 2.25 time: 0.655588 Oct 19 06:55:26.429237 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 757/1510] 10.222.0.39 () {60 vars in 1457 bytes} [Wed Oct 19 06:55:25 2022] DELETE /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments/d7502242-0bfd-4e75-8cdf-2d4a2a805ad1 => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:55:26.447300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:26.454193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:26.458345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:26.459319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:26.460241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:26.461376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:26.464509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:26.465356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:26.814764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:26.826111 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0633bb0e-72b1-422a-acc2-0f83a79703b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1520 microversion: 2.1 time: 0.395342 Oct 19 06:55:26.840211 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 758/1511] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:26 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:26.846976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:26.848074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:26.864906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:26.865591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:26.866192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:26.867085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:26.867730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:26.868382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:27.062034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:27.071563 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21e30294-d8c2-422e-b77e-7951b2eaed94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.229482 Oct 19 06:55:27.072698 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 759/1512] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:26 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:27.081917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ecfb0743-5804-4e98-ba57-3b7ef477f5f1 req-3dbd3cb2-28bd-49d3-8eee-3755214a5476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c92b51c-7d82-44ed-81ff-fefbab541406", "tag": "a0b47758-23a8-44ef-84c0-617e5de683a7"}, {"name": "network-changed", "server_uuid": "27358012-f191-4870-84f2-ef8ef5e7dbd5", "tag": "55412562-3af3-4588-a0dc-badea3ef1b9b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:27.101260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ecfb0743-5804-4e98-ba57-3b7ef477f5f1 req-3dbd3cb2-28bd-49d3-8eee-3755214a5476 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:27.101578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Updating instance_info_cache with network_info: [{"id": "a0b47758-23a8-44ef-84c0-617e5de683a7", "address": "fa:16:3e:3c:4e:05", "network": {"id": "77fecbf9-0d41-4410-ad8b-4a1893b4dd94", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1796361494-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4248165058874e81a53cbcd2f194a649", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0b47758-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 06:55:27.102133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ecfb0743-5804-4e98-ba57-3b7ef477f5f1 req-3dbd3cb2-28bd-49d3-8eee-3755214a5476 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:27.102689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ecfb0743-5804-4e98-ba57-3b7ef477f5f1 req-3dbd3cb2-28bd-49d3-8eee-3755214a5476 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:27.123554 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ecfb0743-5804-4e98-ba57-3b7ef477f5f1 req-3dbd3cb2-28bd-49d3-8eee-3755214a5476 service nova] Creating event network-changed:a0b47758-23a8-44ef-84c0-617e5de683a7 for instance 4c92b51c-7d82-44ed-81ff-fefbab541406 on n-h2-861333-10 Oct 19 06:55:27.132154 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ecfb0743-5804-4e98-ba57-3b7ef477f5f1 req-3dbd3cb2-28bd-49d3-8eee-3755214a5476 service nova] Creating event network-changed:55412562-3af3-4588-a0dc-badea3ef1b9b for instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 on n-h1-861333-10 Oct 19 06:55:27.135100 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ecfb0743-5804-4e98-ba57-3b7ef477f5f1 req-3dbd3cb2-28bd-49d3-8eee-3755214a5476 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060804 Oct 19 06:55:27.136321 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 760/1513] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:27.143131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:27.144513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:27.152381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:27.159904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:27.159904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:27.159904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:27.159904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:27.159904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:27.180868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 06:55:27.467919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:27.476076 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bec19ae5-1c5e-4be6-82c0-d07026ed3fae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1463 microversion: 2.1 time: 0.338329 Oct 19 06:55:27.488060 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 761/1514] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:27 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1463 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:27.490457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bed8d822-2b18-41a1-8d85-a61e9fe988ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:27.493470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bed8d822-2b18-41a1-8d85-a61e9fe988ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:27.501631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bed8d822-2b18-41a1-8d85-a61e9fe988ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:27.502404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bed8d822-2b18-41a1-8d85-a61e9fe988ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:27.503056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bed8d822-2b18-41a1-8d85-a61e9fe988ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:27.503945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bed8d822-2b18-41a1-8d85-a61e9fe988ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:27.504588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bed8d822-2b18-41a1-8d85-a61e9fe988ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:27.505177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bed8d822-2b18-41a1-8d85-a61e9fe988ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:27.565861 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bed8d822-2b18-41a1-8d85-a61e9fe988ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081517 Oct 19 06:55:27.570157 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 762/1515] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 06:55:27 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:55:27.575116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:27.578479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:27.614164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:27.624704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:27.625894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:27.626717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:27.627337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:27.627847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:27.940609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:27.951437 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f042734-0098-442b-b16d-5e981ada5bd9 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1372 microversion: 2.1 time: 0.379965 Oct 19 06:55:27.952030 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 763/1516] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:27 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1372 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:27.967938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:27.971076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:27.984467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:27.984940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:27.985437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:27.986167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:27.986630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:27.989206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:28.218191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:28.224986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Old instance type m1.heat2, new instance type m1.heat {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 06:55:28.247162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:55:28.247162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:55:28.247162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:55:28.247720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:55:28.247905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:55:28.364888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Updating instance_info_cache with network_info: [{"id": "55412562-3af3-4588-a0dc-badea3ef1b9b", "address": "fa:16:3e:5d:a2:d4", "network": {"id": "77fecbf9-0d41-4410-ad8b-4a1893b4dd94", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1796361494-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4248165058874e81a53cbcd2f194a649", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap55412562-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 06:55:28.445295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Releasing lock "refresh_cache-27358012-f191-4870-84f2-ef8ef5e7dbd5" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:55:28.449157 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-379d3c18-fc69-4c0f-88f7-9b937aaaf7db tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "POST /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5/action" status: 202 len: 0 microversion: 2.1 time: 7.534562 Oct 19 06:55:28.449157 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 754/1517] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:20 2022] POST /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5/action => generated 0 bytes in 7536 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 06:55:28.455721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:28.457145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:28.472241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:28.472740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:28.478635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:28.478635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:28.478635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:28.478635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:28.627421 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9bd6e8d1-5528-4c52-b67c-6973bc06a836 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f/action" status: 202 len: 0 microversion: 2.1 time: 0.673978 Oct 19 06:55:28.630920 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 764/1518] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:27 2022] POST /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:55:28.642915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:28.643616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:28.650361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:28.650857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:28.651292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:28.651992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:28.652475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:28.652894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:28.739100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:28.759661 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35bec43f-ba19-48b7-be2a-64942bafd6c0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1520 microversion: 2.1 time: 0.311146 Oct 19 06:55:28.760307 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 755/1519] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:28 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:28.771524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Action: 'action', calling method: .version_select at 0x7f6d6653b670>, body: {"removeFloatingIp": {"address": "172.25.6.111"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:28.860501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:28.864711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:28.877778 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d45135e6-00c8-453f-9c25-6994d96d7b8a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.248183 Oct 19 06:55:28.878654 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 765/1520] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:28 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:28.888457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32d63044-2321-4aa3-a02a-77cd9c0e76c5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:28.890786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32d63044-2321-4aa3-a02a-77cd9c0e76c5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:28.904998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d63044-2321-4aa3-a02a-77cd9c0e76c5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:28.908076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d63044-2321-4aa3-a02a-77cd9c0e76c5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:28.910354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d63044-2321-4aa3-a02a-77cd9c0e76c5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:28.914906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d63044-2321-4aa3-a02a-77cd9c0e76c5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:28.916652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d63044-2321-4aa3-a02a-77cd9c0e76c5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:28.917266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d63044-2321-4aa3-a02a-77cd9c0e76c5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.002431 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32d63044-2321-4aa3-a02a-77cd9c0e76c5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122315 Oct 19 06:55:29.009488 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 766/1521] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 06:55:28 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:55:29.015015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:29.017180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:29.026989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.028972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.028972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.029423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.029973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.030725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.049862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:29.055909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.056497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.056941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.057650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.058107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.058536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.258445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:29.268091 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f26ae757-3781-4a8a-ab00-954ec2e12b5c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1472 microversion: 2.1 time: 0.258598 Oct 19 06:55:29.268705 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 767/1522] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:29 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1472 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:29.294624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:29.295747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:29.304570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.305076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.305823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.306882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.308270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.308860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.469811 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] HTTP exception thrown: Floating IP 172.25.6.111 is not associated with instance 4c92b51c-7d82-44ed-81ff-fefbab541406. Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Request method failure captured: Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406/action HTTP/1.1 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 49 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT58gp6X0VLT-mkZaDiYApcHdlCCtKBCYXZZw14ABKdLVCYqtFhjUScf3sOTNCMJ4jLtjcGoArMoDHUetTyf0Eppkuy2lWDh5UoPqgD5yEhz_WdHIKAw9th0TkYpKOy-5Rg9Ueu-nAJclZ8ia1QHU50JH-r3kG5QpzkU1jDwJwNpjkKo Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4248165058874e81a53cbcd2f194a649 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4248165058874e81a53cbcd2f194a649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4248165058874e81a53cbcd2f194a649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4248165058874e81a53cbcd2f194a649"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4248165058874e81a53cbcd2f194a649", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4248165058874e81a53cbcd2f194a649 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationTestJSON-991858814-project Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 6598d68715524f40aa57fb25b378fb17 Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-991858814-project Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: {"removeFloatingIp": {"address": "172.25.6.111"}} Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: exception: Floating IP 172.25.6.111 is not associated with instance 4c92b51c-7d82-44ed-81ff-fefbab541406. Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '4c92b51c-7d82-44ed-81ff-fefbab541406', 'body': {'removeFloatingIp': {'address': '172.25.6.111'}}} Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.111 is not associated with instance 4c92b51c-7d82-44ed-81ff-fefbab541406. Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.111 is not associated with instance 4c92b51c-7d82-44ed-81ff-fefbab541406. Oct 19 06:55:29.471848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:29.477430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Returning 409 to user: Floating IP 172.25.6.111 is not associated with instance 4c92b51c-7d82-44ed-81ff-fefbab541406. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:55:29.478483 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6af61f7f-1be0-4e61-84a3-7c79181839d5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "POST /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406/action" status: 409 len: 146 microversion: 2.1 time: 0.715610 Oct 19 06:55:29.479300 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 756/1523] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:28 2022] POST /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406/action => generated 146 bytes in 718 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:55:29.488213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.111"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:29.560532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:29.572922 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3fa3369d-9d27-4ed1-ab37-46b806c495a4 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1372 microversion: 2.1 time: 0.286074 Oct 19 06:55:29.584157 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 768/1524] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:29 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1372 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:29.667862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-10eb71b6-6576-4a0f-bcb0-129f64785843 req-8a9ba868-a73b-4b6e-ab74-957253c7f4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c", "name": "network-vif-plugged", "status": "completed", "tag": "151f65d0-8d84-4554-afad-3126bb1f00fb"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:29.681616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:29.684208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-10eb71b6-6576-4a0f-bcb0-129f64785843 req-8a9ba868-a73b-4b6e-ab74-957253c7f4a0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.684643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-10eb71b6-6576-4a0f-bcb0-129f64785843 req-8a9ba868-a73b-4b6e-ab74-957253c7f4a0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.685197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-10eb71b6-6576-4a0f-bcb0-129f64785843 req-8a9ba868-a73b-4b6e-ab74-957253c7f4a0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.690205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.690698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.691138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.691973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.692617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.693663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.701132 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-10eb71b6-6576-4a0f-bcb0-129f64785843 req-8a9ba868-a73b-4b6e-ab74-957253c7f4a0 service nova] Creating event network-vif-plugged:151f65d0-8d84-4554-afad-3126bb1f00fb for instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c on n-h2-861333-10 Oct 19 06:55:29.707792 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-10eb71b6-6576-4a0f-bcb0-129f64785843 req-8a9ba868-a73b-4b6e-ab74-957253c7f4a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044463 Oct 19 06:55:29.708748 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 769/1525] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:55:29.790337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:29.796762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:29.805920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.806649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.807098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:29.810507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:29.811317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:29.814048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:30.033981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "refresh_cache-27358012-f191-4870-84f2-ef8ef5e7dbd5" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:55:30.034406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquired lock "refresh_cache-27358012-f191-4870-84f2-ef8ef5e7dbd5" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:55:30.116136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:30.126663 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2de12c0d-6361-44e1-a381-bfd973a7494d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1520 microversion: 2.1 time: 0.341940 Oct 19 06:55:30.130586 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 770/1526] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:29 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:30.135341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:30.135980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:30.153387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:30.153903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:30.154318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:30.155153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:30.157781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:30.157781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:30.383260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:30.400591 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91356bf2-1322-498f-872c-bfe922fdf3c7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.268873 Oct 19 06:55:30.404325 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 771/1527] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:30 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:30.426672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cc28cb6-df87-4a52-bf98-8bb0cb710f5a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:30.435466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8cc28cb6-df87-4a52-bf98-8bb0cb710f5a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:30.443708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc28cb6-df87-4a52-bf98-8bb0cb710f5a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:30.447263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc28cb6-df87-4a52-bf98-8bb0cb710f5a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:30.448637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc28cb6-df87-4a52-bf98-8bb0cb710f5a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:30.450401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc28cb6-df87-4a52-bf98-8bb0cb710f5a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:30.452352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc28cb6-df87-4a52-bf98-8bb0cb710f5a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:30.455074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc28cb6-df87-4a52-bf98-8bb0cb710f5a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:30.541819 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cc28cb6-df87-4a52-bf98-8bb0cb710f5a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136061 Oct 19 06:55:30.548246 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 772/1528] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 06:55:30 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:55:30.553571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:30.554269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:30.561421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:30.562215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:30.564485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:30.569131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:30.569131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:30.569131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:30.780858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:30.794018 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-407f6199-5c3a-432c-a08b-c5448d2cadd6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1472 microversion: 2.1 time: 0.244376 Oct 19 06:55:30.795192 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 773/1529] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:30 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:30.817778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:30.820221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:30.850142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:30.850636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:30.851070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:30.851778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:30.853754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:30.854195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:31.062024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:31.077637 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a3b1d3f-df95-41cc-a367-7a5d36386643 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1372 microversion: 2.1 time: 0.276334 Oct 19 06:55:31.080157 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 774/1530] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:30 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1372 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:31.155345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:31.156043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:31.174869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:31.180797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:31.181249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:31.182059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:31.182525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:31.182948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:31.394039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:31.403994 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff75337b-304f-4da3-86cb-44a56cbaafee tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1520 microversion: 2.1 time: 0.257923 Oct 19 06:55:31.410439 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 775/1531] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:31 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:31.427897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:31.428852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:31.439639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 06:55:31.464029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:31.464029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:31.464029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:31.464029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:31.464029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:31.464029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:31.678319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:31.690783 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8aa60cb2-4d13-4f19-b344-eea3aed79fd8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.267208 Oct 19 06:55:31.696475 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 776/1532] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:31 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:31.716762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9c0673d9-5e32-4023-bec3-1d3612591074 req-530fadc8-e486-4ffd-ad80-1e24772cea24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27358012-f191-4870-84f2-ef8ef5e7dbd5", "tag": "55412562-3af3-4588-a0dc-badea3ef1b9b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:31.741784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9c0673d9-5e32-4023-bec3-1d3612591074 req-530fadc8-e486-4ffd-ad80-1e24772cea24 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:31.742312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9c0673d9-5e32-4023-bec3-1d3612591074 req-530fadc8-e486-4ffd-ad80-1e24772cea24 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:31.742750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9c0673d9-5e32-4023-bec3-1d3612591074 req-530fadc8-e486-4ffd-ad80-1e24772cea24 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:31.775366 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9c0673d9-5e32-4023-bec3-1d3612591074 req-530fadc8-e486-4ffd-ad80-1e24772cea24 service nova] Creating event network-changed:55412562-3af3-4588-a0dc-badea3ef1b9b for instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 on n-h1-861333-10 Oct 19 06:55:31.788646 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9c0673d9-5e32-4023-bec3-1d3612591074 req-530fadc8-e486-4ffd-ad80-1e24772cea24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087550 Oct 19 06:55:31.789291 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 777/1533] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:31.802751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ac0f9cc-c375-4f12-90f4-26c2ee92a4d3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:31.806973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ac0f9cc-c375-4f12-90f4-26c2ee92a4d3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:31.823791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ac0f9cc-c375-4f12-90f4-26c2ee92a4d3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:31.824275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ac0f9cc-c375-4f12-90f4-26c2ee92a4d3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:31.828935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ac0f9cc-c375-4f12-90f4-26c2ee92a4d3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:31.828935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ac0f9cc-c375-4f12-90f4-26c2ee92a4d3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:31.828935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ac0f9cc-c375-4f12-90f4-26c2ee92a4d3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:31.828935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ac0f9cc-c375-4f12-90f4-26c2ee92a4d3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:31.889464 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ac0f9cc-c375-4f12-90f4-26c2ee92a4d3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098793 Oct 19 06:55:31.890527 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 778/1534] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 06:55:31 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:55:31.908796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:31.911421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:31.937354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:31.939212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:31.939894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:31.941238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:31.942687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:31.943551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:32.224076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:32.245186 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47c4369c-ad66-462b-8b34-e14957956a65 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1472 microversion: 2.1 time: 0.348906 Oct 19 06:55:32.245186 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 779/1535] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:31 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:32.252047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:32.252691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:32.260604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:32.261161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:32.263182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:32.272475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:32.275406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:32.276704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:32.677231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Updating instance_info_cache with network_info: [{"id": "55412562-3af3-4588-a0dc-badea3ef1b9b", "address": "fa:16:3e:5d:a2:d4", "network": {"id": "77fecbf9-0d41-4410-ad8b-4a1893b4dd94", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1796361494-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4248165058874e81a53cbcd2f194a649", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap55412562-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 06:55:32.754934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Releasing lock "refresh_cache-27358012-f191-4870-84f2-ef8ef5e7dbd5" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:55:32.756338 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b6cb048-32fe-4862-a53f-d686a5646552 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "POST /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5/action" status: 202 len: 0 microversion: 2.1 time: 3.272522 Oct 19 06:55:32.757880 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 757/1536] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:29 2022] POST /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5/action => generated 0 bytes in 3274 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 06:55:32.764044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:32.764905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:32.787432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:32.787941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:32.788406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:32.793428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:32.802994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:32.802994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:32.928095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:32.941390 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12802054-6aba-4e82-aed8-d5419bc51107 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1372 microversion: 2.1 time: 0.698135 Oct 19 06:55:32.951660 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 780/1537] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:32 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1372 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:32.961612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:32.969401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:32.992170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:32.992662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:32.993097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:32.993808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:32.994355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:32.994794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.084069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:33.091990 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59d8af6c-1197-412d-a127-b7a5f1326ca6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1505 microversion: 2.1 time: 0.332347 Oct 19 06:55:33.093157 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 758/1538] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:32 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:33.100017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:33.100613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:33.120453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:33.121121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:33.122684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.124215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:33.125161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:33.126498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.161638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:55:33.458050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:33.572705 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-290b079e-a05a-4bbb-9dfd-b8570342d2d6 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 204 len: 0 microversion: 2.1 time: 0.477774 Oct 19 06:55:33.573956 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 759/1539] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:55:33 2022] DELETE /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:55:33.582953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b0845d93-76a9-4ac7-947f-6d22a03b54ce req-38a43dc7-343b-4f2b-991d-e39c8fed8878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9", "name": "network-vif-plugged", "status": "completed", "tag": "351b1d84-abf0-486b-a0c3-f11e51a4d4ef"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:33.611421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b0845d93-76a9-4ac7-947f-6d22a03b54ce req-38a43dc7-343b-4f2b-991d-e39c8fed8878 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:33.612195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b0845d93-76a9-4ac7-947f-6d22a03b54ce req-38a43dc7-343b-4f2b-991d-e39c8fed8878 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:33.621512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b0845d93-76a9-4ac7-947f-6d22a03b54ce req-38a43dc7-343b-4f2b-991d-e39c8fed8878 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.633294 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b0845d93-76a9-4ac7-947f-6d22a03b54ce req-38a43dc7-343b-4f2b-991d-e39c8fed8878 service nova] Creating event network-vif-plugged:351b1d84-abf0-486b-a0c3-f11e51a4d4ef for instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 on n-h1-861333-10 Oct 19 06:55:33.639728 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b0845d93-76a9-4ac7-947f-6d22a03b54ce req-38a43dc7-343b-4f2b-991d-e39c8fed8878 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062867 Oct 19 06:55:33.644619 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 760/1540] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:33.648752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87edd21c-284e-428d-95a5-d1d9389d8a1b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:33.651279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87edd21c-284e-428d-95a5-d1d9389d8a1b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:33.657882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87edd21c-284e-428d-95a5-d1d9389d8a1b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:33.658576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87edd21c-284e-428d-95a5-d1d9389d8a1b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:33.659209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87edd21c-284e-428d-95a5-d1d9389d8a1b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.660084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87edd21c-284e-428d-95a5-d1d9389d8a1b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:33.660717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87edd21c-284e-428d-95a5-d1d9389d8a1b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:33.661493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87edd21c-284e-428d-95a5-d1d9389d8a1b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.699950 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87edd21c-284e-428d-95a5-d1d9389d8a1b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.057374 Oct 19 06:55:33.702008 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 761/1541] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 06:55:33 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:33.709761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:33.710569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:33.719017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:33.719017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:33.719017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.720382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:33.721030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:33.721619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.852574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:33.872217 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-376ccb86-7c23-49ae-b01e-761ce5c5cc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.927119 Oct 19 06:55:33.872217 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 781/1542] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:32 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:33.878573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:33.879148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:33.893887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:33.894401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:33.894844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.895563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:33.896027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:33.897294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:33.978856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:33.983040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=5,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:34.015304 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20446a89-23f8-45fa-8a30-0a5c5592f58a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 200 len: 1505 microversion: 2.1 time: 0.311892 Oct 19 06:55:34.016150 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 762/1543] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:33 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:34.042249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.111"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:34.047897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:34.060069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:34.060596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:34.061041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:34.061739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:34.062379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:34.063554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:34.107330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "refresh_cache-4c92b51c-7d82-44ed-81ff-fefbab541406" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:55:34.110997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquired lock "refresh_cache-4c92b51c-7d82-44ed-81ff-fefbab541406" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:55:34.524596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:34.535123 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e076b08-f633-4504-8bea-636dab37d4c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1472 microversion: 2.1 time: 0.663361 Oct 19 06:55:34.535714 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 782/1544] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:33 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1472 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:34.543923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:34.552718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:34.564323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:34.564817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:34.565247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:34.569561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:34.576215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:34.580520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:34.768950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:34.773915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:34.781233 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a647287-b9ac-4f73-bcfe-e70829eeeb09 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1372 microversion: 2.1 time: 0.240511 Oct 19 06:55:34.782638 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 783/1545] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:34 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:34.788234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:34.788954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:34.796583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:34.797450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:34.798053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:34.798923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:34.799544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:34.800252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:34.834801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:55:35.155487 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a606bd1a-fdf6-4b95-9e3b-9c793de9b916 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 204 len: 0 microversion: 2.1 time: 0.370817 Oct 19 06:55:35.171029 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 784/1546] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:55:34 2022] DELETE /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:55:35.192085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:35.194714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:35.212076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:35.212917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:35.214242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:35.215254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:35.216749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:35.217942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:35.413876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:35.436392 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c545d203-fb63-486a-9b9c-af22e401331b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.250588 Oct 19 06:55:35.436392 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 785/1547] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:35 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:35.436392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1756159756", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "a41d894c-52b0-4b0d-8cab-72c2814699a7"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:35.512157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] validate_networks() for [('a41d894c-52b0-4b0d-8cab-72c2814699a7', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:55:36.052890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 06:55:36.746016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:55:36.747163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:55:36.747723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:55:36.748139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:55:36.748561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:55:36.773181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:36.773683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:36.774420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:36.774854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:36.783310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:36.783310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:36.852162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Getting quotas for project 9ded99a8f4204d6985060451b881d84f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:55:36.861141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:36.868937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Getting quotas for user 4ee94c5c732c4e579ec3e85f3018641b and project 9ded99a8f4204d6985060451b881d84f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:55:36.904765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:55:36.912056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:55:37.012621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Updating instance_info_cache with network_info: [{"id": "a0b47758-23a8-44ef-84c0-617e5de683a7", "address": "fa:16:3e:3c:4e:05", "network": {"id": "77fecbf9-0d41-4410-ad8b-4a1893b4dd94", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1796361494-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4248165058874e81a53cbcd2f194a649", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0b47758-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 06:55:37.076708 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15b9b6d5-1207-4b26-a667-10b0bd885318 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.650537 Oct 19 06:55:37.077796 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 786/1548] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:55:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:55:37.092362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:37.092993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:37.108407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:37.108905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:37.113279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:37.114531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:37.115306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:37.119048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:37.127385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Releasing lock "refresh_cache-4c92b51c-7d82-44ed-81ff-fefbab541406" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:55:37.131064 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a929d7b0-06d7-4cb9-a544-b3b9702a4bbc tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "POST /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406/action" status: 202 len: 0 microversion: 2.1 time: 3.101976 Oct 19 06:55:37.138153 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 763/1549] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:34 2022] POST /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406/action => generated 0 bytes in 3119 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 06:55:37.152146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:37.154257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:37.187132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:37.189083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:37.190781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:37.192469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:37.193138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:37.196000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:37.386725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:37.412786 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cbcc925-1d07-4867-97f1-d7eda7b63a41 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.326906 Oct 19 06:55:37.429955 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 787/1550] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:37 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:37.461958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d79a93c9-de01-4379-a6c9-85cf0ded1120 req-0fb22e82-be0e-48de-8a87-bd3816babe01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c92b51c-7d82-44ed-81ff-fefbab541406", "tag": "a0b47758-23a8-44ef-84c0-617e5de683a7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:37.517718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d79a93c9-de01-4379-a6c9-85cf0ded1120 req-0fb22e82-be0e-48de-8a87-bd3816babe01 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:37.530106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d79a93c9-de01-4379-a6c9-85cf0ded1120 req-0fb22e82-be0e-48de-8a87-bd3816babe01 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:37.530106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d79a93c9-de01-4379-a6c9-85cf0ded1120 req-0fb22e82-be0e-48de-8a87-bd3816babe01 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:37.548031 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d79a93c9-de01-4379-a6c9-85cf0ded1120 req-0fb22e82-be0e-48de-8a87-bd3816babe01 service nova] Creating event network-changed:a0b47758-23a8-44ef-84c0-617e5de683a7 for instance 4c92b51c-7d82-44ed-81ff-fefbab541406 on n-h2-861333-10 Oct 19 06:55:37.556414 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d79a93c9-de01-4379-a6c9-85cf0ded1120 req-0fb22e82-be0e-48de-8a87-bd3816babe01 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125317 Oct 19 06:55:37.557669 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 788/1551] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:37.564148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:37.564961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:37.572565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:37.573120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:37.573625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:37.574338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:37.574941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:37.575453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:37.671164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:37.691274 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca9af114-d888-47b5-881c-c9cb04eb8087 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1558 microversion: 2.1 time: 0.550257 Oct 19 06:55:37.693580 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 764/1552] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:37 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1558 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:37.699810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-fa845c70-94b6-4a1c-a73c-4d0f8561cd60 req-2caff916-5a2b-4731-a709-67cdb8adfe9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27358012-f191-4870-84f2-ef8ef5e7dbd5", "name": "network-vif-deleted", "tag": "55412562-3af3-4588-a0dc-badea3ef1b9b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:37.712412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fa845c70-94b6-4a1c-a73c-4d0f8561cd60 req-2caff916-5a2b-4731-a709-67cdb8adfe9d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:37.712900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fa845c70-94b6-4a1c-a73c-4d0f8561cd60 req-2caff916-5a2b-4731-a709-67cdb8adfe9d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:37.713423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fa845c70-94b6-4a1c-a73c-4d0f8561cd60 req-2caff916-5a2b-4731-a709-67cdb8adfe9d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:37.751520 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-fa845c70-94b6-4a1c-a73c-4d0f8561cd60 req-2caff916-5a2b-4731-a709-67cdb8adfe9d service nova] Creating event network-vif-deleted:55412562-3af3-4588-a0dc-badea3ef1b9b for instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 on n-h1-861333-10 Oct 19 06:55:37.798479 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-fa845c70-94b6-4a1c-a73c-4d0f8561cd60 req-2caff916-5a2b-4731-a709-67cdb8adfe9d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103469 Oct 19 06:55:37.800500 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 765/1553] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:37.809230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1d178ed-4808-45f4-9e5d-0f2d8f4c4424 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:37.821175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1d178ed-4808-45f4-9e5d-0f2d8f4c4424 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:37.995481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:38.007648 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08af1992-908c-400c-9610-960f67fc0151 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.448436 Oct 19 06:55:38.012291 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 789/1554] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:37 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:38.021918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5ad8b9e-4876-4f0b-b927-8b4ed05162da tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '.version_select at 0x7f6d650cb9d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:38.067680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1d178ed-4808-45f4-9e5d-0f2d8f4c4424 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:38.094879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1d178ed-4808-45f4-9e5d-0f2d8f4c4424 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1218 microversion: 2.1 time: 0.292777 Oct 19 06:55:38.101291 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 766/1555] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:37 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1218 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:38.121106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cab69abf-777a-40f0-ae35-df4e9f120222 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:38.127933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cab69abf-777a-40f0-ae35-df4e9f120222 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:38.153994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab69abf-777a-40f0-ae35-df4e9f120222 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:38.155060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab69abf-777a-40f0-ae35-df4e9f120222 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:38.157622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab69abf-777a-40f0-ae35-df4e9f120222 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:38.160890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab69abf-777a-40f0-ae35-df4e9f120222 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:38.162404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab69abf-777a-40f0-ae35-df4e9f120222 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:38.163789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab69abf-777a-40f0-ae35-df4e9f120222 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:38.325244 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cab69abf-777a-40f0-ae35-df4e9f120222 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222503 Oct 19 06:55:38.329197 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5ad8b9e-4876-4f0b-b927-8b4ed05162da tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/61b31e04-9ee5-4f9d-9110-8329d4b98940" status: 200 len: 185 microversion: 2.1 time: 0.315559 Oct 19 06:55:38.333102 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 790/1556] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 06:55:38 2022] GET /compute/v2.1/os-floating-ips/61b31e04-9ee5-4f9d-9110-8329d4b98940 => generated 185 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:38.341355 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 767/1557] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 06:55:38 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-interface => generated 285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:38.349192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Action: 'action', calling method: .version_select at 0x7f6d66532ee0>, body: {"removeFloatingIp": {"address": "172.25.6.111"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:38.446318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:38.446956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:38.463294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:38.468509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:38.474067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:38.474860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:38.475344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:38.475882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:38.778947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:38.793685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-486670fe-02c3-4436-98b1-e60c5ed691d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.349430 Oct 19 06:55:38.796591 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 768/1558] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:38 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:38.932943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:38.940087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:38.940930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:38.941592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:38.943220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:38.944660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:38.946155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:39.039900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:39.044265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:39.063114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:39.063617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:39.064063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:39.064810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:39.072429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:39.077241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:39.381710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:39.391583 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a06bc187-ed2a-4883-86b8-3d8d54ef5594 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1498 microversion: 2.1 time: 0.362475 Oct 19 06:55:39.393093 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 769/1559] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:39 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1498 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:39.401163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:39.406205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:39.429672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:39.435759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:39.436344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:39.438694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:39.439911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:39.440655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:39.531520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "refresh_cache-4c92b51c-7d82-44ed-81ff-fefbab541406" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:55:39.532082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquired lock "refresh_cache-4c92b51c-7d82-44ed-81ff-fefbab541406" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:55:39.539737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:39.552584 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f81b659b-e4ed-424a-b841-424a3a677627 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1214 microversion: 2.1 time: 0.157329 Oct 19 06:55:39.581212 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 770/1560] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:39 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:39.821550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:39.828419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:39.831030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:39.831770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:39.832460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:39.833408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:39.834241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:39.835073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:40.216505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:40.226531 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a483a8d-6acc-4085-ac90-7e71d509ff04 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.409629 Oct 19 06:55:40.240130 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 771/1561] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:39 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:40.241112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-199bbd5a-942a-4302-9a26-7c3858fb21b9 req-763ed6e4-8679-410c-a2eb-b003c42be3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c", "name": "network-vif-deleted", "tag": "151f65d0-8d84-4554-afad-3126bb1f00fb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:40.262142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-199bbd5a-942a-4302-9a26-7c3858fb21b9 req-763ed6e4-8679-410c-a2eb-b003c42be3cf service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:40.262354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-199bbd5a-942a-4302-9a26-7c3858fb21b9 req-763ed6e4-8679-410c-a2eb-b003c42be3cf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:40.262678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-199bbd5a-942a-4302-9a26-7c3858fb21b9 req-763ed6e4-8679-410c-a2eb-b003c42be3cf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:40.276691 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-199bbd5a-942a-4302-9a26-7c3858fb21b9 req-763ed6e4-8679-410c-a2eb-b003c42be3cf service nova] Creating event network-vif-deleted:151f65d0-8d84-4554-afad-3126bb1f00fb for instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c on n-h2-861333-10 Oct 19 06:55:40.283684 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-199bbd5a-942a-4302-9a26-7c3858fb21b9 req-763ed6e4-8679-410c-a2eb-b003c42be3cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053227 Oct 19 06:55:40.285312 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 772/1562] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:40.421285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:40.423542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:40.435902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:40.437300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:40.439273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:40.440492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:40.441150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:40.441864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:40.824089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:40.835480 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0dc3c3f-8b7f-4755-941a-b49f4b4c14b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 200 len: 1475 microversion: 2.1 time: 0.421087 Oct 19 06:55:40.836064 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 773/1563] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:40 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 1475 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:40.857696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:40.860673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:40.906009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:40.907910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:40.908735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:40.911644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:40.912788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:40.913841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:41.157845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Building network info cache for instance {{(pid=127568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 06:55:41.167997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:41.179916 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9351016e-b2bd-4def-bc0b-7c03084b36e3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1278 microversion: 2.1 time: 0.335340 Oct 19 06:55:41.181618 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 774/1564] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:40 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1278 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:41.221207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81ee705d-91cc-4e38-a1d4-855ef3ef9ed6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1358229803"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:41.226095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81ee705d-91cc-4e38-a1d4-855ef3ef9ed6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:41.259907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81ee705d-91cc-4e38-a1d4-855ef3ef9ed6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:41.267772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81ee705d-91cc-4e38-a1d4-855ef3ef9ed6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:41.272291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81ee705d-91cc-4e38-a1d4-855ef3ef9ed6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:41.273582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81ee705d-91cc-4e38-a1d4-855ef3ef9ed6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:41.274314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81ee705d-91cc-4e38-a1d4-855ef3ef9ed6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:41.275100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81ee705d-91cc-4e38-a1d4-855ef3ef9ed6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:41.948844 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81ee705d-91cc-4e38-a1d4-855ef3ef9ed6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684/action" status: 202 len: 0 microversion: 2.1 time: 0.745162 Oct 19 06:55:41.951357 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 775/1565] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:41 2022] POST /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 06:55:41.966237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-19828922-2803-4616-8056-f9152ba42f8c req-0596417e-b3e4-4791-8c3c-96677f18b74c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9", "tag": "351b1d84-abf0-486b-a0c3-f11e51a4d4ef"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:42.001376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-19828922-2803-4616-8056-f9152ba42f8c req-0596417e-b3e4-4791-8c3c-96677f18b74c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:42.002136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-19828922-2803-4616-8056-f9152ba42f8c req-0596417e-b3e4-4791-8c3c-96677f18b74c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:42.003671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-19828922-2803-4616-8056-f9152ba42f8c req-0596417e-b3e4-4791-8c3c-96677f18b74c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:42.021053 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-19828922-2803-4616-8056-f9152ba42f8c req-0596417e-b3e4-4791-8c3c-96677f18b74c service nova] Creating event network-changed:351b1d84-abf0-486b-a0c3-f11e51a4d4ef for instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 on n-h1-861333-10 Oct 19 06:55:42.027447 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-19828922-2803-4616-8056-f9152ba42f8c req-0596417e-b3e4-4791-8c3c-96677f18b74c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073993 Oct 19 06:55:42.029257 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 776/1566] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:42.038292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:42.039500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:42.050625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:42.051412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:42.052085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:42.053048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:42.053766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:42.054380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:42.530224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:42.543022 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62d18983-2b9e-4ef5-acaf-55cf3ea1e1cc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.512094 Oct 19 06:55:42.545087 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 777/1567] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:42 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:42.555010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17fb20e5-25d4-4f62-bfb4-d246fa43375f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d648ca310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:42.615666 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17fb20e5-25d4-4f62-bfb4-d246fa43375f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 0.069105 Oct 19 06:55:42.624790 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 778/1568] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:55:42 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:42.631022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:42.631659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:42.638985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:42.641040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:42.641040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:42.641794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:42.642410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:42.643010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:42.733763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:42.749815 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36c9eab6-873e-47af-84a9-7d40664230ef tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1276 microversion: 2.1 time: 0.122979 Oct 19 06:55:42.754083 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 779/1569] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:42 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:42.759361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4a6695f3-ded1-4eda-b6a7-b85d07d56038 req-0431aec9-76cd-46af-aeab-4d4c097e4a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c92b51c-7d82-44ed-81ff-fefbab541406", "tag": "a0b47758-23a8-44ef-84c0-617e5de683a7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:42.771447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4a6695f3-ded1-4eda-b6a7-b85d07d56038 req-0431aec9-76cd-46af-aeab-4d4c097e4a35 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:42.771943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4a6695f3-ded1-4eda-b6a7-b85d07d56038 req-0431aec9-76cd-46af-aeab-4d4c097e4a35 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:42.772461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4a6695f3-ded1-4eda-b6a7-b85d07d56038 req-0431aec9-76cd-46af-aeab-4d4c097e4a35 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:42.795379 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4a6695f3-ded1-4eda-b6a7-b85d07d56038 req-0431aec9-76cd-46af-aeab-4d4c097e4a35 service nova] Creating event network-changed:a0b47758-23a8-44ef-84c0-617e5de683a7 for instance 4c92b51c-7d82-44ed-81ff-fefbab541406 on n-h2-861333-10 Oct 19 06:55:42.805514 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4a6695f3-ded1-4eda-b6a7-b85d07d56038 req-0431aec9-76cd-46af-aeab-4d4c097e4a35 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049932 Oct 19 06:55:42.806394 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 780/1570] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:43.499978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "091bef54-f8d9-435b-8fae-9d4b25fed20d"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:43.503128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:43.517166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:43.520252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:43.520252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:43.520252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:43.520252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:43.520252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:43.780719 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] HTTP exception thrown: Volume 091bef54-f8d9-435b-8fae-9d4b25fed20d could not be found. Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Request method failure captured: Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments/a32e05a0-dee1-41a2-a56e-931e5114575a HTTP/1.1 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 74 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT57-Lb7TFQ2jk7HBnKXl5kkDCNTtx9KGz-Lf9vOzuRsDlbhPh49GGZB5BA_FEI4flUi2yI6GxxT8X43kUzlF1X1tr79CLIdTGoV3f37ce1nT8NNw_HqeQ3MTb521n3XN3Ssm8g8gWEfw-0QsnGxnDyhimO2ZJitXQuDBSlKG6GpAY20 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 7cf6c2dfe4e440a2bae43112def98b18 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesAdminNegativeTest-822143533 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7cf6c2dfe4e440a2bae43112def98b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7cf6c2dfe4e440a2bae43112def98b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7cf6c2dfe4e440a2bae43112def98b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7cf6c2dfe4e440a2bae43112def98b18", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesAdminNegativeTest-822143533 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 7cf6c2dfe4e440a2bae43112def98b18 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-822143533 Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesAdminNegativeTest-822143533-project-admin Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 0080f061bf3944d294dc9efd3dfaa3dc Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesAdminNegativeTest-822143533-project-admin Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: {"volumeAttachment": {"volumeId": "091bef54-f8d9-435b-8fae-9d4b25fed20d"}} Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: exception: Volume 091bef54-f8d9-435b-8fae-9d4b25fed20d could not be found. Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': '05c7927e-9e6e-4edc-acb0-6fc27121aafd', 'id': 'a32e05a0-dee1-41a2-a56e-931e5114575a', 'body': {'volumeAttachment': {'volumeId': '091bef54-f8d9-435b-8fae-9d4b25fed20d'}}} Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 091bef54-f8d9-435b-8fae-9d4b25fed20d could not be found. (HTTP 404) (Request-ID: req-567d141f-4ad1-4979-8cf7-a9ced4558a02) Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 06:55:43.837077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 091bef54-f8d9-435b-8fae-9d4b25fed20d could not be found. Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 091bef54-f8d9-435b-8fae-9d4b25fed20d could not be found. Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 091bef54-f8d9-435b-8fae-9d4b25fed20d could not be found. Oct 19 06:55:43.842025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:43.847140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Returning 400 to user: Volume 091bef54-f8d9-435b-8fae-9d4b25fed20d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:55:43.848181 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04643392-0fde-44ab-b1a1-9f47a9dfd658 tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] 10.222.0.39 "PUT /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments/a32e05a0-dee1-41a2-a56e-931e5114575a" status: 400 len: 107 microversion: 2.1 time: 0.674109 Oct 19 06:55:43.848826 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 781/1571] 10.222.0.39 () {60 vars in 1433 bytes} [Wed Oct 19 06:55:43 2022] PUT /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments/a32e05a0-dee1-41a2-a56e-931e5114575a => generated 107 bytes in 676 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 06:55:43.856892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:43.857591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:43.876986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:43.880794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:43.883054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:43.892624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:43.893244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:43.895484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.041334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Updating instance_info_cache with network_info: [{"id": "a0b47758-23a8-44ef-84c0-617e5de683a7", "address": "fa:16:3e:3c:4e:05", "network": {"id": "77fecbf9-0d41-4410-ad8b-4a1893b4dd94", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1796361494-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4248165058874e81a53cbcd2f194a649", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0b47758-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 06:55:44.128581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:44.133518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Releasing lock "refresh_cache-4c92b51c-7d82-44ed-81ff-fefbab541406" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:55:44.134894 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3270d657-3497-4383-b752-5628ef772bc4 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "POST /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406/action" status: 202 len: 0 microversion: 2.1 time: 5.792375 Oct 19 06:55:44.136072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:44.136411 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 791/1572] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:38 2022] POST /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406/action => generated 0 bytes in 5794 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 06:55:44.141426 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73f6e1f2-e229-4461-9464-740b2af666a8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.291487 Oct 19 06:55:44.147952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ac4796e-2aeb-4d16-a7c3-782d58e4583e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d6494cee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:44.148667 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 782/1573] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:43 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:44.148667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:44.148667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:44.154957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.157199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.157199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.157410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.157851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.158291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.204299 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ac4796e-2aeb-4d16-a7c3-782d58e4583e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 0.065898 Oct 19 06:55:44.220773 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 792/1574] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:55:44 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:44.220773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:44.221234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:44.237035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.237836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.238734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.240003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.240661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.242387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.403069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lazy-loading 'services' on Instance uuid 05c7927e-9e6e-4edc-acb0-6fc27121aafd {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:55:44.468836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:44.479855 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8a7bc12-37d8-4dea-8fae-11972e95e50e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1318 microversion: 2.1 time: 0.335073 Oct 19 06:55:44.482388 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 783/1575] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:44 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:44.491570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:44.501094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:44.509694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.512589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.514696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.515430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.518505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.519153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.543211 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] HTTP exception thrown: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Request method failure captured: Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 HTTP/1.1 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT58gp6X0VLT-mkZaDiYApcHdlCCtKBCYXZZw14ABKdLVCYqtFhjUScf3sOTNCMJ4jLtjcGoArMoDHUetTyf0Eppkuy2lWDh5UoPqgD5yEhz_WdHIKAw9th0TkYpKOy-5Rg9Ueu-nAJclZ8ia1QHU50JH-r3kG5QpzkU1jDwJwNpjkKo Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4248165058874e81a53cbcd2f194a649 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4248165058874e81a53cbcd2f194a649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4248165058874e81a53cbcd2f194a649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4248165058874e81a53cbcd2f194a649"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4248165058874e81a53cbcd2f194a649", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4248165058874e81a53cbcd2f194a649 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationTestJSON-991858814-project Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 6598d68715524f40aa57fb25b378fb17 Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-991858814-project Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '27358012-f191-4870-84f2-ef8ef5e7dbd5'} Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:55:44.544795 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Returning 404 to user: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f59b803-bcd2-40fa-b17c-bf3b697d2d49 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 404 len: 111 microversion: 2.1 time: 0.062604 Oct 19 06:55:44.555001 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 784/1576] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:55:44 2022] DELETE /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:55:44.563660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:44.564616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 27358012-f191-4870-84f2-ef8ef5e7dbd5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:44.574163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.574738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.575252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.576206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.576678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.577122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.598520 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] HTTP exception thrown: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Request method failure captured: Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 HTTP/1.1 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT58gp6X0VLT-mkZaDiYApcHdlCCtKBCYXZZw14ABKdLVCYqtFhjUScf3sOTNCMJ4jLtjcGoArMoDHUetTyf0Eppkuy2lWDh5UoPqgD5yEhz_WdHIKAw9th0TkYpKOy-5Rg9Ueu-nAJclZ8ia1QHU50JH-r3kG5QpzkU1jDwJwNpjkKo Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4248165058874e81a53cbcd2f194a649 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4248165058874e81a53cbcd2f194a649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4248165058874e81a53cbcd2f194a649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4248165058874e81a53cbcd2f194a649"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4248165058874e81a53cbcd2f194a649", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4248165058874e81a53cbcd2f194a649 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationTestJSON-991858814-project Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 6598d68715524f40aa57fb25b378fb17 Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-991858814-project Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '27358012-f191-4870-84f2-ef8ef5e7dbd5'} Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.600440 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Returning 404 to user: Instance 27358012-f191-4870-84f2-ef8ef5e7dbd5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa725ca1-9851-4932-9778-5bb138207409 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5" status: 404 len: 111 microversion: 2.1 time: 0.049076 Oct 19 06:55:44.604463 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 785/1577] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:44 2022] GET /compute/v2.1/servers/27358012-f191-4870-84f2-ef8ef5e7dbd5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:55:44.611167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-913cf7ba-5cfc-4e7e-ae4e-98ac6d39c26b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '.version_select at 0x7f6d64d68a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:44.772365 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46e2b8e5-25d3-462d-9891-3d2b5ce4731a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "DELETE /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments/a32e05a0-dee1-41a2-a56e-931e5114575a" status: 202 len: 0 microversion: 2.1 time: 0.557318 Oct 19 06:55:44.772965 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 793/1578] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 06:55:44 2022] DELETE /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments/a32e05a0-dee1-41a2-a56e-931e5114575a => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:55:44.782512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-891b96db-e481-4152-b554-33986e7c541b tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:44.793895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-891b96db-e481-4152-b554-33986e7c541b tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:44.800918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-891b96db-e481-4152-b554-33986e7c541b tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.801410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-891b96db-e481-4152-b554-33986e7c541b tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.802084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-891b96db-e481-4152-b554-33986e7c541b tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.802986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-891b96db-e481-4152-b554-33986e7c541b tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.805312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-891b96db-e481-4152-b554-33986e7c541b tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.806030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-891b96db-e481-4152-b554-33986e7c541b tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.849915 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-891b96db-e481-4152-b554-33986e7c541b tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072080 Oct 19 06:55:44.854725 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 794/1579] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:44 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:44.855734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-34a77164-805d-470d-8331-0318af946ca6 req-c9193ab0-a087-4ad3-82dc-53a22abbc71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd0b472-47fb-4849-bf9f-5256db4fdd3b", "tag": "e1ae4327-3a87-4d6c-8dae-44c5eed21aab"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:44.872011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-34a77164-805d-470d-8331-0318af946ca6 req-c9193ab0-a087-4ad3-82dc-53a22abbc71c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:44.873794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-34a77164-805d-470d-8331-0318af946ca6 req-c9193ab0-a087-4ad3-82dc-53a22abbc71c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:44.874613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-34a77164-805d-470d-8331-0318af946ca6 req-c9193ab0-a087-4ad3-82dc-53a22abbc71c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:44.890127 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-34a77164-805d-470d-8331-0318af946ca6 req-c9193ab0-a087-4ad3-82dc-53a22abbc71c service nova] Creating event network-changed:e1ae4327-3a87-4d6c-8dae-44c5eed21aab for instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b on n-h1-861333-10 Oct 19 06:55:44.897998 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-34a77164-805d-470d-8331-0318af946ca6 req-c9193ab0-a087-4ad3-82dc-53a22abbc71c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045325 Oct 19 06:55:44.898873 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 795/1580] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:45.173711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:45.174614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:45.192320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:45.192320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:45.192320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:45.192320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:45.192320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:45.192320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:45.397893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:45.409818 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b52fee06-42af-42a2-a06e-5a65cf59ae31 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.240815 Oct 19 06:55:45.410416 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 796/1581] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:45 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:45.415199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-885218a6-1969-4317-b557-e88dc1f11335 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d6494c9d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:45.593546 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-885218a6-1969-4317-b557-e88dc1f11335 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 0.182058 Oct 19 06:55:45.594167 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 797/1582] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:55:45 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:45.598817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:45.599454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:45.614928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:45.615437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:45.615863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:45.616635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:45.617101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:45.617536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:45.811527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:45.829817 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f8e2082-ba16-45b9-8873-11e3bde7f557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1318 microversion: 2.1 time: 0.234580 Oct 19 06:55:45.830410 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 798/1583] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:45 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:45.863094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97750856-a883-4cb1-bbca-c923dc9a9dce tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:45.865692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97750856-a883-4cb1-bbca-c923dc9a9dce tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:45.878996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97750856-a883-4cb1-bbca-c923dc9a9dce tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:45.880782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97750856-a883-4cb1-bbca-c923dc9a9dce tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:45.882743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97750856-a883-4cb1-bbca-c923dc9a9dce tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:45.883502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97750856-a883-4cb1-bbca-c923dc9a9dce tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:45.885420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97750856-a883-4cb1-bbca-c923dc9a9dce tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:45.887386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97750856-a883-4cb1-bbca-c923dc9a9dce tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:45.940055 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97750856-a883-4cb1-bbca-c923dc9a9dce tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081310 Oct 19 06:55:45.940989 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 799/1584] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:45 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:55:46.033731 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-913cf7ba-5cfc-4e7e-ae4e-98ac6d39c26b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/61b31e04-9ee5-4f9d-9110-8329d4b98940" status: 202 len: 0 microversion: 2.1 time: 1.426893 Oct 19 06:55:46.034610 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 786/1585] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:55:44 2022] DELETE /compute/v2.1/os-floating-ips/61b31e04-9ee5-4f9d-9110-8329d4b98940 => generated 0 bytes in 1428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 06:55:46.042843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:46.043049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:46.051543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:46.052356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:46.052974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:46.054029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:46.054500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:46.054931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:46.093500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:55:46.267428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:46.434506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:46.435640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:46.466045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:46.466830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:46.469471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:46.474355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:46.475371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:46.476198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:46.574065 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be92ee37-1b4b-4f8b-a553-76d52e5f2fe5 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 204 len: 0 microversion: 2.1 time: 0.535103 Oct 19 06:55:46.579997 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 800/1586] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:55:46 2022] DELETE /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:55:46.598355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3fa63a9b-80bd-4c7d-98a8-a580e987d07c req-454b3731-0bcc-4d49-af54-5164001370ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e405aee-9ae5-4c1c-a013-11fb09e48684", "name": "network-vif-plugged", "status": "completed", "tag": "28594c96-ab77-4afe-9c36-c33388040c61"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:46.637681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3fa63a9b-80bd-4c7d-98a8-a580e987d07c req-454b3731-0bcc-4d49-af54-5164001370ab service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:46.640362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3fa63a9b-80bd-4c7d-98a8-a580e987d07c req-454b3731-0bcc-4d49-af54-5164001370ab service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:46.641619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3fa63a9b-80bd-4c7d-98a8-a580e987d07c req-454b3731-0bcc-4d49-af54-5164001370ab service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:46.682047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3fa63a9b-80bd-4c7d-98a8-a580e987d07c req-454b3731-0bcc-4d49-af54-5164001370ab service nova] Creating event network-vif-plugged:28594c96-ab77-4afe-9c36-c33388040c61 for instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 on n-h1-861333-10 Oct 19 06:55:46.694131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:46.696871 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3fa63a9b-80bd-4c7d-98a8-a580e987d07c req-454b3731-0bcc-4d49-af54-5164001370ab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110694 Oct 19 06:55:46.697771 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 801/1587] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:46.703812 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36d9b6e2-1992-412a-a0ad-e31dc413d37a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.273852 Oct 19 06:55:46.705630 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 787/1588] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:46 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:46.708924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:46.711214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e38b85a1-d198-41db-b408-95b686eb9351 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64ee38b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:46.712253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:46.725641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:46.730339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:46.736482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:46.736482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:46.736482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:46.736482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:46.818854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:46.889128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:46.943579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:46.956613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a4e4223-71c6-45cb-b204-383a26eca83d tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1527 microversion: 2.1 time: 0.255037 Oct 19 06:55:46.957817 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 802/1589] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:46 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1527 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:46.965895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:46.966763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:46.976744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:46.977239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:46.977680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:46.978386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:46.978860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:46.979655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:47.191599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:47.205672 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf425325-da5c-46e4-b8ed-350ba04c39f3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1318 microversion: 2.1 time: 0.241791 Oct 19 06:55:47.220738 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 803/1590] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:46 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:47.232639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0378f2a-b4d9-4e75-bf11-6647969059c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:47.235552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0378f2a-b4d9-4e75-bf11-6647969059c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:47.246401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0378f2a-b4d9-4e75-bf11-6647969059c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:47.247253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0378f2a-b4d9-4e75-bf11-6647969059c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:47.247980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0378f2a-b4d9-4e75-bf11-6647969059c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:47.248989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0378f2a-b4d9-4e75-bf11-6647969059c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:47.249696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0378f2a-b4d9-4e75-bf11-6647969059c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:47.250338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0378f2a-b4d9-4e75-bf11-6647969059c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:47.299657 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0378f2a-b4d9-4e75-bf11-6647969059c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071259 Oct 19 06:55:47.301383 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 804/1591] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:47 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:47.730702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:47.732390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:47.743435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:47.744439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:47.745079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:47.745959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:47.746758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:47.747202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:47.971833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:47.981945 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19df6f56-e240-4f75-9e82-09c7b85d5177 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.255259 Oct 19 06:55:47.983389 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 805/1592] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:47 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:48.001807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:48.002707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:48.010655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:48.011634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:48.012309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:48.013306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:48.013933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:48.014627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:48.072766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:48.538889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:48.538889 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4de48197-49f6-4d7a-ae44-56e469392ccd tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1527 microversion: 2.1 time: 0.532525 Oct 19 06:55:48.538889 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 806/1593] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:47 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1527 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:48.542635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:48.543540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:48.563714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:48.564630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:48.565255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:48.566172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:48.569353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:48.570203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:49.306947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:49.321057 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8149b930-f032-474a-8c9e-c6cba56af26e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1318 microversion: 2.1 time: 0.789243 Oct 19 06:55:49.334451 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 807/1594] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:48 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1318 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:49.334451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18871a04-0e1c-43ad-a8d6-b184d183a3cf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:49.342150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18871a04-0e1c-43ad-a8d6-b184d183a3cf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:49.359504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18871a04-0e1c-43ad-a8d6-b184d183a3cf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:49.362952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18871a04-0e1c-43ad-a8d6-b184d183a3cf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:49.363519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18871a04-0e1c-43ad-a8d6-b184d183a3cf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:49.364661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18871a04-0e1c-43ad-a8d6-b184d183a3cf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:49.369180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18871a04-0e1c-43ad-a8d6-b184d183a3cf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:49.370863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18871a04-0e1c-43ad-a8d6-b184d183a3cf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:49.457575 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18871a04-0e1c-43ad-a8d6-b184d183a3cf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129079 Oct 19 06:55:49.458299 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 808/1595] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:49 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:49.465096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:49.477335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:49.487566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:49.489591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:49.492239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:49.493434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:49.497206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:49.497754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:49.901196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:49.913402 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-411c0b2f-095d-46ed-b091-1b2351d14896 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.453813 Oct 19 06:55:49.916259 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 809/1596] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:49 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:49.944569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7d356d23-4ece-4193-919d-aa099dcc3a68 req-7e4e4a34-ad04-4cca-8795-b655dc45e200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c92b51c-7d82-44ed-81ff-fefbab541406", "name": "network-vif-deleted", "tag": "a0b47758-23a8-44ef-84c0-617e5de683a7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:49.964502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7d356d23-4ece-4193-919d-aa099dcc3a68 req-7e4e4a34-ad04-4cca-8795-b655dc45e200 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:49.964992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7d356d23-4ece-4193-919d-aa099dcc3a68 req-7e4e4a34-ad04-4cca-8795-b655dc45e200 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:49.965430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7d356d23-4ece-4193-919d-aa099dcc3a68 req-7e4e4a34-ad04-4cca-8795-b655dc45e200 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:49.982740 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7d356d23-4ece-4193-919d-aa099dcc3a68 req-7e4e4a34-ad04-4cca-8795-b655dc45e200 service nova] Creating event network-vif-deleted:a0b47758-23a8-44ef-84c0-617e5de683a7 for instance 4c92b51c-7d82-44ed-81ff-fefbab541406 on n-h2-861333-10 Oct 19 06:55:49.988600 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7d356d23-4ece-4193-919d-aa099dcc3a68 req-7e4e4a34-ad04-4cca-8795-b655dc45e200 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055089 Oct 19 06:55:49.989618 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 810/1597] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:49.995556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:49.996823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:50.006228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.010438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.010438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:50.010438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.010438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.010438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:50.077523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.078019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.078464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:50.078958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lazy-loading 'fault' on Instance uuid 4c92b51c-7d82-44ed-81ff-fefbab541406 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:55:50.144771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:50.155630 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d022993-b5de-4b34-885f-7fb4cfc3f226 tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1314 microversion: 2.1 time: 0.164450 Oct 19 06:55:50.157666 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 811/1598] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:49 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:50.354107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:50.355065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:50.365730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.367256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.368735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:50.376265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.376265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.376265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:50.661174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:50.670724 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cfc0f056-5301-4085-931a-d1057f7fb147 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1318 microversion: 2.1 time: 0.323934 Oct 19 06:55:50.684255 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 812/1599] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:50 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:50.690504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba082e42-c43a-446c-9701-d5322c5fb05d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:50.697406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba082e42-c43a-446c-9701-d5322c5fb05d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:50.699552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba082e42-c43a-446c-9701-d5322c5fb05d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.700063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba082e42-c43a-446c-9701-d5322c5fb05d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.700605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba082e42-c43a-446c-9701-d5322c5fb05d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:50.701329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba082e42-c43a-446c-9701-d5322c5fb05d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.701788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba082e42-c43a-446c-9701-d5322c5fb05d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.716431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba082e42-c43a-446c-9701-d5322c5fb05d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:50.792045 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba082e42-c43a-446c-9701-d5322c5fb05d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106557 Oct 19 06:55:50.794710 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 813/1600] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:50 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:50.824256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c597f9bf-052e-4a64-99be-93ac42f2c71e req-e9e33762-528f-430d-b85d-3dad9aaea6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd0b472-47fb-4849-bf9f-5256db4fdd3b", "name": "network-vif-plugged", "status": "completed", "tag": "e1ae4327-3a87-4d6c-8dae-44c5eed21aab"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:50.853594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c597f9bf-052e-4a64-99be-93ac42f2c71e req-e9e33762-528f-430d-b85d-3dad9aaea6d1 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.854116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c597f9bf-052e-4a64-99be-93ac42f2c71e req-e9e33762-528f-430d-b85d-3dad9aaea6d1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.854543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c597f9bf-052e-4a64-99be-93ac42f2c71e req-e9e33762-528f-430d-b85d-3dad9aaea6d1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:50.885483 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c597f9bf-052e-4a64-99be-93ac42f2c71e req-e9e33762-528f-430d-b85d-3dad9aaea6d1 service nova] Creating event network-vif-plugged:e1ae4327-3a87-4d6c-8dae-44c5eed21aab for instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b on n-h1-861333-10 Oct 19 06:55:50.902465 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c597f9bf-052e-4a64-99be-93ac42f2c71e req-e9e33762-528f-430d-b85d-3dad9aaea6d1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081878 Oct 19 06:55:50.904169 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 814/1601] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:55:50.940479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:50.941681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:50.949181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.949967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.950579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:50.952354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:50.953455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:50.954801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:51.197430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:51.209895 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72045001-61e7-44b3-ac0a-f6ac6f1e2c2f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.274492 Oct 19 06:55:51.213529 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 815/1602] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:50 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:51.219234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:51.219854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:51.226637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:51.227404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:51.227999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:51.228914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:51.229512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:51.230114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:51.274715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:51.275208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:51.275650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:51.276212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lazy-loading 'fault' on Instance uuid 4c92b51c-7d82-44ed-81ff-fefbab541406 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:55:51.341636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6598d68715524f40aa57fb25b378fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4248165058874e81a53cbcd2f194a649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:51.360229 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f3cf9e7-9964-4923-bb42-01dfd5edac1b tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 200 len: 1314 microversion: 2.1 time: 0.145352 Oct 19 06:55:51.365520 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 816/1603] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:51 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:51.698730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:51.699376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:51.706294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:51.706782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:51.707253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:51.707958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:51.708441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:51.708881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:51.875398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:51.892250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8aa8bf85-b7ee-45f9-8c09-a78ffadcd88a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1318 microversion: 2.1 time: 0.195534 Oct 19 06:55:51.895450 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 817/1604] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:51 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:51.900353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-927fd181-c7b3-4cdc-83b9-3223c4dbc7e9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:51.902631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-927fd181-c7b3-4cdc-83b9-3223c4dbc7e9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:51.921978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927fd181-c7b3-4cdc-83b9-3223c4dbc7e9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:51.922473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927fd181-c7b3-4cdc-83b9-3223c4dbc7e9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:51.923013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927fd181-c7b3-4cdc-83b9-3223c4dbc7e9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:51.923994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927fd181-c7b3-4cdc-83b9-3223c4dbc7e9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:51.930224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927fd181-c7b3-4cdc-83b9-3223c4dbc7e9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:51.930722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927fd181-c7b3-4cdc-83b9-3223c4dbc7e9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:52.015002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:52.019298 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-927fd181-c7b3-4cdc-83b9-3223c4dbc7e9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122782 Oct 19 06:55:52.028712 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 818/1605] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:51 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:55:52.240563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:52.241432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:52.269423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:52.273561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:52.274216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:52.275980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:52.276479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:52.279292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:52.488282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:52.504221 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d3e699dd-d5c7-42d5-883a-5cf4bf57fcec tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.266558 Oct 19 06:55:52.517119 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 819/1606] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:52 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:52.528021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:52.528021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] [instance: 4c92b51c-7d82-44ed-81ff-fefbab541406] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:52.532147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:52.532638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:52.533071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:52.533764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:52.534220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:52.534667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:52.577992 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] HTTP exception thrown: Instance 4c92b51c-7d82-44ed-81ff-fefbab541406 could not be found. Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Request method failure captured: Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 HTTP/1.1 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT58gp6X0VLT-mkZaDiYApcHdlCCtKBCYXZZw14ABKdLVCYqtFhjUScf3sOTNCMJ4jLtjcGoArMoDHUetTyf0Eppkuy2lWDh5UoPqgD5yEhz_WdHIKAw9th0TkYpKOy-5Rg9Ueu-nAJclZ8ia1QHU50JH-r3kG5QpzkU1jDwJwNpjkKo Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 4248165058874e81a53cbcd2f194a649 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4248165058874e81a53cbcd2f194a649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4248165058874e81a53cbcd2f194a649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4248165058874e81a53cbcd2f194a649"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4248165058874e81a53cbcd2f194a649", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 4248165058874e81a53cbcd2f194a649 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-991858814 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsAssociationTestJSON-991858814-project Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 6598d68715524f40aa57fb25b378fb17 Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-991858814-project Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 4c92b51c-7d82-44ed-81ff-fefbab541406 could not be found. Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4c92b51c-7d82-44ed-81ff-fefbab541406'} Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c92b51c-7d82-44ed-81ff-fefbab541406 could not be found. Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c92b51c-7d82-44ed-81ff-fefbab541406 could not be found. Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:55:52.579710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c92b51c-7d82-44ed-81ff-fefbab541406 could not be found. Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] Returning 404 to user: Instance 4c92b51c-7d82-44ed-81ff-fefbab541406 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-facaf97f-e85d-4f56-932b-97930236b65c tempest-FloatingIPsAssociationTestJSON-991858814 tempest-FloatingIPsAssociationTestJSON-991858814-project] 10.222.0.39 "GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406" status: 404 len: 111 microversion: 2.1 time: 0.063171 Oct 19 06:55:52.584862 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 820/1607] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:52 2022] GET /compute/v2.1/servers/4c92b51c-7d82-44ed-81ff-fefbab541406 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:55:52.919147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:52.919928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:52.933399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:52.933660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:52.934098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:52.935872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:52.936524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:52.936980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:53.167556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:53.181155 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6c53ca5-bc05-4449-b164-2c22427db8e9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1508 microversion: 2.1 time: 0.261702 Oct 19 06:55:53.196723 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 821/1608] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:52 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:55:53.218708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e3c1920-16cd-4051-9cdb-cb9afd2f437a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:53.220972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e3c1920-16cd-4051-9cdb-cb9afd2f437a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:53.240578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e3c1920-16cd-4051-9cdb-cb9afd2f437a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:53.241296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e3c1920-16cd-4051-9cdb-cb9afd2f437a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:53.241919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e3c1920-16cd-4051-9cdb-cb9afd2f437a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:53.242799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e3c1920-16cd-4051-9cdb-cb9afd2f437a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:53.243416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e3c1920-16cd-4051-9cdb-cb9afd2f437a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:53.244008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e3c1920-16cd-4051-9cdb-cb9afd2f437a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:53.278835 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e3c1920-16cd-4051-9cdb-cb9afd2f437a tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080640 Oct 19 06:55:53.279987 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 822/1609] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:55:53 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:55:53.285267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:53.286146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:53.293358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:53.294030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:53.294633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:53.295505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:53.296150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:53.296733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:53.916069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:53.934663 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e4689c5-5d85-404c-95f2-d8c38780d022 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1508 microversion: 2.1 time: 0.652380 Oct 19 06:55:53.956270 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 823/1610] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:53 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1508 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:53.966149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:53.966806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:53.984833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:53.985745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:53.986188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:53.986915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:53.987371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:53.987807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:54.351288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:54.369841 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a797f16-3a31-4d96-a654-e6d26a6a0fb0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.407137 Oct 19 06:55:54.370482 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 824/1611] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:53 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:54.375148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1426595623", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "f4729bae-509d-4b40-930f-90da9da6d096"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:56.465795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:56.707218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=17 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:56.880792 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e38b85a1-d198-41db-b408-95b686eb9351 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 10.173053 Oct 19 06:55:56.891063 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 788/1612] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:55:46 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 10184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:56.897204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a901738f-16c6-48a9-a14a-8668ff3df765 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:56.905508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] validate_networks() for [('f4729bae-509d-4b40-930f-90da9da6d096', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:55:56.913853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a901738f-16c6-48a9-a14a-8668ff3df765 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:56.944175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a901738f-16c6-48a9-a14a-8668ff3df765 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:56.946351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a901738f-16c6-48a9-a14a-8668ff3df765 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:56.947169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a901738f-16c6-48a9-a14a-8668ff3df765 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:56.949556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a901738f-16c6-48a9-a14a-8668ff3df765 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:56.950326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a901738f-16c6-48a9-a14a-8668ff3df765 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:56.951375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a901738f-16c6-48a9-a14a-8668ff3df765 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:57.143977 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a901738f-16c6-48a9-a14a-8668ff3df765 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "PUT /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1080 microversion: 2.1 time: 0.251084 Oct 19 06:55:57.145289 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 789/1613] 10.222.0.39 () {60 vars in 1256 bytes} [Wed Oct 19 06:55:56 2022] PUT /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1080 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:57.152336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:57.153365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:57.175476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:57.178068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:57.178887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:57.179989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:57.180667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:57.181523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:57.767675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:57.791363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:55:57.792317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:55:57.793055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:55:57.793774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:55:57.793899 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6f0e8e2-750c-44a6-ba19-77a025fb3339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.647069 Oct 19 06:55:57.794447 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 790/1614] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:57 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:57.794819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:55:57.804199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:57.804822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:57.822765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:57.828926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:57.829448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:57.830211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:57.830686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:57.831311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:57.852554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:57.862670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:57.865029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:57.870154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:57.882925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:57.883676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:57.942887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Getting quotas for project 012922c902b44fc1bb1975dfa27ff074. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:55:57.964137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Getting quotas for user 44e6b0b4228744ecab5536aa08d9495d and project 012922c902b44fc1bb1975dfa27ff074. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:55:57.992990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:55:58.005833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:55:58.012260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:55:58.145631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:58.154168 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-24272c9d-fcc5-4b68-8b48-c70d1b11fae0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1506 microversion: 2.1 time: 0.358726 Oct 19 06:55:58.154763 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 791/1615] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:57 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:58.169075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1938332167", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a7a2cd42-c826-4d50-96f4-6d6e6885e6b0"}], "block_device_mapping_v2": [{"uuid": "3e9bcc73-9848-4da7-80fa-47dcb058231f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:58.189515 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e588226e-99b2-4136-8a95-4a1b0678c5d6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.816848 Oct 19 06:55:58.190876 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 825/1616] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:55:58.195700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7edca9e5-0af6-42c6-8799-85d46a63959f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64d02dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:58.286794 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7edca9e5-0af6-42c6-8799-85d46a63959f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 0.094605 Oct 19 06:55:58.287536 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 826/1617] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:55:58 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:58.297439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:58.300913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:58.317240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:58.318226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:58.319451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:58.320372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:58.320864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:58.321477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:58.339456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] validate_networks() for [('a7a2cd42-c826-4d50-96f4-6d6e6885e6b0', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:55:58.718267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:58.727446 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2192c72b-6e60-4c2b-bc59-7fede58805fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1506 microversion: 2.1 time: 0.433822 Oct 19 06:55:58.732767 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 827/1618] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:58 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:58.747063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9e3476a-15f1-4eed-93fd-2a87581e6998 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:58.748678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9e3476a-15f1-4eed-93fd-2a87581e6998 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:58.945480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9e3476a-15f1-4eed-93fd-2a87581e6998 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:55:58.958349 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9e3476a-15f1-4eed-93fd-2a87581e6998 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1218 microversion: 2.1 time: 0.222656 Oct 19 06:55:58.959294 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 828/1619] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:58 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1218 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:55:58.982404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:55:58.987476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:58.999573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:58.999804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:59.000272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:59.001122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:59.001449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:59.001875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:59.087700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:55:59.088911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:55:59.089699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:55:59.090287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:55:59.090880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:55:59.105446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:59.105446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:59.105446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:59.105446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:59.106335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:59.106940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:59.129624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for project bdca3d9567f34867aa0d9d4489001792. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:55:59.136126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Getting quotas for user f67e466b1aa04d2cbafdbd390c178215 and project bdca3d9567f34867aa0d9d4489001792. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:55:59.246796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:55:59.252251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:55:59.252251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:55:59.252251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:55:59.253667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:55:59.270903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:55:59.273253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e9bcc73-9848-4da7-80fa-47dcb058231f',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:55:59.665529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:59.691964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:59.692507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:59.692957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:59.701413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:59.701932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:59.702388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:59.765624 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c806cd8-803a-4064-8163-4ecad5f883e1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "POST /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b/action" status: 202 len: 1112 microversion: 2.1 time: 0.787136 Oct 19 06:55:59.783170 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 829/1620] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:55:58 2022] POST /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b/action => generated 1112 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 06:55:59.802757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:55:59.803381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:55:59.826883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:59.827389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:59.827826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:59.830696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:55:59.831574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:55:59.832203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:55:59.940774 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d71078f-fd0d-480d-babf-17964c187a91 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.780755 Oct 19 06:55:59.943252 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 792/1621] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:55:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:55:59.986055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ff35f75-56ac-4d28-b46b-d8f67480f81e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d648a81f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:00.108609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:00.118667 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f3c30c6-2855-458b-a39e-d60769744a68 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.334362 Oct 19 06:56:00.133293 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 830/1622] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:55:59 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:00.142193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:00.143311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:00.150676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:00.151455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:00.153303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:00.154578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:00.155209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:00.155799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:00.175424 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ff35f75-56ac-4d28-b46b-d8f67480f81e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 0.230867 Oct 19 06:56:00.183663 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 793/1623] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:55:59 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:00.195703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2eb454e1-03df-4be1-969d-8a3ad3710d64 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:00.201564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2eb454e1-03df-4be1-969d-8a3ad3710d64 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:00.453217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:00.464117 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95abace4-0e08-4885-bfc0-9c392b791bd8 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.328472 Oct 19 06:56:00.480089 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 831/1624] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:00 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:00.487928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:00.492728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2eb454e1-03df-4be1-969d-8a3ad3710d64 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:00.503727 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2eb454e1-03df-4be1-969d-8a3ad3710d64 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1053 microversion: 2.1 time: 0.318078 Oct 19 06:56:00.506828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:00.508402 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 794/1625] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:00 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1053 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:00.528023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:00.530315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:00.531256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:00.533013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:00.533657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:00.536631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:00.732035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:00.746884 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef337eca-7869-4c87-b3de-76a75eb7ddc6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1214 microversion: 2.1 time: 0.265588 Oct 19 06:56:00.752954 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 832/1626] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:00 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:01.146395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:01.147345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:01.167536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:01.168203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:01.168761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:01.169612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:01.171409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:01.172005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:01.192328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7bf1a4b-2a47-4be6-80db-ba3a636edbde tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d6432c550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:01.281324 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7bf1a4b-2a47-4be6-80db-ba3a636edbde tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 0.093615 Oct 19 06:56:01.282481 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 833/1627] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:01 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:01.423023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:01.432936 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-487d10fd-ffd9-403b-916d-33788ca44ce2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.291291 Oct 19 06:56:01.445113 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 795/1628] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:01 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:01.488545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:01.490066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:01.517870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:01.518846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:01.519293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:01.520010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:01.521586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:01.522361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:01.533793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:01.534404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:01.557751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:01.558337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:01.558795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:01.559777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:01.560429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:01.560869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:01.731688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:01.751151 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12cb6349-be6f-495d-98fa-d474a0b66897 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1103 microversion: 2.1 time: 0.219265 Oct 19 06:56:01.751151 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 796/1629] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:01 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1103 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:01.775157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:01.776001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:01.783604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:01.784441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:01.785113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:01.798410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:01.801214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:01.801669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:01.812705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:01.834486 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8490da6-5ba2-46a9-b735-698b5347dc13 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.349262 Oct 19 06:56:01.836435 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 834/1630] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:01 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:01.929918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:01.942678 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0478a141-bb2e-4a61-956e-82033cd876e2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1270 microversion: 2.1 time: 0.168991 Oct 19 06:56:01.943287 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 797/1631] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:01 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:02.298766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24e14ab7-3809-4105-92ad-bd619da23fac tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64c38670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:02.401619 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24e14ab7-3809-4105-92ad-bd619da23fac tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 0.104915 Oct 19 06:56:02.409624 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 835/1632] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:02 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:02.459576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:02.460739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:02.470318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:02.471241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:02.472921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:02.474022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:02.476541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:02.477295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:02.737328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:02.745983 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f620a7e9-82fa-40a2-985d-20df516c962f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.290558 Oct 19 06:56:02.752392 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 798/1633] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:02 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:02.795745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:02.799552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:02.822500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:02.823454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:02.824135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:02.827890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:02.831432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:02.833522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:02.865240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:02.866619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:02.886489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:02.890874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:02.890874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:02.890874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:02.890874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:02.890874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:03.116682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:03.137116 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-025433a3-9ba2-45ef-8eb1-0add2867bc9c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1151 microversion: 2.1 time: 0.347405 Oct 19 06:56:03.137831 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 836/1634] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:02 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:03.138875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:03.145637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:03.146252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:03.159514 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e52c528-45cc-4e79-a01a-6b0e3675f05b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.296414 Oct 19 06:56:03.161150 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 799/1635] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:02 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:03.197294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:03.197796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:03.198245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:03.198972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:03.199437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:03.199868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:03.424027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c38ddc7c-2576-48df-85ae-56a7fa07f6c2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64fb39d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:03.441386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:03.455490 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36481e87-99ba-4f23-a13c-9546511f66e0 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.316400 Oct 19 06:56:03.456884 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 837/1636] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:03 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:03.485929 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c38ddc7c-2576-48df-85ae-56a7fa07f6c2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 0.067014 Oct 19 06:56:03.486552 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 800/1637] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:03 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:03.780211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:03.780211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:03.798985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:03.799739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:03.801504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:03.806735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:03.806735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:03.806735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:04.175082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:04.176241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:04.186035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:04.189026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:04.189653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:04.192440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:04.194445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:04.195247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:04.330248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:04.332702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:04.339486 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-051999ca-11c1-4d85-8002-4a0283a73e39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.567184 Oct 19 06:56:04.343698 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 838/1638] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:03 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:04.372257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:04.372257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:04.372257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:04.372257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:04.372257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:04.372257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:04.372257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:04.376823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:04.405505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:04.415459 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efe80b7f-53a5-407e-8df8-bbb6c8c9e0a5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1169 microversion: 2.1 time: 0.244507 Oct 19 06:56:04.426016 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 801/1639] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:04 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1169 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:04.482830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:04.483845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:04.498624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:04.499300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:04.499726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:04.501032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:04.501709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:04.506872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:04.776381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:04.786020 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02a97898-252a-43f5-861b-0c329ab1656e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.438819 Oct 19 06:56:04.789715 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 839/1640] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:04 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:04.804088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c01ce2b-d2a1-4423-883b-d31f5be7b079 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64774700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:04.881589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:04.897024 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c01ce2b-d2a1-4423-883b-d31f5be7b079 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1412 microversion: 2.1 time: 0.097009 Oct 19 06:56:04.897024 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 840/1641] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:04 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:04.900175 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-193347dd-247e-4ed3-996a-115a9b97d1c1 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.421145 Oct 19 06:56:04.912467 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 802/1642] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:04 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:05.393752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:05.394554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:05.409162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:05.409935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:05.410573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:05.411502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:05.412183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:05.412839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:05.468027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:05.468027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:05.479634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:05.480166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:05.480622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:05.481346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:05.481808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:05.482239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:05.589100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:05.617468 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eed400a9-0669-4568-ae2d-4b08ff487f6d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1169 microversion: 2.1 time: 0.166949 Oct 19 06:56:05.621316 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 803/1643] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:05 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:05.711894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:05.721918 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82236aec-d46f-4dc3-9719-15e4d1045039 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.334717 Oct 19 06:56:05.723104 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 841/1644] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:05 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:05.814489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:05.819122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:05.821721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:05.822320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:05.822874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:05.824234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:05.825025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:05.825710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:05.904299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f24397a-bc0d-4606-80dd-368775fef88e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64774790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:06.006391 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f24397a-bc0d-4606-80dd-368775fef88e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1421 microversion: 2.1 time: 0.105886 Oct 19 06:56:06.016921 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 842/1645] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:05 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1421 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:06.039002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:06.042038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:06.060770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:06.061599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:06.062261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:06.065461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:06.066142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:06.066743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:06.107812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:06.117361 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-023f4778-ecdc-4c36-a4ec-50f096109b0d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.306701 Oct 19 06:56:06.128704 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 804/1646] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:05 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:06.139575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-579bfb38-a3a6-4d16-a8b1-0c3fd7e8bf41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64d68ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:06.193379 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-579bfb38-a3a6-4d16-a8b1-0c3fd7e8bf41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 200 len: 1421 microversion: 2.1 time: 0.063192 Oct 19 06:56:06.194540 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 805/1647] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:06 2022] GET /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 1421 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:06.199434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6a68c36f-6b4f-4049-af91-dda222b37fe3 req-5ac478ed-d58a-4b82-8834-8c22177fd148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f0a66f-16c0-467e-a984-d98a4ca51887", "tag": "328361be-b382-4c71-a1d3-bc7b34544dad"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:06.211320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6a68c36f-6b4f-4049-af91-dda222b37fe3 req-5ac478ed-d58a-4b82-8834-8c22177fd148 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:06.211809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6a68c36f-6b4f-4049-af91-dda222b37fe3 req-5ac478ed-d58a-4b82-8834-8c22177fd148 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:06.212301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6a68c36f-6b4f-4049-af91-dda222b37fe3 req-5ac478ed-d58a-4b82-8834-8c22177fd148 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:06.224868 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6a68c36f-6b4f-4049-af91-dda222b37fe3 req-5ac478ed-d58a-4b82-8834-8c22177fd148 service nova] Creating event network-changed:328361be-b382-4c71-a1d3-bc7b34544dad for instance 04f0a66f-16c0-467e-a984-d98a4ca51887 on n-h2-861333-10 Oct 19 06:56:06.233209 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6a68c36f-6b4f-4049-af91-dda222b37fe3 req-5ac478ed-d58a-4b82-8834-8c22177fd148 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034584 Oct 19 06:56:06.233209 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 806/1648] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:06.238655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-727b099d-0010-4511-adfc-b29bd111335d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64987820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:06.306732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:06.318896 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5efe9bb3-11d7-40f3-8b53-3c7b0d8460d2 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.304343 Oct 19 06:56:06.324338 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 843/1649] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:06 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:06.643563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:06.644208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:06.650288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:06.650790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:06.651233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:06.651941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:06.652432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:06.653049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:06.877483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:06.887509 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8c08f71-cfb6-40d0-8e3b-dec8a0a807ef tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1211 microversion: 2.1 time: 0.248419 Oct 19 06:56:06.888363 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 844/1650] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:06 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1211 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:06.894027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:06.894854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:06.912823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:06.917865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:06.917865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:06.917865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:06.917865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:06.917865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:07.762033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:07.776596 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4be8af29-2e93-4a0f-8036-5a7ea54e0dc9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1477 microversion: 2.1 time: 0.886963 Oct 19 06:56:07.792518 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 845/1651] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:06 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1477 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:07.802230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:07.803205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:07.810092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:07.811107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:07.811841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:07.812778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:07.813458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:07.814087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:07.912968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:08.177290 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-727b099d-0010-4511-adfc-b29bd111335d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 204 len: 0 microversion: 2.1 time: 1.944473 Oct 19 06:56:08.178421 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 807/1652] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:06 2022] DELETE /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 0 bytes in 1946 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:56:08.186486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:08.187230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:08.197787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:08.198602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:08.199463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:08.200423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:08.201086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:08.201749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:08.281716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:08.292900 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2021ba37-f5d6-4539-a878-690c43c22dd1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.498931 Oct 19 06:56:08.314339 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 846/1653] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:07 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:08.321924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:08.324679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:08.331965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:08.332906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:08.333552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:08.334732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:08.335390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:08.336033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:08.634241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:08.648340 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-260a8140-8e5e-4c4e-a7b3-672ad03929b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.465691 Oct 19 06:56:08.650814 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 808/1654] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:08 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:08.665116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:08.668545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:08.687257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:08.687708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:08.689962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:08.690791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:08.691284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:08.691843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:08.742087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:56:08.763918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:08.778298 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0755986-71b7-42dc-9483-073254ec264d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1211 microversion: 2.1 time: 0.462399 Oct 19 06:56:08.778894 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 847/1655] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:08 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1211 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:08.808899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:08.813696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:08.817430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:08.826986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:08.827684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:08.829273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:08.829885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:08.830487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:08.908543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:08.951637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:09.120668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:09.249982 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9f4fea0-5e68-4a2e-9a24-376c0c92cb52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 204 len: 0 microversion: 2.1 time: 0.595521 Oct 19 06:56:09.253253 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 809/1656] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:56:08 2022] DELETE /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:56:09.262030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-61c4aa51-3fd1-4f21-9768-9b12c9d8f2c0 req-54493554-0f79-4c78-a422-bcd6c7667674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf886d10-4fa6-4a13-a48e-d0e90d602b8f", "name": "network-vif-unplugged", "status": "completed", "tag": "6f00e575-44f1-4568-8060-a0deaaa1aadb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:09.287711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-61c4aa51-3fd1-4f21-9768-9b12c9d8f2c0 req-54493554-0f79-4c78-a422-bcd6c7667674 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:09.288431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-61c4aa51-3fd1-4f21-9768-9b12c9d8f2c0 req-54493554-0f79-4c78-a422-bcd6c7667674 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:09.289016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-61c4aa51-3fd1-4f21-9768-9b12c9d8f2c0 req-54493554-0f79-4c78-a422-bcd6c7667674 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:09.321800 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-61c4aa51-3fd1-4f21-9768-9b12c9d8f2c0 req-54493554-0f79-4c78-a422-bcd6c7667674 service nova] Creating event network-vif-unplugged:6f00e575-44f1-4568-8060-a0deaaa1aadb for instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f on n-h1-861333-10 Oct 19 06:56:09.334937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-61c4aa51-3fd1-4f21-9768-9b12c9d8f2c0 req-54493554-0f79-4c78-a422-bcd6c7667674 service nova] Instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:56:09.362225 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-61c4aa51-3fd1-4f21-9768-9b12c9d8f2c0 req-54493554-0f79-4c78-a422-bcd6c7667674 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107123 Oct 19 06:56:09.362866 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 810/1657] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:09.376252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-daab152b-41f7-43dc-a024-74e2a82936f7 req-349ba4ac-0671-4cf4-a1cc-285b1b89b4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e405aee-9ae5-4c1c-a013-11fb09e48684", "name": "network-vif-unplugged", "status": "completed", "tag": "28594c96-ab77-4afe-9c36-c33388040c61"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:09.393002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-daab152b-41f7-43dc-a024-74e2a82936f7 req-349ba4ac-0671-4cf4-a1cc-285b1b89b4a9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:09.393492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-daab152b-41f7-43dc-a024-74e2a82936f7 req-349ba4ac-0671-4cf4-a1cc-285b1b89b4a9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:09.393931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-daab152b-41f7-43dc-a024-74e2a82936f7 req-349ba4ac-0671-4cf4-a1cc-285b1b89b4a9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:09.418769 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-daab152b-41f7-43dc-a024-74e2a82936f7 req-349ba4ac-0671-4cf4-a1cc-285b1b89b4a9 service nova] Creating event network-vif-unplugged:28594c96-ab77-4afe-9c36-c33388040c61 for instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 on n-h1-861333-10 Oct 19 06:56:09.432646 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-daab152b-41f7-43dc-a024-74e2a82936f7 req-349ba4ac-0671-4cf4-a1cc-285b1b89b4a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068187 Oct 19 06:56:09.433637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 811/1658] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:09.452610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:09.453326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:09.460706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:09.461794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:09.462241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:09.463016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:09.463418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:09.463838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:09.470655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:09.480695 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0f96508-5b70-40e8-a980-9dcbacb59c3f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1476 microversion: 2.1 time: 0.676353 Oct 19 06:56:09.490761 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 848/1659] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:08 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1476 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:09.504986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1994433619", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:09.650048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] validate_networks() for [('e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:56:09.905248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:09.919431 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f2a0c46-90f1-4215-99ca-0ba96cd98cca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.483479 Oct 19 06:56:09.923017 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 812/1660] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:09 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:09.933792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:09.935054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:09.946206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:09.946206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:09.946206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:09.946206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:09.946206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:09.946206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.120936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:10.131137 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86f9571a-4542-46e9-ba4e-b7c8f42f4607 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.206919 Oct 19 06:56:10.132009 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 813/1661] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:09 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:10.149543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:10.150207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:10.158257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:10.158754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:10.159195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.159906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:10.161629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:10.162228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.314741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:10.324903 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6681381c-3e4a-4f00-8b4d-cca25538f96a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1211 microversion: 2.1 time: 0.182208 Oct 19 06:56:10.325488 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 814/1662] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:10 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1211 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:10.334474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-cbde145b-8ed7-4b5d-bf3c-493adcbcdd14 req-34c3837b-9c2d-49b8-9967-f9023e49fd75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5efd0f-0b7c-4af7-9cf3-680a046bc396", "tag": "3d2e51f5-b99e-4084-9485-e38140e78566"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:10.346564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cbde145b-8ed7-4b5d-bf3c-493adcbcdd14 req-34c3837b-9c2d-49b8-9967-f9023e49fd75 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:10.347105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cbde145b-8ed7-4b5d-bf3c-493adcbcdd14 req-34c3837b-9c2d-49b8-9967-f9023e49fd75 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:10.347545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cbde145b-8ed7-4b5d-bf3c-493adcbcdd14 req-34c3837b-9c2d-49b8-9967-f9023e49fd75 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.360201 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-cbde145b-8ed7-4b5d-bf3c-493adcbcdd14 req-34c3837b-9c2d-49b8-9967-f9023e49fd75 service nova] Creating event network-changed:3d2e51f5-b99e-4084-9485-e38140e78566 for instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 on n-h2-861333-10 Oct 19 06:56:10.365451 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-cbde145b-8ed7-4b5d-bf3c-493adcbcdd14 req-34c3837b-9c2d-49b8-9967-f9023e49fd75 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038255 Oct 19 06:56:10.366052 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 815/1663] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:10.503693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:10.507752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:10.508481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:10.514805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:10.515290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:10.515729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.517078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:10.517557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:10.517960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.666475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:10.675977 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45ca0133-aded-46c0-b170-596fdc5d0f28 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1476 microversion: 2.1 time: 0.173750 Oct 19 06:56:10.676962 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 816/1664] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:10 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1476 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:10.736080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:56:10.737071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:56:10.737883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:56:10.738329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:56:10.739177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:56:10.749550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:10.750113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:10.751134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.752294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:10.752948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:10.753539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.780989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:56:10.787231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for user f5b2575fb29940ab95fc8bb9dd177dd9 and project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:56:10.802420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:56:10.805850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:56:10.943534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:10.944151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:10.950921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:10.951470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:10.951908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.952643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:10.953103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:10.953594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:10.974164 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87747011-b3f4-4026-8b31-313acd55cbdb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482185 Oct 19 06:56:10.981290 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 849/1665] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:56:10.989009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c287d0bc-0af5-4829-9ee2-4a6058232f1c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:10.990239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c287d0bc-0af5-4829-9ee2-4a6058232f1c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:11.260939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:11.288604 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5fdf09a-a738-4a89-b3c7-bfa2b5abb326 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.334782 Oct 19 06:56:11.291873 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 817/1666] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:10 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:11.299519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:11.300278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:11.307712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:11.308337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:11.308869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:11.309645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:11.310170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:11.310667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:11.476076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c287d0bc-0af5-4829-9ee2-4a6058232f1c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:11.483303 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c287d0bc-0af5-4829-9ee2-4a6058232f1c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1208 microversion: 2.1 time: 0.500609 Oct 19 06:56:11.484792 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 850/1667] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:10 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1208 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:11.490421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:11.491287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:11.517809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:11.522088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:11.522088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:11.522088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:11.522088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:11.522088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:11.628493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:11.641594 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69fbc8cc-4b95-4f3f-94ef-5d8d42e167ac tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.347535 Oct 19 06:56:11.642544 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 818/1668] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:11 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:11.648679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-db0226a9-d5df-4bb5-88bd-53d137d7b86f req-c1b259db-f461-482e-a6b8-28f15b7d9235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf886d10-4fa6-4a13-a48e-d0e90d602b8f", "tag": "6f00e575-44f1-4568-8060-a0deaaa1aadb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:11.664928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-db0226a9-d5df-4bb5-88bd-53d137d7b86f req-c1b259db-f461-482e-a6b8-28f15b7d9235 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:11.666057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-db0226a9-d5df-4bb5-88bd-53d137d7b86f req-c1b259db-f461-482e-a6b8-28f15b7d9235 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:11.667045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-db0226a9-d5df-4bb5-88bd-53d137d7b86f req-c1b259db-f461-482e-a6b8-28f15b7d9235 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:11.682906 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-db0226a9-d5df-4bb5-88bd-53d137d7b86f req-c1b259db-f461-482e-a6b8-28f15b7d9235 service nova] Creating event network-changed:6f00e575-44f1-4568-8060-a0deaaa1aadb for instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f on n-h1-861333-10 Oct 19 06:56:11.692490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-db0226a9-d5df-4bb5-88bd-53d137d7b86f req-c1b259db-f461-482e-a6b8-28f15b7d9235 service nova] Instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:56:11.721497 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-db0226a9-d5df-4bb5-88bd-53d137d7b86f req-c1b259db-f461-482e-a6b8-28f15b7d9235 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077161 Oct 19 06:56:11.723232 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 819/1669] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:11.742403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:11.744958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:11.771043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:11.776013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:11.776836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:11.777819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:11.778571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:11.779229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:12.023728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:12.037291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:12.041457 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b513a42c-a9a1-427d-a488-9d2138d19f3c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1211 microversion: 2.1 time: 0.555367 Oct 19 06:56:12.042055 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 851/1670] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:11 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1211 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:12.048287 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb500e85-f044-4f9b-b455-abf3f6e01b03 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1476 microversion: 2.1 time: 0.321503 Oct 19 06:56:12.048890 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 820/1671] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:11 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:12.306466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:12.307085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:12.314446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:12.314941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:12.315384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:12.316090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:12.316607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:12.317037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:12.507834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:12.508477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:12.514949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:12.515431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:12.515871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:12.517207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:12.517665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:12.518153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:12.583581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:12.591664 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e52a176f-931f-49ce-aba2-6566c1bd6a15 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1212 microversion: 2.1 time: 0.087775 Oct 19 06:56:12.592465 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 821/1672] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:12 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:12.666544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:12.667252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:12.673340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:12.673833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:12.674272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:12.674976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:12.675438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:12.675864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:12.779440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:12.798043 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a26a7109-5ef5-4cf9-8565-335e2e603c09 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.494766 Oct 19 06:56:12.799107 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 852/1673] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:12 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:12.853734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:12.863547 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ce9cbed-63a3-4a70-8fa3-e92e5e63db85 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.201208 Oct 19 06:56:12.865184 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 822/1674] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:12 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:12.896323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3cfa431e-72c6-45b9-8c69-313ac614a61f req-ea22ee35-e631-494c-9e41-476a95ff7e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e405aee-9ae5-4c1c-a013-11fb09e48684", "name": "network-vif-deleted", "tag": "28594c96-ab77-4afe-9c36-c33388040c61"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:12.905962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3cfa431e-72c6-45b9-8c69-313ac614a61f req-ea22ee35-e631-494c-9e41-476a95ff7e81 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:12.907555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3cfa431e-72c6-45b9-8c69-313ac614a61f req-ea22ee35-e631-494c-9e41-476a95ff7e81 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:12.907998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3cfa431e-72c6-45b9-8c69-313ac614a61f req-ea22ee35-e631-494c-9e41-476a95ff7e81 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:12.919288 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3cfa431e-72c6-45b9-8c69-313ac614a61f req-ea22ee35-e631-494c-9e41-476a95ff7e81 service nova] Creating event network-vif-deleted:28594c96-ab77-4afe-9c36-c33388040c61 for instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 on n-h1-861333-10 Oct 19 06:56:12.925466 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3cfa431e-72c6-45b9-8c69-313ac614a61f req-ea22ee35-e631-494c-9e41-476a95ff7e81 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032781 Oct 19 06:56:12.926674 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 853/1675] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:13.068155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:13.068788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:13.077976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.078491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:13.079626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.080087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:13.080782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:13.080919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.081343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.081776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:13.089018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.089842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.090620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:13.097505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.098502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.099173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:13.275992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:13.284595 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e901eb1f-17e8-4acd-a0ed-1a08c0cb0f58 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.220895 Oct 19 06:56:13.285187 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 823/1676] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:13 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:13.539013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:13.546674 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63a75866-60a0-406e-aae2-268a97f8fbcf tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1474 microversion: 2.1 time: 0.477606 Oct 19 06:56:13.547242 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 854/1677] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:13 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1474 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:13.628644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:13.632034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:13.662746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.663709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.664828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:13.666068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.667042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.668402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:13.806728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:13.823273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:13.824020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:13.829964 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe9330ea-9986-4b56-97f8-0620daaaf2ec tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1212 microversion: 2.1 time: 0.218252 Oct 19 06:56:13.831421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.832159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.832769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:13.833677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.834384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.834524 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 824/1678] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:13 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1212 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:13.835113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:13.887048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:13.887776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:13.895814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.897200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.901678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:13.902485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:13.903080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:13.903522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:14.135735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:14.153938 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bee45c3d-d4f5-476a-88f3-de6e894047a3 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.270736 Oct 19 06:56:14.155958 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 825/1679] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:13 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:14.311669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:14.312675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:14.325163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:14.327486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:14.328295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:14.330584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:14.331376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:14.332710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:14.551523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:14.562893 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1b7baea-df62-478e-a03a-9fbef06cd728 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.255734 Oct 19 06:56:14.576776 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 826/1680] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:14 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:14.576776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:14.576776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:14.582376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:14.583492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:14.583991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:14.584803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:14.585285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:14.585796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:14.670133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:14.682089 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b224e4a7-abe2-44cd-8e22-aa36af4379db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.863173 Oct 19 06:56:14.698256 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 855/1681] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:13 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:14.791598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:14.803127 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bcecbf26-0b34-462b-a4a3-c6e24522c7cb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1471 microversion: 2.1 time: 0.235342 Oct 19 06:56:14.809016 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 827/1682] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:14 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:14.829662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b1412e4-bfdd-4d75-b210-265b280b8d34 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:14.830506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b1412e4-bfdd-4d75-b210-265b280b8d34 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:14.838073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1412e4-bfdd-4d75-b210-265b280b8d34 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:14.838732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1412e4-bfdd-4d75-b210-265b280b8d34 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:14.839275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1412e4-bfdd-4d75-b210-265b280b8d34 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:14.840085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1412e4-bfdd-4d75-b210-265b280b8d34 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:14.840580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1412e4-bfdd-4d75-b210-265b280b8d34 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:14.841046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1412e4-bfdd-4d75-b210-265b280b8d34 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:14.855094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:14.855760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:14.870906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:14.871417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:14.871856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:14.872836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:14.874228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:14.876863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:14.890217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:15.059041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:15.077949 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5bf00e04-f84b-4b4a-a7e0-526bd8ea0f33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1204 microversion: 2.1 time: 0.226511 Oct 19 06:56:15.084529 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 828/1683] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:14 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1204 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:15.180554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:15.181362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:15.186119 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b1412e4-bfdd-4d75-b210-265b280b8d34 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f/action" status: 204 len: 0 microversion: 2.1 time: 0.362743 Oct 19 06:56:15.186959 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 856/1684] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:56:14 2022] POST /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f/action => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:56:15.189508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:15.189508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:15.191192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:15.192632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:15.193334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:15.193955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:15.195455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:15.196209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:15.207878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:15.219116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:15.220382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:15.221021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:15.221859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:15.222380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:15.401306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:15.420331 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48a141ce-51c1-4e36-9a4d-6027f277c0e8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.245050 Oct 19 06:56:15.422542 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 829/1685] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:15 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:15.597588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:15.598340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:15.615913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:15.620237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:15.620789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:15.621665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:15.623363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:15.624356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:15.827874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:15.839746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:15.857520 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-132d9e4d-f6e8-40c1-b97f-fba96af81d72 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.271145 Oct 19 06:56:15.859734 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-736664b5-e015-425a-bfd7-eb8ce71206de tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1471 microversion: 2.1 time: 0.668226 Oct 19 06:56:15.861325 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 830/1686] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:15 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:15.863764 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 857/1687] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:15 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1471 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:15.868502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:15.870261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:15.880488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:15.882986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:15.887534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:15.889015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:15.890305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:15.891996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:15.892793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:16.099310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:16.108840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:16.109692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:16.110307 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96e74e05-7f61-4cd3-b3d4-f181ccf4c3db tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.247119 Oct 19 06:56:16.123405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:16.124675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:16.125298 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 831/1688] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:15 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:16.126039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:16.128395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:16.132648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:16.132826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:16.171579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:16.206961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b92a2b28-d9e4-4e73-bad9-21d5d98fda4e req-d3e1443a-1fac-4bde-8820-891f58190703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f0a66f-16c0-467e-a984-d98a4ca51887", "name": "network-vif-plugged", "status": "completed", "tag": "328361be-b382-4c71-a1d3-bc7b34544dad"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:16.241068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b92a2b28-d9e4-4e73-bad9-21d5d98fda4e req-d3e1443a-1fac-4bde-8820-891f58190703 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:16.242324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b92a2b28-d9e4-4e73-bad9-21d5d98fda4e req-d3e1443a-1fac-4bde-8820-891f58190703 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:16.242848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b92a2b28-d9e4-4e73-bad9-21d5d98fda4e req-d3e1443a-1fac-4bde-8820-891f58190703 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:16.269270 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b92a2b28-d9e4-4e73-bad9-21d5d98fda4e req-d3e1443a-1fac-4bde-8820-891f58190703 service nova] Creating event network-vif-plugged:328361be-b382-4c71-a1d3-bc7b34544dad for instance 04f0a66f-16c0-467e-a984-d98a4ca51887 on n-h2-861333-10 Oct 19 06:56:16.279343 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b92a2b28-d9e4-4e73-bad9-21d5d98fda4e req-d3e1443a-1fac-4bde-8820-891f58190703 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077124 Oct 19 06:56:16.280902 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 832/1689] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:16.310419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:16.319751 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c145b5f-b636-4353-bec5-0f5f5ca52752 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1260 microversion: 2.1 time: 0.214830 Oct 19 06:56:16.320923 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 858/1690] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:16 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:16.450197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:16.458312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:16.466993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:16.467709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:16.468253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:16.469681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:16.470325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:16.470955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:16.667679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:16.676858 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9e2fad2-b019-4712-b650-96ef396bc0bf tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.232038 Oct 19 06:56:16.677768 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 833/1691] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:16 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:16.890065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:16.891014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:16.891804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:16.892698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:16.902152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:16.902928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:16.903318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:16.903735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:16.904157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:16.904784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:16.905001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:16.905616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:16.905864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:16.906432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:16.906667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:16.907125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:17.141471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:17.156071 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0cb7fdc3-53d3-422b-bd91-2deff52d4269 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1471 microversion: 2.1 time: 0.270638 Oct 19 06:56:17.159012 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 834/1692] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:16 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:17.186311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:17.186981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:17.201318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:17.202593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:17.205344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:17.206334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:17.207002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:17.209971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:17.264958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:17.285039 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a507c82-af89-4abd-b902-d7affd390fe2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.400199 Oct 19 06:56:17.296128 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 859/1693] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:16 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:17.353230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:17.354098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:17.364122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:17.366277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:17.367915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:17.369122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:17.371624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:17.372494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:17.422643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:17.433013 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af715193-0000-4f9d-9f9a-12d61fee693b tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1517 microversion: 2.1 time: 0.272640 Oct 19 06:56:17.442745 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 835/1694] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:17 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1517 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:17.544745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:17.558508 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4fcdee5-9b20-4b23-b404-8ce96e118e68 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1260 microversion: 2.1 time: 0.209208 Oct 19 06:56:17.573884 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 860/1695] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:17 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:17.701067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:17.702327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:17.719068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:17.724655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:17.725480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:17.726254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:17.726723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:17.727160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:18.012900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:18.024563 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c20b641-03eb-4643-b335-8316f8e540b4 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1318 microversion: 2.1 time: 0.327980 Oct 19 06:56:18.025701 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 836/1696] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:17 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:18.121586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-633597687", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "a75b7e29-d679-4927-b162-08de115eec1f"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:18.184815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:18.185927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:18.196779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:18.198360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:18.198811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:18.199756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:18.200464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:18.201404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:18.231555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] validate_networks() for [('a75b7e29-d679-4927-b162-08de115eec1f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:56:18.427995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:18.436235 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97177be4-0b61-4eda-b743-b47a9e08a7f7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1471 microversion: 2.1 time: 0.258172 Oct 19 06:56:18.436873 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 837/1697] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:18 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1471 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:18.443753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:18.448486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:18.455263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:18.456407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:18.457031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:18.458540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:18.459021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:18.459628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:18.665218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:18.674576 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-686f8b9e-3197-4a91-8094-316b18874c12 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.236354 Oct 19 06:56:18.675171 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 838/1698] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:18 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:18.688824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9efede06-5476-45d9-b5af-cda12dba1ab7 req-d97c1036-d38c-45a2-b70d-96802609b9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf886d10-4fa6-4a13-a48e-d0e90d602b8f", "name": "network-vif-plugged", "status": "completed", "tag": "6f00e575-44f1-4568-8060-a0deaaa1aadb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:18.691789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9efede06-5476-45d9-b5af-cda12dba1ab7 req-d97c1036-d38c-45a2-b70d-96802609b9fe service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:18.693948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9efede06-5476-45d9-b5af-cda12dba1ab7 req-d97c1036-d38c-45a2-b70d-96802609b9fe service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:18.693948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9efede06-5476-45d9-b5af-cda12dba1ab7 req-d97c1036-d38c-45a2-b70d-96802609b9fe service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:18.709646 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9efede06-5476-45d9-b5af-cda12dba1ab7 req-d97c1036-d38c-45a2-b70d-96802609b9fe service nova] Creating event network-vif-plugged:6f00e575-44f1-4568-8060-a0deaaa1aadb for instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f on n-h1-861333-10 Oct 19 06:56:18.715498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-9efede06-5476-45d9-b5af-cda12dba1ab7 req-d97c1036-d38c-45a2-b70d-96802609b9fe service nova] Instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:56:18.727147 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9efede06-5476-45d9-b5af-cda12dba1ab7 req-d97c1036-d38c-45a2-b70d-96802609b9fe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050540 Oct 19 06:56:18.727856 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 839/1699] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:18.733660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-137651393", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b05059e7-85f2-4cad-a60f-f98042236a76"}], "block_device_mapping_v2": [{"uuid": "770360bd-7c5b-4739-91ae-a29622541294", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:18.748685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:56:18.749237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:56:18.749817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:56:18.751125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:56:18.751619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:56:18.761708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:18.762172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:18.762609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:18.763333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:18.763784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:18.764412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:18.785667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Getting quotas for project b08e9e6be87c411796dec57a649da36c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:56:18.791038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Getting quotas for user 08c23581eda747cda3e4d3696703edf4 and project b08e9e6be87c411796dec57a649da36c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:56:18.799857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] validate_networks() for [('b05059e7-85f2-4cad-a60f-f98042236a76', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:56:18.804275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:56:18.806571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:56:18.826500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:18.935725 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-569f30ac-c2b8-4de8-b8a6-0da11e85ccd2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.027285 Oct 19 06:56:18.936493 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 861/1700] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:56:18.947384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:18.948522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:18.956219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:18.960123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:18.960123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:18.960123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:18.960123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:18.960123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:19.156365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:19.165591 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e83b0bb-7745-429a-8a87-54c0e3ae6f44 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1523 microversion: 2.1 time: 0.228047 Oct 19 06:56:19.168166 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 862/1701] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:18 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:19.172352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:19.172352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:19.178042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:19.178537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:19.178964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:19.179663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:19.180129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:19.180561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:19.296267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:19.304663 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-361abfae-1e5f-4674-b2a8-543618c4ac95 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1278 microversion: 2.1 time: 0.137029 Oct 19 06:56:19.305254 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 863/1702] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:19 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:19.312721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53e45010-fc74-409d-8a30-f827e2637660 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:19.314101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53e45010-fc74-409d-8a30-f827e2637660 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:19.399524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53e45010-fc74-409d-8a30-f827e2637660 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:19.414657 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53e45010-fc74-409d-8a30-f827e2637660 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1231 microversion: 2.1 time: 0.108128 Oct 19 06:56:19.433696 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 864/1703] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:19 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1231 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:19.439272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:19.442183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:19.452982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:19.454990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:19.456133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:19.456643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:19.457100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:19.457690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:19.634730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:19.663755 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e9b9b4a-0baa-4f49-adde-526cfdaf68ab tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1508 microversion: 2.1 time: 0.228565 Oct 19 06:56:19.664592 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 865/1704] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:19 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:19.671149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-599e5e72-81b0-4dda-84e9-952cb6b7fd22 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c65b2b9c-8688-43f3-abaa-4ec18e312447"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:19.674128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-599e5e72-81b0-4dda-84e9-952cb6b7fd22 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:19.692758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-599e5e72-81b0-4dda-84e9-952cb6b7fd22 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:19.693288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-599e5e72-81b0-4dda-84e9-952cb6b7fd22 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:19.694005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-599e5e72-81b0-4dda-84e9-952cb6b7fd22 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:19.696218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-599e5e72-81b0-4dda-84e9-952cb6b7fd22 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:19.696783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-599e5e72-81b0-4dda-84e9-952cb6b7fd22 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:19.697219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-599e5e72-81b0-4dda-84e9-952cb6b7fd22 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:19.734076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:56:19.737140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:56:19.746411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:56:19.746411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:56:19.746411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:56:19.778237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:19.781347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:19.781347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:19.783784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:19.784700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:19.786595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:19.816264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:56:19.828034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Getting quotas for user 641a9af15ca24743baa3049fa9ad2e68 and project b43fcf22c22a4b0fa4705d5031c3f17c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:56:19.957305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:56:19.957305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='770360bd-7c5b-4739-91ae-a29622541294',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:56:20.517531 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f293eef-7fd5-49be-9b88-ca71b80323e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.788328 Oct 19 06:56:20.518183 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 840/1705] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:56:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 06:56:20.531532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:20.532606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:20.539812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:20.540630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:20.541260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:20.542174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:20.542813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:20.543434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:20.967632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:20.976780 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ea7ac78-d087-4fe6-bd85-d0c56d937e3e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1463 microversion: 2.1 time: 0.449702 Oct 19 06:56:20.977215 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 841/1706] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:20 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1463 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:20.993189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:20.993881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:21.014871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.015383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.016990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.017745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.018219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.021514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.077688 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-599e5e72-81b0-4dda-84e9-952cb6b7fd22 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "POST /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.411519 Oct 19 06:56:21.080341 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 866/1707] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 06:56:19 2022] POST /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments => generated 194 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:21.102819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:21.112071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:21.122417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.122736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.123190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.123913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.124413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.124848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.327865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:21.345584 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-984e7b9b-77ab-40b7-bb99-17b440a441d6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.367251 Oct 19 06:56:21.349693 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 842/1708] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:20 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:21.369200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:21.372265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:21.399325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.403009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.405619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.409396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.412728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.413308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.479284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:21.488081 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd75d4e7-b22d-4ac6-8190-2f2d34f9a9a2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1523 microversion: 2.1 time: 0.406256 Oct 19 06:56:21.490570 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 867/1709] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:21 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:21.495741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:21.496638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:21.504589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.505331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.506158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.507352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.508078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.508860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.622062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:21.641891 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8633c42-3233-4107-911a-694125179c3c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1283 microversion: 2.1 time: 0.146147 Oct 19 06:56:21.649961 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 868/1710] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:21 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:21.660594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33abe11c-1088-45cd-8af4-66b7c9d19d12 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:21.661256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33abe11c-1088-45cd-8af4-66b7c9d19d12 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:21.782016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33abe11c-1088-45cd-8af4-66b7c9d19d12 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:21.793193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33abe11c-1088-45cd-8af4-66b7c9d19d12 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:21.795574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33abe11c-1088-45cd-8af4-66b7c9d19d12 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:21.797998 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33abe11c-1088-45cd-8af4-66b7c9d19d12 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1103 microversion: 2.25 time: 0.151083 Oct 19 06:56:21.823873 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 869/1711] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:21 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1103 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:21.829351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:21.830896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:21.841867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.842614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.843223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.856683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:21.857741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:21.859588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:21.898068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:21.916062 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c64d573a-accd-4d2c-9d2a-c8c8094b7120 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1308 microversion: 2.1 time: 0.563629 Oct 19 06:56:21.916676 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 843/1712] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:21 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:22.154237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:22.164775 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cfe36c21-715e-4d53-a160-ff3e2a3cdd5a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1463 microversion: 2.1 time: 0.339504 Oct 19 06:56:22.165993 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 870/1713] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:21 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1463 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:22.202387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e88c648-5549-4e0b-bee2-580194f525f0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'create', calling method: .version_select at 0x7f6d649659d0>, body: {"keypair": {"name": "tempest-keypair-615809835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBULecSyPDywnnB07Y+T/7spPqY5nCiueMxP8WkLZVzR2cjYwV+nVEeg8ieuN9x7JfvnCcWsyuEYIrXmSW6tmbwbIN7wtpV09VLzQ/v8iGsoioqF1DsnhLddPEFYfTffjQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:22.220137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2e88c648-5549-4e0b-bee2-580194f525f0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for project d80c925de0b447909ae6fbfe56e61dda. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:56:22.233047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2e88c648-5549-4e0b-bee2-580194f525f0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for user 631a2a90a44a40b2bd751a4feaf69d0f and project d80c925de0b447909ae6fbfe56e61dda. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:56:22.390904 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e88c648-5549-4e0b-bee2-580194f525f0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.200276 Oct 19 06:56:22.404310 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 844/1714] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 06:56:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:22.415874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:22.416616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:22.430904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-23fc04e2-8708-42c1-b7eb-011bcfa9f90a req-d040ebc2-a455-4c70-9a8d-1580c6ea0b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e9ce9b7-76c3-46e8-8de2-b50c0e126dce", "tag": "95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:22.440910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:22.441732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:22.442358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:22.443299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:22.443986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:22.444626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:22.457312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-23fc04e2-8708-42c1-b7eb-011bcfa9f90a req-d040ebc2-a455-4c70-9a8d-1580c6ea0b21 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:22.458164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-23fc04e2-8708-42c1-b7eb-011bcfa9f90a req-d040ebc2-a455-4c70-9a8d-1580c6ea0b21 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:22.458886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-23fc04e2-8708-42c1-b7eb-011bcfa9f90a req-d040ebc2-a455-4c70-9a8d-1580c6ea0b21 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:22.476755 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-23fc04e2-8708-42c1-b7eb-011bcfa9f90a req-d040ebc2-a455-4c70-9a8d-1580c6ea0b21 service nova] Creating event network-changed:95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a for instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce on n-h1-861333-10 Oct 19 06:56:22.485856 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-23fc04e2-8708-42c1-b7eb-011bcfa9f90a req-d040ebc2-a455-4c70-9a8d-1580c6ea0b21 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204381 Oct 19 06:56:22.486815 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 871/1715] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:56:22.526780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:22.528453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:22.550394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:22.551678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:22.552367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:22.553431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:22.554104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:22.554688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:22.765156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:22.779030 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d7a0763-9b4c-4a22-9286-e4e07a7824bf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.372662 Oct 19 06:56:22.781101 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 845/1716] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:22 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:22.794150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:22.796318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:22.816551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:22.817524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:22.819002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:22.821220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:22.822562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:22.826501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:22.976038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:22.991401 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3acd4cba-061a-42f9-acc5-7d9ae31b0121 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1523 microversion: 2.1 time: 0.472366 Oct 19 06:56:22.992001 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 872/1717] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:22 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1523 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:23.014861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:23.015423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:23.022420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:23.022916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:23.023572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:23.024344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:23.025001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:23.025443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:23.129992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:23.151535 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9439305e-2255-465a-a5d8-f8f707ea42b3 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1291 microversion: 2.1 time: 0.367080 Oct 19 06:56:23.152711 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 846/1718] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:22 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1291 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:23.153138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:23.159218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:23.160064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:23.164388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:23.165862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:23.169326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:23.170061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:23.170733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:23.171678 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1cdb455d-afec-44f4-84c8-d8f3284bb8b4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1176 microversion: 2.25 time: 0.161246 Oct 19 06:56:23.173496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:23.174206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:23.174840 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 873/1719] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:22 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1176 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:23.175173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:23.238794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:23.350126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3ad92d31-83ab-46fb-8c7a-2722f146ba91 req-0df60b47-a7e9-43a2-abca-d6e20aad0bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd0b472-47fb-4849-bf9f-5256db4fdd3b", "name": "network-vif-plugged", "status": "completed", "tag": "e1ae4327-3a87-4d6c-8dae-44c5eed21aab"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:23.381077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3ad92d31-83ab-46fb-8c7a-2722f146ba91 req-0df60b47-a7e9-43a2-abca-d6e20aad0bae service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:23.381582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3ad92d31-83ab-46fb-8c7a-2722f146ba91 req-0df60b47-a7e9-43a2-abca-d6e20aad0bae service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:23.383097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3ad92d31-83ab-46fb-8c7a-2722f146ba91 req-0df60b47-a7e9-43a2-abca-d6e20aad0bae service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:23.435618 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3ad92d31-83ab-46fb-8c7a-2722f146ba91 req-0df60b47-a7e9-43a2-abca-d6e20aad0bae service nova] Creating event network-vif-plugged:e1ae4327-3a87-4d6c-8dae-44c5eed21aab for instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b on n-h1-861333-10 Oct 19 06:56:23.446925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:23.452280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3ad92d31-83ab-46fb-8c7a-2722f146ba91 req-0df60b47-a7e9-43a2-abca-d6e20aad0bae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108217 Oct 19 06:56:23.453504 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 874/1720] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:23.472531 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62979a0e-c117-467b-a636-e5c045cb4305 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1308 microversion: 2.1 time: 0.311014 Oct 19 06:56:23.472531 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 847/1721] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:23 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:23.808597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:23.809722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:23.816825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:23.821294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:23.821294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:23.821294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:23.821294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:23.821294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:24.010247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:24.013837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e526a883-83d4-4b03-87d7-f58f19ba0e63"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:24.017007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:24.023526 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5efd83a-4ae9-40a8-961b-229cbf117a4d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.218621 Oct 19 06:56:24.025046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:24.025710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:24.026328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:24.027281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:24.028030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:24.028644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:24.061093 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 875/1722] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:23 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:24.067775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:24.069054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:24.076454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:24.078123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:24.080962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:24.081474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:24.082253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:24.082747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:24.093760 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] HTTP exception thrown: Volume 90234d15-60cd-4112-85d5-7c45d7c7e578 could not be found. Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Request method failure captured: Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887/os-volume_attachments/90234d15-60cd-4112-85d5-7c45d7c7e578 HTTP/1.1 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 74 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT57-Lb7TFQ2jk7HBnKXl5kkDCNTtx9KGz-Lf9vOzuRsDlbhPh49GGZB5BA_FEI4flUi2yI6GxxT8X43kUzlF1X1tr79CLIdTGoV3f37ce1nT8NNw_HqeQ3MTb521n3XN3Ssm8g8gWEfw-0QsnGxnDyhimO2ZJitXQuDBSlKG6GpAY20 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 7cf6c2dfe4e440a2bae43112def98b18 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesAdminNegativeTest-822143533 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7cf6c2dfe4e440a2bae43112def98b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7cf6c2dfe4e440a2bae43112def98b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7cf6c2dfe4e440a2bae43112def98b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7cf6c2dfe4e440a2bae43112def98b18", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesAdminNegativeTest-822143533 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 7cf6c2dfe4e440a2bae43112def98b18 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-822143533 Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesAdminNegativeTest-822143533-project-admin Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 0080f061bf3944d294dc9efd3dfaa3dc Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesAdminNegativeTest-822143533-project-admin Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: {"volumeAttachment": {"volumeId": "e526a883-83d4-4b03-87d7-f58f19ba0e63"}} Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: exception: Volume 90234d15-60cd-4112-85d5-7c45d7c7e578 could not be found. Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': '04f0a66f-16c0-467e-a984-d98a4ca51887', 'id': '90234d15-60cd-4112-85d5-7c45d7c7e578', 'body': {'volumeAttachment': {'volumeId': 'e526a883-83d4-4b03-87d7-f58f19ba0e63'}}} Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90234d15-60cd-4112-85d5-7c45d7c7e578 could not be found. (HTTP 404) (Request-ID: req-d1f470d6-7569-4dde-90f6-45cef4686e3b) Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 06:56:24.098999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90234d15-60cd-4112-85d5-7c45d7c7e578 could not be found. Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90234d15-60cd-4112-85d5-7c45d7c7e578 could not be found. Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90234d15-60cd-4112-85d5-7c45d7c7e578 could not be found. Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] Returning 404 to user: Volume 90234d15-60cd-4112-85d5-7c45d7c7e578 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d512de7-764e-4884-80a5-43ba81b38f8c tempest-VolumesAdminNegativeTest-822143533 tempest-VolumesAdminNegativeTest-822143533-project-admin] 10.222.0.39 "PUT /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887/os-volume_attachments/90234d15-60cd-4112-85d5-7c45d7c7e578" status: 404 len: 109 microversion: 2.1 time: 0.096192 Oct 19 06:56:24.112807 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 848/1723] 10.222.0.39 () {60 vars in 1433 bytes} [Wed Oct 19 06:56:24 2022] PUT /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887/os-volume_attachments/90234d15-60cd-4112-85d5-7c45d7c7e578 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:56:24.179549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:24.180211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:24.192581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:24.193087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:24.193531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:24.194243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:24.194717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:24.206018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:24.471647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:24.490924 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce8f425e-3013-4860-991c-40f5c75d2c3d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.310745 Oct 19 06:56:24.492263 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 849/1724] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:24 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:24.767736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:24.772240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:24.780666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:24.782425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:24.784470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:24.785530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:24.786901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:24.789107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:24.942856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:24.960713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:24.964074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:24.966908 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29c8cad9-574b-4fe8-8947-906675faf84f tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1250 microversion: 2.25 time: 0.472978 Oct 19 06:56:24.972392 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 850/1725] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:24 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1250 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:24.995530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:24.996667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:25.024741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:25.026680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:25.028417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:25.031499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:25.037348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:25.038830 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f5591cf-95b1-4efb-9051-83ef9fa007f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1523 microversion: 2.1 time: 0.972704 Oct 19 06:56:25.040257 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 876/1726] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:24 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1523 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:25.040731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:25.041587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:25.053846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:25.056586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:25.067611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:25.070911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:25.073611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:25.074472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:25.077561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:25.078264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:25.364367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:25.381219 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-733fd68c-6ece-4aa3-bf3a-b4dc5a6b21f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1308 microversion: 2.1 time: 0.407226 Oct 19 06:56:25.382089 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 851/1727] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:24 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:25.472593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-59b91297-3f4f-4a2c-ace3-58ffb19b6968 req-fa8fde74-3190-43d5-a77e-305d5a73d798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5efd0f-0b7c-4af7-9cf3-680a046bc396", "name": "network-vif-plugged", "status": "completed", "tag": "3d2e51f5-b99e-4084-9485-e38140e78566"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:25.488179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59b91297-3f4f-4a2c-ace3-58ffb19b6968 req-fa8fde74-3190-43d5-a77e-305d5a73d798 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:25.491528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59b91297-3f4f-4a2c-ace3-58ffb19b6968 req-fa8fde74-3190-43d5-a77e-305d5a73d798 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:25.492059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59b91297-3f4f-4a2c-ace3-58ffb19b6968 req-fa8fde74-3190-43d5-a77e-305d5a73d798 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:25.518534 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-59b91297-3f4f-4a2c-ace3-58ffb19b6968 req-fa8fde74-3190-43d5-a77e-305d5a73d798 service nova] Creating event network-vif-plugged:3d2e51f5-b99e-4084-9485-e38140e78566 for instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 on n-h2-861333-10 Oct 19 06:56:25.528992 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-59b91297-3f4f-4a2c-ace3-58ffb19b6968 req-fa8fde74-3190-43d5-a77e-305d5a73d798 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060430 Oct 19 06:56:25.534422 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 852/1728] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:25.544988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:25.547223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:25.565001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:25.566289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:25.568440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:25.571529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:25.572303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:25.575263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:25.886797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:25.890899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:25.898022 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0edd081f-72bd-406f-bf50-2923979b4a69 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.848089 Oct 19 06:56:25.902773 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 877/1729] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:25 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:26.003346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:26.004258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:26.011391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:26.012274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:26.013812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:26.014790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:26.016802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:26.017475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:26.098012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:26.110939 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6958e4b6-01c6-4bd5-8e2c-fc094002f854 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.573904 Oct 19 06:56:26.114520 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 853/1730] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:25 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:26.129872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:26.130507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:26.143577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:26.144077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:26.151382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:26.152228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:26.152913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:26.153964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:26.159446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:26.192440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:26.195137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:26.198780 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c5b1283-3d1e-4fb3-8e2d-4d403f5dbc3e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1250 microversion: 2.25 time: 0.204714 Oct 19 06:56:26.205290 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 878/1731] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:25 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1250 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:26.412701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:26.414141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:26.428891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:26.429446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:26.431559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:26.432432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:26.436158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:26.440536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:26.664368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:26.675128 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2cdb587-7bde-42b0-a5e1-9618526e9bd9 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1523 microversion: 2.1 time: 0.556882 Oct 19 06:56:26.677738 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 854/1732] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:26 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1523 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:26.735456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:26.757946 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e1edd43-d465-4105-ac63-e391838ade49 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1308 microversion: 2.1 time: 0.350229 Oct 19 06:56:26.758595 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 879/1733] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:26 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:26.927768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:26.938802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:26.943563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:26.944286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:26.944885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:26.947493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:26.948163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:26.949902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:27.139338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:27.140837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:27.152962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:27.153674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:27.155077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:27.156017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:27.159383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:27.161697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:27.337681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:27.349403 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49b1c948-1cde-40cb-8255-8e1c8807c7b1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1199 microversion: 2.1 time: 0.426468 Oct 19 06:56:27.353114 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 855/1734] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:26 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1199 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:27.363148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:27.368293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:27.377809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:27.378481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:27.382387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:27.383676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:27.384500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:27.385289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:27.805438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:27.820895 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54a2cc7c-b78e-49b6-a688-96417279a5ac tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.685488 Oct 19 06:56:27.822005 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 880/1735] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:27 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:27.826628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8dd3154-e367-4205-b250-07befc9763f3 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '.version_select at 0x7f6d6432c310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:27.836376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8dd3154-e367-4205-b250-07befc9763f3 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:27.838940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8dd3154-e367-4205-b250-07befc9763f3 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:27.840479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8dd3154-e367-4205-b250-07befc9763f3 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:27.878247 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8dd3154-e367-4205-b250-07befc9763f3 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 3138 microversion: 2.1 time: 0.054981 Oct 19 06:56:27.879752 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 881/1736] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:56:27 2022] GET /compute/v2.1/os-migrations => generated 3138 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:27.887102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:27.888057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:27.902016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:27.902794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:27.903632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:27.905422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:27.906529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:27.907882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.039760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:28.049241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:28.050720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:28.052056 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4eb5b1b-d986-4760-bfcf-8ffcd3e5437e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1292 microversion: 2.25 time: 0.697772 Oct 19 06:56:28.052986 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 856/1737] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:27 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1292 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:28.057763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:28.058363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:28.081290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:28.082131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:28.082781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.083709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:28.087212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:28.087969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.279855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:28.304213 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1972b76c-0fa7-45cc-93cc-8e904c7da2fe tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1308 microversion: 2.1 time: 0.235003 Oct 19 06:56:28.304213 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 857/1738] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:28 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:28.304213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2843fefe-18bc-42f2-bc17-3f02d24b3e62 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:28.309194 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2843fefe-18bc-42f2-bc17-3f02d24b3e62 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012596 Oct 19 06:56:28.309194 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 858/1739] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:56:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:28.315281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6e538f92-1470-4131-8a6d-4eef172d206c req-bf495a21-b899-491e-97e0-601688b4094b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f66da6-3501-4058-9a3d-7360d82a18ad", "tag": "685438d8-d237-4136-944c-d9aec20c706e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:28.326167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e538f92-1470-4131-8a6d-4eef172d206c req-bf495a21-b899-491e-97e0-601688b4094b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:28.326643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e538f92-1470-4131-8a6d-4eef172d206c req-bf495a21-b899-491e-97e0-601688b4094b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:28.328401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e538f92-1470-4131-8a6d-4eef172d206c req-bf495a21-b899-491e-97e0-601688b4094b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.341716 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6e538f92-1470-4131-8a6d-4eef172d206c req-bf495a21-b899-491e-97e0-601688b4094b service nova] Creating event network-changed:685438d8-d237-4136-944c-d9aec20c706e for instance c8f66da6-3501-4058-9a3d-7360d82a18ad on n-h2-861333-10 Oct 19 06:56:28.347833 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6e538f92-1470-4131-8a6d-4eef172d206c req-bf495a21-b899-491e-97e0-601688b4094b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039849 Oct 19 06:56:28.351314 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 859/1740] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:28.353838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2defc88-5118-4648-9e9e-8980564eda68 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-485718786", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:28.377638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:28.386168 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f9ca55c-7923-49f9-b278-dd847441f0ca tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1508 microversion: 2.1 time: 0.505129 Oct 19 06:56:28.386734 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 882/1741] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:27 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1508 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:28.393961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:28.394760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:28.412969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:28.413932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:28.414650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.416474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:28.417469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:28.420339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.469660 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2defc88-5118-4648-9e9e-8980564eda68 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.119900 Oct 19 06:56:28.470362 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 860/1742] 10.222.0.39 () {60 vars in 1146 bytes} [Wed Oct 19 06:56:28 2022] POST /compute/v2.1/flavors => generated 498 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:28.475794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:28.481516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:28.491070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:28.491882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:28.492610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.494696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:28.495610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:28.496419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.671067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:28.682720 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe2fd5f9-2068-4c50-8dda-d2701d6d4663 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 200 len: 1508 microversion: 2.1 time: 0.210360 Oct 19 06:56:28.683969 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 861/1743] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:28 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:28.690421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3bfcc19f-7718-4178-b06e-6a4d1183ebcf tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:28.702942 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3bfcc19f-7718-4178-b06e-6a4d1183ebcf tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017544 Oct 19 06:56:28.705396 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 862/1744] 10.222.0.39 () {58 vars in 1182 bytes} [Wed Oct 19 06:56:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:56:28.712588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:28.713618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:28.739805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:28.743555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:28.744351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.746905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:28.749825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:28.751114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:28.757831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:28.775307 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c64e5f8c-c326-482d-be8a-6478a1d2d2ab tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1382 microversion: 2.1 time: 0.386827 Oct 19 06:56:28.775986 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 883/1745] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:28 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1382 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:28.803489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:28.811342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:56:29.032874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da4ffe34-5789-4007-acca-0572d7ae32d4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:29.032874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da4ffe34-5789-4007-acca-0572d7ae32d4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:29.040604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da4ffe34-5789-4007-acca-0572d7ae32d4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.041628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da4ffe34-5789-4007-acca-0572d7ae32d4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.042244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da4ffe34-5789-4007-acca-0572d7ae32d4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.043367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da4ffe34-5789-4007-acca-0572d7ae32d4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.044051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da4ffe34-5789-4007-acca-0572d7ae32d4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.044869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da4ffe34-5789-4007-acca-0572d7ae32d4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.170216 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4765eb0c-f5ce-4dbc-8d24-a4aea3c3b1a5 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 204 len: 0 microversion: 2.1 time: 0.461306 Oct 19 06:56:29.185437 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 863/1746] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:56:28 2022] DELETE /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:56:29.210297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:29.224353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:29.240214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.243637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.244915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.246495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.247218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.250112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.532584 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da4ffe34-5789-4007-acca-0572d7ae32d4 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1535 microversion: 2.1 time: 0.734305 Oct 19 06:56:29.536820 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 884/1747] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:28 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1535 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:29.543759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1332496724", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "ba881663-0df0-4881-94b9-0584868e985b"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:29.546266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:29.558665 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57b47d6d-adeb-473e-afaf-36cb368c959f tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.371501 Oct 19 06:56:29.561039 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 864/1748] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:29 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:29.568046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:29.568949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:29.574688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:29.576366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.577203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.577809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.578729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.579361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.580010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.626588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:56:29.734694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:29.744125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:29.745851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:29.747217 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-803c86b1-be56-4da3-ba83-8c53c8ea6e91 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1292 microversion: 2.25 time: 0.185240 Oct 19 06:56:29.748278 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 865/1749] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:29 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1292 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:29.753518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2c6976bd-409a-4575-a279-7f5cb16b0911 req-888e87db-44bd-4865-acd1-c4a9d685c606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9ce9b7-76c3-46e8-8de2-b50c0e126dce", "name": "network-vif-plugged", "status": "completed", "tag": "95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:29.772082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c6976bd-409a-4575-a279-7f5cb16b0911 req-888e87db-44bd-4865-acd1-c4a9d685c606 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.772957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c6976bd-409a-4575-a279-7f5cb16b0911 req-888e87db-44bd-4865-acd1-c4a9d685c606 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.773652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c6976bd-409a-4575-a279-7f5cb16b0911 req-888e87db-44bd-4865-acd1-c4a9d685c606 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.787190 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2c6976bd-409a-4575-a279-7f5cb16b0911 req-888e87db-44bd-4865-acd1-c4a9d685c606 service nova] Creating event network-vif-plugged:95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a for instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce on n-h1-861333-10 Oct 19 06:56:29.792369 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2c6976bd-409a-4575-a279-7f5cb16b0911 req-888e87db-44bd-4865-acd1-c4a9d685c606 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042590 Oct 19 06:56:29.793289 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 866/1750] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:29.800654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:29.801625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:29.803834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:29.809344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.810210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.811184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.812893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.812893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.813220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.872361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:56:29.872793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:56:29.873308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:56:29.873720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:56:29.874134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:56:29.885535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.886025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.886462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.887187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:29.887643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:29.888068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:29.908206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:56:29.914410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for user 631a2a90a44a40b2bd751a4feaf69d0f and project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:56:29.929155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:56:29.931535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:56:29.959659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:29.963367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:29.968422 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fda6794-3ddc-404c-8146-a358b63832e0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1308 microversion: 2.1 time: 0.173678 Oct 19 06:56:29.969356 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 867/1751] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:29 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:29.974036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-320035579", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "a41d894c-52b0-4b0d-8cab-72c2814699a7"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:30.035710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] validate_networks() for [('a41d894c-52b0-4b0d-8cab-72c2814699a7', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:56:30.083891 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90aabcbe-5601-44dd-814b-ed0e48b65437 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543999 Oct 19 06:56:30.097877 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 885/1752] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:56:30.097877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6222dde8-5b90-43e3-b122-d2f0236972f5 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:30.098697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6222dde8-5b90-43e3-b122-d2f0236972f5 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:30.106252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6222dde8-5b90-43e3-b122-d2f0236972f5 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.106844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6222dde8-5b90-43e3-b122-d2f0236972f5 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.107364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6222dde8-5b90-43e3-b122-d2f0236972f5 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.108419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6222dde8-5b90-43e3-b122-d2f0236972f5 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.108730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6222dde8-5b90-43e3-b122-d2f0236972f5 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.110512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6222dde8-5b90-43e3-b122-d2f0236972f5 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.286860 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6222dde8-5b90-43e3-b122-d2f0236972f5 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1535 microversion: 2.1 time: 0.192999 Oct 19 06:56:30.287755 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 886/1753] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:30 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1535 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:30.292483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-667d764b-cba6-473e-a825-7c302421e323 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:30.293093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-667d764b-cba6-473e-a825-7c302421e323 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:30.392150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-667d764b-cba6-473e-a825-7c302421e323 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:30.399507 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-667d764b-cba6-473e-a825-7c302421e323 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1279 microversion: 2.1 time: 0.110813 Oct 19 06:56:30.400602 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 887/1754] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:30 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1279 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:30.405303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12a1d985-62c6-479a-ad27-623a612457f2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:30.418326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12a1d985-62c6-479a-ad27-623a612457f2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.418998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12a1d985-62c6-479a-ad27-623a612457f2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.419488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12a1d985-62c6-479a-ad27-623a612457f2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.420392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12a1d985-62c6-479a-ad27-623a612457f2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.420952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12a1d985-62c6-479a-ad27-623a612457f2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.421481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12a1d985-62c6-479a-ad27-623a612457f2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.449825 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12a1d985-62c6-479a-ad27-623a612457f2 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.047805 Oct 19 06:56:30.450590 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 888/1755] 10.222.0.39 () {58 vars in 1176 bytes} [Wed Oct 19 06:56:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:30.455847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-409dfd99-6b6c-4cbe-aa17-a90df240d251 req-5c39df51-98e7-4977-847e-ad09ea6a339c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c979c511-6f7d-4d9b-8987-9862804d3a38", "tag": "1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:30.474381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-409dfd99-6b6c-4cbe-aa17-a90df240d251 req-5c39df51-98e7-4977-847e-ad09ea6a339c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.478108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-409dfd99-6b6c-4cbe-aa17-a90df240d251 req-5c39df51-98e7-4977-847e-ad09ea6a339c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.478108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-409dfd99-6b6c-4cbe-aa17-a90df240d251 req-5c39df51-98e7-4977-847e-ad09ea6a339c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.488577 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-409dfd99-6b6c-4cbe-aa17-a90df240d251 req-5c39df51-98e7-4977-847e-ad09ea6a339c service nova] Creating event network-changed:1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9 for instance c979c511-6f7d-4d9b-8987-9862804d3a38 on n-h2-861333-10 Oct 19 06:56:30.494610 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-409dfd99-6b6c-4cbe-aa17-a90df240d251 req-5c39df51-98e7-4977-847e-ad09ea6a339c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042548 Oct 19 06:56:30.495336 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 889/1756] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:30.504385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-861333-10", "block_migration": false, "disk_over_commit": false}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:30.507224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:30.514263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.514886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.515429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.516826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.517390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.517951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.545082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lazy-loading 'flavor' on Instance uuid cb5efd0f-0b7c-4af7-9cf3-680a046bc396 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:56:30.558761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Going to try to live migrate instance to n-h1-861333-10 {{(pid=127568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 06:56:30.642763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:56:30.643343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:56:30.647911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:56:30.649688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:56:30.650299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:56:30.682449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.687248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.687708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.689086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.689549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.693417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.721749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Getting quotas for project 9ded99a8f4204d6985060451b881d84f. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:56:30.727407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Getting quotas for user 4ee94c5c732c4e579ec3e85f3018641b and project 9ded99a8f4204d6985060451b881d84f. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:56:30.740893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:56:30.743489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:56:30.945710 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4be2d9bb-27e5-4f62-8125-efb721d19cfd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975386 Oct 19 06:56:30.953488 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 868/1757] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:56:30.960577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:30.961562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:30.970299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.971084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.971775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:30.972795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:30.973977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:30.974725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:31.177014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:31.190328 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-833273b2-85be-4dac-a422-89f809858713 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.230672 Oct 19 06:56:31.190328 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 869/1758] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:30 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:31.193112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:31.193937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:31.200303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:31.200788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:31.201251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:31.202187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:31.202978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:31.204887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:31.531593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:31.543691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:31.545954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:31.555001 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55fdb520-1e6a-4213-a7aa-0bceeff5791b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1292 microversion: 2.25 time: 0.358228 Oct 19 06:56:31.555001 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 870/1759] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:31 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1292 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:31.555001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d2b6a05-1be3-4abb-a06f-9ade8be15a0f tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:31.555857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d2b6a05-1be3-4abb-a06f-9ade8be15a0f tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:31.658006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d2b6a05-1be3-4abb-a06f-9ade8be15a0f tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:31.667099 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d2b6a05-1be3-4abb-a06f-9ade8be15a0f tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1217 microversion: 2.1 time: 0.116715 Oct 19 06:56:31.682219 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 871/1760] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:31 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:31.692270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:31.693060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:31.702185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:31.702629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:31.703142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:31.703919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:31.704428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:31.704861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:31.976122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:31.988159 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a11c25bd-45f9-4bad-8039-aacec9f55edb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1308 microversion: 2.1 time: 0.305537 Oct 19 06:56:31.994449 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 872/1761] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:31 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:31.995849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:31.996762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:32.019944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:32.020825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:32.031231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:32.034220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:32.036079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:32.040872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:32.179618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:32.192944 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f525c88d-93a3-410f-b673-060d38842bb1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1275 microversion: 2.1 time: 0.202175 Oct 19 06:56:32.193976 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 873/1762] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:31 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:32.210617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:32.211304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:32.217537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:32.218270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:32.218715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:32.219569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:32.220234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:32.220839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:32.413702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:32.423090 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04779207-c002-4481-a91b-02756dbbd3dd tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.216742 Oct 19 06:56:32.452667 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 874/1763] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:32 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:32.513729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0154c1c2-d93d-4b6c-b857-f55b9bc01c64 req-affaf728-fb11-4cc1-ad26-2f26a6432972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd0b472-47fb-4849-bf9f-5256db4fdd3b", "name": "network-vif-deleted", "tag": "e1ae4327-3a87-4d6c-8dae-44c5eed21aab"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:32.534001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0154c1c2-d93d-4b6c-b857-f55b9bc01c64 req-affaf728-fb11-4cc1-ad26-2f26a6432972 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:32.535891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0154c1c2-d93d-4b6c-b857-f55b9bc01c64 req-affaf728-fb11-4cc1-ad26-2f26a6432972 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:32.536814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0154c1c2-d93d-4b6c-b857-f55b9bc01c64 req-affaf728-fb11-4cc1-ad26-2f26a6432972 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:32.555731 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0154c1c2-d93d-4b6c-b857-f55b9bc01c64 req-affaf728-fb11-4cc1-ad26-2f26a6432972 service nova] Creating event network-vif-deleted:e1ae4327-3a87-4d6c-8dae-44c5eed21aab for instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b on n-h1-861333-10 Oct 19 06:56:32.565792 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0154c1c2-d93d-4b6c-b857-f55b9bc01c64 req-affaf728-fb11-4cc1-ad26-2f26a6432972 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056626 Oct 19 06:56:32.566346 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 875/1764] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:56:32.578480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:32.580407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:32.611334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:32.612088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:32.614162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:32.616574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:32.617462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:32.618524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:32.855387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:32.864131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:32.865595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:32.866995 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4aa45ed-0802-4060-a7bf-b625f691f9e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1292 microversion: 2.25 time: 0.293528 Oct 19 06:56:32.867806 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 876/1765] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:32 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1292 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:32.891977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:32.899915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:32.907089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:32.907598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:32.908051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:32.908801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:32.912280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:32.913519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.021453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:33.031111 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c9647fa0-708c-46f0-953a-c4d51f78fa08 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1213 microversion: 2.1 time: 0.149643 Oct 19 06:56:33.032121 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 877/1766] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:32 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:33.038963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:33.039753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:33.052584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.053139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.053732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.054632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.055389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.056314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.267732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:33.275817 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a13210e9-0e8b-42b4-a33a-4a808ce3554a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1488 microversion: 2.1 time: 0.242259 Oct 19 06:56:33.288281 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 878/1767] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:33 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1488 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:33.295202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:33.299042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:33.304619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.305869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.306506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.308454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.309035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.309592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.345329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:56:33.643492 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44850ae3-d015-4738-8585-31643943ed7c tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "DELETE /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 204 len: 0 microversion: 2.1 time: 0.352195 Oct 19 06:56:33.644687 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 879/1768] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:56:33 2022] DELETE /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:56:33.650674 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8de3991d-e766-4b0f-9a76-c0a9fc8dd853 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396/action" status: 202 len: 0 microversion: 2.1 time: 3.147887 Oct 19 06:56:33.650674 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 890/1769] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:56:30 2022] POST /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396/action => generated 0 bytes in 3152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:56:33.654360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:33.655473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:33.657302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:33.658267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:33.665824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.666608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.667296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.668136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.668838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.669349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.674758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.676500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.677535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.679378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.680042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.680773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.759528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lazy-loading 'flavor' on Instance uuid 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:56:33.760532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:33.786799 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4bff29e-8b14-47b2-87a6-609b85823e13 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1339 microversion: 2.1 time: 0.135718 Oct 19 06:56:33.798264 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 880/1770] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:33 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1339 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:33.798264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:33.798264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:33.814779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.815540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.816140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:33.816951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:33.817522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:33.818767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.033524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:34.062000 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-520ac590-03e6-4f45-9f95-eb95020c1ec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce/action" status: 202 len: 0 microversion: 2.1 time: 0.412075 Oct 19 06:56:34.069608 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 891/1771] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:56:33 2022] POST /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:56:34.083002 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59e1e24f-7b4f-4ea8-a450-07e21f01fef0 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.293804 Oct 19 06:56:34.084054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:34.084887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:34.086894 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 881/1772] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:33 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:34.095796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:34.096442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:34.098931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.099428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.101687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.102836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.104959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.107350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.110966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.113126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.115377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.116531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.118599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.119151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.300405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:34.308946 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6ddb4af-df70-4fe3-9469-1617d6c31932 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.221010 Oct 19 06:56:34.309628 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 882/1773] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:34 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:34.315119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:34.315806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:34.322814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.322814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.323325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.324159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.324668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.325174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.388057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:34.399172 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5099d07f-17dd-4f12-8cc6-16e2e2aa0fd5 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1514 microversion: 2.1 time: 0.326487 Oct 19 06:56:34.400011 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 892/1774] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:34 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:34.421698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:34.423701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:34.431111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.432042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.438762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.438762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.438762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.438762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.525710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:34.534677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:34.539694 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ee15889-e7d5-4303-a319-017b0f33304d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1269 microversion: 2.1 time: 0.125918 Oct 19 06:56:34.541109 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 893/1775] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:34 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:34.549011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:34.549796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:34.560071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:34.564832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:34.564996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.564996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.564996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.565232 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06082422-1fa9-4ed6-ab5d-42877ff9b9f9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1292 microversion: 2.25 time: 0.252735 Oct 19 06:56:34.565326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.565412 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 883/1776] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:34 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1292 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:34.565493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.565493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.585003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:34.819414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:34.820680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:34.824261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:34.829439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.832630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.833434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:34.834357 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3f1513e-595f-4530-a424-9e9e309e8059 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1496 microversion: 2.1 time: 0.289898 Oct 19 06:56:34.837509 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 894/1777] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:34 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1496 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:34.840355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:34.840962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:34.841428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.106530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:35.107166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:35.124256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.131023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.132031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.137560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.139026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.142963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.249359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:35.270655 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ca1c407-51f1-4dcb-ad18-91a8ba2eaff4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1379 microversion: 2.1 time: 0.458020 Oct 19 06:56:35.294764 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 884/1778] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:34 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1379 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:35.334304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:35.335182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:35.343383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.343900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.344411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.345120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.345578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.346012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.374315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:35.605244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:35.615127 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c35043f-e599-4ed2-8e2f-a6ff5b8d34a2 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.512962 Oct 19 06:56:35.620445 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 895/1779] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:35 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:35.638721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:35.638925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:35.639068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:35.645339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.646306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.647380 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e827d9b-ccca-4181-aae2-b97fc9fb693e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.317671 Oct 19 06:56:35.648165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.648329 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 885/1780] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:35 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:35.649202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.650023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.650775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.658890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:35.659564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:35.673678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.674173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.676703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.677457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.678118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.678928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.761927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:35.770540 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e1bfa6d-e184-4038-aa83-7eee566aab9d tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1275 microversion: 2.1 time: 0.120877 Oct 19 06:56:35.771256 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 886/1781] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:35 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1275 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:35.778119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:35.778731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:35.785375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.786212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.787090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:35.788070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:35.788775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:35.789555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:36.004642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:36.013091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:36.014527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:36.018019 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-538f7efa-994e-401b-9550-45f0b8d41747 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1280 microversion: 2.25 time: 0.244593 Oct 19 06:56:36.019088 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 887/1782] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:35 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:36.029282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:36.030628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:36.044042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:36.044971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:36.045429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:36.046163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:36.048038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:36.048519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:36.110894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:36.119101 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca516312-4722-49b1-8359-c29273d2178d tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1514 microversion: 2.1 time: 0.496789 Oct 19 06:56:36.132611 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 896/1783] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:35 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1514 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:36.210000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cf32efb4-80e6-4ffd-bf3f-74e87cb628b4 req-56ad40d3-609f-4e5f-b7d9-ab058fec3ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f66da6-3501-4058-9a3d-7360d82a18ad", "name": "network-vif-plugged", "status": "completed", "tag": "685438d8-d237-4136-944c-d9aec20c706e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:36.232184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cf32efb4-80e6-4ffd-bf3f-74e87cb628b4 req-56ad40d3-609f-4e5f-b7d9-ab058fec3ab9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:36.233323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cf32efb4-80e6-4ffd-bf3f-74e87cb628b4 req-56ad40d3-609f-4e5f-b7d9-ab058fec3ab9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:36.234080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cf32efb4-80e6-4ffd-bf3f-74e87cb628b4 req-56ad40d3-609f-4e5f-b7d9-ab058fec3ab9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:36.253968 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cf32efb4-80e6-4ffd-bf3f-74e87cb628b4 req-56ad40d3-609f-4e5f-b7d9-ab058fec3ab9 service nova] Creating event network-vif-plugged:685438d8-d237-4136-944c-d9aec20c706e for instance c8f66da6-3501-4058-9a3d-7360d82a18ad on n-h2-861333-10 Oct 19 06:56:36.259831 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cf32efb4-80e6-4ffd-bf3f-74e87cb628b4 req-56ad40d3-609f-4e5f-b7d9-ab058fec3ab9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053542 Oct 19 06:56:36.265371 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 897/1784] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:56:36.303515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:36.304350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:36.317718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:36.318441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:36.319177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:36.320761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:36.322047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:36.323478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:36.334612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:36.347342 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-951f0851-7533-482b-a82e-5610d75101f2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 200 len: 1479 microversion: 2.1 time: 0.324305 Oct 19 06:56:36.351689 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 888/1785] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:36 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 1479 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:36.390159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9b855c8-ca64-47c8-809e-2b38369c3a2b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2091460317"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:36.410703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9b855c8-ca64-47c8-809e-2b38369c3a2b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:36.429119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9b855c8-ca64-47c8-809e-2b38369c3a2b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:36.430854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9b855c8-ca64-47c8-809e-2b38369c3a2b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:36.433889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9b855c8-ca64-47c8-809e-2b38369c3a2b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:36.435084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9b855c8-ca64-47c8-809e-2b38369c3a2b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:36.435566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9b855c8-ca64-47c8-809e-2b38369c3a2b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:36.443126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9b855c8-ca64-47c8-809e-2b38369c3a2b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:36.920176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:36.930074 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f5a6d42-adea-4221-a8e1-ffc6083a3923 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1379 microversion: 2.1 time: 0.631918 Oct 19 06:56:36.931415 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 898/1786] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:36 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1379 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:36.952804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:36.953419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:36.958824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:36.961018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:36.961502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:36.961939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:36.962640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:36.963263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:36.963860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.048712 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9b855c8-ca64-47c8-809e-2b38369c3a2b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce/action" status: 202 len: 0 microversion: 2.1 time: 0.666243 Oct 19 06:56:37.055213 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 889/1787] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:56:36 2022] POST /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 06:56:37.055213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:37.056580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:37.063123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.064249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.064963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.065762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.066933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.067466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.282645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:37.296092 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f4104e0-f3eb-4d06-86bf-d0f2cddf05dc tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.363230 Oct 19 06:56:37.297128 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 899/1788] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:36 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:37.303964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:37.308802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:37.309688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:37.313565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.315008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.316092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.317191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.317859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.318817 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b28d7ab-1144-4d21-b071-28043f9a34c1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.268056 Oct 19 06:56:37.319472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.322537 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 890/1789] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:37 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:37.327144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2faa5e25-7086-4445-9d8b-3fba84e71646 req-71c83c21-8cf7-4bf7-8f50-2f5befe39f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f0a66f-16c0-467e-a984-d98a4ca51887", "name": "network-vif-deleted", "tag": "328361be-b382-4c71-a1d3-bc7b34544dad"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:37.350801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2faa5e25-7086-4445-9d8b-3fba84e71646 req-71c83c21-8cf7-4bf7-8f50-2f5befe39f5b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.354045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2faa5e25-7086-4445-9d8b-3fba84e71646 req-71c83c21-8cf7-4bf7-8f50-2f5befe39f5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.354709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2faa5e25-7086-4445-9d8b-3fba84e71646 req-71c83c21-8cf7-4bf7-8f50-2f5befe39f5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.381724 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2faa5e25-7086-4445-9d8b-3fba84e71646 req-71c83c21-8cf7-4bf7-8f50-2f5befe39f5b service nova] Creating event network-vif-deleted:328361be-b382-4c71-a1d3-bc7b34544dad for instance 04f0a66f-16c0-467e-a984-d98a4ca51887 on n-h2-861333-10 Oct 19 06:56:37.394392 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2faa5e25-7086-4445-9d8b-3fba84e71646 req-71c83c21-8cf7-4bf7-8f50-2f5befe39f5b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066451 Oct 19 06:56:37.394392 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 891/1790] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:37.418374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:37.423228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:37.444327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.446426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.446426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.446426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.446753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.447114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.522234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:37.531573 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58d22cb8-e34c-4a22-a520-1749935a1a14 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.231736 Oct 19 06:56:37.533393 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 900/1791] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:37 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:37.540961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfadbe9e-251b-47a4-b664-7fa49402c65b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d643001f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:37.592455 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bfadbe9e-251b-47a4-b664-7fa49402c65b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.056872 Oct 19 06:56:37.593382 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 901/1792] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:37 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:37.599066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:37.599875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:37.606103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.611903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.611903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.611903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.611903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.611903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.646015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.646659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.647102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.647568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lazy-loading 'fault' on Instance uuid 04f0a66f-16c0-467e-a984-d98a4ca51887 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:56:37.670953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:37.679670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:37.681153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:37.682242 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74cb85f5-4a6b-4ce6-8c37-ad089f06120d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1280 microversion: 2.25 time: 0.289420 Oct 19 06:56:37.682797 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 892/1793] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:37 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1280 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:37.687420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ec9fdf00-f8ac-4d02-80c1-680a892b14e5 req-c5cdc9e2-83c6-48a6-84cc-8ea3185bd6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1380e3-bb02-4aff-af35-4f131e5ba49d", "tag": "fdb44651-a8ef-4afb-aeff-358617020463"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:37.692158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:37.696695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec9fdf00-f8ac-4d02-80c1-680a892b14e5 req-c5cdc9e2-83c6-48a6-84cc-8ea3185bd6be service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.697177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec9fdf00-f8ac-4d02-80c1-680a892b14e5 req-c5cdc9e2-83c6-48a6-84cc-8ea3185bd6be service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.697607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec9fdf00-f8ac-4d02-80c1-680a892b14e5 req-c5cdc9e2-83c6-48a6-84cc-8ea3185bd6be service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.701687 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9e81fed-2c77-48f3-8a3b-c430191be0c6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1308 microversion: 2.1 time: 0.107077 Oct 19 06:56:37.702707 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 902/1794] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:37 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:37.709636 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ec9fdf00-f8ac-4d02-80c1-680a892b14e5 req-c5cdc9e2-83c6-48a6-84cc-8ea3185bd6be service nova] Creating event network-changed:fdb44651-a8ef-4afb-aeff-358617020463 for instance 4e1380e3-bb02-4aff-af35-4f131e5ba49d on n-h1-861333-10 Oct 19 06:56:37.714482 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ec9fdf00-f8ac-4d02-80c1-680a892b14e5 req-c5cdc9e2-83c6-48a6-84cc-8ea3185bd6be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030515 Oct 19 06:56:37.715273 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 893/1795] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:37.958219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:37.959335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:37.968180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.968673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.969118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:37.971307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:37.971779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:37.972246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.324345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:38.325058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:38.331573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.332333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.332940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.333841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.334467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.335121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.512430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:38.521544 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-252a279f-8bb0-4071-8408-008b19237a50 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1379 microversion: 2.1 time: 0.570740 Oct 19 06:56:38.522762 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 903/1796] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:37 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1379 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:38.527429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:38.528143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:38.534856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.535474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.536041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.536914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.537571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.538243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.574024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:38.586156 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49acdcd9-edde-4d7a-b877-1e87f61943b8 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1331 microversion: 2.1 time: 0.266848 Oct 19 06:56:38.597330 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 894/1797] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:38 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1331 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:38.609351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:38.610998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:38.622028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.623522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.624054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.624866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.625401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.625927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.698814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:38.711136 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d214a3a-cb2a-498b-9aee-1c02966fd162 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.187340 Oct 19 06:56:38.712035 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 904/1798] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:38 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:38.718340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da6cdaec-0796-4259-8578-db2cd7133f84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d642d0e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:38.775499 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da6cdaec-0796-4259-8578-db2cd7133f84 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.061898 Oct 19 06:56:38.776264 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 905/1799] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:38 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:38.789477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:38.789477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:38.791990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.792670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.793733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.794805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.796464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.797240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.805680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:38.827918 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d11faebf-215f-4097-a231-1cb4ffdebae1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.229111 Oct 19 06:56:38.829527 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 895/1800] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:38 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:38.842522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:38.846520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:38.855809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.856758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.860948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.862345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.863099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.863875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.912175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:38.913051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:38.914396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:38.915109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lazy-loading 'fault' on Instance uuid 04f0a66f-16c0-467e-a984-d98a4ca51887 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:56:38.978845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:38.988419 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0b0c3f5-e9f6-44fb-b273-f2019a307704 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 200 len: 1308 microversion: 2.1 time: 0.157010 Oct 19 06:56:38.989214 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 896/1801] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:38 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:39.146393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:39.155370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:39.157091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:39.158516 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d17747c2-d6f6-4581-8f81-a64c77224e7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1280 microversion: 2.25 time: 0.381249 Oct 19 06:56:39.159289 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 906/1802] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:38 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1280 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:39.407763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-79ac72d0-9ea6-4ad3-b61b-08e658bb44d5 req-f85723a9-c05d-4e14-b2b7-22e98f42a8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327ba1a3-a8b5-41c4-b255-1fe00ce5f005", "tag": "d625756d-d7ae-40fb-a597-39024348ca41"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:39.419843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79ac72d0-9ea6-4ad3-b61b-08e658bb44d5 req-f85723a9-c05d-4e14-b2b7-22e98f42a8b6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:39.420372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79ac72d0-9ea6-4ad3-b61b-08e658bb44d5 req-f85723a9-c05d-4e14-b2b7-22e98f42a8b6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:39.420873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79ac72d0-9ea6-4ad3-b61b-08e658bb44d5 req-f85723a9-c05d-4e14-b2b7-22e98f42a8b6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:39.433468 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-79ac72d0-9ea6-4ad3-b61b-08e658bb44d5 req-f85723a9-c05d-4e14-b2b7-22e98f42a8b6 service nova] Creating event network-changed:d625756d-d7ae-40fb-a597-39024348ca41 for instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 on n-h1-861333-10 Oct 19 06:56:39.438943 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-79ac72d0-9ea6-4ad3-b61b-08e658bb44d5 req-f85723a9-c05d-4e14-b2b7-22e98f42a8b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034257 Oct 19 06:56:39.442229 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 897/1803] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:39.546857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:39.548868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:39.557012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:39.557634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:39.558326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:39.560233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:39.561449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:39.561449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:39.614806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:39.616585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:39.623414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:39.624060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:39.624756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:39.625572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:39.626110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:39.626617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:39.751960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:39.760795 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6adf927-4023-4c7a-a077-a8258b865a52 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1379 microversion: 2.1 time: 0.218070 Oct 19 06:56:39.762149 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 907/1804] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:39 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1379 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:39.768207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:39.769081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:39.776433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:39.777128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:39.777744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:39.778611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:39.779418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:39.780093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:39.815899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:39.824351 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3758e20-5baa-4405-ac8b-1e74f864fc18 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1534 microversion: 2.1 time: 0.215389 Oct 19 06:56:39.829789 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 898/1805] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:39 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1534 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:39.836944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-018ff551-d869-46c8-8062-1df6b083bed4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68ba09d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:39.900203 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-018ff551-d869-46c8-8062-1df6b083bed4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.068787 Oct 19 06:56:39.900906 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 899/1806] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:39 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:39.905731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0ab698a-f532-4f0b-90df-da19f16784a1 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Action: 'create', calling method: .version_select at 0x7f6d68bec040>, body: {"pool": "6ca08089-6704-47df-a013-49691731b317"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:39.933401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:39.942871 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-80751255-7d64-436c-9f63-732b0b4a3030 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.178974 Oct 19 06:56:39.948156 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 908/1807] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:39 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:39.949409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:39.949409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:39.968839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:39.970067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:39.970632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:39.971877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:39.972492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:39.973032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:40.123805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:40.133174 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5072fc0c-d474-47ce-a43e-2c3e4da17474 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.188565 Oct 19 06:56:40.133887 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 909/1808] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:39 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:40.144132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a553d75-030f-401e-bf94-6e27cac990da tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:40.144132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a553d75-030f-401e-bf94-6e27cac990da tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:40.150011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a553d75-030f-401e-bf94-6e27cac990da tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:40.150910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a553d75-030f-401e-bf94-6e27cac990da tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:40.151662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a553d75-030f-401e-bf94-6e27cac990da tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:40.152789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a553d75-030f-401e-bf94-6e27cac990da tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:40.153502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a553d75-030f-401e-bf94-6e27cac990da tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:40.154352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a553d75-030f-401e-bf94-6e27cac990da tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:40.190212 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a553d75-030f-401e-bf94-6e27cac990da tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054009 Oct 19 06:56:40.190891 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 910/1809] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:56:40 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:40.195920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:40.196645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 04f0a66f-16c0-467e-a984-d98a4ca51887] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:40.203210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:40.204550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:40.205145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:40.206044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:40.206653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:40.207096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:40.231931 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] HTTP exception thrown: Instance 04f0a66f-16c0-467e-a984-d98a4ca51887 could not be found. Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Request method failure captured: Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 HTTP/1.1 Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57wAZ4In8re5DswpkFimD9e6_9w-So_fmsSNk-JKjT1BhbZ3J0YQJqBn93DZwfWmCqChPTybYZQhNPG0rlhijGUZs4eYw-amwrUtAcG_JDBvK_8Uea7QDIhkZ27q_yUP48Hbv6OEQhROggj-vwDNHwOUBJWtnvuJZEGJWLhplF81FY Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 012922c902b44fc1bb1975dfa27ff074 Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesAdminNegativeTest-539970662 Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/012922c902b44fc1bb1975dfa27ff074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/012922c902b44fc1bb1975dfa27ff074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/012922c902b44fc1bb1975dfa27ff074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_012922c902b44fc1bb1975dfa27ff074", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesAdminNegativeTest-539970662 Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 012922c902b44fc1bb1975dfa27ff074 Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-539970662 Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesAdminNegativeTest-539970662-project Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44e6b0b4228744ecab5536aa08d9495d Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesAdminNegativeTest-539970662-project Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 04f0a66f-16c0-467e-a984-d98a4ca51887 could not be found. Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '04f0a66f-16c0-467e-a984-d98a4ca51887'} Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f0a66f-16c0-467e-a984-d98a4ca51887 could not be found. Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f0a66f-16c0-467e-a984-d98a4ca51887 could not be found. Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:40.234565 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f0a66f-16c0-467e-a984-d98a4ca51887 could not be found. Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Returning 404 to user: Instance 04f0a66f-16c0-467e-a984-d98a4ca51887 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e729905e-c77a-49a6-ba5d-66dbd9ca6da6 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887" status: 404 len: 111 microversion: 2.1 time: 0.044287 Oct 19 06:56:40.244837 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 911/1810] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:40 2022] GET /compute/v2.1/servers/04f0a66f-16c0-467e-a984-d98a4ca51887 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:56:40.258013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:40.258768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:40.272036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:40.276687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:40.277646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:40.278481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:40.280697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:40.281274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:40.396874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=26 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:40.431048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:40.538755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:40.566188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:40.567658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:40.568944 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58fde590-1712-45ba-aaaa-261980af92b6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1280 microversion: 2.25 time: 0.330744 Oct 19 06:56:40.569727 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 912/1811] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:40 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1280 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:40.574940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:40.575679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:40.583228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:40.584077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:40.584783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:40.585713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:40.586339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:40.587013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:40.693224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lazy-loading 'services' on Instance uuid 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:56:40.697458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:40.710135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:40.944541 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06c96fdc-8d3f-4430-a5a2-89f3c601e514 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "DELETE /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments/c65b2b9c-8688-43f3-abaa-4ec18e312447" status: 202 len: 0 microversion: 2.1 time: 0.373134 Oct 19 06:56:40.945140 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 913/1812] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 06:56:40 2022] DELETE /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments/c65b2b9c-8688-43f3-abaa-4ec18e312447 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:56:40.987012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:40.989456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:41.001464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:41.007042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:41.007042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:41.007042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:41.007042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:41.007042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:41.312836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:41.324917 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f63b8879-a7ca-41a7-9d38-f3923caeb2bb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1379 microversion: 2.1 time: 0.378426 Oct 19 06:56:41.325830 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 914/1813] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:40 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1379 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:41.331176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-baa2f4f1-8724-4c0d-ab56-6117ce088801 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d642f40d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:41.396600 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-baa2f4f1-8724-4c0d-ab56-6117ce088801 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.068750 Oct 19 06:56:41.397373 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 915/1814] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:41 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:41.426446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:41.427015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:41.433314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:41.433811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:41.434281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:41.434987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:41.435448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:41.435881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:41.624682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:41.639394 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-783c36a3-8967-45b0-9654-49328b4bc800 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.223074 Oct 19 06:56:41.641692 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 916/1815] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:41 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:41.663614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:41.665553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:41.666178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:41.675836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:41.678138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:41.678595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:41.679361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:41.684910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:41.685813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:41.859900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:41.872471 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b624cda0-0f47-49c3-bf41-f19f3c0a6ac3 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.229118 Oct 19 06:56:41.873129 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 917/1816] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:41 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:41.878410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-61c6854d-cb75-473a-a0de-c426aed9348f req-f7af3b16-f2dc-48fe-b177-baa13f469981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9ce9b7-76c3-46e8-8de2-b50c0e126dce", "name": "network-vif-plugged", "status": "completed", "tag": "95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:41.909897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-61c6854d-cb75-473a-a0de-c426aed9348f req-f7af3b16-f2dc-48fe-b177-baa13f469981 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:41.910329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-61c6854d-cb75-473a-a0de-c426aed9348f req-f7af3b16-f2dc-48fe-b177-baa13f469981 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:41.910756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-61c6854d-cb75-473a-a0de-c426aed9348f req-f7af3b16-f2dc-48fe-b177-baa13f469981 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:41.928258 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-61c6854d-cb75-473a-a0de-c426aed9348f req-f7af3b16-f2dc-48fe-b177-baa13f469981 service nova] Creating event network-vif-plugged:95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a for instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce on n-h1-861333-10 Oct 19 06:56:41.934340 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-61c6854d-cb75-473a-a0de-c426aed9348f req-f7af3b16-f2dc-48fe-b177-baa13f469981 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059814 Oct 19 06:56:41.935117 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 918/1817] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:41.942970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:41.948482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:41.951781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:41.953193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:41.953566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:41.954322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:41.954780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:41.955207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:42.129858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:42.163272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:42.165109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:42.171272 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca8deb24-a829-445b-adb9-2c964710eae4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1280 microversion: 2.25 time: 0.234808 Oct 19 06:56:42.172058 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 919/1818] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:41 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1280 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:42.347415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:42.348024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:42.354094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:42.354913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:42.355414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:42.356210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:42.356907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:42.357551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:42.604919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:42.616440 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0da93f3-d29e-4811-9c8f-f8954350005b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1379 microversion: 2.1 time: 0.272952 Oct 19 06:56:42.631561 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0ab698a-f532-4f0b-90df-da19f16784a1 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.720963 Oct 19 06:56:42.631561 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 900/1819] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 06:56:39 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:42.631561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be80814f-9d40-4c8e-b885-4b715efada10 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68bae5e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:42.635862 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 920/1820] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:42 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1379 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:42.644684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Action: 'action', calling method: .version_select at 0x7f6d66532ca0>, body: {"addFloatingIp": {"address": "172.25.6.2"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:42.647540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:42.654849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:42.655565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:42.656221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:42.657425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:42.658074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:42.658673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:42.691601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:56:42.692233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquired lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:56:42.693047 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be80814f-9d40-4c8e-b885-4b715efada10 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.068042 Oct 19 06:56:42.693732 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 901/1821] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:42 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:42.698701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:42.699577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:42.707081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:42.707736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:42.708460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:42.709597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:42.710274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:42.710918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:42.912674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:42.925628 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8deb07a8-4888-4833-b4d1-99035390d031 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.230445 Oct 19 06:56:42.926913 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 902/1822] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:42 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:42.941200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:42.942113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:42.952331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:42.953141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:42.954051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:42.956596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:42.961273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:42.961819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:43.462545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:43.471241 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cf322ff-1dbb-4811-8bbd-ff115604600e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.543000 Oct 19 06:56:43.482716 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 903/1823] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:42 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:43.488837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:43.489766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:43.515920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:43.519733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:43.520632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:43.523445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:43.529053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:43.532446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:43.952692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:43.975767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:43.983666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:43.989393 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e90d73f2-7474-49c2-94c2-f65d0ad57e2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1280 microversion: 2.25 time: 0.505146 Oct 19 06:56:44.004760 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 904/1824] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:43 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1280 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:44.022883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:44.026435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:44.046543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:44.053215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:44.054354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:44.069055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:44.074803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:44.077597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:44.118189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:44.588381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:44.605723 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85fb901f-db8b-45f4-8aa2-16461bbe012c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1379 microversion: 2.1 time: 0.599367 Oct 19 06:56:44.607019 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 905/1825] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:44 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1379 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:44.633345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1733c393-572a-43e0-b481-86985c18bec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68ba04c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:44.718005 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1733c393-572a-43e0-b481-86985c18bec5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.109694 Oct 19 06:56:44.723130 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 906/1826] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:44 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:44.736162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6d008927-d648-449d-b3c4-ce1bf62246ad req-6bb8a7d7-e205-4fc6-abd1-159ccebc1e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327ba1a3-a8b5-41c4-b255-1fe00ce5f005", "name": "network-vif-plugged", "status": "completed", "tag": "d625756d-d7ae-40fb-a597-39024348ca41"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:44.749592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:44.762645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6d008927-d648-449d-b3c4-ce1bf62246ad req-6bb8a7d7-e205-4fc6-abd1-159ccebc1e43 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:44.763086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6d008927-d648-449d-b3c4-ce1bf62246ad req-6bb8a7d7-e205-4fc6-abd1-159ccebc1e43 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:44.771562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6d008927-d648-449d-b3c4-ce1bf62246ad req-6bb8a7d7-e205-4fc6-abd1-159ccebc1e43 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:44.791217 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6d008927-d648-449d-b3c4-ce1bf62246ad req-6bb8a7d7-e205-4fc6-abd1-159ccebc1e43 service nova] Creating event network-vif-plugged:d625756d-d7ae-40fb-a597-39024348ca41 for instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 on n-h1-861333-10 Oct 19 06:56:44.798900 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6d008927-d648-449d-b3c4-ce1bf62246ad req-6bb8a7d7-e205-4fc6-abd1-159ccebc1e43 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072976 Oct 19 06:56:44.803836 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 907/1827] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:44.811595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:44.813957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:44.850588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:44.855038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:44.855038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:44.855038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:44.855038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:44.855038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:45.190490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:45.200603 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02f3df8a-542a-4dbd-9fa1-7dfc400a672d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.394342 Oct 19 06:56:45.216958 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 908/1828] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:44 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:45.222715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:45.222915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:45.233376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:45.233376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:45.233376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:45.233376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:45.233376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:45.233376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:45.331424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Building network info cache for instance {{(pid=127568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 06:56:45.538565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:45.547093 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73add7e7-558b-433c-a4bd-eed72308c97e tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.328934 Oct 19 06:56:45.568481 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 909/1829] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:45 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:45.578174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:45.578841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:45.599667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:45.602390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:45.604430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:45.605377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:45.607523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:45.611028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:45.897903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:45.907615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:45.908984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:45.920747 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f32258ca-fc74-404a-9372-5d943f2a87be tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1280 microversion: 2.25 time: 0.350947 Oct 19 06:56:45.936954 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 910/1830] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:45 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1280 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:45.941833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-11bf4066-be6e-4147-acf1-a865885f72c0 req-82b56486-9213-461f-9316-3bb75586168e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f66da6-3501-4058-9a3d-7360d82a18ad", "tag": "685438d8-d237-4136-944c-d9aec20c706e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:45.975594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-11bf4066-be6e-4147-acf1-a865885f72c0 req-82b56486-9213-461f-9316-3bb75586168e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:45.976357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-11bf4066-be6e-4147-acf1-a865885f72c0 req-82b56486-9213-461f-9316-3bb75586168e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:45.977519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-11bf4066-be6e-4147-acf1-a865885f72c0 req-82b56486-9213-461f-9316-3bb75586168e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:45.995299 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-11bf4066-be6e-4147-acf1-a865885f72c0 req-82b56486-9213-461f-9316-3bb75586168e service nova] Creating event network-changed:685438d8-d237-4136-944c-d9aec20c706e for instance c8f66da6-3501-4058-9a3d-7360d82a18ad on n-h2-861333-10 Oct 19 06:56:46.019574 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-11bf4066-be6e-4147-acf1-a865885f72c0 req-82b56486-9213-461f-9316-3bb75586168e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081248 Oct 19 06:56:46.020792 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 911/1831] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:46.026341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:46.034864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:46.053285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:46.054081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:46.059918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:46.060959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:46.069654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:46.069654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:46.229373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:46.242043 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4121b0c6-cf2b-4b5e-af2f-549f2677b0e6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1379 microversion: 2.1 time: 0.219626 Oct 19 06:56:46.243285 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 912/1832] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:46 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1379 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:46.249094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69372695-41c3-43e2-962b-b17d26a0f1e5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d649650d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:46.313995 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69372695-41c3-43e2-962b-b17d26a0f1e5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.067963 Oct 19 06:56:46.314850 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 913/1833] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:46 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:46.320548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:46.321502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:46.330939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:46.331835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:46.332528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:46.333473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:46.334149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:46.334812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:46.674144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:46.690824 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-931b1b37-23bc-49b4-8b86-9c32c5a06c1a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.374567 Oct 19 06:56:46.714149 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 914/1834] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:46 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:46.728903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:46.737758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:46.751984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:46.752827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:46.753442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:46.755295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:46.757658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:46.759456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:47.011543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:47.026686 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-075e9763-003f-4605-80cb-293284f5b4f4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.302875 Oct 19 06:56:47.028331 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 915/1835] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:46 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:47.036352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b4bca897-202a-48df-887e-2dac1261cdec req-8371439c-f5a5-4d81-81b5-7caae74f4744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c979c511-6f7d-4d9b-8987-9862804d3a38", "name": "network-vif-plugged", "status": "completed", "tag": "1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:47.052530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b4bca897-202a-48df-887e-2dac1261cdec req-8371439c-f5a5-4d81-81b5-7caae74f4744 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:47.053166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b4bca897-202a-48df-887e-2dac1261cdec req-8371439c-f5a5-4d81-81b5-7caae74f4744 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:47.053823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b4bca897-202a-48df-887e-2dac1261cdec req-8371439c-f5a5-4d81-81b5-7caae74f4744 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:47.069298 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b4bca897-202a-48df-887e-2dac1261cdec req-8371439c-f5a5-4d81-81b5-7caae74f4744 service nova] Creating event network-vif-plugged:1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9 for instance c979c511-6f7d-4d9b-8987-9862804d3a38 on n-h2-861333-10 Oct 19 06:56:47.076178 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b4bca897-202a-48df-887e-2dac1261cdec req-8371439c-f5a5-4d81-81b5-7caae74f4744 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046422 Oct 19 06:56:47.080932 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 916/1836] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:47.086794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:47.087504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:47.094934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:47.095494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:47.096695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:47.097469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:47.097941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:47.098507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:47.372236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:47.381960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:47.383428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:47.385166 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-044c51d9-4ca1-4bdf-9189-9e4767529b24 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1280 microversion: 2.25 time: 0.302955 Oct 19 06:56:47.396147 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 917/1837] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:47 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:47.396147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:47.396147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:47.399093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:47.406679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:47.406679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:47.406679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:47.406679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:47.406679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:47.759164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:47.772904 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d663e91-ac55-4d4b-86f0-32c95fead51d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1529 microversion: 2.1 time: 0.385555 Oct 19 06:56:47.776421 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 918/1838] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:47 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1529 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:47.781518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10418d4a-20c9-488d-9f71-16a962c4567c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68be1160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:47.863761 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10418d4a-20c9-488d-9f71-16a962c4567c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.085811 Oct 19 06:56:47.867913 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 919/1839] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:47 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:47.877784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:47.880737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:47.899342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:47.900146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:47.900748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:47.901640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:47.902258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:47.902845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:48.118744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Updating instance_info_cache with network_info: [{"id": "685438d8-d237-4136-944c-d9aec20c706e", "address": "fa:16:3e:82:b4:eb", "network": {"id": "a75b7e29-d679-4927-b162-08de115eec1f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-458922686-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b08e9e6be87c411796dec57a649da36c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap685438d8-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 06:56:48.201950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:48.212129 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe099f45-10c4-408e-a029-09d5aa8e75a7 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.342917 Oct 19 06:56:48.216556 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 920/1840] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:47 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:48.228455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Releasing lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:56:48.229456 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13012d47-de9c-4c56-841e-9a65f6d6d513 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action" status: 202 len: 0 microversion: 2.1 time: 5.591855 Oct 19 06:56:48.234210 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 921/1841] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:56:42 2022] POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action => generated 0 bytes in 5593 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 06:56:48.235023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:48.235742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:48.239705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:48.245239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:48.247601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:48.254424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:48.254424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:48.254424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:48.254424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:48.254424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:48.267313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:48.267931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:48.269825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:48.270634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:48.273729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:48.287001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:48.528088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:48.537356 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5776b14b-30e7-4163-9084-710ec6be8cd8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1529 microversion: 2.1 time: 0.319223 Oct 19 06:56:48.538159 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 921/1842] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:48 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1529 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:48.542883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cfe5b782-032d-4003-a720-8845d3240657 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Action: 'create', calling method: .version_select at 0x7f6d68c01f70>, body: {"pool": "6ca08089-6704-47df-a013-49691731b317"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:48.600453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:48.612138 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-990e38ea-43d1-4489-8ba6-b551b1832b2c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.380853 Oct 19 06:56:48.615485 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 922/1843] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:48 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:48.631117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:48.631998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:48.644345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:48.645166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:48.646679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:48.650482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:48.651189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:48.651822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:48.894186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:48.922075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:48.927499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:48.929527 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9076afa2-5e71-476a-9686-8c8e28c2a63b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1280 microversion: 2.25 time: 0.312379 Oct 19 06:56:48.933309 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 923/1844] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:48 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1280 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:48.940094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffb53952-4373-4f4d-8ef6-158ea90fd0f3 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:49.029832 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffb53952-4373-4f4d-8ef6-158ea90fd0f3 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/ba881663-0df0-4881-94b9-0584868e985b" status: 202 len: 0 microversion: 2.1 time: 0.094558 Oct 19 06:56:49.033882 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 924/1845] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:56:48 2022] DELETE /compute/v2.1/flavors/ba881663-0df0-4881-94b9-0584868e985b => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:56:49.040034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5cb8c709-97ec-432f-a1ff-d1b673a808c1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68ba90d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:49.146178 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5cb8c709-97ec-432f-a1ff-d1b673a808c1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.110964 Oct 19 06:56:49.147723 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 925/1846] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:49 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:49.152413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-680f02b2-8410-4989-a96a-509abffe47ff tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:49.173594 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-680f02b2-8410-4989-a96a-509abffe47ff tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024422 Oct 19 06:56:49.174804 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 926/1847] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:56:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:49.179495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-fc454f23-d582-4a68-a14b-36bfafef33d9 req-2e56fc92-a5cf-4255-81d4-a2aab64d5f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1380e3-bb02-4aff-af35-4f131e5ba49d", "name": "network-vif-plugged", "status": "completed", "tag": "fdb44651-a8ef-4afb-aeff-358617020463"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:49.210584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fc454f23-d582-4a68-a14b-36bfafef33d9 req-2e56fc92-a5cf-4255-81d4-a2aab64d5f84 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:49.211384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fc454f23-d582-4a68-a14b-36bfafef33d9 req-2e56fc92-a5cf-4255-81d4-a2aab64d5f84 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:49.211986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fc454f23-d582-4a68-a14b-36bfafef33d9 req-2e56fc92-a5cf-4255-81d4-a2aab64d5f84 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:49.224057 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-fc454f23-d582-4a68-a14b-36bfafef33d9 req-2e56fc92-a5cf-4255-81d4-a2aab64d5f84 service nova] Creating event network-vif-plugged:fdb44651-a8ef-4afb-aeff-358617020463 for instance 4e1380e3-bb02-4aff-af35-4f131e5ba49d on n-h1-861333-10 Oct 19 06:56:49.233244 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-fc454f23-d582-4a68-a14b-36bfafef33d9 req-2e56fc92-a5cf-4255-81d4-a2aab64d5f84 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056994 Oct 19 06:56:49.234174 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 927/1848] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:49.241917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:49.244335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:49.251809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:49.252635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:49.253237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:49.254118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:49.254756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:49.255459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:49.304808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:49.331679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Old instance type tempest-test_resize_flavor_-485718786, new instance type m1.heat {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 06:56:49.338955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:56:49.348911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:56:49.349713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:56:49.350319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:56:49.350903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:56:49.645950 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3acfaa08-27a7-4444-8070-1ee00d7c74dc tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005/action" status: 202 len: 0 microversion: 2.1 time: 0.410186 Oct 19 06:56:49.647246 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 928/1849] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:56:49 2022] POST /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:56:49.652697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:49.653720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:49.660910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:49.661788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:49.662490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:49.663460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:49.664218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:49.664920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:49.872263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:49.882125 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9d8067f-8977-4a0d-81ed-0f6f8ec5b6c2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.233492 Oct 19 06:56:49.920869 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 929/1850] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:49 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:49.920869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:49.920869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:49.920869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:49.920869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:49.920869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:49.920869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:49.920869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:49.920869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:50.053265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:50.062613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c4e8be6-c9d8-4b96-b21b-b7135fb380dd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.177592 Oct 19 06:56:50.063950 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 930/1851] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:49 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:50.070874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:50.072888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:50.080585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:50.081229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:50.081771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:50.082692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:50.083296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:50.083995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:50.234863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:50.245276 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2367fb5f-ba33-4d5e-b208-1b751ccff53b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1538 microversion: 2.1 time: 0.179972 Oct 19 06:56:50.246268 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 931/1852] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:50 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1538 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:50.251376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:50.254963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:50.260894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:50.261654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:50.262173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:50.262953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:50.263540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:50.264033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:50.473099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:50.484226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:50.485993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:50.487502 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51cea1a8-c6de-4521-b315-e12a2828b540 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1477 microversion: 2.25 time: 0.240077 Oct 19 06:56:50.488541 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 932/1853] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:50 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:50.494035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4014fd78-7708-492a-a055-8b206b893476 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68ba43a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:50.557893 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4014fd78-7708-492a-a055-8b206b893476 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.068082 Oct 19 06:56:50.558764 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 933/1854] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:50 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:50.742775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:50.743387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:50.751344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:50.751831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:50.756419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:50.756419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:50.756419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:50.756419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:50.794254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:51.122892 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cfe5b782-032d-4003-a720-8845d3240657 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.417744 Oct 19 06:56:51.122892 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 922/1855] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 06:56:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:51.122892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:51.122892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:51.124619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid c979c511-6f7d-4d9b-8987-9862804d3a38 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:56:51.125444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.125444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.125444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.125444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.125444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.125444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5809129e-45cb-4f02-9ca5-09e40b48e2ab tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1971 microversion: 2.25 time: 0.437697 Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 934/1856] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:50 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1971 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.126833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.163672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:51.196270 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c56a4167-1150-4a07-b528-951dda00627a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.215268 Oct 19 06:56:51.196270 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 923/1857] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:50 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:51.196270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.95"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:51.196270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:51.196270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.196270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.198939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.200569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.201118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.201568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.247695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:56:51.248403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquired lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:56:51.361602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:51.383937 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2e226b1-d1bf-49ca-82f4-2c5e3144b557 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1317 microversion: 2.1 time: 0.288834 Oct 19 06:56:51.383937 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 935/1858] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:51 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:56:51.396154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:51.396154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:51.420019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.420536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.420975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.423998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.424488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.424924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.696599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid c979c511-6f7d-4d9b-8987-9862804d3a38 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:56:51.714082 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-035c4025-b6cc-409d-ad5d-70df51fd9a85 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1971 microversion: 2.25 time: 0.333470 Oct 19 06:56:51.715559 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 936/1859] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:51 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1971 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:56:51.722642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:51.723733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:51.732126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.732772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.733449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.734349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:51.735590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:51.737257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:51.981296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:51.992607 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e03876b-b477-4c84-9781-b522ee98d0ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1538 microversion: 2.1 time: 0.271693 Oct 19 06:56:51.998946 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 937/1860] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:51 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1538 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:52.014252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a94785ae-e647-4feb-844f-8acc8210d368 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d6433b820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:52.076018 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a94785ae-e647-4feb-844f-8acc8210d368 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.074081 Oct 19 06:56:52.100486 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 938/1861] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:51 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:52.113749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06e48f0f-e1e7-469a-b67a-3abf03a61863 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:52.118297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06e48f0f-e1e7-469a-b67a-3abf03a61863 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:52.129223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e48f0f-e1e7-469a-b67a-3abf03a61863 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.134136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e48f0f-e1e7-469a-b67a-3abf03a61863 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.136341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e48f0f-e1e7-469a-b67a-3abf03a61863 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.139985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e48f0f-e1e7-469a-b67a-3abf03a61863 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.141081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e48f0f-e1e7-469a-b67a-3abf03a61863 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.142375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e48f0f-e1e7-469a-b67a-3abf03a61863 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.243116 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06e48f0f-e1e7-469a-b67a-3abf03a61863 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139987 Oct 19 06:56:52.244768 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 939/1862] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:56:52 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:56:52.257803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:52.258438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:52.267143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.267804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.268292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.269465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.269465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.269874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.322725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:56:52.601721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.95 (b1ba9ea2-2f4d-4938-8750-1a4aa942aab7) with port 685438d8-d237-4136-944c-d9aec20c706e using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6ca08089-6704-47df-a013-49691731b317.", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 06:56:52.603434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Releasing lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:56:52.604287 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.95 (b1ba9ea2-2f4d-4938-8750-1a4aa942aab7) with port 685438d8-d237-4136-944c-d9aec20c706e using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6ca08089-6704-47df-a013-49691731b317. Oct 19 06:56:52.604287 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-43698d81-00bb-49ee-bea2-3a7d3a147925'] Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Request method failure captured: Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action HTTP/1.1 Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 45 Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT5-RuhmjpN3u_ZzhEBzLdt2Gs48J8jOPJaStBy4OFxyl7Udc8oAFy09a0hn-aSuLtXfKK__JLsrqKvpnr17xfbGl9OvR_t311si8TdOVfDdPzMLFnBLnNIZe6ZWCPZaz3Mpv8NUe5-EKjed4M1-ofI6xOEcWMIiFtAEFzKwrTurE8Rk Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b08e9e6be87c411796dec57a649da36c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 08c23581eda747cda3e4d3696703edf4 Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: {"addFloatingIp": {"address": "172.25.6.95"}} Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot associate floating IP 172.25.6.95 (b1ba9ea2-2f4d-4938-8750-1a4aa942aab7) with port 685438d8-d237-4136-944c-d9aec20c706e using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6ca08089-6704-47df-a013-49691731b317. Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-43698d81-00bb-49ee-bea2-3a7d3a147925'] Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c8f66da6-3501-4058-9a3d-7360d82a18ad', 'body': {'addFloatingIp': {'address': '172.25.6.95'}}} Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 06:56:52.610662 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.95 (b1ba9ea2-2f4d-4938-8750-1a4aa942aab7) with port 685438d8-d237-4136-944c-d9aec20c706e using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6ca08089-6704-47df-a013-49691731b317. Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43698d81-00bb-49ee-bea2-3a7d3a147925'] Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.95 (b1ba9ea2-2f4d-4938-8750-1a4aa942aab7) with port 685438d8-d237-4136-944c-d9aec20c706e using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6ca08089-6704-47df-a013-49691731b317. Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43698d81-00bb-49ee-bea2-3a7d3a147925'] Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.95 (b1ba9ea2-2f4d-4938-8750-1a4aa942aab7) with port 685438d8-d237-4136-944c-d9aec20c706e using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6ca08089-6704-47df-a013-49691731b317. Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43698d81-00bb-49ee-bea2-3a7d3a147925'] Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.95 (b1ba9ea2-2f4d-4938-8750-1a4aa942aab7) with port 685438d8-d237-4136-944c-d9aec20c706e using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6ca08089-6704-47df-a013-49691731b317. Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43698d81-00bb-49ee-bea2-3a7d3a147925'] Oct 19 06:56:52.615216 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:56:52.624057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Returning 400 to user: Cannot associate floating IP 172.25.6.95 (b1ba9ea2-2f4d-4938-8750-1a4aa942aab7) with port 685438d8-d237-4136-944c-d9aec20c706e using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6ca08089-6704-47df-a013-49691731b317. Oct 19 06:56:52.624057 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-43698d81-00bb-49ee-bea2-3a7d3a147925'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:56:52.624057 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8470c821-dc29-4fdf-8c1e-708cbddcbb2d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action" status: 400 len: 380 microversion: 2.1 time: 1.444066 Oct 19 06:56:52.624057 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 924/1863] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:56:51 2022] POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action => generated 380 bytes in 1446 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:56:52.629744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95b53f1b-b21f-41f8-aa80-f08306cc678e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:52.634568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b53f1b-b21f-41f8-aa80-f08306cc678e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.635290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b53f1b-b21f-41f8-aa80-f08306cc678e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.650604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b53f1b-b21f-41f8-aa80-f08306cc678e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.654345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b53f1b-b21f-41f8-aa80-f08306cc678e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.655095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b53f1b-b21f-41f8-aa80-f08306cc678e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.655879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b53f1b-b21f-41f8-aa80-f08306cc678e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.701278 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95b53f1b-b21f-41f8-aa80-f08306cc678e tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.077858 Oct 19 06:56:52.702816 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 925/1864] 10.222.0.39 () {60 vars in 1217 bytes} [Wed Oct 19 06:56:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:56:52.708764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:52.709615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:52.719214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.720466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.721358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.722263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.722893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.723591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.785799 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33cf4fdc-ad9f-4f17-9130-83d31fa60d30 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "DELETE /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 204 len: 0 microversion: 2.1 time: 0.539448 Oct 19 06:56:52.787390 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 940/1865] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:56:52 2022] DELETE /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:56:52.794944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e884580e-a7c5-44f4-8b28-c6fd068f1c5a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:52.812756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e884580e-a7c5-44f4-8b28-c6fd068f1c5a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:52.830480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e884580e-a7c5-44f4-8b28-c6fd068f1c5a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.830978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e884580e-a7c5-44f4-8b28-c6fd068f1c5a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.831416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e884580e-a7c5-44f4-8b28-c6fd068f1c5a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.832147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e884580e-a7c5-44f4-8b28-c6fd068f1c5a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.832606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e884580e-a7c5-44f4-8b28-c6fd068f1c5a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.833046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e884580e-a7c5-44f4-8b28-c6fd068f1c5a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.896991 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e884580e-a7c5-44f4-8b28-c6fd068f1c5a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108278 Oct 19 06:56:52.897878 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 941/1866] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 06:56:52 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:56:52.916295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:52.917038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:52.923534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.924029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.924499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.925214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:52.925671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:52.926099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:52.972830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:52.999526 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afdd6955-5e3b-47d8-8248-6e66aa26c596 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.294353 Oct 19 06:56:53.003276 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 926/1867] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:52 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:53.015872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7425c48-1a72-4074-ba8a-1c2d80e214a9 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '.version_select at 0x7f6d68bec9d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:53.243224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:53.259426 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bf88da2-6521-4fc1-8120-551de93d6ca0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1507 microversion: 2.1 time: 0.359992 Oct 19 06:56:53.261343 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 942/1868] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:52 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:53.280676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-861333-10", "block_migration": "auto"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:53.289825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:53.300499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:53.300994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:53.301432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:53.302151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:53.302588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:53.303009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:53.344005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'flavor' on Instance uuid c979c511-6f7d-4d9b-8987-9862804d3a38 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:56:53.373214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Going to try to live migrate instance to n-h1-861333-10 {{(pid=127568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 06:56:54.193259 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7425c48-1a72-4074-ba8a-1c2d80e214a9 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/b1ba9ea2-2f4d-4938-8750-1a4aa942aab7" status: 202 len: 0 microversion: 2.1 time: 1.186945 Oct 19 06:56:54.194126 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 927/1869] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:56:53 2022] DELETE /compute/v2.1/os-floating-ips/b1ba9ea2-2f4d-4938-8750-1a4aa942aab7 => generated 0 bytes in 1190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:56:54.198916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:54.199531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:54.207675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:54.208259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:54.208703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:54.209462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:54.209967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:54.210349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:54.380850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e6b0b4228744ecab5536aa08d9495d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012922c902b44fc1bb1975dfa27ff074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:54.392159 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e121e047-c606-4533-9eeb-2ac529b291c9 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 200 len: 1683 microversion: 2.1 time: 0.195776 Oct 19 06:56:54.393919 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 928/1870] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:54 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:54.399915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:54.406612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:54.414781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:54.415529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:54.415966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:54.416864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:54.417525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:54.418124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:54.449186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:56:54.452632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:54.840905 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-705e9c31-f06c-4a07-8b00-831eb376327a tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "DELETE /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 204 len: 0 microversion: 2.1 time: 0.445658 Oct 19 06:56:54.841738 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 929/1871] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:56:54 2022] DELETE /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:56:54.850815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:54.851517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:54.865454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:54.865955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:54.866399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:54.873257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:54.873870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:54.924554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:55.071263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:55.080744 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-846e5131-395d-40ed-9311-9c1a24a63657 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1538 microversion: 2.1 time: 0.234775 Oct 19 06:56:55.081315 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 930/1872] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:54 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1538 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:55.086149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb95ed75-42a3-4229-85ed-03259d3bf517 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68ad9d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:55.132836 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb95ed75-42a3-4229-85ed-03259d3bf517 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.050383 Oct 19 06:56:55.133710 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 931/1873] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:55 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:55.138587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:55.139207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:55.146207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:55.146762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:55.147268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:55.148005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:55.148524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:55.148960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:55.291150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:55.299403 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38f8ef1f-ea5a-426c-8e20-c6b988ee2436 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1507 microversion: 2.1 time: 0.164647 Oct 19 06:56:55.299971 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 932/1874] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:55 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:55.304543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:55.305248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:55.312442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:55.314893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:55.314893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:55.316612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:55.317747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:55.318640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:55.529715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:55.540866 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-baf174e0-570f-4bce-9496-81491c9dcaaf tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.239797 Oct 19 06:56:55.541774 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 933/1875] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:55 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:55.547091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.2"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:55.758641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:55.773366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:55.773869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:55.774311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:55.775037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:55.775908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:55.775908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:56.074989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:56:56.075410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquired lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:56:57.807843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 06:56:58.523795 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b8ecf54-2bbe-4070-ac45-0c4e1078f3e6 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38/action" status: 202 len: 0 microversion: 2.25 time: 5.260819 Oct 19 06:56:58.528291 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 943/1876] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:56:53 2022] POST /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38/action => generated 0 bytes in 5266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:56:58.533963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:58.534603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:58.559728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:58.559845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:58.563924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:58.564755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:58.566955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:58.567412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:58.707724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:58.716950 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da1bda02-a51e-4ea3-9207-8897a9ca4faf tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1615 microversion: 2.1 time: 0.186353 Oct 19 06:56:58.737167 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 944/1877] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:58 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1615 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:58.740432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0263e0b5-ebe1-4fbc-bb2f-e6e7639b04af tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:58.744313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0263e0b5-ebe1-4fbc-bb2f-e6e7639b04af tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:58.748178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:58.754026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0263e0b5-ebe1-4fbc-bb2f-e6e7639b04af tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:58.754831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0263e0b5-ebe1-4fbc-bb2f-e6e7639b04af tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:58.755463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0263e0b5-ebe1-4fbc-bb2f-e6e7639b04af tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:58.760733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0263e0b5-ebe1-4fbc-bb2f-e6e7639b04af tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:58.760733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0263e0b5-ebe1-4fbc-bb2f-e6e7639b04af tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:58.760733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0263e0b5-ebe1-4fbc-bb2f-e6e7639b04af tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:58.936374 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0263e0b5-ebe1-4fbc-bb2f-e6e7639b04af tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "PUT /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1079 microversion: 2.1 time: 0.200538 Oct 19 06:56:58.937418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 945/1878] 10.222.0.39 () {60 vars in 1256 bytes} [Wed Oct 19 06:56:58 2022] PUT /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1079 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:58.947911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:58.948580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] [instance: 05c7927e-9e6e-4edc-acb0-6fc27121aafd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:58.965743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:58.966871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:58.967374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:58.973130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:58.973950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:58.974593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] HTTP exception thrown: Instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd could not be found. Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Request method failure captured: Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd HTTP/1.1 Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57wAZ4In8re5DswpkFimD9e6_9w-So_fmsSNk-JKjT1BhbZ3J0YQJqBn93DZwfWmCqChPTybYZQhNPG0rlhijGUZs4eYw-amwrUtAcG_JDBvK_8Uea7QDIhkZ27q_yUP48Hbv6OEQhROggj-vwDNHwOUBJWtnvuJZEGJWLhplF81FY Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 012922c902b44fc1bb1975dfa27ff074 Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesAdminNegativeTest-539970662 Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/012922c902b44fc1bb1975dfa27ff074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/012922c902b44fc1bb1975dfa27ff074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/012922c902b44fc1bb1975dfa27ff074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_012922c902b44fc1bb1975dfa27ff074", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesAdminNegativeTest-539970662 Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 012922c902b44fc1bb1975dfa27ff074 Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-539970662 Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesAdminNegativeTest-539970662-project Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44e6b0b4228744ecab5536aa08d9495d Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesAdminNegativeTest-539970662-project Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd could not be found. Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '05c7927e-9e6e-4edc-acb0-6fc27121aafd'} Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd could not be found. Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:56:59.011079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd could not be found. Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd could not be found. Oct 19 06:56:59.017608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:56:59.020849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Returning 404 to user: Instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:56:59.022692 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de46ebe8-8658-4a8d-a97e-2f70b1d35ff8 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd" status: 404 len: 111 microversion: 2.1 time: 0.083845 Oct 19 06:56:59.023744 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 946/1879] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:58 2022] GET /compute/v2.1/servers/05c7927e-9e6e-4edc-acb0-6fc27121aafd => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:56:59.033823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9a06a5f5-86e8-44fd-b098-4e017830678c req-44ee29d7-5c0b-4619-8ece-325ffeff3e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c7927e-9e6e-4edc-acb0-6fc27121aafd", "name": "network-vif-deleted", "tag": "95a34e28-71ae-49ac-8e7a-3699806f8abd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:59.044799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9a06a5f5-86e8-44fd-b098-4e017830678c req-44ee29d7-5c0b-4619-8ece-325ffeff3e0c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.045634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9a06a5f5-86e8-44fd-b098-4e017830678c req-44ee29d7-5c0b-4619-8ece-325ffeff3e0c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.046246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9a06a5f5-86e8-44fd-b098-4e017830678c req-44ee29d7-5c0b-4619-8ece-325ffeff3e0c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.061898 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9a06a5f5-86e8-44fd-b098-4e017830678c req-44ee29d7-5c0b-4619-8ece-325ffeff3e0c service nova] Creating event network-vif-deleted:95a34e28-71ae-49ac-8e7a-3699806f8abd for instance 05c7927e-9e6e-4edc-acb0-6fc27121aafd on n-h1-861333-10 Oct 19 06:56:59.067744 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9a06a5f5-86e8-44fd-b098-4e017830678c req-44ee29d7-5c0b-4619-8ece-325ffeff3e0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042623 Oct 19 06:56:59.068589 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 947/1880] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:59.088617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:59.089749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:59.098652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.099431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.100028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.101280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.102296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.102913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.134518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:56:59.337814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:59.350352 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3758dc7-3d80-478e-bf8a-0b0534761232 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.279646 Oct 19 06:56:59.352374 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 948/1881] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:59 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:59.362175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-170cf96b-1ce1-4eba-b418-eea3a0392d60 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68b48dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:59.460313 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-170cf96b-1ce1-4eba-b418-eea3a0392d60 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.106189 Oct 19 06:56:59.465156 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 949/1882] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:56:59 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:59.477914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:59.479656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:59.492448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.493208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.493981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.495431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.496096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.496863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.601134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Updating instance_info_cache with network_info: [{"id": "685438d8-d237-4136-944c-d9aec20c706e", "address": "fa:16:3e:82:b4:eb", "network": {"id": "a75b7e29-d679-4927-b162-08de115eec1f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-458922686-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b08e9e6be87c411796dec57a649da36c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap685438d8-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 06:56:59.720888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Releasing lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:56:59.724643 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5b04898-1819-4c7b-8185-8c7c244d3a2a tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action" status: 202 len: 0 microversion: 2.1 time: 4.179191 Oct 19 06:56:59.725957 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 934/1883] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:56:55 2022] POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action => generated 0 bytes in 4183 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 06:56:59.730847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-76ab8f42-c8e7-40e2-a0ed-8e44ff7b7e97 req-4f473b64-8edc-44d9-a850-8440e4fb10ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f66da6-3501-4058-9a3d-7360d82a18ad", "tag": "685438d8-d237-4136-944c-d9aec20c706e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:56:59.762142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:56:59.763089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-76ab8f42-c8e7-40e2-a0ed-8e44ff7b7e97 req-4f473b64-8edc-44d9-a850-8440e4fb10ae service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.763516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-76ab8f42-c8e7-40e2-a0ed-8e44ff7b7e97 req-4f473b64-8edc-44d9-a850-8440e4fb10ae service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.772956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-76ab8f42-c8e7-40e2-a0ed-8e44ff7b7e97 req-4f473b64-8edc-44d9-a850-8440e4fb10ae service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.783030 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-689a8181-06c7-46b8-ab97-32266132f3da tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.312306 Oct 19 06:56:59.784764 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 950/1884] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:59 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:56:59.790473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:59.791184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:59.799684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.802310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.802310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.802310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.802310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.803094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.803640 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-76ab8f42-c8e7-40e2-a0ed-8e44ff7b7e97 req-4f473b64-8edc-44d9-a850-8440e4fb10ae service nova] Creating event network-changed:685438d8-d237-4136-944c-d9aec20c706e for instance c8f66da6-3501-4058-9a3d-7360d82a18ad on n-h2-861333-10 Oct 19 06:56:59.813941 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-76ab8f42-c8e7-40e2-a0ed-8e44ff7b7e97 req-4f473b64-8edc-44d9-a850-8440e4fb10ae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086647 Oct 19 06:56:59.821908 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 935/1885] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:56:59.836594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:56:59.837733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:56:59.851883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.854301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.855791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:56:59.857552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:56:59.859819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:56:59.861446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:00.171918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:00.194993 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97341cb6-114e-4fe6-9fb4-486034ef39e4 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1505 microversion: 2.1 time: 0.369116 Oct 19 06:57:00.212132 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 936/1886] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:56:59 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:00.212373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1443058d-48c1-4edc-9f79-577172f3a923 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] Calling method '.version_select at 0x7f6d68ad9820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:00.290617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:00.299483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:00.301057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:00.302434 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fea0d03c-f875-4ac8-88e9-d97edaad77a6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.516149 Oct 19 06:57:00.302867 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 951/1887] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:56:59 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:00.320029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26588603-01fb-41c3-af04-7803cc95cb41 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '.version_select at 0x7f6d642f4310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:00.785365 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1443058d-48c1-4edc-9f79-577172f3a923 tempest-VolumesAdminNegativeTest-539970662 tempest-VolumesAdminNegativeTest-539970662-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006411450" status: 202 len: 0 microversion: 2.1 time: 0.584171 Oct 19 06:57:00.786041 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 937/1888] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 06:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006411450 => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:57:00.791009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:00.791598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:00.810747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:00.811252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:00.811702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:00.812486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:00.812949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:00.813950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:00.970586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:00.985284 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69c7fc53-dccb-40f8-8a08-7f18bfc4b216 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1327 microversion: 2.1 time: 0.197973 Oct 19 06:57:01.027522 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 938/1889] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:00 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1327 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:01.036880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:01.044057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:01.053394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:01.054167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:01.054792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:01.055882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:01.056613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:01.057207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:01.481680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:01.493093 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b9f257c-2f07-4224-ad65-08afe6f3c666 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1505 microversion: 2.1 time: 0.464125 Oct 19 06:57:01.497868 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 939/1890] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:01 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:01.518669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:01.522122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:01.538698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:01.539659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:01.540340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:01.543606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:01.544320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:01.555946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:01.845571 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26588603-01fb-41c3-af04-7803cc95cb41 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/da449146-d636-43f2-98bf-7c04f83d5e03" status: 202 len: 0 microversion: 2.1 time: 1.541629 Oct 19 06:57:01.846717 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 952/1891] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:57:00 2022] DELETE /compute/v2.1/os-floating-ips/da449146-d636-43f2-98bf-7c04f83d5e03 => generated 0 bytes in 1543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:57:01.859480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fed029d1-29fc-400a-869e-cf06525e2a00 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68bb41f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:01.877737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:01.893297 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ea055af-19cd-4f17-a378-0a23e12e29ba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.393317 Oct 19 06:57:01.893880 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 940/1892] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:01 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:01.908307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:01.908307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:01.915073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:01.919358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:01.919358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:01.919358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:01.919358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:01.919358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:01.971363 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fed029d1-29fc-400a-869e-cf06525e2a00 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1438 microversion: 2.1 time: 0.123191 Oct 19 06:57:01.980247 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 953/1893] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:01 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:01.985689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:01.988168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:02.001823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.004786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.005706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.006716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.007448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.008982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.151803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:02.162213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:02.163710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:02.165385 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03d6635a-cd20-4748-9620-6a20835f6f2a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.191657 Oct 19 06:57:02.166118 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 954/1894] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:01 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:02.191766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6efeb0d4-1ad7-4182-9198-f31e475fb5ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:02.196992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6efeb0d4-1ad7-4182-9198-f31e475fb5ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:02.211153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6efeb0d4-1ad7-4182-9198-f31e475fb5ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.211943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6efeb0d4-1ad7-4182-9198-f31e475fb5ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.212612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6efeb0d4-1ad7-4182-9198-f31e475fb5ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.213515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6efeb0d4-1ad7-4182-9198-f31e475fb5ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.214727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6efeb0d4-1ad7-4182-9198-f31e475fb5ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.215326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6efeb0d4-1ad7-4182-9198-f31e475fb5ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.275797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:02.285932 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4c772ed-a84a-47b7-947d-036801f7588b tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.385921 Oct 19 06:57:02.286934 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 941/1895] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:01 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:02.291825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8a732438-2ea1-49a4-9ceb-ac3aea92c4b5 req-e96a8565-fba0-497f-ac9e-648d910ea471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9", "name": "network-vif-deleted", "tag": "351b1d84-abf0-486b-a0c3-f11e51a4d4ef"}, {"server_uuid": "cb5efd0f-0b7c-4af7-9cf3-680a046bc396", "name": "network-vif-unplugged", "status": "completed", "tag": "3d2e51f5-b99e-4084-9485-e38140e78566"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:02.303502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8a732438-2ea1-49a4-9ceb-ac3aea92c4b5 req-e96a8565-fba0-497f-ac9e-648d910ea471 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.303991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8a732438-2ea1-49a4-9ceb-ac3aea92c4b5 req-e96a8565-fba0-497f-ac9e-648d910ea471 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.304463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8a732438-2ea1-49a4-9ceb-ac3aea92c4b5 req-e96a8565-fba0-497f-ac9e-648d910ea471 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.317948 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8a732438-2ea1-49a4-9ceb-ac3aea92c4b5 req-e96a8565-fba0-497f-ac9e-648d910ea471 service nova] Creating event network-vif-deleted:351b1d84-abf0-486b-a0c3-f11e51a4d4ef for instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 on n-h1-861333-10 Oct 19 06:57:02.318463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8a732438-2ea1-49a4-9ceb-ac3aea92c4b5 req-e96a8565-fba0-497f-ac9e-648d910ea471 service nova] Creating event network-vif-unplugged:3d2e51f5-b99e-4084-9485-e38140e78566 for instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 on n-h2-861333-10 Oct 19 06:57:02.326396 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8a732438-2ea1-49a4-9ceb-ac3aea92c4b5 req-e96a8565-fba0-497f-ac9e-648d910ea471 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038157 Oct 19 06:57:02.326986 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 942/1896] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:02.334041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a462bf2b-157b-48aa-921c-73ca7347112d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a462bf2b-157b-48aa-921c-73ca7347112d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Request method failure captured: Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action HTTP/1.1 Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 34 Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT5-RuhmjpN3u_ZzhEBzLdt2Gs48J8jOPJaStBy4OFxyl7Udc8oAFy09a0hn-aSuLtXfKK__JLsrqKvpnr17xfbGl9OvR_t311si8TdOVfDdPzMLFnBLnNIZe6ZWCPZaz3Mpv8NUe5-EKjed4M1-ofI6xOEcWMIiFtAEFzKwrTurE8Rk Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b08e9e6be87c411796dec57a649da36c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 08c23581eda747cda3e4d3696703edf4 Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: {"addFloatingIp": {"address": ""}} Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c8f66da6-3501-4058-9a3d-7360d82a18ad', 'body': {'addFloatingIp': {'address': ''}}} Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '' Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:57:02.336349 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a462bf2b-157b-48aa-921c-73ca7347112d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a462bf2b-157b-48aa-921c-73ca7347112d tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action" status: 400 len: 142 microversion: 2.1 time: 0.009740 Oct 19 06:57:02.341490 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 943/1897] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:57:02 2022] POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action => generated 142 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:57:02.343058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:02.343751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:02.350664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.351154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.351597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.352337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.356833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.356833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.388698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.389341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.389793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.390246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lazy-loading 'fault' on Instance uuid 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:57:02.434810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372b893598646b1b7dc0fc37650ebff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178cc497ec0483e9fa05a6b1fe83da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:02.442790 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9649c9d9-8ae2-4fa5-8178-7f36ff11025e tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 200 len: 1332 microversion: 2.1 time: 0.103174 Oct 19 06:57:02.443416 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 944/1898] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:02 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:02.448066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:02.450520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:02.456973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.457466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.457901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.458602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.459132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.459570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.469215 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6efeb0d4-1ad7-4182-9198-f31e475fb5ce tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "PUT /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1081 microversion: 2.1 time: 0.299340 Oct 19 06:57:02.469215 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 955/1899] 10.222.0.39 () {60 vars in 1256 bytes} [Wed Oct 19 06:57:02 2022] PUT /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1081 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:02.486993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:02.487683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:02.487983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 06:57:02.489175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquired lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 06:57:02.501531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.501531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.501772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.502375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.503050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.503664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.651960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Releasing lock "refresh_cache-c8f66da6-3501-4058-9a3d-7360d82a18ad" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 06:57:02.652618 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] HTTP exception thrown: floating IP not found Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Request method failure captured: Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action HTTP/1.1 Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 41 Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT5-RuhmjpN3u_ZzhEBzLdt2Gs48J8jOPJaStBy4OFxyl7Udc8oAFy09a0hn-aSuLtXfKK__JLsrqKvpnr17xfbGl9OvR_t311si8TdOVfDdPzMLFnBLnNIZe6ZWCPZaz3Mpv8NUe5-EKjed4M1-ofI6xOEcWMIiFtAEFzKwrTurE8Rk Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b08e9e6be87c411796dec57a649da36c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 08c23581eda747cda3e4d3696703edf4 Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: exception: floating IP not found Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c8f66da6-3501-4058-9a3d-7360d82a18ad', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 19 06:57:02.654368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Returning 404 to user: floating IP not found {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b73a54b-8e40-48b8-a132-59022b812837 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action" status: 404 len: 67 microversion: 2.1 time: 0.211515 Oct 19 06:57:02.659368 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 945/1900] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:57:02 2022] POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action => generated 67 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:57:02.667004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5290511-60d9-454a-b5ee-10b6dfb2269c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:02.673461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:02.714323 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b5290511-60d9-454a-b5ee-10b6dfb2269c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5290511-60d9-454a-b5ee-10b6dfb2269c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Request method failure captured: Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action HTTP/1.1 Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 44 Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT5-RuhmjpN3u_ZzhEBzLdt2Gs48J8jOPJaStBy4OFxyl7Udc8oAFy09a0hn-aSuLtXfKK__JLsrqKvpnr17xfbGl9OvR_t311si8TdOVfDdPzMLFnBLnNIZe6ZWCPZaz3Mpv8NUe5-EKjed4M1-ofI6xOEcWMIiFtAEFzKwrTurE8Rk Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b08e9e6be87c411796dec57a649da36c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 08c23581eda747cda3e4d3696703edf4 Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: exception: Floating IP not found for address 0.0.0.0. Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c8f66da6-3501-4058-9a3d-7360d82a18ad', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 19 06:57:02.716000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5290511-60d9-454a-b5ee-10b6dfb2269c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5290511-60d9-454a-b5ee-10b6dfb2269c tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action" status: 404 len: 88 microversion: 2.1 time: 0.054755 Oct 19 06:57:02.722092 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 946/1901] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:57:02 2022] POST /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad/action => generated 88 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 06:57:02.730587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:02.731093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:02.739223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.739946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.740805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.741191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.742099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.742701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.771443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:57:02.909651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:02.940354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:02.949936 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6582d3c-118a-49f9-b5d3-174618647f04 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1507 microversion: 2.1 time: 0.466716 Oct 19 06:57:02.950529 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 956/1902] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:02 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:02.973364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:02.974230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:02.980970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.986413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.986413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:02.986413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:02.986413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:02.986413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.084346 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb3191ed-5e22-413e-a10d-9343731e1051 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 204 len: 0 microversion: 2.1 time: 0.358182 Oct 19 06:57:03.085244 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 947/1903] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:02 2022] DELETE /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:57:03.092706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:03.093410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:03.099627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.100139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.100580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.101544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.102057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.102480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.235719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:03.247522 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48817edb-ab14-4a35-b91e-88539be8c03d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.286066 Oct 19 06:57:03.250544 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 957/1904] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:02 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:03.264229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-443e33b1-9b9e-41b0-b5f2-3f25230236eb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68b8e820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:03.313788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:03.320995 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-443e33b1-9b9e-41b0-b5f2-3f25230236eb tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1447 microversion: 2.1 time: 0.067620 Oct 19 06:57:03.322309 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 958/1905] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:03 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1447 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:03.323078 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-880c5026-c199-4425-841e-e1f5a8f830f1 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1507 microversion: 2.1 time: 0.236338 Oct 19 06:57:03.325453 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 948/1906] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:03 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:03.329424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:03.330344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:03.331898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:03.332661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:03.341155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.342045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.342598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.343605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.344268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.344972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.351890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.352703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.353308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.354232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.354862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.356898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.525172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:03.538245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:03.540671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:03.542427 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1403786-1ef3-4f96-8313-f7c3c5b66b2c tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.215839 Oct 19 06:57:03.544169 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 949/1907] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:03 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:03.550220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:03.552768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:03.563130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.564319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.565342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.566094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.566572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.567032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.671379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:03.681652 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4ddbee3-ef24-4eec-be5e-0cc34ff1e506 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1540 microversion: 2.1 time: 0.357294 Oct 19 06:57:03.684125 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 959/1908] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:03 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1540 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:03.687525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93c75f68-dc64-49b9-aaf4-59ce62ddd9f6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68ba9310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:03.726242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:03.734876 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4850d21c-4175-489e-8dc7-c706052fa124 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.189330 Oct 19 06:57:03.739098 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93c75f68-dc64-49b9-aaf4-59ce62ddd9f6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 200 len: 1447 microversion: 2.1 time: 0.055428 Oct 19 06:57:03.739670 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 960/1909] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:03 2022] GET /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 1447 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:03.751840 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 950/1910] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:03 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:03.754489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:03.755321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:03.759420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:03.761763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:03.763096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.763724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.764379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.765283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.765818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.766267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.769949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.772246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.772808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.774279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:03.774279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:03.774714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:03.793553 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] HTTP exception thrown: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:03.801217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Request method failure captured: Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 HTTP/1.1 Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT58LRQnTx3tbAFnGV-3QCsGrx7S01exngJr3YT7cXj1Uq0cpGRrI-ecXJZR_jpEyHyfZKr6xoip8xo2uXRyIwcBDRc-Zdxz2ye0WHsXIwi-w34G3804zPWxpQWNkJwlTHYvdpdGMZPAuSD06znvFfrVOmLgnitkd38tC_PPRdaw-w8s Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 6178cc497ec0483e9fa05a6b1fe83da2 Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-262925740 Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6178cc497ec0483e9fa05a6b1fe83da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6178cc497ec0483e9fa05a6b1fe83da2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6178cc497ec0483e9fa05a6b1fe83da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6178cc497ec0483e9fa05a6b1fe83da2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-262925740 Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 6178cc497ec0483e9fa05a6b1fe83da2 Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-262925740 Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachSCSIVolumeTestJSON-262925740-project Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f372b893598646b1b7dc0fc37650ebff Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-262925740-project Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9'} Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:03.801424 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Returning 404 to user: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33c502f8-6608-4ff9-8dbc-9e108671f343 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 404 len: 111 microversion: 2.1 time: 0.043736 Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 951/1911] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:03 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:03.809430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77f61c95-3318-4268-827a-a71fb6a10883 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68adcaf0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:04.243267 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4dcde5c9-04c5-40db-aecc-44a9ea9e2431 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 204 len: 0 microversion: 2.1 time: 0.496533 Oct 19 06:57:04.243267 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 961/1912] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:03 2022] DELETE /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:57:04.243796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9e2a6e3-ee9a-4813-ab37-8cbbcdf0b5db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '.version_select at 0x7f6d68ba9550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:04.379986 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9e2a6e3-ee9a-4813-ab37-8cbbcdf0b5db tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326300680" status: 202 len: 0 microversion: 2.1 time: 0.140451 Oct 19 06:57:04.380864 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 962/1913] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 06:57:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326300680 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:57:04.387632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:04.388655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:04.398240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:04.399141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:04.407514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:04.407514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:04.407514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:04.407514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:04.442110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:57:04.629261 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.compute.api [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Instance is already in deleting state, ignoring this request Oct 19 06:57:04.630328 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a18239f-3498-465a-97ea-418fad671d8a tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 204 len: 0 microversion: 2.1 time: 0.248252 Oct 19 06:57:04.630985 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 963/1914] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:04 2022] DELETE /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:57:04.635930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:04.637045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:04.643660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:04.644263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:04.644783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:04.645563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:04.646183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:04.646637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.064449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:05.076476 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58580d1c-d5df-4cec-a45b-5c0c45f300e9 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.444077 Oct 19 06:57:05.079379 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 964/1915] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:04 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:05.096508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-61ac398b-032f-4339-a3a1-de9b992a127c req-39405811-6e08-4acf-bcf1-0a7b62549928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5efd0f-0b7c-4af7-9cf3-680a046bc396", "tag": "3d2e51f5-b99e-4084-9485-e38140e78566"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:05.109261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-61ac398b-032f-4339-a3a1-de9b992a127c req-39405811-6e08-4acf-bcf1-0a7b62549928 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.110920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-61ac398b-032f-4339-a3a1-de9b992a127c req-39405811-6e08-4acf-bcf1-0a7b62549928 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.111459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-61ac398b-032f-4339-a3a1-de9b992a127c req-39405811-6e08-4acf-bcf1-0a7b62549928 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.130995 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-61ac398b-032f-4339-a3a1-de9b992a127c req-39405811-6e08-4acf-bcf1-0a7b62549928 service nova] Creating event network-changed:3d2e51f5-b99e-4084-9485-e38140e78566 for instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 on n-h2-861333-10 Oct 19 06:57:05.146601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-61ac398b-032f-4339-a3a1-de9b992a127c req-39405811-6e08-4acf-bcf1-0a7b62549928 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065608 Oct 19 06:57:05.147308 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 965/1916] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:05.159305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:05.159850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:05.166514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.167020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.167448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.168862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.173737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.174476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.182555 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77f61c95-3318-4268-827a-a71fb6a10883 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 204 len: 0 microversion: 2.1 time: 1.383670 Oct 19 06:57:05.183843 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 952/1917] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:03 2022] DELETE /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 0 bytes in 1386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:57:05.189781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:05.191706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:05.210265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.211130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.211750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.212998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.213798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.214416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.524575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:05.538587 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-117a3c5e-575d-417b-9c81-b250311d74fe tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1513 microversion: 2.1 time: 0.353265 Oct 19 06:57:05.539849 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 953/1918] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:05 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1513 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:05.558486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:05.559368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:05.572990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.573893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.575738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.576997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.577664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.578290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.765718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:05.790019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:05.792761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:05.793997 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48b75bb9-f705-4a92-9708-3a8970e7ce67 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.643808 Oct 19 06:57:05.794787 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 966/1919] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:05 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:05.803483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:05.804600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:05.812590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.813963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.815387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.816215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.817019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.817673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.936005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:05.945635 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1ceb717-a43b-483b-a71c-dff8a62121c6 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1540 microversion: 2.1 time: 0.403146 Oct 19 06:57:05.946528 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 954/1920] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:05 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1540 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:05.951738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:05.953480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:05.963183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.964204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.967742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.967742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:05.967742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:05.967742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:05.996540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:57:06.156153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:06.253002 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-131bbfeb-f01f-45c7-b373-fbbd98c97869 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 204 len: 0 microversion: 2.1 time: 0.304912 Oct 19 06:57:06.253895 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 955/1921] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:05 2022] DELETE /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:57:06.258987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:06.259937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:06.281249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:06.282110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:06.282867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:06.283762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:06.284406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:06.289321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:06.481206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:06.490058 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d4014b5-9929-418f-9622-387a8b0f3cce tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.694017 Oct 19 06:57:06.490794 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 967/1922] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:05 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:06.501446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-179593958", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:06.577929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] validate_networks() for [('e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:57:06.677844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:06.686178 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd1f814e-abe4-4178-a2f7-c458a711d4d2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.431055 Oct 19 06:57:06.686831 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 956/1923] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:06 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:06.691735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:06.692704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:06.699018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:06.699596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:06.700167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:06.700905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:06.701425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:06.702101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:06.958969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:06.983463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b36841e-8bf6-40b0-9bdb-5e841dfc28b6 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1513 microversion: 2.1 time: 0.294228 Oct 19 06:57:06.985116 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 957/1924] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:06 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:06.994781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:06.997080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:07.008547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.009810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.011100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.012753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.013970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.015103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.331579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:07.343027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:07.345752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:07.350223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-461fca05-11d4-42a2-bfb5-db225ad4510a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.360280 Oct 19 06:57:07.350223 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 958/1925] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:06 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:07.360599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:07.361662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:07.369929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.370514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.370959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.371727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.372230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.372661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.458576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:07.467675 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d62e44b-2b0d-490b-9469-a016961c1c86 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1498 microversion: 2.1 time: 0.119060 Oct 19 06:57:07.468686 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 959/1926] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:07 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1498 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:07.474645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c42b64a5-59da-45c6-9637-624581e297ef req-0e22c606-dce7-4cbd-8ea9-4523fd51e70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1380e3-bb02-4aff-af35-4f131e5ba49d", "name": "network-vif-deleted", "tag": "fdb44651-a8ef-4afb-aeff-358617020463"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:07.502100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c42b64a5-59da-45c6-9637-624581e297ef req-0e22c606-dce7-4cbd-8ea9-4523fd51e70c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.502866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c42b64a5-59da-45c6-9637-624581e297ef req-0e22c606-dce7-4cbd-8ea9-4523fd51e70c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.503313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c42b64a5-59da-45c6-9637-624581e297ef req-0e22c606-dce7-4cbd-8ea9-4523fd51e70c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.517532 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c42b64a5-59da-45c6-9637-624581e297ef req-0e22c606-dce7-4cbd-8ea9-4523fd51e70c service nova] Creating event network-vif-deleted:fdb44651-a8ef-4afb-aeff-358617020463 for instance 4e1380e3-bb02-4aff-af35-4f131e5ba49d on n-h1-861333-10 Oct 19 06:57:07.523233 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c42b64a5-59da-45c6-9637-624581e297ef req-0e22c606-dce7-4cbd-8ea9-4523fd51e70c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053095 Oct 19 06:57:07.527069 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 960/1927] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:07.532932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-cad95cb9-39ad-45ae-a31b-81c47c26997c req-9d7e4b48-b641-46e4-bcaa-4a8310b49635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f66da6-3501-4058-9a3d-7360d82a18ad", "name": "network-vif-deleted", "tag": "685438d8-d237-4136-944c-d9aec20c706e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:07.559917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cad95cb9-39ad-45ae-a31b-81c47c26997c req-9d7e4b48-b641-46e4-bcaa-4a8310b49635 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.560585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cad95cb9-39ad-45ae-a31b-81c47c26997c req-9d7e4b48-b641-46e4-bcaa-4a8310b49635 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.561148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cad95cb9-39ad-45ae-a31b-81c47c26997c req-9d7e4b48-b641-46e4-bcaa-4a8310b49635 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.579176 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-cad95cb9-39ad-45ae-a31b-81c47c26997c req-9d7e4b48-b641-46e4-bcaa-4a8310b49635 service nova] Creating event network-vif-deleted:685438d8-d237-4136-944c-d9aec20c706e for instance c8f66da6-3501-4058-9a3d-7360d82a18ad on n-h2-861333-10 Oct 19 06:57:07.585491 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-cad95cb9-39ad-45ae-a31b-81c47c26997c req-9d7e4b48-b641-46e4-bcaa-4a8310b49635 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056619 Oct 19 06:57:07.586373 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 961/1928] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:07.591776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:07.592726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:07.606272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.607579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.608414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.609402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.610815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.611479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.706100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:57:07.713340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:57:07.713340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:57:07.713340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:57:07.713340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:57:07.725383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.727859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.728989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.732772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.740670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.740670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.750987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:07.769461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:57:07.776805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for user f5b2575fb29940ab95fc8bb9dd177dd9 and project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:57:07.792317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:57:07.795474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:57:07.833774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:07.845246 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74e2294e-d73e-4b25-a20e-742f988a7b7f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.257041 Oct 19 06:57:07.845922 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 962/1929] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:07 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:07.850644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f47fe4f2-e0ad-489b-aff8-b2be0f9fc4cd req-f32802dd-2cb4-4fa1-9abb-b4215be62360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9ce9b7-76c3-46e8-8de2-b50c0e126dce", "name": "network-vif-unplugged", "status": "completed", "tag": "95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:07.860651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f47fe4f2-e0ad-489b-aff8-b2be0f9fc4cd req-f32802dd-2cb4-4fa1-9abb-b4215be62360 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.861486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f47fe4f2-e0ad-489b-aff8-b2be0f9fc4cd req-f32802dd-2cb4-4fa1-9abb-b4215be62360 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.862186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f47fe4f2-e0ad-489b-aff8-b2be0f9fc4cd req-f32802dd-2cb4-4fa1-9abb-b4215be62360 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.875974 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f47fe4f2-e0ad-489b-aff8-b2be0f9fc4cd req-f32802dd-2cb4-4fa1-9abb-b4215be62360 service nova] Creating event network-vif-unplugged:95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a for instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce on n-h1-861333-10 Oct 19 06:57:07.883128 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f47fe4f2-e0ad-489b-aff8-b2be0f9fc4cd req-f32802dd-2cb4-4fa1-9abb-b4215be62360 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035562 Oct 19 06:57:07.884810 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 963/1930] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:07.892248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:07.894113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:07.903399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.904223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.904893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:07.905961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:07.906608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:07.907865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:08.041761 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2752db3-445d-44f4-9e21-475fbe7fad28 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547349 Oct 19 06:57:08.044616 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 968/1931] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:57:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:57:08.088348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:08.088975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:08.113523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:08.114061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:08.114549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:08.115629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:08.116146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:08.116555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:08.157552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:08.185414 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d63f6d8-dbb0-428c-ae47-080e60beb999 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.299074 Oct 19 06:57:08.186435 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 964/1932] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:07 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:08.196978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b3de23f-1696-49b1-90e0-2d4ccf4384c1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:08.200272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b3de23f-1696-49b1-90e0-2d4ccf4384c1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:08.362857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b3de23f-1696-49b1-90e0-2d4ccf4384c1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:08.374158 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b3de23f-1696-49b1-90e0-2d4ccf4384c1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1207 microversion: 2.1 time: 0.184629 Oct 19 06:57:08.375290 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 965/1933] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:08 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1207 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:08.388685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:08.389412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:08.403925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:08.406655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:08.407737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:08.408523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:08.409006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:08.409448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:08.419604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:08.436643 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38135f1a-8048-47b1-8df9-e7ecb48ab7fd tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1302 microversion: 2.1 time: 0.386252 Oct 19 06:57:08.439141 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 969/1934] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:08 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1302 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:08.494083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:08.501832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:08.513182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:08.513674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:08.514110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:08.514825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:08.515237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:08.525979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:08.613281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:08.613858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:08.614307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:08.614773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lazy-loading 'fault' on Instance uuid c8f66da6-3501-4058-9a3d-7360d82a18ad {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:57:08.710064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c23581eda747cda3e4d3696703edf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e9e6be87c411796dec57a649da36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:08.725604 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54c78507-d632-4580-8f71-3eafd71b5793 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 200 len: 1321 microversion: 2.1 time: 0.234181 Oct 19 06:57:08.727518 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 970/1935] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:08 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:08.875585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:08.881263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:08.896002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:08.896938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:08.898400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:08.900771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:08.901550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:08.902185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:09.176434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:09.191161 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c896066-c29e-4a72-842a-9b79df48f03f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.323913 Oct 19 06:57:09.210101 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 971/1936] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:08 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:09.238838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:09.239457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:09.256022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:09.258747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:09.265251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:09.265251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:09.265251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:09.265251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:09.321891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:09.335656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:09.337233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:09.338437 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01466d8c-f93a-4c65-82e3-2efc7cf1383e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.961417 Oct 19 06:57:09.348198 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 966/1937] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:08 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:09.400136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3fb45f83-753c-4ae4-8ad3-a12ff2ec1948 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:09.401650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3fb45f83-753c-4ae4-8ad3-a12ff2ec1948 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:09.528817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:09.549198 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-003cd8f9-533f-4f41-9b00-ffd8fe81d99e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.337684 Oct 19 06:57:09.550588 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 972/1938] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:09 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:09.556200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:09.557121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:09.573764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3fb45f83-753c-4ae4-8ad3-a12ff2ec1948 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:09.583538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:09.584041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:09.585849 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3fb45f83-753c-4ae4-8ad3-a12ff2ec1948 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1207 microversion: 2.1 time: 0.189741 Oct 19 06:57:09.586700 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 967/1939] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:09 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1207 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:09.587426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:09.588436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:09.589052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:09.589623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:09.644141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:09.645069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:09.645902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:09.646882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lazy-loading 'fault' on Instance uuid 4e1380e3-bb02-4aff-af35-4f131e5ba49d {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:57:09.699702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee94c5c732c4e579ec3e85f3018641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ded99a8f4204d6985060451b881d84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:09.709406 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81833259-2a07-4df0-914f-aa070ce6ad4c tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 200 len: 1307 microversion: 2.1 time: 0.157127 Oct 19 06:57:09.710216 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 973/1940] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:09 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:09.752839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:09.753720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] [instance: c8f66da6-3501-4058-9a3d-7360d82a18ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:09.763407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:09.764507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:09.766024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:09.767499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:09.767989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:09.768486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:09.786238 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] HTTP exception thrown: Instance c8f66da6-3501-4058-9a3d-7360d82a18ad could not be found. Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Request method failure captured: Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad HTTP/1.1 Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT5-RuhmjpN3u_ZzhEBzLdt2Gs48J8jOPJaStBy4OFxyl7Udc8oAFy09a0hn-aSuLtXfKK__JLsrqKvpnr17xfbGl9OvR_t311si8TdOVfDdPzMLFnBLnNIZe6ZWCPZaz3Mpv8NUe5-EKjed4M1-ofI6xOEcWMIiFtAEFzKwrTurE8Rk Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b08e9e6be87c411796dec57a649da36c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b08e9e6be87c411796dec57a649da36c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b08e9e6be87c411796dec57a649da36c Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 08c23581eda747cda3e4d3696703edf4 Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance c8f66da6-3501-4058-9a3d-7360d82a18ad could not be found. Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c8f66da6-3501-4058-9a3d-7360d82a18ad'} Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f66da6-3501-4058-9a3d-7360d82a18ad could not be found. Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f66da6-3501-4058-9a3d-7360d82a18ad could not be found. Oct 19 06:57:09.787977 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f66da6-3501-4058-9a3d-7360d82a18ad could not be found. Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] Returning 404 to user: Instance c8f66da6-3501-4058-9a3d-7360d82a18ad could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:09.793642 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5fef4bc-83cd-4316-bb1c-76bcb751a359 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327 tempest-FloatingIPsAssociationNegativeTestJSON-1792262327-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad" status: 404 len: 111 microversion: 2.1 time: 0.041497 Oct 19 06:57:09.796257 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 968/1941] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:09 2022] GET /compute/v2.1/servers/c8f66da6-3501-4058-9a3d-7360d82a18ad => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:10.172351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ba07a3d9-18ab-4c1e-8910-5614a64620bc req-e19be304-6fd1-455b-a9a2-609d6e83a14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9ce9b7-76c3-46e8-8de2-b50c0e126dce", "name": "network-vif-deleted", "tag": "95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:10.205782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ba07a3d9-18ab-4c1e-8910-5614a64620bc req-e19be304-6fd1-455b-a9a2-609d6e83a14e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.208254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ba07a3d9-18ab-4c1e-8910-5614a64620bc req-e19be304-6fd1-455b-a9a2-609d6e83a14e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.216316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ba07a3d9-18ab-4c1e-8910-5614a64620bc req-e19be304-6fd1-455b-a9a2-609d6e83a14e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.216509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:10.216950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:10.226763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.227274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.227711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.228453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.238867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.239549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.242943 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ba07a3d9-18ab-4c1e-8910-5614a64620bc req-e19be304-6fd1-455b-a9a2-609d6e83a14e service nova] Creating event network-vif-deleted:95c5c3d2-7f94-429a-8b5c-73d3ab1e5e9a for instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce on n-h1-861333-10 Oct 19 06:57:10.268261 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ba07a3d9-18ab-4c1e-8910-5614a64620bc req-e19be304-6fd1-455b-a9a2-609d6e83a14e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096989 Oct 19 06:57:10.269839 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 974/1942] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:10.299844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:10.365138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:10.365932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:10.375248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.383847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.385628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.388531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.389278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.389974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.593145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:10.604301 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbdba370-24c4-45b1-a1b4-7e06acadf306 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.388705 Oct 19 06:57:10.619324 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 969/1943] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:10 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:10.628793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:10.629755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:10.636420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.639541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.639541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.639541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.639541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.639541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.647271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:10.660021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:10.663387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:10.669262 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab131f5a-e1f5-4704-a3cb-c877087e4283 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.309480 Oct 19 06:57:10.669843 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 975/1944] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:10 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:10.684033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:10.684978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:10.695905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.696433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.697250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.698162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.698812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.699474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.820641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:10.845743 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fab7b83d-5325-46b1-8f22-9e7889b62e99 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1259 microversion: 2.1 time: 0.161023 Oct 19 06:57:10.845743 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 976/1945] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:10 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:10.845743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:10.845743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 4e1380e3-bb02-4aff-af35-4f131e5ba49d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:10.855341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.855844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.856473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.857193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.857652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.858094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.890585 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] HTTP exception thrown: Instance 4e1380e3-bb02-4aff-af35-4f131e5ba49d could not be found. Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Request method failure captured: Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d HTTP/1.1 Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT58kb7L3rKsSdnThYgcAtcXWbPdTdaVc8aU9Z_Gfyhj2k-v8vt8oE0cMLQ0bvdROZDXJmO8JxGjNyV_H6INTA6bre0HlpBKACTyr_3_1TpsHnLsA8TIabEKtI9kdNpSR5BSvRYQPRKZbmzoJsJwnSrrHIxijWNaiOjNyg6BLOCtMbk0 Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ded99a8f4204d6985060451b881d84f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 4ee94c5c732c4e579ec3e85f3018641b Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 4e1380e3-bb02-4aff-af35-4f131e5ba49d could not be found. Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4e1380e3-bb02-4aff-af35-4f131e5ba49d'} Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1380e3-bb02-4aff-af35-4f131e5ba49d could not be found. Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1380e3-bb02-4aff-af35-4f131e5ba49d could not be found. Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:10.892904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.899381 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:10.899381 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:10.899381 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:10.899381 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:10.899381 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:10.899381 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1380e3-bb02-4aff-af35-4f131e5ba49d could not be found. Oct 19 06:57:10.899381 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.902675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Returning 404 to user: Instance 4e1380e3-bb02-4aff-af35-4f131e5ba49d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:10.902675 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aad75654-2c2b-45f8-9b64-833b86984038 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d" status: 404 len: 111 microversion: 2.1 time: 0.068359 Oct 19 06:57:10.905834 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 977/1946] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:10 2022] GET /compute/v2.1/servers/4e1380e3-bb02-4aff-af35-4f131e5ba49d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:10.911731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:10.922767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:10.937120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.937120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.937120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.937120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:10.937120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:10.939654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:10.963888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:10.973902 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8666a068-7833-4ef7-b1a6-c50fa4e1dac7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.352940 Oct 19 06:57:10.976301 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] HTTP exception thrown: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Request method failure captured: Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b HTTP/1.1 Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT58kb7L3rKsSdnThYgcAtcXWbPdTdaVc8aU9Z_Gfyhj2k-v8vt8oE0cMLQ0bvdROZDXJmO8JxGjNyV_H6INTA6bre0HlpBKACTyr_3_1TpsHnLsA8TIabEKtI9kdNpSR5BSvRYQPRKZbmzoJsJwnSrrHIxijWNaiOjNyg6BLOCtMbk0 Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ded99a8f4204d6985060451b881d84f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 4ee94c5c732c4e579ec3e85f3018641b Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '6dd0b472-47fb-4849-bf9f-5256db4fdd3b'} Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:10.980217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:10.985201 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:10.986042 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 970/1947] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:10 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:10.987044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Returning 404 to user: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:10.988075 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a8f4f6e-b6e2-41a1-a904-4d8453202faf tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 404 len: 111 microversion: 2.1 time: 0.081181 Oct 19 06:57:10.996858 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 978/1948] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:10 2022] DELETE /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:11.006222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:11.006222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: 6dd0b472-47fb-4849-bf9f-5256db4fdd3b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:11.012847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.013634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.014300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:11.015251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.016218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.017425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:11.038789 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] HTTP exception thrown: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Request method failure captured: Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b HTTP/1.1 Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT58kb7L3rKsSdnThYgcAtcXWbPdTdaVc8aU9Z_Gfyhj2k-v8vt8oE0cMLQ0bvdROZDXJmO8JxGjNyV_H6INTA6bre0HlpBKACTyr_3_1TpsHnLsA8TIabEKtI9kdNpSR5BSvRYQPRKZbmzoJsJwnSrrHIxijWNaiOjNyg6BLOCtMbk0 Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ded99a8f4204d6985060451b881d84f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 4ee94c5c732c4e579ec3e85f3018641b Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '6dd0b472-47fb-4849-bf9f-5256db4fdd3b'} Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:11.040888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.046319 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:11.046319 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:11.046319 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:11.046319 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:11.046319 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:11.046319 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. Oct 19 06:57:11.046319 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.046319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Returning 404 to user: Instance 6dd0b472-47fb-4849-bf9f-5256db4fdd3b could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:11.049158 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9acc2c7-ca6b-4108-8dbc-7923c896aba0 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b" status: 404 len: 111 microversion: 2.1 time: 0.050947 Oct 19 06:57:11.049158 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 971/1949] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:10 2022] GET /compute/v2.1/servers/6dd0b472-47fb-4849-bf9f-5256db4fdd3b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:57:11.056708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:11.057209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:11.073239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.074016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.074471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:11.075351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.075672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.079350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] HTTP exception thrown: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Request method failure captured: Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c HTTP/1.1 Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT58kb7L3rKsSdnThYgcAtcXWbPdTdaVc8aU9Z_Gfyhj2k-v8vt8oE0cMLQ0bvdROZDXJmO8JxGjNyV_H6INTA6bre0HlpBKACTyr_3_1TpsHnLsA8TIabEKtI9kdNpSR5BSvRYQPRKZbmzoJsJwnSrrHIxijWNaiOjNyg6BLOCtMbk0 Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ded99a8f4204d6985060451b881d84f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 4ee94c5c732c4e579ec3e85f3018641b Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'd0c3cd43-d83f-49b8-9ac8-8ff3fd81148c'} Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:57:11.104953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Returning 404 to user: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f28a4077-b3d6-4dc2-9045-dfe0d7c4c229 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 404 len: 111 microversion: 2.1 time: 0.046955 Oct 19 06:57:11.110086 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 979/1950] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:11 2022] DELETE /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:11.113246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:11.114023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] [instance: d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:11.122064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.122988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.123506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:11.124330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.124919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.125418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:11.144455 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] HTTP exception thrown: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Request method failure captured: Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c HTTP/1.1 Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT58kb7L3rKsSdnThYgcAtcXWbPdTdaVc8aU9Z_Gfyhj2k-v8vt8oE0cMLQ0bvdROZDXJmO8JxGjNyV_H6INTA6bre0HlpBKACTyr_3_1TpsHnLsA8TIabEKtI9kdNpSR5BSvRYQPRKZbmzoJsJwnSrrHIxijWNaiOjNyg6BLOCtMbk0 Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ded99a8f4204d6985060451b881d84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ded99a8f4204d6985060451b881d84f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 9ded99a8f4204d6985060451b881d84f Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418243190 Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 4ee94c5c732c4e579ec3e85f3018641b Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerDiskConfigTestJSON-418243190-project Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'd0c3cd43-d83f-49b8-9ac8-8ff3fd81148c'} Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:11.146524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.153954 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:11.153954 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:11.153954 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:11.153954 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:11.153954 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:11.153954 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. Oct 19 06:57:11.153954 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:11.153954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] Returning 404 to user: Instance d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:11.155302 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0cf0cbe1-0a46-4a89-afea-f1e2ea1c0ef2 tempest-ServerDiskConfigTestJSON-418243190 tempest-ServerDiskConfigTestJSON-418243190-project] 10.222.0.39 "GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c" status: 404 len: 111 microversion: 2.1 time: 0.046099 Oct 19 06:57:11.156409 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 972/1951] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:11 2022] GET /compute/v2.1/servers/d0c3cd43-d83f-49b8-9ac8-8ff3fd81148c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:11.632340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:11.633315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:11.647938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.658609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.659213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:11.660259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.664987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.665742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:11.701429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:11.703058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:11.719064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.720947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.721657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:11.722650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:11.723315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:11.724370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:12.078530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:12.101600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:12.103182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:12.104451 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-692fd84c-b08b-45a7-82e2-e765a5d6407b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.410522 Oct 19 06:57:12.119202 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 973/1952] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:11 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:12.119202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:12.119202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:12.133631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:12.134176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:12.134628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:12.135412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:12.135922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:12.136389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:12.306138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:12.315456 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-abf465ce-7d31-4939-8406-63a40dfe95a0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1267 microversion: 2.1 time: 0.209365 Oct 19 06:57:12.328560 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 974/1953] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:12 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:12.334235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:12.334856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:12.341518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:12.348577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:12.352088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:12.352088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:12.352088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:12.352088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:12.552502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:12.562015 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55d24e2c-97a8-40ff-bb20-0d5cbc28225d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.933727 Oct 19 06:57:12.572923 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 980/1954] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:11 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:12.831309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:12.849634 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a964fb4b-a33e-4207-9910-cc90c9a23cba tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.518713 Oct 19 06:57:12.851463 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 975/1955] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:12 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:13.133460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:13.134077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:13.143431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:13.143930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:13.144408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:13.145122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:13.157774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:13.158319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:13.345322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:13.346411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:13.361283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:13.363599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:13.364880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:13.369319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:13.370937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:13.371677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:13.522570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:13.537377 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6252b34-1808-4689-8f93-1633fafe22aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1265 microversion: 2.1 time: 0.197644 Oct 19 06:57:13.539352 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 976/1956] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:13 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:13.599629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:13.600278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:13.612229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:13.612809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:13.613424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:13.614429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:13.614905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:13.615346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:13.812901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:13.823344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:13.837519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:13.841726 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce55c298-44d0-4645-a190-64c6d7512653 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.712281 Oct 19 06:57:13.844471 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 981/1957] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:13 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:13.875419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:13.876603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:13.887399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:13.889140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:13.890238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:13.892782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:13.893476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:13.897984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:14.071787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:14.083570 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1941bdfd-0ce4-4f47-8d5c-8235fcd46c89 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.487656 Oct 19 06:57:14.085775 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 977/1958] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:13 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:14.569528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:14.575501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:14.579803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:14.580885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:14.581577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:14.582744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:14.583374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:14.584000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:14.702822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:14.715531 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17405618-ef88-4b6d-89e7-97aae6e6460e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1265 microversion: 2.1 time: 0.152390 Oct 19 06:57:14.720139 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 978/1959] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:14 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:14.828051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:14.857861 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92e01b88-8e7b-4546-8e54-6ba76d1320a0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.979438 Oct 19 06:57:14.857861 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 982/1960] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:13 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:14.872615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:14.873267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:14.885730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:14.886228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:14.886674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:14.887393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:14.887853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:14.888313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:15.110919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:15.111533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:15.124665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:15.125545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:15.127958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:15.134646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:15.135458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:15.136499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:15.430515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:15.447162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:15.463968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:15.468636 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4db1b902-3b2f-427e-899e-90572e5cdc81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.599954 Oct 19 06:57:15.472386 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 979/1961] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:14 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:15.740826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:15.741918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:15.757490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:15.759550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:15.761503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:15.762557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:15.764941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:15.767202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:15.816012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:15.837266 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9370e5af-c479-4c89-b3a6-0224970e117e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.728383 Oct 19 06:57:15.859438 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 983/1962] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:15 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:15.883351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:15.883984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:15.906563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:15.908373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:15.908818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:15.909538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:15.912094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:15.914052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:16.537966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:16.552183 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-40cd2449-c35f-475e-8105-28cf464033ed tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.676737 Oct 19 06:57:16.557627 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 984/1963] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:15 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:16.561157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:16.561838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:16.574084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:16.575583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:16.576556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:16.586326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:16.586326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:16.586326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:16.605047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] HTTP exception thrown: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Request method failure captured: Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 HTTP/1.1 Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT58LRQnTx3tbAFnGV-3QCsGrx7S01exngJr3YT7cXj1Uq0cpGRrI-ecXJZR_jpEyHyfZKr6xoip8xo2uXRyIwcBDRc-Zdxz2ye0WHsXIwi-w34G3804zPWxpQWNkJwlTHYvdpdGMZPAuSD06znvFfrVOmLgnitkd38tC_PPRdaw-w8s Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 6178cc497ec0483e9fa05a6b1fe83da2 Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-262925740 Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6178cc497ec0483e9fa05a6b1fe83da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6178cc497ec0483e9fa05a6b1fe83da2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6178cc497ec0483e9fa05a6b1fe83da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6178cc497ec0483e9fa05a6b1fe83da2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-262925740 Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 6178cc497ec0483e9fa05a6b1fe83da2 Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-262925740 Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachSCSIVolumeTestJSON-262925740-project Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f372b893598646b1b7dc0fc37650ebff Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-262925740-project Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9'} Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:16.613904 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.620196 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.622751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Returning 404 to user: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:16.623835 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cee2ccf4-0f03-4b02-9321-3f4bd994ce1b tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "DELETE /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 404 len: 111 microversion: 2.1 time: 0.069354 Oct 19 06:57:16.628138 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 985/1964] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:16 2022] DELETE /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:16.640054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:16.643326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:16.652552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:16.652552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:16.652552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:16.652552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:16.655838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:16.661327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:16.678982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:16.694683 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83c509c4-ae56-49e7-b71c-647e43054e23 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.958009 Oct 19 06:57:16.696912 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 980/1965] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:15 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:16.711491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:16.713116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] [instance: 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:16.750511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:16.751704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:16.753635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:16.754713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:16.755978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:16.758140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:16.800600 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] HTTP exception thrown: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Request method failure captured: Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 HTTP/1.1 Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT58LRQnTx3tbAFnGV-3QCsGrx7S01exngJr3YT7cXj1Uq0cpGRrI-ecXJZR_jpEyHyfZKr6xoip8xo2uXRyIwcBDRc-Zdxz2ye0WHsXIwi-w34G3804zPWxpQWNkJwlTHYvdpdGMZPAuSD06znvFfrVOmLgnitkd38tC_PPRdaw-w8s Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 6178cc497ec0483e9fa05a6b1fe83da2 Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-262925740 Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6178cc497ec0483e9fa05a6b1fe83da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6178cc497ec0483e9fa05a6b1fe83da2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6178cc497ec0483e9fa05a6b1fe83da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6178cc497ec0483e9fa05a6b1fe83da2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-262925740 Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 6178cc497ec0483e9fa05a6b1fe83da2 Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-262925740 Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachSCSIVolumeTestJSON-262925740-project Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f372b893598646b1b7dc0fc37650ebff Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-262925740-project Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9'} Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:16.802380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.810210 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:16.810210 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:16.810210 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:16.810210 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:16.810210 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:16.810210 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. Oct 19 06:57:16.810210 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:57:16.810210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] Returning 404 to user: Instance 33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:16.810210 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-488e6e41-0819-420c-8731-be1851412fd7 tempest-AttachSCSIVolumeTestJSON-262925740 tempest-AttachSCSIVolumeTestJSON-262925740-project] 10.222.0.39 "GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9" status: 404 len: 111 microversion: 2.1 time: 0.107306 Oct 19 06:57:16.812654 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 981/1966] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:16 2022] GET /compute/v2.1/servers/33fde08e-eef7-4d1f-9836-a2ffe0ea3bb9 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:16.866949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:16.868483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:16.876375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:16.879127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:16.879127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:16.879127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:16.879127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:16.880826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:17.525406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:17.538609 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-693d202b-7953-426d-896b-6fe72f9e7cfa tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1392 microversion: 2.1 time: 0.675742 Oct 19 06:57:17.555124 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 982/1967] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:16 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1392 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:17.580877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:17.581569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:17.591474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:17.592402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:17.594119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:17.595015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:17.597701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:17.598288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:17.688016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:17.702850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:17.706071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:17.707785 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cadc363-3ecb-494f-836f-e5441e31fc7e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 1.078331 Oct 19 06:57:17.726329 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 986/1968] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:16 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:17.737711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:17.741109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:17.757743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:17.759574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:17.764022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:17.767394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:17.769055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:17.772441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:17.772927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:17.774217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:17.786516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:17.984172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:17.998546 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dedfa819-bdfe-4c90-935f-3f28b39458ab tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.423204 Oct 19 06:57:18.017855 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 983/1969] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:17 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:18.380204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:18.390187 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed8f3275-4c37-4951-aeb9-778db56b2a37 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.662390 Oct 19 06:57:18.390831 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 987/1970] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:17 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:18.566237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:18.566948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:18.573065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:18.573647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:18.574174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:18.574921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:18.575420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:18.576060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:18.738471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:18.740393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:18.754388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:18.755144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:18.755751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:18.757828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:18.758520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:18.760584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:18.775262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:18.932995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:18.955542 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fb0ad3e-13b7-43ea-866c-4ca406501e19 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1382 microversion: 2.1 time: 0.393897 Oct 19 06:57:18.962484 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 984/1971] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:18 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1382 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:18.988297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-faf15574-01ca-4d56-ad5e-b17176b2e97e tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '.version_select at 0x7f6d68a9d670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:18.991861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faf15574-01ca-4d56-ad5e-b17176b2e97e tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:18.992652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faf15574-01ca-4d56-ad5e-b17176b2e97e tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:18.993108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faf15574-01ca-4d56-ad5e-b17176b2e97e tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.013457 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-faf15574-01ca-4d56-ad5e-b17176b2e97e tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 4308 microversion: 2.1 time: 0.029598 Oct 19 06:57:19.027879 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 985/1972] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:57:18 2022] GET /compute/v2.1/os-migrations => generated 4308 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:19.033826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:19.034543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:19.042805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:19.043917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:19.044743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.045640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:19.046291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:19.048142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.385831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:19.397804 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1f45568-270d-4f5b-87f6-f523fc0903f5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.368272 Oct 19 06:57:19.401200 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 986/1973] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:19 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:19.416005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3bfb72a-a695-42c4-b6cb-30ca9ac243b8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:19.419370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e3bfb72a-a695-42c4-b6cb-30ca9ac243b8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:19.435647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3bfb72a-a695-42c4-b6cb-30ca9ac243b8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:19.436378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3bfb72a-a695-42c4-b6cb-30ca9ac243b8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:19.439028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3bfb72a-a695-42c4-b6cb-30ca9ac243b8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.440177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3bfb72a-a695-42c4-b6cb-30ca9ac243b8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:19.440988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3bfb72a-a695-42c4-b6cb-30ca9ac243b8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:19.441767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3bfb72a-a695-42c4-b6cb-30ca9ac243b8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.452361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:19.463163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:19.468950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:19.472516 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8db6b933-6351-45a3-97ad-0ec3855ed0ce tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.737273 Oct 19 06:57:19.472969 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 988/1974] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:18 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:19.487774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:19.488703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:19.523886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:19.523886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:19.523886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.523886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:19.523886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:19.523886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.579911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:19.841629 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3bfb72a-a695-42c4-b6cb-30ca9ac243b8 tempest-LiveMigrationTest-642557406 tempest-LiveMigrationTest-642557406-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1535 microversion: 2.1 time: 0.438268 Oct 19 06:57:19.842232 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 987/1975] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:19 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1535 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:19.871010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ab061010-c9b4-40d8-ba4c-8e0409a722e4 req-e60526c5-a71a-44e6-a483-a753e67fd241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac94d23-f2b1-4845-8e83-16cdbd84ca27", "tag": "c7d56b40-d00e-4dd3-902c-0debbf325b61"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:19.903746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab061010-c9b4-40d8-ba4c-8e0409a722e4 req-e60526c5-a71a-44e6-a483-a753e67fd241 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:19.904645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab061010-c9b4-40d8-ba4c-8e0409a722e4 req-e60526c5-a71a-44e6-a483-a753e67fd241 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:19.907534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab061010-c9b4-40d8-ba4c-8e0409a722e4 req-e60526c5-a71a-44e6-a483-a753e67fd241 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.925799 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ab061010-c9b4-40d8-ba4c-8e0409a722e4 req-e60526c5-a71a-44e6-a483-a753e67fd241 service nova] Creating event network-changed:c7d56b40-d00e-4dd3-902c-0debbf325b61 for instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 on n-h2-861333-10 Oct 19 06:57:19.931295 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ab061010-c9b4-40d8-ba4c-8e0409a722e4 req-e60526c5-a71a-44e6-a483-a753e67fd241 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075129 Oct 19 06:57:19.932519 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 988/1976] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:19.939054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:19.939904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:19.948428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:19.949207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:19.950025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.954600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:19.954600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:19.954600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:19.979672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:19.984780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:57:20.123346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:20.132169 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c170f06d-d4f9-4041-9fd7-3fd9db448430 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.658059 Oct 19 06:57:20.138269 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 989/1977] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:19 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:20.304422 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67cae5ab-c51d-4fc3-8ef2-8c11df8866d4 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 204 len: 0 microversion: 2.1 time: 0.370170 Oct 19 06:57:20.309926 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 989/1978] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:19 2022] DELETE /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:57:20.315404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:20.316022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:20.334932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:20.335440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:20.335888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:20.336664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:20.337109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:20.337538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:20.428794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:20.429716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:20.454429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:20.454429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:20.454852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:20.455742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:20.455900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:20.464874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:20.909226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:20.920674 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-115b8249-39c7-4f54-a650-7d9bd1c4b22c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1543 microversion: 2.1 time: 0.498656 Oct 19 06:57:20.921575 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 990/1979] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:20 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1543 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:20.930701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:20.935759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:20.949139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:20.949639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:20.949773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:20.950078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:20.950784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:20.957895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:20.958632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:20.959401 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-190ec686-3289-46a9-899f-fbb3c973c758 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1388 microversion: 2.1 time: 0.648773 Oct 19 06:57:20.961619 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 990/1980] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:20 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1388 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:21.164554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:21.165925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:21.173175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:21.173652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:21.174083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:21.174779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:21.175843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:21.176565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:21.338195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:21.354824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:21.357685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:21.361614 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-206360a4-4bc7-4305-9090-a07a3f381593 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.439382 Oct 19 06:57:21.389104 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 991/1981] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:20 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:21.763246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:21.778675 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9993508-9bd2-455b-947e-00b16e5811dc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.616777 Oct 19 06:57:21.780562 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 991/1982] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:21 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:21.949756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:21.950629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:21.965718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:21.968383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:21.973054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:21.974225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:21.977598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:21.978469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:21.994468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:21.996389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:22.021890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:22.022665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:22.023137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:22.032913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:22.036353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:22.038379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:22.392596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:22.392596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-460b31b2-73e7-4a36-b631-5fd86019a2c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1542 microversion: 2.1 time: 0.332969 Oct 19 06:57:22.392596 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 992/1983] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:21 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1542 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:22.400593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:22.401321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:22.408566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:22.409183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:22.409719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:22.410518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:22.411078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:22.411686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:22.574717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:22.585052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:22.586501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:22.587716 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b0802ab-a829-42c6-b7ed-ec8345dc51e8 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.194904 Oct 19 06:57:22.588265 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 993/1984] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:22 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:57:22.590689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:22.636967 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2499f71c-8ca5-460d-a8f8-60b161866d8c tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1388 microversion: 2.1 time: 0.657131 Oct 19 06:57:22.645229 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 992/1985] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:21 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1388 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:22.810750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:22.813325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:22.818887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:22.822673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:22.823183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:22.831660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:22.831660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:22.831660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:23.050298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:23.058340 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6985c0a-7770-473b-bb6e-b9e6d7e0e45d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.257603 Oct 19 06:57:23.058918 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 994/1986] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:22 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:23.352719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-eac6a384-985c-499c-bba5-8835697caca6 req-ae13e0a8-ffd9-4abb-b60a-a9e158891a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5efd0f-0b7c-4af7-9cf3-680a046bc396", "name": "network-vif-deleted", "tag": "3d2e51f5-b99e-4084-9485-e38140e78566"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:23.373781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-eac6a384-985c-499c-bba5-8835697caca6 req-ae13e0a8-ffd9-4abb-b60a-a9e158891a92 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:23.388409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-eac6a384-985c-499c-bba5-8835697caca6 req-ae13e0a8-ffd9-4abb-b60a-a9e158891a92 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:23.388917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-eac6a384-985c-499c-bba5-8835697caca6 req-ae13e0a8-ffd9-4abb-b60a-a9e158891a92 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:23.413661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:23.414147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:23.417609 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-eac6a384-985c-499c-bba5-8835697caca6 req-ae13e0a8-ffd9-4abb-b60a-a9e158891a92 service nova] Creating event network-vif-deleted:3d2e51f5-b99e-4084-9485-e38140e78566 for instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 on n-h1-861333-10 Oct 19 06:57:23.426942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:23.427933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:23.428405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:23.429128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:23.429587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:23.430018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:23.433361 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-eac6a384-985c-499c-bba5-8835697caca6 req-ae13e0a8-ffd9-4abb-b60a-a9e158891a92 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085396 Oct 19 06:57:23.435247 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 993/1987] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:23.625349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:23.638741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:23.675589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:23.676126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:23.676579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:23.684649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:23.684649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:23.684649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:24.217684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:24.226254 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5fbbe7c7-87bc-4748-88a9-3af266863ba0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1542 microversion: 2.1 time: 0.820415 Oct 19 06:57:24.232407 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 995/1988] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:23 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1542 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:24.241963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:24.243057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:24.265410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:24.265906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:24.266607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:24.267508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:24.268163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:24.272928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:24.415289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:24.443529 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2c7570c-87fb-474d-af0d-40199ba858d1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1184 microversion: 2.1 time: 0.208100 Oct 19 06:57:24.458678 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 996/1989] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:24 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1184 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:24.475456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:24.475456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:24.512404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:24.514506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:24.517438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:24.520994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:24.525779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:24.529099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:24.805199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:24.816535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:24.817989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:24.820794 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af2a3405-db50-4cd6-b714-1f3040e4d9ea tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 1.205137 Oct 19 06:57:24.820794 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 994/1990] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:23 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:24.874171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:24.898809 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-643f426b-7d8f-4e18-ac01-6e057f714812 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.449500 Oct 19 06:57:24.906951 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 997/1991] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:24 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:25.255337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:25.256203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:25.272898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:25.275031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:25.276316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:25.277302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:25.279205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:25.282492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:25.473946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:25.475164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:25.494037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:25.495939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:25.496647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:25.500493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:25.502873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:25.503539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:25.685569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:25.701478 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-659a0acc-cf7b-4c05-a9e9-c6a8f6cf4f23 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1184 microversion: 2.1 time: 0.230272 Oct 19 06:57:25.702445 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 998/1992] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:25 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1184 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:25.720197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d1d2762e-8c01-4560-bb5e-f4c86f9472a8 req-50ad81db-35d8-4ad9-9c48-32f0923393f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327ba1a3-a8b5-41c4-b255-1fe00ce5f005", "name": "network-vif-unplugged", "status": "completed", "tag": "d625756d-d7ae-40fb-a597-39024348ca41"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:25.735533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:25.745134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d1d2762e-8c01-4560-bb5e-f4c86f9472a8 req-50ad81db-35d8-4ad9-9c48-32f0923393f8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:25.747759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d1d2762e-8c01-4560-bb5e-f4c86f9472a8 req-50ad81db-35d8-4ad9-9c48-32f0923393f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:25.750186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d1d2762e-8c01-4560-bb5e-f4c86f9472a8 req-50ad81db-35d8-4ad9-9c48-32f0923393f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:25.814480 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d1d2762e-8c01-4560-bb5e-f4c86f9472a8 req-50ad81db-35d8-4ad9-9c48-32f0923393f8 service nova] Creating event network-vif-unplugged:d625756d-d7ae-40fb-a597-39024348ca41 for instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 on n-h2-861333-10 Oct 19 06:57:25.829330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-d1d2762e-8c01-4560-bb5e-f4c86f9472a8 req-50ad81db-35d8-4ad9-9c48-32f0923393f8 service nova] Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:57:25.859513 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d1d2762e-8c01-4560-bb5e-f4c86f9472a8 req-50ad81db-35d8-4ad9-9c48-32f0923393f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153486 Oct 19 06:57:25.861452 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 999/1993] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:25.868645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:25.869560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:25.876644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:25.877388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:25.878019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:25.878953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:25.879577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:25.880254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:26.165841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:26.214924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:26.224650 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ee11614-f1f5-4d69-81ba-7a9dfb9c387f tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1542 microversion: 2.1 time: 0.973669 Oct 19 06:57:26.238793 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 995/1994] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:25 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1542 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:26.243422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:26.246562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:26.247648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:26.253708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:26.259460 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-603f470d-51d5-49d8-afe5-0c09481744d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.391578 Oct 19 06:57:26.259661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:26.260071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:26.260802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:26.260926 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1000/1995] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:25 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:26.261884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:26.262731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:26.263350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:26.639674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:26.655864 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41c02e07-df87-47c3-9627-3e8c1d937b6e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.413258 Oct 19 06:57:26.657071 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 996/1996] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:26 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:26.729803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:26.731167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:26.743811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:26.744356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:26.744805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:26.745755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:26.752006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:26.752757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:26.875069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:26.887660 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8ddb653-a7ee-4932-8822-929fac373fd2 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1184 microversion: 2.1 time: 0.162405 Oct 19 06:57:26.892754 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1001/1997] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:26 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1184 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:27.256390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:27.257766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:27.266259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:27.271089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:27.276536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:27.276536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:27.276536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:27.276536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:27.299772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:27.305724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:27.321514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:27.322808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:27.323891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:27.325161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:27.330445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:27.331344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:27.757403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:27.767087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:27.782082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:27.789961 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-618e323c-cdf6-4a66-aa01-4c512b8d77e7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.499290 Oct 19 06:57:27.791813 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1002/1998] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:27 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:57:27.811637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:27.812699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:27.827838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:27.828380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:27.828849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:27.829563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:27.830017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:27.830446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:28.242577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:28.248409 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dcb92bf4-c5df-4e12-8ab7-72ad12fbdd35 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1542 microversion: 2.1 time: 0.996347 Oct 19 06:57:28.249578 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 997/1999] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:27 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1542 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:28.257322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:28.259175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:28.266887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:28.267711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:28.268406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:28.271354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:28.271354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:28.271354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:28.406248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:28.418376 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-424fc726-9832-477f-9009-9fdbeccc702a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.625317 Oct 19 06:57:28.418826 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1003/2000] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:27 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:28.426421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4de7a07b-6d9b-4410-881b-f404dc5eb9a1 req-aaf42fc2-c146-4e45-803d-d08316d36012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327ba1a3-a8b5-41c4-b255-1fe00ce5f005", "tag": "d625756d-d7ae-40fb-a597-39024348ca41"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:28.440051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:28.452892 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a88e0fc-5b10-407d-b08e-5e72d9db5ff5 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1184 microversion: 2.1 time: 0.200836 Oct 19 06:57:28.455725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4de7a07b-6d9b-4410-881b-f404dc5eb9a1 req-aaf42fc2-c146-4e45-803d-d08316d36012 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:28.456655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4de7a07b-6d9b-4410-881b-f404dc5eb9a1 req-aaf42fc2-c146-4e45-803d-d08316d36012 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:28.460982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4de7a07b-6d9b-4410-881b-f404dc5eb9a1 req-aaf42fc2-c146-4e45-803d-d08316d36012 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:28.461499 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 998/2001] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:28 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1184 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:28.471962 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4de7a07b-6d9b-4410-881b-f404dc5eb9a1 req-aaf42fc2-c146-4e45-803d-d08316d36012 service nova] Creating event network-changed:d625756d-d7ae-40fb-a597-39024348ca41 for instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 on n-h2-861333-10 Oct 19 06:57:28.474992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:28.479598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-4de7a07b-6d9b-4410-881b-f404dc5eb9a1 req-aaf42fc2-c146-4e45-803d-d08316d36012 service nova] Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:57:28.494497 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4de7a07b-6d9b-4410-881b-f404dc5eb9a1 req-aaf42fc2-c146-4e45-803d-d08316d36012 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073863 Oct 19 06:57:28.499989 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1004/2002] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:28.821317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:28.826273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:28.835938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:28.837275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:28.837952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:28.840198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:28.841379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:28.843014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:28.850681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4dd35bdc-dc0b-45f3-9ce0-b0d329c19f81 req-230a9537-db7c-4a55-8099-cc4655b67381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac94d23-f2b1-4845-8e83-16cdbd84ca27", "name": "network-vif-plugged", "status": "completed", "tag": "c7d56b40-d00e-4dd3-902c-0debbf325b61"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:28.871245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4dd35bdc-dc0b-45f3-9ce0-b0d329c19f81 req-230a9537-db7c-4a55-8099-cc4655b67381 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:28.871741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4dd35bdc-dc0b-45f3-9ce0-b0d329c19f81 req-230a9537-db7c-4a55-8099-cc4655b67381 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:28.872251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4dd35bdc-dc0b-45f3-9ce0-b0d329c19f81 req-230a9537-db7c-4a55-8099-cc4655b67381 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:28.905036 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4dd35bdc-dc0b-45f3-9ce0-b0d329c19f81 req-230a9537-db7c-4a55-8099-cc4655b67381 service nova] Creating event network-vif-plugged:c7d56b40-d00e-4dd3-902c-0debbf325b61 for instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 on n-h2-861333-10 Oct 19 06:57:28.912679 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4dd35bdc-dc0b-45f3-9ce0-b0d329c19f81 req-230a9537-db7c-4a55-8099-cc4655b67381 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070322 Oct 19 06:57:28.913962 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1005/2003] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:57:29.277413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:29.278172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:29.296769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:29.297319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:29.298347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:29.299188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:29.299541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:29.299982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:29.558462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:29.574407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:29.581380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:29.581380 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2693e9da-bdb2-4aed-b15e-6859d16c5d81 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.762025 Oct 19 06:57:29.581380 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 999/2004] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:28 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:29.606828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:29.610269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:29.614245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:29.614997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:29.615652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:29.616787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:29.617480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:29.618381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:29.954631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:29.972002 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-903ce527-7475-4618-ad25-d2fe6bdb4977 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1474 microversion: 2.1 time: 0.699839 Oct 19 06:57:29.974525 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1006/2005] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:29 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1474 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:29.987073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:29.989073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:30.009852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:30.010922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:30.012409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:30.017628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:30.018213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:30.018867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:30.146076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:30.155634 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2c6222b-17b1-430c-b568-e1dd18bd374d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1184 microversion: 2.1 time: 0.178200 Oct 19 06:57:30.158145 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1007/2006] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:29 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1184 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:30.420699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:30.434587 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0fdf43de-e66a-4e6e-914b-dd735ef85780 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.830821 Oct 19 06:57:30.435513 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1000/2007] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:29 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:30.610546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:30.611583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:30.623153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:30.625099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:30.627090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:30.630427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:30.633428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:30.633932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:31.000494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:31.001583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:31.012603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:31.013606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:31.017760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:31.020075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:31.028416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:31.028416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:31.488478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:31.497431 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68910f2c-3516-4761-aab4-e4900ebb7f96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1471 microversion: 2.1 time: 0.502360 Oct 19 06:57:31.513516 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1001/2008] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:30 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:31.521765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:31.527480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:31.549249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:31.552545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:31.553233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:31.557411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:31.562357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:31.565303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:31.734480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:31.739642 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74675561-0e5f-45ad-8d16-ceced14cf8af tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 200 len: 1184 microversion: 2.1 time: 0.232603 Oct 19 06:57:31.740394 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1002/2009] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:31 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 1184 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:31.772003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:31.773087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:31.788741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:31.789179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:31.789622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:31.790327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:31.796554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:31.797521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:31.927671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:31.942268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:31.962479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:31.967798 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07688005-bc37-4ea6-a965-089b09753528 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 1.363235 Oct 19 06:57:31.986297 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1008/2010] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:30 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:32.003058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:32.003599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:32.029079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:32.029588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:32.030039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:32.033993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:32.038440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:32.039161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:32.166614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:32.167134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:32.167582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:32.168354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:32.168816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:32.170353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:32.283852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:57:32.284990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:32.309655 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-faff042a-f64b-4735-8b1d-e560d3341971 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1307 microversion: 2.1 time: 0.535801 Oct 19 06:57:32.311876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for user 631a2a90a44a40b2bd751a4feaf69d0f and project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:57:32.319686 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1003/2011] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:31 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1307 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:32.769874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:32.769874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cb5efd0f-0b7c-4af7-9cf3-680a046bc396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:32.781296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:32.781889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:32.782561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:32.783294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:32.783760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:32.784221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:32.816917 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] HTTP exception thrown: Instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 could not be found. Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Request method failure captured: Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 HTTP/1.1 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54oPsNQQYwaBbbQV2-8_IdFne9c0nZQAH-3Z085CI2tiqa74XebS94m6AQYixlRuiX-T_Oeguf6BA4L3NIg9tMDrad86Fnd_qYcF-4DNyHmZ_mNM1A6OWvviC1aLoAE5I0qaKybmyvmklwJqIOiIBorI9G7oOO8GYVNoti5GPMwrPE Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: bdca3d9567f34867aa0d9d4489001792 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveMigrationTest-93923442 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdca3d9567f34867aa0d9d4489001792", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-LiveMigrationTest-93923442 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: bdca3d9567f34867aa0d9d4489001792 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveMigrationTest-93923442 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-LiveMigrationTest-93923442-project Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f67e466b1aa04d2cbafdbd390c178215 Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-LiveMigrationTest-93923442-project Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 could not be found. Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'cb5efd0f-0b7c-4af7-9cf3-680a046bc396'} Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 could not be found. Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 could not be found. Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:32.820641 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:32.828206 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:32.828206 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:32.828206 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:32.828206 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:32.828206 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:32.828206 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 could not be found. Oct 19 06:57:32.828206 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:32.828206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Returning 404 to user: Instance cb5efd0f-0b7c-4af7-9cf3-680a046bc396 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:32.828206 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7367edf-d6dc-42fc-a340-933102efa551 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396" status: 404 len: 111 microversion: 2.1 time: 0.059927 Oct 19 06:57:32.831265 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1004/2012] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:32 2022] GET /compute/v2.1/servers/cb5efd0f-0b7c-4af7-9cf3-680a046bc396 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:57:32.999221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:32.999840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:33.011386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:33.012277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:33.012926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:33.015085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:33.017305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:33.019564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:33.106453 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a25743f-c912-4dfe-b8b4-d93983b6a8c0 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005/action" status: 202 len: 0 microversion: 2.1 time: 1.117395 Oct 19 06:57:33.112509 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1009/2013] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:57:31 2022] POST /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005/action => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:57:33.127050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:33.144527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:33.170819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:33.184384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:33.184967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:33.185749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:33.186229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:33.186666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:33.659160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:33.673703 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-938c6fb6-eda4-41db-a648-b0fc63916792 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1470 microversion: 2.1 time: 0.557564 Oct 19 06:57:33.674910 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1010/2014] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:33 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1470 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:33.685405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:33.688073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:33.697345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:33.698208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:33.698885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:33.699873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:33.700596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:33.701278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:33.770370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:33.784266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:33.788559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:33.792167 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a04b705-b031-40a5-978f-1eddc756916b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.795934 Oct 19 06:57:33.793473 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1005/2015] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:32 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:34.022822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:34.038387 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d15d0a2-8268-4120-b6c8-4b74413ebcd7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 200 len: 1487 microversion: 2.1 time: 0.357350 Oct 19 06:57:34.039473 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1011/2016] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:33 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 1487 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:34.069677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7858a89f-dfc8-4269-b84d-efeba1b6db55 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1169234580"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:34.076396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7858a89f-dfc8-4269-b84d-efeba1b6db55 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:34.085748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858a89f-dfc8-4269-b84d-efeba1b6db55 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:34.087941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858a89f-dfc8-4269-b84d-efeba1b6db55 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:34.088515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858a89f-dfc8-4269-b84d-efeba1b6db55 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:34.095164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858a89f-dfc8-4269-b84d-efeba1b6db55 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:34.095850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858a89f-dfc8-4269-b84d-efeba1b6db55 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:34.096509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7858a89f-dfc8-4269-b84d-efeba1b6db55 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:34.106535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:34.702193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:34.704025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:34.719115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:34.720843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:34.724765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:34.725789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:34.730828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:34.736028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:34.917791 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7858a89f-dfc8-4269-b84d-efeba1b6db55 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27/action" status: 202 len: 0 microversion: 2.1 time: 0.847939 Oct 19 06:57:34.919614 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1006/2017] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:57:34 2022] POST /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27/action => generated 0 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 06:57:34.932028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:34.933286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:34.950262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:34.953898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:34.953898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:34.955446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:34.957236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:34.957872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:35.510159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:35.520563 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bdb31b3d-d9d8-4227-a151-d2a8f61a8565 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1470 microversion: 2.1 time: 0.822934 Oct 19 06:57:35.529191 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1012/2018] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:34 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1470 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:35.544586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50281f69-4b7f-4b80-ab3a-a842d42d86c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68a9d430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:35.637184 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50281f69-4b7f-4b80-ab3a-a842d42d86c0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.106452 Oct 19 06:57:35.638293 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1013/2019] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:35 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:35.650641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bb0aabe3-6898-4840-8d23-8fb27d0fdc5a req-844c1bea-1e4a-4a44-a1d3-997281bea783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327ba1a3-a8b5-41c4-b255-1fe00ce5f005", "name": "network-vif-plugged", "status": "completed", "tag": "d625756d-d7ae-40fb-a597-39024348ca41"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:35.678898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bb0aabe3-6898-4840-8d23-8fb27d0fdc5a req-844c1bea-1e4a-4a44-a1d3-997281bea783 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:35.679906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bb0aabe3-6898-4840-8d23-8fb27d0fdc5a req-844c1bea-1e4a-4a44-a1d3-997281bea783 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:35.680618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bb0aabe3-6898-4840-8d23-8fb27d0fdc5a req-844c1bea-1e4a-4a44-a1d3-997281bea783 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:35.701627 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bb0aabe3-6898-4840-8d23-8fb27d0fdc5a req-844c1bea-1e4a-4a44-a1d3-997281bea783 service nova] Creating event network-vif-plugged:d625756d-d7ae-40fb-a597-39024348ca41 for instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 on n-h2-861333-10 Oct 19 06:57:35.720972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-bb0aabe3-6898-4840-8d23-8fb27d0fdc5a req-844c1bea-1e4a-4a44-a1d3-997281bea783 service nova] Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:57:35.746993 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bb0aabe3-6898-4840-8d23-8fb27d0fdc5a req-844c1bea-1e4a-4a44-a1d3-997281bea783 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107073 Oct 19 06:57:35.749392 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1014/2020] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:36.026120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:36.037840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:36.040393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:36.043428 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf97eb77-30b8-478a-bddf-f54a418b840a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 1.121888 Oct 19 06:57:36.046443 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1007/2021] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:34 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:36.566931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:36.567998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:36.583792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:36.586183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:36.586863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:36.589003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:36.589725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:36.592614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:36.653439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d112c51b-1467-4f2c-aaf3-2e8519a623be tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68b1cdc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:36.736254 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d112c51b-1467-4f2c-aaf3-2e8519a623be tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.086457 Oct 19 06:57:36.737384 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1008/2022] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:36 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:57:37.073658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:37.075491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:37.083863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:37.084690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:37.085797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:37.086740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:37.087552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:37.089312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:37.396946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:37.407516 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0e7df06-32bd-4a05-b5a5-1409a7752c53 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1470 microversion: 2.1 time: 0.855954 Oct 19 06:57:37.413188 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1015/2023] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:36 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1470 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:37.415776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:37.425290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:37.431686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:37.437648 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d54bb00-0768-42c4-af1d-d0dd72bb9af5 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.371203 Oct 19 06:57:37.438792 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1009/2024] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:37 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:57:37.758091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a3a28c5-6b1b-4813-aff1-a4d3cbdebcab tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68a75a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:37.815680 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a3a28c5-6b1b-4813-aff1-a4d3cbdebcab tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.062429 Oct 19 06:57:37.816918 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1016/2025] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:37 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:38.449235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:38.449876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:38.466950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:38.467875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:38.477332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:38.478576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:38.482487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:38.483866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:38.484618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:38.486097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:38.529036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:38.535735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:38.554077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:38.559941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:38.569997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:38.572664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:39.154595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:39.164420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:39.167454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:39.174729 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6c58b98-e6fc-4933-a948-9fb89dfd6776 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.708176 Oct 19 06:57:39.178643 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1017/2026] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:38 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:39.209753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4abdfee-a269-4c0c-8a3c-efe15ad085b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68a6d310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:39.322567 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4abdfee-a269-4c0c-8a3c-efe15ad085b0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.142392 Oct 19 06:57:39.323925 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1018/2027] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:39 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:39.394439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:39.403319 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e05c1703-f523-478a-815b-299b571cb7c4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1470 microversion: 2.1 time: 0.966205 Oct 19 06:57:39.405420 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1010/2028] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:38 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1470 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:39.699072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-629625959", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "a505c32b-ddac-4aae-907a-08c283293dab"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:39.932428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] validate_networks() for [('a505c32b-ddac-4aae-907a-08c283293dab', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:57:40.208058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:40.208717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:40.226521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:40.228707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:40.230197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:40.235886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:40.236687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:40.238352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:41.145420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:41.157116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:41.158693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:41.181590 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbfef282-13c0-4d76-8837-df178468bee6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.977947 Oct 19 06:57:41.187429 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1011/2029] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:40 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:57:41.215465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2646f78-b14f-4007-8dc0-595734e41915 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68b3e790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:41.305072 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2646f78-b14f-4007-8dc0-595734e41915 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.116482 Oct 19 06:57:41.328793 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1012/2030] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:41 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:41.340408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:41.341147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:41.357058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:41.357632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:41.358634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:41.359629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:41.360146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:41.360675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:42.087809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:42.105256 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a83935c-485c-4ac5-af35-0ae6edd0bcae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1536 microversion: 2.1 time: 0.774019 Oct 19 06:57:42.116926 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1013/2031] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:41 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1536 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:42.126639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c3fdd52f-d0be-4224-a4c1-835da81a9c95 req-ba993fe8-6ab3-446a-a348-bccc1a026b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327ba1a3-a8b5-41c4-b255-1fe00ce5f005", "name": "network-vif-unplugged", "status": "completed", "tag": "d625756d-d7ae-40fb-a597-39024348ca41"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:42.144084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c3fdd52f-d0be-4224-a4c1-835da81a9c95 req-ba993fe8-6ab3-446a-a348-bccc1a026b74 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:42.144590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c3fdd52f-d0be-4224-a4c1-835da81a9c95 req-ba993fe8-6ab3-446a-a348-bccc1a026b74 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:42.145030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c3fdd52f-d0be-4224-a4c1-835da81a9c95 req-ba993fe8-6ab3-446a-a348-bccc1a026b74 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:42.201545 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c3fdd52f-d0be-4224-a4c1-835da81a9c95 req-ba993fe8-6ab3-446a-a348-bccc1a026b74 service nova] Creating event network-vif-unplugged:d625756d-d7ae-40fb-a597-39024348ca41 for instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 on n-h1-861333-10 Oct 19 06:57:42.236490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:42.238781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-c3fdd52f-d0be-4224-a4c1-835da81a9c95 req-ba993fe8-6ab3-446a-a348-bccc1a026b74 service nova] Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:57:42.268959 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c3fdd52f-d0be-4224-a4c1-835da81a9c95 req-ba993fe8-6ab3-446a-a348-bccc1a026b74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161772 Oct 19 06:57:42.274958 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1014/2032] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:42.288084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:42.288084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:42.321908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:42.322403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:42.322843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:42.342480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:42.342480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:42.342480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:42.669180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:42.684293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:42.686363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:42.687868 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a3428af-40c2-480b-8e0e-e128865f27f7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.411488 Oct 19 06:57:42.690577 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1015/2033] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:42 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:42.696954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d64dc83-9239-45da-82dd-fb975149bfde tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68bb4ee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:42.798762 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d64dc83-9239-45da-82dd-fb975149bfde tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.104944 Oct 19 06:57:42.802941 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1016/2034] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:42 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:42.822181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:42.825454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:42.845949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:42.849056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:42.851456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:42.853652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:42.856744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:42.858070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:42.963218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:57:43.055621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:57:43.056561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:57:43.057303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:57:43.057951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:57:43.058633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:57:43.091106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:43.096270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:43.096961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:43.100517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:43.102366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:43.103291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:43.242468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Getting quotas for project 294676299e874aa9a6ef62eedc6a73b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:57:43.268204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Getting quotas for user 8b725b4abc3e4717aae64ecccfa75f98 and project 294676299e874aa9a6ef62eedc6a73b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:57:43.346255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:57:43.348642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:57:43.383589 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c45eab38-4707-4e0b-916b-d0a6024b512d tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 204 len: 0 microversion: 2.1 time: 0.577726 Oct 19 06:57:43.384892 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1017/2035] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:42 2022] DELETE /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:57:43.390941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:43.392852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:43.415147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:43.421532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:43.423476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:43.429386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:43.430797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:43.434033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:43.583497 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-346c62e1-d25a-456e-ae59-e958c291dbcf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.257515 Oct 19 06:57:43.591145 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1019/2036] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:57:43.612528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:43.613150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:43.648319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:43.648832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:43.649273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:43.655778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:43.661472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:43.670357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:44.117379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:44.138737 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5436b5e7-15a2-444b-ae9f-808750a9cc49 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1536 microversion: 2.1 time: 0.752168 Oct 19 06:57:44.148359 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1018/2037] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:43 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1536 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:44.197065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:44.198038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:44.236692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:44.257505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:44.258889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:44.262341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:44.268464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:44.277789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:44.672495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:44.713934 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bfbc8104-a80f-4e2b-adc6-6f6a8a6a5ed6 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1665 microversion: 2.1 time: 1.117384 Oct 19 06:57:44.718596 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1020/2038] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:43 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1665 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:44.735063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef1258fb-188e-4fcc-bd04-5615fa426b00 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68a56ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:44.881687 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef1258fb-188e-4fcc-bd04-5615fa426b00 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.157993 Oct 19 06:57:44.886553 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1021/2039] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:44 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:44.906690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1154184169", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "a505c32b-ddac-4aae-907a-08c283293dab"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:45.090443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] validate_networks() for [('a505c32b-ddac-4aae-907a-08c283293dab', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:57:45.520409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:45.549614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:45.553328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:45.556498 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ebb0289-bd9b-49f7-8557-fc0871a08c45 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 1.387013 Oct 19 06:57:45.559589 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1019/2040] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:44 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:45.566109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:45.566965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:45.575123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:45.576317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:45.577642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:45.578065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:45.578798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:45.579656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:46.814266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:46.835354 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43943d5f-7c30-40a6-bc08-1b993cdd0ef8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1536 microversion: 2.1 time: 1.269778 Oct 19 06:57:46.836021 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1020/2041] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:45 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1536 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:46.885000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-99b6d3e1-3728-4b11-a920-26a679606190 req-c3345e27-e644-454e-a304-79144b21d13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac94d23-f2b1-4845-8e83-16cdbd84ca27", "name": "network-vif-plugged", "status": "completed", "tag": "c7d56b40-d00e-4dd3-902c-0debbf325b61"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:46.923582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-99b6d3e1-3728-4b11-a920-26a679606190 req-c3345e27-e644-454e-a304-79144b21d13f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:46.924961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-99b6d3e1-3728-4b11-a920-26a679606190 req-c3345e27-e644-454e-a304-79144b21d13f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:46.926427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-99b6d3e1-3728-4b11-a920-26a679606190 req-c3345e27-e644-454e-a304-79144b21d13f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:46.986146 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-99b6d3e1-3728-4b11-a920-26a679606190 req-c3345e27-e644-454e-a304-79144b21d13f service nova] Creating event network-vif-plugged:c7d56b40-d00e-4dd3-902c-0debbf325b61 for instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 on n-h2-861333-10 Oct 19 06:57:47.003517 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-99b6d3e1-3728-4b11-a920-26a679606190 req-c3345e27-e644-454e-a304-79144b21d13f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137082 Oct 19 06:57:47.009451 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1021/2042] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:47.030274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:47.031752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:47.059133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:47.059644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:47.060089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:47.064425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:47.064978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:47.065426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:47.745035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:47.781664 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd10e929-1fac-4787-99c2-652f13212cf1 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1665 microversion: 2.1 time: 0.768444 Oct 19 06:57:47.783047 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1022/2043] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:47 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1665 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:47.800846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58c007ba-d86e-4b10-b450-26b8f453d8c1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d645bc670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:47.873757 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58c007ba-d86e-4b10-b450-26b8f453d8c1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.089402 Oct 19 06:57:47.882341 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1023/2044] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:47 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:48.183033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2199d3e6-822e-40f2-95a9-8aca449434c0 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Action: 'create', calling method: .version_select at 0x7f6d68ae8b80>, body: {"keypair": {"name": "tempest-keypair-924072454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWyRWvhfSNzgL+83Ue/G22QeOoigvR6sw4STGKYkB3V8McCszDnRRtQ6+pkpyxK5bgQanmnAzvsHmVvQEQY6OrDVcZHkgHDC96lpmuq0h5zhDS8BcPvhhSCm6U65B6eMg=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:48.216967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2199d3e6-822e-40f2-95a9-8aca449434c0 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Getting quotas for project af5f1db3c5044e68bc7b8525196441dc. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:57:48.228360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2199d3e6-822e-40f2-95a9-8aca449434c0 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Getting quotas for user 25848ed5bded46faa0176778a6eb100f and project af5f1db3c5044e68bc7b8525196441dc. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:57:48.400802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:57:48.406904 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2199d3e6-822e-40f2-95a9-8aca449434c0 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.521851 Oct 19 06:57:48.406904 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1024/2045] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 06:57:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:48.407615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:57:48.409950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:57:48.412998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:57:48.413462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:57:48.419766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:48.421881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:48.433247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:48.434025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:48.434653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:48.436298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:48.436934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:48.437567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:48.440511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:48.445987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:48.449243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:48.450325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:48.455170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:48.456914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:48.571668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Getting quotas for project 294676299e874aa9a6ef62eedc6a73b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:57:48.586274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Getting quotas for user 8b725b4abc3e4717aae64ecccfa75f98 and project 294676299e874aa9a6ef62eedc6a73b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:57:48.616795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:57:48.622521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:57:48.831357 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-989c4d00-ae09-4c9a-9abf-b82797ecdf23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.942427 Oct 19 06:57:48.833666 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1022/2046] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:57:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:57:48.841290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dab00c1c-52ec-4b47-a9d5-cd3ce019deac req-68592dc1-6cd8-4796-bbe9-04afb9a8d292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327ba1a3-a8b5-41c4-b255-1fe00ce5f005", "tag": "d625756d-d7ae-40fb-a597-39024348ca41"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:48.867911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dab00c1c-52ec-4b47-a9d5-cd3ce019deac req-68592dc1-6cd8-4796-bbe9-04afb9a8d292 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:48.868876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dab00c1c-52ec-4b47-a9d5-cd3ce019deac req-68592dc1-6cd8-4796-bbe9-04afb9a8d292 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:48.870777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dab00c1c-52ec-4b47-a9d5-cd3ce019deac req-68592dc1-6cd8-4796-bbe9-04afb9a8d292 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:48.896646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:48.904180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:48.913536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:48.913536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:48.915063 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dab00c1c-52ec-4b47-a9d5-cd3ce019deac req-68592dc1-6cd8-4796-bbe9-04afb9a8d292 service nova] Creating event network-changed:d625756d-d7ae-40fb-a597-39024348ca41 for instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 on n-h1-861333-10 Oct 19 06:57:48.917970 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9bb7b58-b359-4f8c-9d2c-1c97015e93cd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.505650 Oct 19 06:57:48.918727 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1025/2047] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:48 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:48.926196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:48.939578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:48.947976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-dab00c1c-52ec-4b47-a9d5-cd3ce019deac req-68592dc1-6cd8-4796-bbe9-04afb9a8d292 service nova] Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:57:48.969204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:48.971224 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dab00c1c-52ec-4b47-a9d5-cd3ce019deac req-68592dc1-6cd8-4796-bbe9-04afb9a8d292 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134610 Oct 19 06:57:48.971438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:48.972385 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1023/2048] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:48.977178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:48.977872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:48.978856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:48.979491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:48.980141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:48.994511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:48.995764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:49.007057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:49.008231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:49.008934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:49.010085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:49.010780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:49.011406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:49.935282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:49.958663 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8353d9d6-a5d3-4c01-b66c-f97e05d9cf34 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1665 microversion: 2.1 time: 0.984749 Oct 19 06:57:49.964388 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1024/2049] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:48 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1665 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:49.987544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54d37c17-2b1d-4869-99d6-ff0c9e445521 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68ab33a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:50.119595 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54d37c17-2b1d-4869-99d6-ff0c9e445521 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.153840 Oct 19 06:57:50.120185 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1025/2050] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:49 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:50.135715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2143440713", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "451", "networks": [{"uuid": "a505c32b-ddac-4aae-907a-08c283293dab"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:50.189857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:50.222678 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b7613ca-fad9-4b0e-8e0d-5ef2bf5e5a73 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1536 microversion: 2.1 time: 1.301226 Oct 19 06:57:50.225773 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1026/2051] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:48 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1536 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:50.288887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:50.289895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:50.317548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] validate_networks() for [('a505c32b-ddac-4aae-907a-08c283293dab', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:57:50.329099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:50.330709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:50.330709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:50.330709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:50.336354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:50.337249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:51.816294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:51.826014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:51.827450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:51.853079 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4298c2e-b6d0-4555-babd-23cb9af482d4 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 1.595958 Oct 19 06:57:51.853741 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1027/2052] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:50 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:51.876841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:51.890094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:51.909925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:51.911070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:51.913248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:51.918144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:51.918144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:51.918424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:52.099501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:52.120533 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3aa39cb0-d903-4e5a-842c-94751bbc3bf3 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1598 microversion: 2.1 time: 0.264172 Oct 19 06:57:52.128080 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1028/2053] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:51 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1598 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:52.171639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b71a2966-4f24-4f15-9a3e-d156f50d6af5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68bb44c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:52.289537 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b71a2966-4f24-4f15-9a3e-d156f50d6af5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.156267 Oct 19 06:57:52.290335 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1029/2054] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:52 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:52.309664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:52.310453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:52.324908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:52.325825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:52.326882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:52.328610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:52.329931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:52.330590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:53.159005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:53.199664 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4fb36372-25b1-4090-9e4c-d7eca082fd06 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1536 microversion: 2.1 time: 0.907999 Oct 19 06:57:53.218504 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1030/2055] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:52 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1536 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:53.241641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-365304fd-3d37-4405-9be2-7db702916617 req-ffb9baa7-ccb3-4e29-9e5b-453c7bf1583a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d231a12d-b118-41ec-b9e2-f987bea670ba", "name": "network-vif-deleted", "tag": "f66ec07e-1db7-450e-9282-9e31fda912b1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:53.258638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:57:53.258638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:57:53.259690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:57:53.261208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:57:53.261776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:57:53.297199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-365304fd-3d37-4405-9be2-7db702916617 req-ffb9baa7-ccb3-4e29-9e5b-453c7bf1583a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:53.298258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:53.298714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-365304fd-3d37-4405-9be2-7db702916617 req-ffb9baa7-ccb3-4e29-9e5b-453c7bf1583a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:53.300397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:53.301363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-365304fd-3d37-4405-9be2-7db702916617 req-ffb9baa7-ccb3-4e29-9e5b-453c7bf1583a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:53.301735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:53.305449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:53.309342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:53.312946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:53.350022 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-365304fd-3d37-4405-9be2-7db702916617 req-ffb9baa7-ccb3-4e29-9e5b-453c7bf1583a service nova] Creating event network-vif-deleted:f66ec07e-1db7-450e-9282-9e31fda912b1 for instance d231a12d-b118-41ec-b9e2-f987bea670ba on n-h1-861333-10 Oct 19 06:57:53.363833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:53.375612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Getting quotas for project 294676299e874aa9a6ef62eedc6a73b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:57:53.380236 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-365304fd-3d37-4405-9be2-7db702916617 req-ffb9baa7-ccb3-4e29-9e5b-453c7bf1583a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158389 Oct 19 06:57:53.383006 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1031/2056] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:53.385684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Getting quotas for user 8b725b4abc3e4717aae64ecccfa75f98 and project 294676299e874aa9a6ef62eedc6a73b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:57:53.408509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:53.409447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:53.420644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:57:53.424501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:53.424970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:57:53.435289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:53.435921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:53.442592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:53.442592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:53.442991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:53.509356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:53.867860 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9bee92a5-7772-446d-a0bd-962907a7d957 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.746596 Oct 19 06:57:53.877429 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1026/2057] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:57:53.918212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:53.918838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:54.004287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:54.004551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:54.004929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:54.005656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:54.020232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:54.020801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:54.496842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:54.520765 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dca15a03-0614-4b20-9ce0-c6c6668a9b86 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1319 microversion: 2.1 time: 0.633769 Oct 19 06:57:54.521459 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1027/2058] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:53 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1319 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:54.561629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a729242-6e06-4fcb-8a65-086ba5b7380a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68a93b80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:54.759776 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a729242-6e06-4fcb-8a65-086ba5b7380a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.208697 Oct 19 06:57:54.759776 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1028/2059] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:54 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:54.759776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd18be36-e657-4960-b68a-a10dc12fd8e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:54.759776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd18be36-e657-4960-b68a-a10dc12fd8e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:55.068044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:55.111413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:55.118052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:55.121846 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7aa7561-e960-45b1-aa2e-ba67e961ec5d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 1.735692 Oct 19 06:57:55.125917 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1032/2060] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:53 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:55.135785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:55.139172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:55.148856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:55.155560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:55.155560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:55.155560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:55.155560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:55.155560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:55.208594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd18be36-e657-4960-b68a-a10dc12fd8e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:55.216749 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd18be36-e657-4960-b68a-a10dc12fd8e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1221 microversion: 2.1 time: 0.476362 Oct 19 06:57:55.224723 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1029/2061] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:54 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1221 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:55.459684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-79e7ddbe-dbdb-427b-ab72-2364e823f447 req-9e613391-939f-4a67-a729-a60eaff78245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c979c511-6f7d-4d9b-8987-9862804d3a38", "name": "network-vif-unplugged", "status": "completed", "tag": "1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:55.494804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79e7ddbe-dbdb-427b-ab72-2364e823f447 req-9e613391-939f-4a67-a729-a60eaff78245 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:55.504705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79e7ddbe-dbdb-427b-ab72-2364e823f447 req-9e613391-939f-4a67-a729-a60eaff78245 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:55.505417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79e7ddbe-dbdb-427b-ab72-2364e823f447 req-9e613391-939f-4a67-a729-a60eaff78245 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:55.564822 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-79e7ddbe-dbdb-427b-ab72-2364e823f447 req-9e613391-939f-4a67-a729-a60eaff78245 service nova] Creating event network-vif-unplugged:1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9 for instance c979c511-6f7d-4d9b-8987-9862804d3a38 on n-h2-861333-10 Oct 19 06:57:55.582780 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-79e7ddbe-dbdb-427b-ab72-2364e823f447 req-9e613391-939f-4a67-a729-a60eaff78245 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124875 Oct 19 06:57:55.591780 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1030/2062] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:57:55.607830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:55.611119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:55.645423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:55.648467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:55.648979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:55.650581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:55.651083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:55.651545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:55.844846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:55.845356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:55.845809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:55.846270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lazy-loading 'fault' on Instance uuid d231a12d-b118-41ec-b9e2-f987bea670ba {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:57:55.885278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:55.897838 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53b5d0a8-22b0-4705-a666-4dd67dd5d126 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1529 microversion: 2.1 time: 0.765807 Oct 19 06:57:55.899530 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1033/2063] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:55 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1529 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:55.928038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd10ed3c-60d7-404c-b545-e0d974c3ff8c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68b3eb80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:56.068048 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd10ed3c-60d7-404c-b545-e0d974c3ff8c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.167126 Oct 19 06:57:56.070026 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1034/2064] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:55 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:56.085760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:56.095940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:56.128500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:56.129411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:56.137021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:56.138145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:56.143717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:56.144569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:56.452097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:56.465749 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63c805f7-0909-4673-8f3a-8ab434c5c2d6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1529 microversion: 2.1 time: 0.394428 Oct 19 06:57:56.466348 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1035/2065] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:56 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1529 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:56.473041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:56.475655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:56.492752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:56.493553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:56.494435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:56.495320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:56.495942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:56.498474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:56.558419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:56.599771 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5094a7a-9ace-4ca8-8c3e-8ec090aeeedd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 200 len: 1324 microversion: 2.1 time: 1.009108 Oct 19 06:57:56.613978 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1031/2066] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:55 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 1324 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:56.634820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:56.635456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:56.685209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:56.685736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:56.686196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:56.692668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:56.695974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:56.695974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:57.064018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:57.078003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:57.081385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:57.082797 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fea12a0-e991-45c2-b3aa-e1530f7ba1e2 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.615339 Oct 19 06:57:57.083538 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1036/2067] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:56 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:57:57.088363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11029c33-5297-4726-9bb1-a13cd16fdb1f tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:57.094798 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-11029c33-5297-4726-9bb1-a13cd16fdb1f tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] HTTP exception thrown: Flavor ba881663-0df0-4881-94b9-0584868e985b could not be found. Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11029c33-5297-4726-9bb1-a13cd16fdb1f tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Request method failure captured: Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/flavors/ba881663-0df0-4881-94b9-0584868e985b HTTP/1.1 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57690DZOurOQGb2rjfAFY7VQoENVLfaZ34qR5d5ywKS_PevxSKvuBMa6ADvqzhwkzo1IwumLby8CfugFOiCnVVY6xldBiGORbXQS5F0Jzzrzsz4x15xqtfRsFh4Lyh-SOcZWD746QKpiXCusaAiF2n4rpVlyJN1KSFsizOtLWtaSAM Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 493dfc15cb08458ba24012ec7f0949e1 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-MigrationsAdminTest-1719357456 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/493dfc15cb08458ba24012ec7f0949e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/493dfc15cb08458ba24012ec7f0949e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/493dfc15cb08458ba24012ec7f0949e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_493dfc15cb08458ba24012ec7f0949e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-MigrationsAdminTest-1719357456 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 493dfc15cb08458ba24012ec7f0949e1 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MigrationsAdminTest-1719357456 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-MigrationsAdminTest-1719357456-project-admin Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 015a9e0e3237439d83ab05470bcc14a2 Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-MigrationsAdminTest-1719357456-project-admin Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: exception: Flavor ba881663-0df0-4881-94b9-0584868e985b could not be found. Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'ba881663-0df0-4881-94b9-0584868e985b'} Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ba881663-0df0-4881-94b9-0584868e985b could not be found. Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ba881663-0df0-4881-94b9-0584868e985b could not be found. Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.102002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:57.108611 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.108611 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:57.108611 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:57.108611 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:57.108611 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:57.108611 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:57.108611 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ba881663-0df0-4881-94b9-0584868e985b could not be found. Oct 19 06:57:57.108611 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.108611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11029c33-5297-4726-9bb1-a13cd16fdb1f tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Returning 404 to user: Flavor ba881663-0df0-4881-94b9-0584868e985b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:57.109383 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11029c33-5297-4726-9bb1-a13cd16fdb1f tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/ba881663-0df0-4881-94b9-0584868e985b" status: 404 len: 109 microversion: 2.1 time: 0.018949 Oct 19 06:57:57.110649 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1037/2068] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:57:57 2022] DELETE /compute/v2.1/flavors/ba881663-0df0-4881-94b9-0584868e985b => generated 109 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:57.128902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8dd47245-0933-49e1-8271-03621e3bf1b3 req-7958d7e1-1d71-4038-84d9-a1ba3cbc5d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d3b7f20-85db-4e78-bb43-118ccd5ef401", "tag": "0404710e-510e-48fa-be5e-029723586840"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:57.174641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8dd47245-0933-49e1-8271-03621e3bf1b3 req-7958d7e1-1d71-4038-84d9-a1ba3cbc5d63 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:57.177170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8dd47245-0933-49e1-8271-03621e3bf1b3 req-7958d7e1-1d71-4038-84d9-a1ba3cbc5d63 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:57.178534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8dd47245-0933-49e1-8271-03621e3bf1b3 req-7958d7e1-1d71-4038-84d9-a1ba3cbc5d63 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:57.196335 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8dd47245-0933-49e1-8271-03621e3bf1b3 req-7958d7e1-1d71-4038-84d9-a1ba3cbc5d63 service nova] Creating event network-changed:0404710e-510e-48fa-be5e-029723586840 for instance 4d3b7f20-85db-4e78-bb43-118ccd5ef401 on n-h1-861333-10 Oct 19 06:57:57.202978 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8dd47245-0933-49e1-8271-03621e3bf1b3 req-7958d7e1-1d71-4038-84d9-a1ba3cbc5d63 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090844 Oct 19 06:57:57.203943 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1038/2069] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:57.204881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:57.210535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35c8b53f-e6cd-43f4-843e-6280a9642db8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68bb4b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:57.218693 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31d138d6-8975-4ad7-9681-0b3f4ec73057 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1217 microversion: 2.1 time: 0.603494 Oct 19 06:57:57.227090 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1032/2070] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:56 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1217 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:57.305273 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35c8b53f-e6cd-43f4-843e-6280a9642db8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.099705 Oct 19 06:57:57.307110 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1039/2071] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:57 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:57.372023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1936548336", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:57.570814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:57:57.630063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:57.632330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: d231a12d-b118-41ec-b9e2-f987bea670ba] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:57.645208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:57.648441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:57.649255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:57.651267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:57.655306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:57.656090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:57.686483 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] HTTP exception thrown: Instance d231a12d-b118-41ec-b9e2-f987bea670ba could not be found. Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Request method failure captured: Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba HTTP/1.1 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54oPsNQQYwaBbbQV2-8_IdFne9c0nZQAH-3Z085CI2tiqa74XebS94m6AQYixlRuiX-T_Oeguf6BA4L3NIg9tMDrad86Fnd_qYcF-4DNyHmZ_mNM1A6OWvviC1aLoAE5I0qaKybmyvmklwJqIOiIBorI9G7oOO8GYVNoti5GPMwrPE Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: bdca3d9567f34867aa0d9d4489001792 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveMigrationTest-93923442 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdca3d9567f34867aa0d9d4489001792", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-LiveMigrationTest-93923442 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: bdca3d9567f34867aa0d9d4489001792 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveMigrationTest-93923442 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-LiveMigrationTest-93923442-project Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f67e466b1aa04d2cbafdbd390c178215 Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-LiveMigrationTest-93923442-project Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance d231a12d-b118-41ec-b9e2-f987bea670ba could not be found. Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'd231a12d-b118-41ec-b9e2-f987bea670ba'} Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d231a12d-b118-41ec-b9e2-f987bea670ba could not be found. Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d231a12d-b118-41ec-b9e2-f987bea670ba could not be found. Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:57:57.690789 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.700556 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:57:57.700556 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:57:57.700556 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:57:57.700556 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:57:57.700556 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:57:57.700556 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d231a12d-b118-41ec-b9e2-f987bea670ba could not be found. Oct 19 06:57:57.700556 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:57:57.701665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Returning 404 to user: Instance d231a12d-b118-41ec-b9e2-f987bea670ba could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:57:57.703732 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bbb42542-3306-4b56-a6cb-10cf33559520 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba" status: 404 len: 111 microversion: 2.1 time: 0.079612 Oct 19 06:57:57.705351 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1040/2072] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:57 2022] GET /compute/v2.1/servers/d231a12d-b118-41ec-b9e2-f987bea670ba => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:57:57.712957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-68cbe794-27fc-40e7-8325-7acfbcd7c746 req-65d22c0a-cc0e-4f16-9eca-fa0a6c74b182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c979c511-6f7d-4d9b-8987-9862804d3a38", "tag": "1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:57.726563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-68cbe794-27fc-40e7-8325-7acfbcd7c746 req-65d22c0a-cc0e-4f16-9eca-fa0a6c74b182 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:57.727434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-68cbe794-27fc-40e7-8325-7acfbcd7c746 req-65d22c0a-cc0e-4f16-9eca-fa0a6c74b182 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:57.728233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-68cbe794-27fc-40e7-8325-7acfbcd7c746 req-65d22c0a-cc0e-4f16-9eca-fa0a6c74b182 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:57.751164 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-68cbe794-27fc-40e7-8325-7acfbcd7c746 req-65d22c0a-cc0e-4f16-9eca-fa0a6c74b182 service nova] Creating event network-changed:1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9 for instance c979c511-6f7d-4d9b-8987-9862804d3a38 on n-h2-861333-10 Oct 19 06:57:57.757791 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-68cbe794-27fc-40e7-8325-7acfbcd7c746 req-65d22c0a-cc0e-4f16-9eca-fa0a6c74b182 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050221 Oct 19 06:57:57.758831 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1041/2073] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:57:57.768422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c861c1df-7e3a-4c74-b584-8b9fe53776dd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '.version_select at 0x7f6d647b9f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:57.901993 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c861c1df-7e3a-4c74-b584-8b9fe53776dd tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-184332789" status: 202 len: 0 microversion: 2.1 time: 0.139183 Oct 19 06:57:57.906058 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1042/2074] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 06:57:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-184332789 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:57:58.117819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:58.118628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:58.138718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:58.143859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:58.144713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:58.150233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:58.150808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:58.151260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:58.267546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:57:59.322133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:59.333147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:59.333147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:59.346235 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dacd6e43-7752-4205-ac01-5fb429b691af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 1.233384 Oct 19 06:57:59.346828 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1043/2075] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:57:58 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:57:59.357813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:59.358447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:57:59.388899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:59.396422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:59.408597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:59.408597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:59.408597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:59.408597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:59.557173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:57:59.569594 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e62398f1-02dc-412f-902e-3db59444a5ed tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1279 microversion: 2.1 time: 0.221655 Oct 19 06:57:59.588067 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1044/2076] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:57:59 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:59.597353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-56d52caf-7d88-4083-a947-b3a189cd4c53 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64774f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:57:59.645623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:57:59.646821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:57:59.647744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:57:59.648538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:57:59.649323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:57:59.700424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:59.702791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:59.710807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:59.718668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:59.718668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:59.718668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:59.743631 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-56d52caf-7d88-4083-a947-b3a189cd4c53 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.157131 Oct 19 06:57:59.746833 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1045/2077] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:57:59 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:57:59.759464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:57:59.761300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-19920b55-727b-4dab-8614-966797c8aa9e req-370021a5-0bc2-4e8f-bb5d-f08730ec1af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327ba1a3-a8b5-41c4-b255-1fe00ce5f005", "name": "network-vif-plugged", "status": "completed", "tag": "d625756d-d7ae-40fb-a597-39024348ca41"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:57:59.767340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Getting quotas for user 631a2a90a44a40b2bd751a4feaf69d0f and project d80c925de0b447909ae6fbfe56e61dda. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:57:59.782544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-19920b55-727b-4dab-8614-966797c8aa9e req-370021a5-0bc2-4e8f-bb5d-f08730ec1af6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:57:59.783069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-19920b55-727b-4dab-8614-966797c8aa9e req-370021a5-0bc2-4e8f-bb5d-f08730ec1af6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:57:59.783769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-19920b55-727b-4dab-8614-966797c8aa9e req-370021a5-0bc2-4e8f-bb5d-f08730ec1af6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:57:59.794370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:57:59.798615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:57:59.806805 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-19920b55-727b-4dab-8614-966797c8aa9e req-370021a5-0bc2-4e8f-bb5d-f08730ec1af6 service nova] Creating event network-vif-plugged:d625756d-d7ae-40fb-a597-39024348ca41 for instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 on n-h1-861333-10 Oct 19 06:57:59.818799 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-19920b55-727b-4dab-8614-966797c8aa9e req-370021a5-0bc2-4e8f-bb5d-f08730ec1af6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060997 Oct 19 06:57:59.823383 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1046/2078] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:00.021634 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e4c5166-966f-4638-b47d-07733167a93c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.656700 Oct 19 06:58:00.028068 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1033/2079] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:58:00.034595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-77e40933-8377-48d6-b147-6db5e48f2375 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:00.035333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-77e40933-8377-48d6-b147-6db5e48f2375 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:00.266042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77e40933-8377-48d6-b147-6db5e48f2375 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:00.277839 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-77e40933-8377-48d6-b147-6db5e48f2375 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1213 microversion: 2.1 time: 0.247332 Oct 19 06:58:00.280022 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1047/2080] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:00 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1213 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:00.379124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:00.379699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:00.396379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:00.396808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:00.397266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:00.411747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:00.412311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:00.412770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:00.597702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:00.598327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:00.606568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:00.607069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:00.619588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:00.621977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:00.622898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:00.626502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:00.843084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:00.858128 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7971afa-594b-4205-a0ad-12952c7eb0b3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1279 microversion: 2.1 time: 0.264187 Oct 19 06:58:00.879300 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1048/2081] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:00 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1279 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:00.887291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7f2e4fd-07bf-4085-bbb0-d7e85ee6c925 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d645bcc10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:00.984676 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7f2e4fd-07bf-4085-bbb0-d7e85ee6c925 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.104043 Oct 19 06:58:00.993546 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1049/2082] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:58:00 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:01.106485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-859ba3dc-dc6c-4623-b91e-289618cf20d8 req-3a6a1b63-2f8f-4c3f-a81f-79fc57816170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19d2a23-24c7-4a4f-95c4-8b64f4519cd6", "tag": "00462ba1-6947-4079-8eca-16f73bbb2f23"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:01.125292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-859ba3dc-dc6c-4623-b91e-289618cf20d8 req-3a6a1b63-2f8f-4c3f-a81f-79fc57816170 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:01.126197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-859ba3dc-dc6c-4623-b91e-289618cf20d8 req-3a6a1b63-2f8f-4c3f-a81f-79fc57816170 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:01.127907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-859ba3dc-dc6c-4623-b91e-289618cf20d8 req-3a6a1b63-2f8f-4c3f-a81f-79fc57816170 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:01.160257 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-859ba3dc-dc6c-4623-b91e-289618cf20d8 req-3a6a1b63-2f8f-4c3f-a81f-79fc57816170 service nova] Creating event network-changed:00462ba1-6947-4079-8eca-16f73bbb2f23 for instance a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 on n-h2-861333-10 Oct 19 06:58:01.172169 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-859ba3dc-dc6c-4623-b91e-289618cf20d8 req-3a6a1b63-2f8f-4c3f-a81f-79fc57816170 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069260 Oct 19 06:58:01.173937 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1050/2083] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:58:01.304941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:01.305654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:01.317855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:01.322813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:01.323451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:01.324268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:01.326918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:01.327428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:01.551218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:01.587647 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a7ff5979-059d-4d72-a024-fe4914debaf2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1217 microversion: 2.1 time: 0.286326 Oct 19 06:58:01.590795 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1051/2084] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:01 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1217 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:01.895963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:01.896678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:01.911958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:01.913603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:01.914126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:01.915036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:01.915504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:01.915942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:02.062873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:02.095049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:02.109110 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c30a15c-0077-4838-8dbf-5bb747baedb7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1279 microversion: 2.1 time: 0.218144 Oct 19 06:58:02.109914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:02.110256 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1052/2085] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:01 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:02.115972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:02.118315 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94ff1b1a-4afa-4654-abc1-d6bc11a6dfae tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 1.746206 Oct 19 06:58:02.122126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d5fb9ec-b057-40ee-a21f-fbc378590480 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64774160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:02.161487 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1034/2086] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:00 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:02.211481 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d5fb9ec-b057-40ee-a21f-fbc378590480 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.094424 Oct 19 06:58:02.213594 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1053/2087] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:58:02 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:02.619994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:02.622459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:02.639758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:02.643167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:02.650979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:02.652745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:02.653403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:02.654017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:03.106574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:03.127181 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b99b65ab-2fd2-40b9-b180-077d0f9c6264 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1265 microversion: 2.1 time: 0.511210 Oct 19 06:58:03.128033 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1035/2088] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:02 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1265 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:03.138118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:03.139437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:03.156404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:03.159145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:03.160625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:03.163472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:03.163957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:03.164086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:03.164790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:03.166045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:03.178067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:03.178518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:03.179090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:03.181070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:03.181556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:03.182002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:03.504589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:03.527222 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a54982c5-69c5-4315-b3dd-f5d381bcadd3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1279 microversion: 2.1 time: 0.384912 Oct 19 06:58:03.530813 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1054/2089] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:03 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1279 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:03.557125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d7f437d-4c08-403a-b8ff-f5e43dba0a33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d647745e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:03.669015 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d7f437d-4c08-403a-b8ff-f5e43dba0a33 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.130742 Oct 19 06:58:03.679378 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1055/2090] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:58:03 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:03.872274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8024a6d3-fb5f-4ca4-a7d6-ef5949ab4437 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Action: 'create', calling method: .version_select at 0x7f6d64729820>, body: {"pool": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:03.910317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:03.922208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:03.935101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:03.942220 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f294c731-6c15-4b3d-bf28-9d4cdfa90d50 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.782461 Oct 19 06:58:03.948589 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1036/2091] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:03 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:58:03.972360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:03.973067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:04.003448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:04.007635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:04.011236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:04.016171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:04.016171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:04.016171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:04.073490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:58:04.722162 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb8d38e9-f41b-4b40-8bc9-9bf14b7dc78a tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 204 len: 0 microversion: 2.1 time: 0.771884 Oct 19 06:58:04.723163 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1037/2092] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:58:03 2022] DELETE /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:58:04.730288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:04.733051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:04.748561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:04.753853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:04.754929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:04.756806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:04.758736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:04.759725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:05.370494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:05.385756 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6d37427-3184-4096-a2a7-8735ff8a83c3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1271 microversion: 2.1 time: 0.660985 Oct 19 06:58:05.402924 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1038/2093] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:04 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1271 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:05.416345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1140188380", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fc75c467-80b0-4f75-b908-72b84f125d0c"}], "security_groups": [{"name": "tempest-securitygroup--1514730796"}], "key_name": "tempest-keypair-924072454", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:05.709093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] validate_networks() for [('fc75c467-80b0-4f75-b908-72b84f125d0c', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:58:07.395691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Getting quotas for project af5f1db3c5044e68bc7b8525196441dc. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:58:07.422776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Getting quotas for user 25848ed5bded46faa0176778a6eb100f and project af5f1db3c5044e68bc7b8525196441dc. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:58:07.457636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:58:07.462257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:58:07.463201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:58:07.463851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:58:07.464575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:58:07.491698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:07.493341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:07.497615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:07.498647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:07.499218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:07.499732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:07.551620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Getting quotas for project af5f1db3c5044e68bc7b8525196441dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:58:07.568046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Getting quotas for user 25848ed5bded46faa0176778a6eb100f and project af5f1db3c5044e68bc7b8525196441dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:58:07.599836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:58:07.607693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:58:07.848634 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5cfd2f4-c0e3-4850-bca4-a0181e6d15b6 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.442540 Oct 19 06:58:07.853621 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1039/2094] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:58:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:58:07.877562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:07.879229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:07.890886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:07.891416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:07.892409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:07.893136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:07.893598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:07.894033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:08.583006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:08.594593 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f4a061c-25ea-45e7-a6fc-9a2dee41ccfd tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1321 microversion: 2.1 time: 0.739259 Oct 19 06:58:08.614268 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1040/2095] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:07 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1321 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:08.624768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-699da074-0095-4ffa-9c8e-8add820fa03d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68a2cca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:08.748674 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-699da074-0095-4ffa-9c8e-8add820fa03d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.133180 Oct 19 06:58:08.749559 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1041/2096] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:58:08 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:08.767057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:08.776305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:08.807287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:08.816993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:08.817858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:08.820782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:08.824551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:08.826356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:09.308191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:09.323943 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea9f3b56-ec48-43c2-9588-5c4a9091d8bb tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1484 microversion: 2.1 time: 0.573083 Oct 19 06:58:09.324925 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1042/2097] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:08 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1484 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:09.345787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:09.347309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:09.362148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:09.362972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:09.363662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:09.364646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:09.365323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:09.365968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:09.851101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:09.865192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:09.870178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:09.881631 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cfa67b6-c95e-4d29-a34b-3d60c5c4f4de tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.535934 Oct 19 06:58:09.883151 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1043/2098] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:09 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:09.890517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b230e607-3269-4ff6-b57d-738b442593cf req-26dd7e85-2204-461a-ae09-829d45ef84fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3b7f20-85db-4e78-bb43-118ccd5ef401", "name": "network-vif-plugged", "status": "completed", "tag": "0404710e-510e-48fa-be5e-029723586840"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:09.912624 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8024a6d3-fb5f-4ca4-a7d6-ef5949ab4437 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.230538 Oct 19 06:58:09.921392 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1056/2099] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 06:58:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:09.926348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:09.928943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b230e607-3269-4ff6-b57d-738b442593cf req-26dd7e85-2204-461a-ae09-829d45ef84fc service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:09.932149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b230e607-3269-4ff6-b57d-738b442593cf req-26dd7e85-2204-461a-ae09-829d45ef84fc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:09.932826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:09.933094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b230e607-3269-4ff6-b57d-738b442593cf req-26dd7e85-2204-461a-ae09-829d45ef84fc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:09.956462 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b230e607-3269-4ff6-b57d-738b442593cf req-26dd7e85-2204-461a-ae09-829d45ef84fc service nova] Creating event network-vif-plugged:0404710e-510e-48fa-be5e-029723586840 for instance 4d3b7f20-85db-4e78-bb43-118ccd5ef401 on n-h1-861333-10 Oct 19 06:58:09.957834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:09.958452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:09.959055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:09.960573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:09.962649 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b230e607-3269-4ff6-b57d-738b442593cf req-26dd7e85-2204-461a-ae09-829d45ef84fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077639 Oct 19 06:58:09.963918 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1044/2100] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:09.964634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:09.973056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:09.973870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:09.975289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:10.017984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.020046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.020760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:10.021144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:10.024511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.026881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.028406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:10.150161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:10.163944 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3811f92d-69c3-4b33-b6f8-bc034060008f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1265 microversion: 2.1 time: 0.198000 Oct 19 06:58:10.166921 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1045/2101] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:09 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:10.174738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5cdeb7c2-bc84-47a3-a653-1f655a8ca088 req-7880be90-44c2-41c4-bbe6-f345c8cd9821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab2ea78-908d-4061-8e08-27b47f475760", "tag": "3a639a80-ec51-48cd-9023-5e4a4e7a5d2f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:10.190535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5cdeb7c2-bc84-47a3-a653-1f655a8ca088 req-7880be90-44c2-41c4-bbe6-f345c8cd9821 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.191490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5cdeb7c2-bc84-47a3-a653-1f655a8ca088 req-7880be90-44c2-41c4-bbe6-f345c8cd9821 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.194190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5cdeb7c2-bc84-47a3-a653-1f655a8ca088 req-7880be90-44c2-41c4-bbe6-f345c8cd9821 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:10.218738 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5cdeb7c2-bc84-47a3-a653-1f655a8ca088 req-7880be90-44c2-41c4-bbe6-f345c8cd9821 service nova] Creating event network-changed:3a639a80-ec51-48cd-9023-5e4a4e7a5d2f for instance 7ab2ea78-908d-4061-8e08-27b47f475760 on n-h1-861333-10 Oct 19 06:58:10.236457 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5cdeb7c2-bc84-47a3-a653-1f655a8ca088 req-7880be90-44c2-41c4-bbe6-f345c8cd9821 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057742 Oct 19 06:58:10.236457 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1046/2102] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:10.256804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:10.256804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:10.256804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.256804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.256804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:10.296482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:10.296874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.296874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.296874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:10.473312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:10.475912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:10.484376 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4692ad6-ffa1-4ee5-93b0-b7bce2df54e0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1321 microversion: 2.1 time: 0.254660 Oct 19 06:58:10.485366 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1047/2103] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:10 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:10.490661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c6c7758-b6cf-40ae-a357-7afed72e9c1d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68a6d940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:10.549561 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c6c7758-b6cf-40ae-a357-7afed72e9c1d tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1412 microversion: 2.1 time: 0.062881 Oct 19 06:58:10.550207 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1048/2104] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:58:10 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:10.562567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce992ccd-5011-4fa0-a719-88c24bbdb123 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Action: 'create', calling method: .version_select at 0x7f6d68a565e0>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:10.577572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:10.589065 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c18e57f-8169-40ef-a75c-3b0a1730b07b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1313 microversion: 2.1 time: 0.666389 Oct 19 06:58:10.611174 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1057/2105] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:09 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:10.611174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:10.611174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:10.611174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.611174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.611174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:10.611174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.611174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.611174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:10.729532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:10.741613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b645436-4f5d-4f67-8539-87a1a4b642c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 200 len: 1442 microversion: 2.1 time: 0.148360 Oct 19 06:58:10.742234 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1058/2106] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:10 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 1442 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:10.756303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ab08988f-f13c-446b-bb07-6f1fb67ae62e req-e47f8936-9ff6-44b9-a16f-e950c633c6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a33734-978d-4ec5-8a10-062f8208e013", "name": "network-vif-deleted", "tag": "8f191a47-185e-4db5-97b0-9f273b9ba3c8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:10.801928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab08988f-f13c-446b-bb07-6f1fb67ae62e req-e47f8936-9ff6-44b9-a16f-e950c633c6ef service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.806365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab08988f-f13c-446b-bb07-6f1fb67ae62e req-e47f8936-9ff6-44b9-a16f-e950c633c6ef service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.807116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab08988f-f13c-446b-bb07-6f1fb67ae62e req-e47f8936-9ff6-44b9-a16f-e950c633c6ef service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:10.842941 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ab08988f-f13c-446b-bb07-6f1fb67ae62e req-e47f8936-9ff6-44b9-a16f-e950c633c6ef service nova] Creating event network-vif-deleted:8f191a47-185e-4db5-97b0-9f273b9ba3c8 for instance f1a33734-978d-4ec5-8a10-062f8208e013 on n-h2-861333-10 Oct 19 06:58:10.859654 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ab08988f-f13c-446b-bb07-6f1fb67ae62e req-e47f8936-9ff6-44b9-a16f-e950c633c6ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112192 Oct 19 06:58:10.861447 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1059/2107] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:10.920076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:10.921393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:10.936295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.937101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.937718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:10.940035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:10.940718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:10.941784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:11.796693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:11.809783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:11.812533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:11.819737 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a290bcd-414f-41b9-a230-94290bf5e110 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.910885 Oct 19 06:58:11.822297 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1060/2108] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:10 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:11.838561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:11.839612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:11.888055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:11.929364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:11.929364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:11.929364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:11.929364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:11.929364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:12.007547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:12.017137 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5238c233-8077-4834-bf9a-38bc629afe86 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1321 microversion: 2.1 time: 0.192694 Oct 19 06:58:12.033162 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1061/2109] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:11 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:12.039641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:12.040439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:12.065588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:12.066271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:12.066946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:12.069230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:12.070540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:12.072250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:12.340179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:12.394450 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cfad8391-d6ec-47f3-952b-33ff074b991d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1321 microversion: 2.1 time: 0.359659 Oct 19 06:58:12.399475 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1062/2110] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:12 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:12.417599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d44cbbc-1154-47c2-ba40-9f2a726bcf6b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68b3e1f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:12.506213 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d44cbbc-1154-47c2-ba40-9f2a726bcf6b tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1421 microversion: 2.1 time: 0.104773 Oct 19 06:58:12.508675 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1063/2111] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:58:12 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:12.529510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:12.531785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:12.548455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:12.548970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:12.550675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:12.550675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:12.550675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:12.551262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.424070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:13.431931 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-294b8306-e8f7-434a-b6a7-f4bbe77429da tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1313 microversion: 2.1 time: 0.919704 Oct 19 06:58:13.447433 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1064/2112] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:12 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1313 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:13.452744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:13.453509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: f1a33734-978d-4ec5-8a10-062f8208e013] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:13.460457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.461226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.461892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.462862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.463689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.464402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.479182 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] HTTP exception thrown: Instance f1a33734-978d-4ec5-8a10-062f8208e013 could not be found. Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Request method failure captured: Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 HTTP/1.1 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54oPsNQQYwaBbbQV2-8_IdFne9c0nZQAH-3Z085CI2tiqa74XebS94m6AQYixlRuiX-T_Oeguf6BA4L3NIg9tMDrad86Fnd_qYcF-4DNyHmZ_mNM1A6OWvviC1aLoAE5I0qaKybmyvmklwJqIOiIBorI9G7oOO8GYVNoti5GPMwrPE Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: bdca3d9567f34867aa0d9d4489001792 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveMigrationTest-93923442 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdca3d9567f34867aa0d9d4489001792", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-LiveMigrationTest-93923442 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: bdca3d9567f34867aa0d9d4489001792 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveMigrationTest-93923442 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-LiveMigrationTest-93923442-project Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f67e466b1aa04d2cbafdbd390c178215 Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-LiveMigrationTest-93923442-project Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance f1a33734-978d-4ec5-8a10-062f8208e013 could not be found. Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'f1a33734-978d-4ec5-8a10-062f8208e013'} Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a33734-978d-4ec5-8a10-062f8208e013 could not be found. Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a33734-978d-4ec5-8a10-062f8208e013 could not be found. Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:13.480996 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:13.486660 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:13.486660 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:13.486660 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:13.486660 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:58:13.486660 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:58:13.486660 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a33734-978d-4ec5-8a10-062f8208e013 could not be found. Oct 19 06:58:13.486660 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:13.488241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Returning 404 to user: Instance f1a33734-978d-4ec5-8a10-062f8208e013 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:13.489457 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a75bd58-0254-45cb-b1c3-6da2ca440323 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013" status: 404 len: 111 microversion: 2.1 time: 0.040581 Oct 19 06:58:13.490128 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1065/2113] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:13 2022] GET /compute/v2.1/servers/f1a33734-978d-4ec5-8a10-062f8208e013 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:58:13.495221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6ce43ac-8970-4cd5-8065-cf715c47dffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64729f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:13.552341 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6ce43ac-8970-4cd5-8065-cf715c47dffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 200 len: 1421 microversion: 2.1 time: 0.060866 Oct 19 06:58:13.552919 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1066/2114] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:58:13 2022] GET /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 1421 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:13.557617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:13.558583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:13.565184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.565675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.570373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.570373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.570373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.570373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.828032 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce992ccd-5011-4fa0-a719-88c24bbdb123 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.274753 Oct 19 06:58:13.830214 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1049/2115] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 06:58:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:13.835371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b61a5cbe-619f-4723-ad22-9b05a9596c87 req-8044cb15-1b5e-48c0-a5e1-a02f3c58e152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19d2a23-24c7-4a4f-95c4-8b64f4519cd6", "name": "network-vif-plugged", "status": "completed", "tag": "00462ba1-6947-4079-8eca-16f73bbb2f23"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:13.847869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b61a5cbe-619f-4723-ad22-9b05a9596c87 req-8044cb15-1b5e-48c0-a5e1-a02f3c58e152 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.848503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b61a5cbe-619f-4723-ad22-9b05a9596c87 req-8044cb15-1b5e-48c0-a5e1-a02f3c58e152 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.849618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b61a5cbe-619f-4723-ad22-9b05a9596c87 req-8044cb15-1b5e-48c0-a5e1-a02f3c58e152 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.861031 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b61a5cbe-619f-4723-ad22-9b05a9596c87 req-8044cb15-1b5e-48c0-a5e1-a02f3c58e152 service nova] Creating event network-vif-plugged:00462ba1-6947-4079-8eca-16f73bbb2f23 for instance a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 on n-h2-861333-10 Oct 19 06:58:13.866270 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b61a5cbe-619f-4723-ad22-9b05a9596c87 req-8044cb15-1b5e-48c0-a5e1-a02f3c58e152 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034432 Oct 19 06:58:13.866877 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1050/2116] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:13.876327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:13.877119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:13.884616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.885350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.889352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.889352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.889352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.889352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.893233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:13.903519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:13.905265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:13.906724 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f33a61fa-d450-4e43-b56b-a411f68cd0f6 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1487 microversion: 2.25 time: 0.352553 Oct 19 06:58:13.927238 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1067/2117] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:13 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1487 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:13.933002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a0c89c6e-8c77-4c55-9d16-d14aea6c0b51 req-d7f65017-8bc8-478e-a261-1d42bcae265e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6467606f-c64d-4472-aeb1-4e30dbd9a9ab", "tag": "77095c95-cb01-4107-b1ee-3dbfefb01f4c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:13.943583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a0c89c6e-8c77-4c55-9d16-d14aea6c0b51 req-d7f65017-8bc8-478e-a261-1d42bcae265e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.944066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a0c89c6e-8c77-4c55-9d16-d14aea6c0b51 req-d7f65017-8bc8-478e-a261-1d42bcae265e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.944525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a0c89c6e-8c77-4c55-9d16-d14aea6c0b51 req-d7f65017-8bc8-478e-a261-1d42bcae265e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.957082 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a0c89c6e-8c77-4c55-9d16-d14aea6c0b51 req-d7f65017-8bc8-478e-a261-1d42bcae265e service nova] Creating event network-changed:77095c95-cb01-4107-b1ee-3dbfefb01f4c for instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab on n-h2-861333-10 Oct 19 06:58:13.961978 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a0c89c6e-8c77-4c55-9d16-d14aea6c0b51 req-d7f65017-8bc8-478e-a261-1d42bcae265e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033284 Oct 19 06:58:13.962569 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1068/2118] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:13.967672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:13.968536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:13.975121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.975775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.976240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:13.976941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:13.977394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:13.977817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:14.010175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:14.021378 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0268795-a908-4952-864d-d75ec2023796 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1327 microversion: 2.1 time: 0.148855 Oct 19 06:58:14.022912 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1051/2119] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:13 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1327 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:14.034937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:14.035718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:14.045908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:14.046708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:14.047319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:14.050268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:14.050972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:14.051604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:14.110110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:58:14.294018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:14.305195 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf47a67c-8b84-46ee-8270-a5253b6e241c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1321 microversion: 2.1 time: 0.341124 Oct 19 06:58:14.307145 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1069/2120] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:13 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:14.322450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2051516745", "imageRef": "570a689e-c143-48d7-bfc1-4a9a075a58c1", "flavorRef": "452", "networks": [{"uuid": "e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:14.379866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] validate_networks() for [('e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:58:14.540502 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2091f75-9c68-4b17-8492-e0390988d6c0 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 204 len: 0 microversion: 2.1 time: 0.513948 Oct 19 06:58:14.546311 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1052/2121] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:58:14 2022] DELETE /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:58:14.572088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cff84e6-ee54-4c3a-9003-44792dacdf2c tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Action: 'create', calling method: .version_select at 0x7f6d68b8cee0>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:15.130201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:58:15.131532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:58:15.132239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:58:15.132657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:58:15.133076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:58:15.143487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:15.144343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:15.144456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:15.145151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:15.145831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:15.146387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:15.165902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:58:15.171526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for user f5b2575fb29940ab95fc8bb9dd177dd9 and project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:58:15.186661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:58:15.189233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='570a689e-c143-48d7-bfc1-4a9a075a58c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:58:15.358364 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1263b8ac-b576-4789-bcc9-8ba6e3e1a941 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049914 Oct 19 06:58:15.359001 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1070/2122] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:58:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:58:15.378207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:15.379485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:15.388992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:15.389498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:15.390043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:15.390816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:15.391349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:15.392355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:15.644676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:15.654249 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a0864d8-db6e-436c-b5b3-903f6f855c4e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1313 microversion: 2.1 time: 0.294190 Oct 19 06:58:15.654839 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1071/2123] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:15 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:15.661004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:15.661814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:15.675078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:15.681586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:15.688091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:15.688091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:15.688091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:15.688091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:15.866061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:15.878454 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b28a9087-713a-4396-bb2e-524da7c8ae1f tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1499 microversion: 2.1 time: 0.221408 Oct 19 06:58:15.879032 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1072/2124] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:15 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1499 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:15.887496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:15.887496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:15.895408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:15.895901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:15.896951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:15.897315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:15.897957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:15.898596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:16.121455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:16.130653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:16.132138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:16.133614 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b8bfa16-a31b-4eaf-8023-1fef4d25539a tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1477 microversion: 2.25 time: 0.253165 Oct 19 06:58:16.134182 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1073/2125] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:15 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1477 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:16.152191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:16.152191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:16.152191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:16.152191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:16.152191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:16.152191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:16.152191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:16.152191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:16.433543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:16.445966 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04a15182-3c5a-4d0d-803d-7c8485f7f18e tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1395 microversion: 2.1 time: 0.310373 Oct 19 06:58:16.446568 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1074/2126] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:16 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1395 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:16.469393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:16.473027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:16.481055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:16.481979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:16.482660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:16.483822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:16.484562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:16.486276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:16.771045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:16.779755 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8c7ca3e-4d51-4683-8c00-fa388ec7191c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1321 microversion: 2.1 time: 0.332098 Oct 19 06:58:16.783929 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1075/2127] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:16 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:16.795314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:16.796573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:16.811984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:16.812734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:16.813893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:16.816416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:16.816892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:16.817363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:16.925860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:16.936967 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ff3dacb-3e35-4d9a-9b99-d0f8c7347dc7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1212 microversion: 2.1 time: 0.151701 Oct 19 06:58:16.942114 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1076/2128] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:16 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1212 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:17.039730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1248843229", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "9e8a498f-1e98-47fb-92fa-47fd5d4c664f"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:17.064673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:17.134566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] validate_networks() for [('9e8a498f-1e98-47fb-92fa-47fd5d4c664f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:58:17.526013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:17.587632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=36 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:17.763416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:58:17.764540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:58:17.765260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:58:17.765870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:58:17.767771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:58:17.790344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:17.791363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:17.792076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:17.793096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:17.793821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:17.794495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:17.819481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Getting quotas for project 8fd6bbb748b5440fb72fb253477b4180. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:58:17.825827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Getting quotas for user 2fe41984e17744dfa71d2ce82d1023e3 and project 8fd6bbb748b5440fb72fb253477b4180. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:58:17.851214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:58:17.853669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:58:17.989166 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-354ae845-3f74-4a46-9afc-3dc3c99c2c7f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050514 Oct 19 06:58:17.996687 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1077/2129] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:58:18.020581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-93772c8e-ff21-47fb-b111-7a0a31d62be8 req-7c4c0906-5077-4479-9824-1818b2f56a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab2ea78-908d-4061-8e08-27b47f475760", "name": "network-vif-plugged", "status": "completed", "tag": "3a639a80-ec51-48cd-9023-5e4a4e7a5d2f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:18.043924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93772c8e-ff21-47fb-b111-7a0a31d62be8 req-7c4c0906-5077-4479-9824-1818b2f56a61 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.046085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93772c8e-ff21-47fb-b111-7a0a31d62be8 req-7c4c0906-5077-4479-9824-1818b2f56a61 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.046693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93772c8e-ff21-47fb-b111-7a0a31d62be8 req-7c4c0906-5077-4479-9824-1818b2f56a61 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.067383 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-93772c8e-ff21-47fb-b111-7a0a31d62be8 req-7c4c0906-5077-4479-9824-1818b2f56a61 service nova] Creating event network-vif-plugged:3a639a80-ec51-48cd-9023-5e4a4e7a5d2f for instance 7ab2ea78-908d-4061-8e08-27b47f475760 on n-h1-861333-10 Oct 19 06:58:18.073011 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-93772c8e-ff21-47fb-b111-7a0a31d62be8 req-7c4c0906-5077-4479-9824-1818b2f56a61 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062832 Oct 19 06:58:18.074412 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1078/2130] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:18.081201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b7b2339-bcba-4b98-ad27-8f0dcca7ca88 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '.version_select at 0x7f6d64ab7e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:18.085124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b7b2339-bcba-4b98-ad27-8f0dcca7ca88 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.085987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b7b2339-bcba-4b98-ad27-8f0dcca7ca88 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.086621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b7b2339-bcba-4b98-ad27-8f0dcca7ca88 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.114706 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b7b2339-bcba-4b98-ad27-8f0dcca7ca88 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 3415 microversion: 2.25 time: 0.037446 Oct 19 06:58:18.115817 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1079/2131] 10.222.0.39 () {60 vars in 1184 bytes} [Wed Oct 19 06:58:18 2022] GET /compute/v2.1/os-migrations => generated 3415 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:18.121225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:18.122218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:18.130698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.131195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.131638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.132409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.132863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.133477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.156823 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5cff84e6-ee54-4c3a-9003-44792dacdf2c tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.607337 Oct 19 06:58:18.157467 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1053/2132] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 06:58:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:18.171010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5cd4ff62-4eb9-45a2-8091-979d313f9736 req-5d3a7dd0-ab2c-4d72-9d1d-de6d926634d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf535c5e-75cc-4e86-a7d7-6866903c675c", "name": "network-vif-deleted", "tag": "dadfbd32-34d8-4d27-bbd2-6e23781bea92"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:18.178683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:18.198603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5cd4ff62-4eb9-45a2-8091-979d313f9736 req-5d3a7dd0-ab2c-4d72-9d1d-de6d926634d2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.199093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5cd4ff62-4eb9-45a2-8091-979d313f9736 req-5d3a7dd0-ab2c-4d72-9d1d-de6d926634d2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.199533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5cd4ff62-4eb9-45a2-8091-979d313f9736 req-5d3a7dd0-ab2c-4d72-9d1d-de6d926634d2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.247571 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5cd4ff62-4eb9-45a2-8091-979d313f9736 req-5d3a7dd0-ab2c-4d72-9d1d-de6d926634d2 service nova] Creating event network-vif-deleted:dadfbd32-34d8-4d27-bbd2-6e23781bea92 for instance cf535c5e-75cc-4e86-a7d7-6866903c675c on n-h1-861333-10 Oct 19 06:58:18.265945 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5cd4ff62-4eb9-45a2-8091-979d313f9736 req-5d3a7dd0-ab2c-4d72-9d1d-de6d926634d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103962 Oct 19 06:58:18.266156 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1054/2133] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:18.271729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:18.274630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:18.285174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.285732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.286182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.287068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.287568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.288144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.365033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:18.365940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.366448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.366889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.367374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:18.367718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lazy-loading 'fault' on Instance uuid cf535c5e-75cc-4e86-a7d7-6866903c675c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:58:18.374635 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42cffc8b-ff8b-4300-b667-134c74b9b44c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1313 microversion: 2.1 time: 0.257581 Oct 19 06:58:18.375526 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1080/2134] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:18 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:18.392334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:18.393260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:18.409971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.410442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.411100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.412032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.412683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.413295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.435553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67e466b1aa04d2cbafdbd390c178215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdca3d9567f34867aa0d9d4489001792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:18.446802 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d7454ce-ca68-4209-b705-69445719db04 tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 200 len: 1301 microversion: 2.1 time: 0.179088 Oct 19 06:58:18.451674 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1055/2135] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:18 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 1301 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:18.472606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:18.480332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:18.499501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.502196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.502196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.502841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.503336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.506031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.593511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:18.602440 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17c67a30-d044-4c6c-92ca-101376b57695 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1395 microversion: 2.1 time: 0.224993 Oct 19 06:58:18.603324 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1081/2136] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:18 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1395 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:18.643700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:18.644360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:18.662405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.668392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.668392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.668392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.668392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.668392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.742343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:18.752258 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa9d48b4-6220-48ec-9b38-2f6ad403647e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1321 microversion: 2.1 time: 0.295328 Oct 19 06:58:18.753486 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1056/2137] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:18 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:18.758189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0fded8c-b2f9-41d0-8476-e8ae2b4c2d69 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:18.764216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0fded8c-b2f9-41d0-8476-e8ae2b4c2d69 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:18.822588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0fded8c-b2f9-41d0-8476-e8ae2b4c2d69 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:18.831476 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0fded8c-b2f9-41d0-8476-e8ae2b4c2d69 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1225 microversion: 2.1 time: 0.076656 Oct 19 06:58:18.832386 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1057/2138] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:18 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:18.839318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:18.840357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:18.849425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.850447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.851215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:18.852304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:18.852808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:18.853401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:19.083064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] Lazy-loading 'services' on Instance uuid c979c511-6f7d-4d9b-8987-9862804d3a38 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:58:19.103535 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e94a9ac-2704-4f7b-bf68-32dbcf56b765 tempest-LiveAutoBlockMigrationV225Test-1839635418 tempest-LiveAutoBlockMigrationV225Test-1839635418-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1971 microversion: 2.25 time: 0.269358 Oct 19 06:58:19.104803 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1058/2139] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:18 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1971 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:19.109769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01b86235-8b39-4386-ae37-44c1e6895f10 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Action: 'create', calling method: .version_select at 0x7f6d68af79d0>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:19.180268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:19.197072 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-946da5cd-5450-407d-bbaa-c08f54f46946 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1268 microversion: 2.1 time: 0.557134 Oct 19 06:58:19.198261 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1082/2140] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:18 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1268 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:19.203215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:19.206851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:19.223962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:19.225171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:19.228526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:19.234156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:19.234156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:19.234156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:19.298970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:58:19.715682 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e53fe68-42d1-4641-81e8-2dc55188a8f3 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 204 len: 0 microversion: 2.25 time: 0.515862 Oct 19 06:58:19.716417 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1083/2141] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 06:58:19 2022] DELETE /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 06:58:19.721692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:19.722699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:19.736806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:19.737450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:19.738645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:19.739402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:19.739983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:19.740583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:19.983753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:20.007582 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2620f5f-8ba5-479b-93d5-d9ac6b189f11 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1313 microversion: 2.1 time: 0.289987 Oct 19 06:58:20.008220 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1084/2142] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:19 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:20.031614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:20.031614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] [instance: cf535c5e-75cc-4e86-a7d7-6866903c675c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:20.037640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:20.038139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:20.038660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:20.039648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:20.040049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:20.040503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:20.073134 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] HTTP exception thrown: Instance cf535c5e-75cc-4e86-a7d7-6866903c675c could not be found. Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Request method failure captured: Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c HTTP/1.1 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT54oPsNQQYwaBbbQV2-8_IdFne9c0nZQAH-3Z085CI2tiqa74XebS94m6AQYixlRuiX-T_Oeguf6BA4L3NIg9tMDrad86Fnd_qYcF-4DNyHmZ_mNM1A6OWvviC1aLoAE5I0qaKybmyvmklwJqIOiIBorI9G7oOO8GYVNoti5GPMwrPE Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: bdca3d9567f34867aa0d9d4489001792 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveMigrationTest-93923442 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdca3d9567f34867aa0d9d4489001792"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdca3d9567f34867aa0d9d4489001792", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-LiveMigrationTest-93923442 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: bdca3d9567f34867aa0d9d4489001792 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveMigrationTest-93923442 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-LiveMigrationTest-93923442-project Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f67e466b1aa04d2cbafdbd390c178215 Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-LiveMigrationTest-93923442-project Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance cf535c5e-75cc-4e86-a7d7-6866903c675c could not be found. Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'cf535c5e-75cc-4e86-a7d7-6866903c675c'} Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf535c5e-75cc-4e86-a7d7-6866903c675c could not be found. Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf535c5e-75cc-4e86-a7d7-6866903c675c could not be found. Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:20.076486 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:20.081819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:20.081819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:20.081819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:20.081819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:58:20.081819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:58:20.081819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf535c5e-75cc-4e86-a7d7-6866903c675c could not be found. Oct 19 06:58:20.081819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:20.085469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] Returning 404 to user: Instance cf535c5e-75cc-4e86-a7d7-6866903c675c could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:20.087938 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-78a8329b-09b0-4633-8249-f986af44e64e tempest-LiveMigrationTest-93923442 tempest-LiveMigrationTest-93923442-project] 10.222.0.39 "GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c" status: 404 len: 111 microversion: 2.1 time: 0.078752 Oct 19 06:58:20.091709 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1085/2143] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:20 2022] GET /compute/v2.1/servers/cf535c5e-75cc-4e86-a7d7-6866903c675c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:58:20.104606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:20.105632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:20.118451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:20.120081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:20.120081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:20.120372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:20.120904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:20.121337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:20.864720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:20.881207 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7af555cf-e550-4008-9f5d-f8f8bb5f1c6a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1395 microversion: 2.1 time: 0.786564 Oct 19 06:58:20.883205 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1086/2144] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:20 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1395 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:20.911925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:20.914023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:20.931577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:20.945550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:20.947639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:20.950312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:20.952386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:20.953760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:21.538635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:21.556852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:21.558892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:21.560693 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d63dc151-f7e4-41a1-bf1c-d6981e0cfdfc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1483 microversion: 2.25 time: 0.674385 Oct 19 06:58:21.576415 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1087/2145] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:20 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1483 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:21.588152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:21.588930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:21.595458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:21.595960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:21.596525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:21.597254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:21.597792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:21.598226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:21.858285 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01b86235-8b39-4386-ae37-44c1e6895f10 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.752158 Oct 19 06:58:21.875222 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1059/2146] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 06:58:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:21.881530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:21.882037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:21.904602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:21.905113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:21.905562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:21.908328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:21.908808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:21.909256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:22.073044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:22.082644 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a2a6893-b34a-443d-94ae-18402cbeb951 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1512 microversion: 2.1 time: 0.504621 Oct 19 06:58:22.088596 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1088/2147] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:21 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1512 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:22.111537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d91931e0-ae83-42f5-b2e8-fa6bbe07ee84 req-aec085d1-d8e8-4651-84ea-14f188ac7821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac94d23-f2b1-4845-8e83-16cdbd84ca27", "name": "network-vif-unplugged", "status": "completed", "tag": "c7d56b40-d00e-4dd3-902c-0debbf325b61"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:22.122231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d91931e0-ae83-42f5-b2e8-fa6bbe07ee84 req-aec085d1-d8e8-4651-84ea-14f188ac7821 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:22.123088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d91931e0-ae83-42f5-b2e8-fa6bbe07ee84 req-aec085d1-d8e8-4651-84ea-14f188ac7821 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:22.123744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d91931e0-ae83-42f5-b2e8-fa6bbe07ee84 req-aec085d1-d8e8-4651-84ea-14f188ac7821 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:22.136544 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d91931e0-ae83-42f5-b2e8-fa6bbe07ee84 req-aec085d1-d8e8-4651-84ea-14f188ac7821 service nova] Creating event network-vif-unplugged:c7d56b40-d00e-4dd3-902c-0debbf325b61 for instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 on n-h2-861333-10 Oct 19 06:58:22.143394 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d91931e0-ae83-42f5-b2e8-fa6bbe07ee84 req-aec085d1-d8e8-4651-84ea-14f188ac7821 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041271 Oct 19 06:58:22.144615 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1089/2148] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:22.152663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:22.154278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:22.163276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:22.164345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:22.165135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:22.166255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:22.166958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:22.167607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:22.182039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:22.194735 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe4af43b-f678-4532-962e-4c7f4a21784f tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1277 microversion: 2.1 time: 0.316842 Oct 19 06:58:22.205285 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1060/2149] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:21 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1277 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:22.221991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9279a5bf-c9b3-44b9-a126-9b6982e4cb61 req-720822a6-62d1-40c9-bbde-753da34eb2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4949732f-5c02-49ea-abdf-b5ad3fbc8448", "tag": "88b3ccba-3dbf-4b6a-8c42-07933009484a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:22.242685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9279a5bf-c9b3-44b9-a126-9b6982e4cb61 req-720822a6-62d1-40c9-bbde-753da34eb2fd service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:22.243422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9279a5bf-c9b3-44b9-a126-9b6982e4cb61 req-720822a6-62d1-40c9-bbde-753da34eb2fd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:22.244540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9279a5bf-c9b3-44b9-a126-9b6982e4cb61 req-720822a6-62d1-40c9-bbde-753da34eb2fd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:22.270715 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9279a5bf-c9b3-44b9-a126-9b6982e4cb61 req-720822a6-62d1-40c9-bbde-753da34eb2fd service nova] Creating event network-changed:88b3ccba-3dbf-4b6a-8c42-07933009484a for instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 on n-h1-861333-10 Oct 19 06:58:22.279275 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9279a5bf-c9b3-44b9-a126-9b6982e4cb61 req-720822a6-62d1-40c9-bbde-753da34eb2fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071668 Oct 19 06:58:22.284450 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1061/2150] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:22.287059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:22.298144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:22.314913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:22.315892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:22.316536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:22.317789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:22.319573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:22.320053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:22.979775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:22.994242 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f4ab70a-0c83-4b48-a8de-fe603ca88b90 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.848078 Oct 19 06:58:22.995348 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1090/2151] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:22 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:23.011402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2dc803e8-c591-4e4f-8725-af9cb5dd34de tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Calling method '.version_select at 0x7f6d64ab7940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:23.167128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:23.180858 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6f85651-5aaf-4985-93db-187d18b70b14 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1313 microversion: 2.1 time: 0.898699 Oct 19 06:58:23.184866 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1062/2152] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:22 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1313 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:23.204232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:23.208650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:23.251113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:23.251616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:23.252301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:23.257461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:23.258182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:23.258799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:23.509568 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2dc803e8-c591-4e4f-8725-af9cb5dd34de tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/778e4404-8a47-47cf-9b28-768fb9980092" status: 200 len: 141 microversion: 2.1 time: 0.513084 Oct 19 06:58:23.511027 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1091/2153] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 06:58:22 2022] GET /compute/v2.1/os-floating-ips/778e4404-8a47-47cf-9b28-768fb9980092 => generated 141 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:23.515782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:23.517050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:23.532886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:23.533169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:23.533846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:23.534794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:23.537859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:23.538571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:23.545817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:23.561596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-090ef161-68e6-47dc-ad9c-9b0851436602 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1395 microversion: 2.1 time: 0.375304 Oct 19 06:58:23.576688 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1063/2154] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:23 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1395 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:23.587862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:23.588568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:23.605048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:23.605548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:23.605993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:23.606711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:23.607177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:23.612840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:23.718967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:23.736074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:23.737593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:23.738839 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3ed8dd8-d089-442c-9616-882f7dbc65e0 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1265 microversion: 2.25 time: 0.161136 Oct 19 06:58:23.739737 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1064/2155] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:23 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:23.749576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:23.750503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:23.769934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:23.770716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:23.771341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:23.772312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:23.772966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:23.773575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:23.886727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:23.896362 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f9ef9fe-0240-46f1-9e77-78cd01831b12 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1283 microversion: 2.1 time: 0.151405 Oct 19 06:58:23.904721 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1065/2156] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:23 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1283 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:23.910791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6e7e0fe-cbf7-4f8e-b52a-589fabf4d290 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Calling method '.version_select at 0x7f6d68a565e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:24.645760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:24.664737 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf30d4dc-6b9c-43d7-9a34-26e15c1b36ba tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1511 microversion: 2.1 time: 1.148252 Oct 19 06:58:24.665396 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1092/2157] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:23 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1511 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:24.674885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:24.680823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:24.711481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:24.711991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:24.712474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:24.719141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:24.720516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:24.725448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:25.260688 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6e7e0fe-cbf7-4f8e-b52a-589fabf4d290 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/778e4404-8a47-47cf-9b28-768fb9980092" status: 202 len: 0 microversion: 2.1 time: 1.354502 Oct 19 06:58:25.261278 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1066/2158] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:58:23 2022] DELETE /compute/v2.1/os-floating-ips/778e4404-8a47-47cf-9b28-768fb9980092 => generated 0 bytes in 1356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:58:25.275097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b77e0d1d-d8e2-40af-bfcd-f0d46f0939f5 req-728e85b6-b563-49c6-8bc7-cfbc15550808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6467606f-c64d-4472-aeb1-4e30dbd9a9ab", "name": "network-vif-plugged", "status": "completed", "tag": "77095c95-cb01-4107-b1ee-3dbfefb01f4c"}, {"server_uuid": "4949732f-5c02-49ea-abdf-b5ad3fbc8448", "name": "network-vif-plugged", "status": "completed", "tag": "88b3ccba-3dbf-4b6a-8c42-07933009484a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:25.295625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b77e0d1d-d8e2-40af-bfcd-f0d46f0939f5 req-728e85b6-b563-49c6-8bc7-cfbc15550808 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:25.296643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b77e0d1d-d8e2-40af-bfcd-f0d46f0939f5 req-728e85b6-b563-49c6-8bc7-cfbc15550808 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:25.303181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b77e0d1d-d8e2-40af-bfcd-f0d46f0939f5 req-728e85b6-b563-49c6-8bc7-cfbc15550808 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:25.331814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:25.351289 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e1f68972-623e-4578-b80b-b53efde72630 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.683311 Oct 19 06:58:25.354834 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1093/2159] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:24 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:25.362795 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b77e0d1d-d8e2-40af-bfcd-f0d46f0939f5 req-728e85b6-b563-49c6-8bc7-cfbc15550808 service nova] Creating event network-vif-plugged:77095c95-cb01-4107-b1ee-3dbfefb01f4c for instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab on n-h2-861333-10 Oct 19 06:58:25.367324 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b77e0d1d-d8e2-40af-bfcd-f0d46f0939f5 req-728e85b6-b563-49c6-8bc7-cfbc15550808 service nova] Creating event network-vif-plugged:88b3ccba-3dbf-4b6a-8c42-07933009484a for instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 on n-h1-861333-10 Oct 19 06:58:25.390010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:25.391308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:25.394926 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b77e0d1d-d8e2-40af-bfcd-f0d46f0939f5 req-728e85b6-b563-49c6-8bc7-cfbc15550808 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.131806 Oct 19 06:58:25.395711 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1067/2160] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:25.403957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:25.404550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:25.405012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:25.405759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:25.408442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:25.409776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:25.437644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-23e80293-7d67-4273-8063-96e636df9aeb req-9d8cea6e-22b6-47d5-92ce-b501074ea41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c979c511-6f7d-4d9b-8987-9862804d3a38", "name": "network-vif-deleted", "tag": "1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:25.477266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-23e80293-7d67-4273-8063-96e636df9aeb req-9d8cea6e-22b6-47d5-92ce-b501074ea41b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:25.477761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-23e80293-7d67-4273-8063-96e636df9aeb req-9d8cea6e-22b6-47d5-92ce-b501074ea41b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:25.478216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-23e80293-7d67-4273-8063-96e636df9aeb req-9d8cea6e-22b6-47d5-92ce-b501074ea41b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:25.517171 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-23e80293-7d67-4273-8063-96e636df9aeb req-9d8cea6e-22b6-47d5-92ce-b501074ea41b service nova] Creating event network-vif-deleted:1f92a21f-8dd1-4bcc-a1cd-c1406ccf32c9 for instance c979c511-6f7d-4d9b-8987-9862804d3a38 on n-h1-861333-10 Oct 19 06:58:25.529348 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-23e80293-7d67-4273-8063-96e636df9aeb req-9d8cea6e-22b6-47d5-92ce-b501074ea41b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114957 Oct 19 06:58:25.531302 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1068/2161] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:25.546228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:25.549185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:25.561620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:25.576163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:25.576657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:25.577555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:25.578060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:25.578563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:25.935085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:25.944871 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-439edf0a-db3a-4285-9226-5a4d57f7ba2a tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1395 microversion: 2.1 time: 0.410795 Oct 19 06:58:25.954999 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1069/2162] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:25 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1395 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:25.981004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:25.983097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:25.990302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:25.991135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:25.991806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:25.992815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:25.993507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:25.994157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:26.262058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:26.278483 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6dba2e5b-4f10-41c7-ae50-5ecd372966d4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6" status: 200 len: 1512 microversion: 2.1 time: 0.322457 Oct 19 06:58:26.282280 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1070/2163] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:25 2022] GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:26.311917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-72aa26bd-cfd8-447d-9221-8e67827ad91a req-a3d2b922-6af5-4c76-b04f-5732a84868d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166a88da-e0f9-45c5-97c0-fe97b62c1196", "tag": "f27df404-9b2d-4951-9435-7db64cf21318"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:26.341813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72aa26bd-cfd8-447d-9221-8e67827ad91a req-a3d2b922-6af5-4c76-b04f-5732a84868d4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:26.341813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72aa26bd-cfd8-447d-9221-8e67827ad91a req-a3d2b922-6af5-4c76-b04f-5732a84868d4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:26.341813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72aa26bd-cfd8-447d-9221-8e67827ad91a req-a3d2b922-6af5-4c76-b04f-5732a84868d4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:26.353309 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-72aa26bd-cfd8-447d-9221-8e67827ad91a req-a3d2b922-6af5-4c76-b04f-5732a84868d4 service nova] Creating event network-changed:f27df404-9b2d-4951-9435-7db64cf21318 for instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 on n-h2-861333-10 Oct 19 06:58:26.358206 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-72aa26bd-cfd8-447d-9221-8e67827ad91a req-a3d2b922-6af5-4c76-b04f-5732a84868d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073967 Oct 19 06:58:26.359077 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1071/2164] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:26.365138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:26.366087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:26.373956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:26.374697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:26.375329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:26.376925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:26.377569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:26.378166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:26.382964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:26.408828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:26.418656 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48a8b3e8-497f-45dd-b7c9-9d2a739abb7c tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1313 microversion: 2.1 time: 1.042532 Oct 19 06:58:26.448179 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1094/2165] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:25 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:26.453321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:26.456507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:26.464646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:26.465383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:26.466061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:26.466965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:26.467592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:26.468405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:26.546494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:26.562336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:26.563753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:26.564940 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa31cb4a-3278-458b-9176-67bbf268b1ef tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1265 microversion: 2.25 time: 0.204616 Oct 19 06:58:26.572397 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1072/2166] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:26 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:26.590730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c68907ef-c429-485e-af03-b6ab05c9753d tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Calling method '.version_select at 0x7f6d68aadee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:27.044858 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c68907ef-c429-485e-af03-b6ab05c9753d tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.477324 Oct 19 06:58:27.054007 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1073/2167] 10.222.0.39 () {58 vars in 1164 bytes} [Wed Oct 19 06:58:26 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:58:27.060339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:27.068343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:27.069548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:27.097199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:27.098637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:27.099375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:27.100627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:27.101595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:27.104690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:27.105343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:27.105780 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f639c32b-e1ef-4c10-bc3b-c31a533e02ee tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1325 microversion: 2.1 time: 0.656207 Oct 19 06:58:27.108938 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1095/2168] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:26 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1325 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:27.127106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:27.131232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:27.136337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:27.137159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:27.137794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:27.138840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:27.139527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:27.140152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:27.259762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:27.398519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:27.413615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:27.421291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:27.422204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:27.669460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:27.683071 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4fd0268-6ed5-4530-b7de-0a45940c18fd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.567697 Oct 19 06:58:27.683747 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1096/2169] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:27 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:27.694975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:27.695596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:27.720978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:27.723073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:27.723225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:27.723957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:27.726630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:27.728547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:27.813403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:27.843636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:27.853610 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95f732ea-9629-4740-a951-ac793126109f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.797879 Oct 19 06:58:27.854996 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1074/2170] 10.222.0.39 () {58 vars in 1167 bytes} [Wed Oct 19 06:58:27 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:27.865485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4046b6a7-43e3-40d2-8281-a7d87265f420 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Calling method '.version_select at 0x7f6d68af7160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:28.957533 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4046b6a7-43e3-40d2-8281-a7d87265f420 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 1.100824 Oct 19 06:58:28.959004 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1075/2171] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 06:58:27 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:28.964279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:28.966371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:28.978298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:28.982103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:28.982103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:28.982103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:28.982103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:28.982103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-972d8214-789d-4210-9e31-1caacb8af163 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1575 microversion: 2.1 time: 1.552909 Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1097/2172] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:27 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1575 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:29.256880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:29.258839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:29.453869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:29.480236 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aeead204-3e88-497e-8b2b-6b7e13902bfa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1463 microversion: 2.1 time: 0.516790 Oct 19 06:58:29.505881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:29.510166 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1076/2173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:28 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1463 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:29.523549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:29.525896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:29.527205 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e395637-291f-44cb-96d7-179f9773967b tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1265 microversion: 2.25 time: 0.287149 Oct 19 06:58:29.528061 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1098/2174] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:29 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:29.530587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:29.539346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:29.553985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:29.553985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:29.554239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-629625959', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:29.554659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:29.555051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:29.555184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:29.555582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:29.556549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:29.557272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:29.557426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:29.557753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:29.557884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:29.560874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:29.561389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:29.561828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:29.788256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:29.998819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:30.005751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:30.006244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:30.006954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:30.146315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:30.170640 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbc89fd6-f239-4019-804b-368151dd9d7e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1325 microversion: 2.1 time: 0.641436 Oct 19 06:58:30.171960 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1099/2175] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:29 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1325 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:30.275055 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f59b78e-9190-4009-89e4-debcdae945c7 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-629625959" status: 200 len: 1514 microversion: 2.1 time: 0.758598 Oct 19 06:58:30.280242 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1077/2176] 10.222.0.39 () {58 vars in 1261 bytes} [Wed Oct 19 06:58:29 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-629625959 => generated 1514 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:30.287613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0aa5a7e7-c21d-4585-b28e-6d21e7e2b37a tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Calling method '.version_select at 0x7f6d68a3a940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:30.302859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:30.304707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:30.317215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:30.317215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:30.317215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:30.317215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:30.317215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:30.318177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:30.719868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:30.733268 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cd961ac-29d2-4cfe-8604-e7f03de36d79 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.559847 Oct 19 06:58:30.734375 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1100/2177] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:30 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:30.743879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c4c91a3-2d2f-4579-841e-071ac4d7ed1f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:30.749845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c4c91a3-2d2f-4579-841e-071ac4d7ed1f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:30.766588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4c91a3-2d2f-4579-841e-071ac4d7ed1f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:30.767892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4c91a3-2d2f-4579-841e-071ac4d7ed1f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:30.768543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4c91a3-2d2f-4579-841e-071ac4d7ed1f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:30.769461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4c91a3-2d2f-4579-841e-071ac4d7ed1f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:30.770113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4c91a3-2d2f-4579-841e-071ac4d7ed1f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:30.770711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4c91a3-2d2f-4579-841e-071ac4d7ed1f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:31.017539 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c4c91a3-2d2f-4579-841e-071ac4d7ed1f tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.278985 Oct 19 06:58:31.020967 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1101/2178] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 06:58:30 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448/os-interface => generated 284 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:31.047309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00f412ba-8b57-4956-af87-c28f7273acbb tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:31.052784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00f412ba-8b57-4956-af87-c28f7273acbb tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:31.093132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f412ba-8b57-4956-af87-c28f7273acbb tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:31.100576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f412ba-8b57-4956-af87-c28f7273acbb tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:31.101166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f412ba-8b57-4956-af87-c28f7273acbb tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:31.102135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f412ba-8b57-4956-af87-c28f7273acbb tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:31.102684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f412ba-8b57-4956-af87-c28f7273acbb tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:31.103187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f412ba-8b57-4956-af87-c28f7273acbb tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:31.399325 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00f412ba-8b57-4956-af87-c28f7273acbb tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1616 microversion: 2.1 time: 0.376525 Oct 19 06:58:31.406241 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1102/2179] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:31 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1616 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:31.423566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-aa53f646-4576-4734-9116-1546085e6abd req-4188564c-835a-44e8-8308-9925cfbd79d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c9f25f-c754-463e-8847-72c9e399ce82", "tag": "e02e6189-be26-48ff-b8a1-923763b464a0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:31.436500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aa53f646-4576-4734-9116-1546085e6abd req-4188564c-835a-44e8-8308-9925cfbd79d7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:31.437469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aa53f646-4576-4734-9116-1546085e6abd req-4188564c-835a-44e8-8308-9925cfbd79d7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:31.438450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aa53f646-4576-4734-9116-1546085e6abd req-4188564c-835a-44e8-8308-9925cfbd79d7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:31.462896 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-aa53f646-4576-4734-9116-1546085e6abd req-4188564c-835a-44e8-8308-9925cfbd79d7 service nova] Creating event network-changed:e02e6189-be26-48ff-b8a1-923763b464a0 for instance 61c9f25f-c754-463e-8847-72c9e399ce82 on n-h1-861333-10 Oct 19 06:58:31.481014 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-aa53f646-4576-4734-9116-1546085e6abd req-4188564c-835a-44e8-8308-9925cfbd79d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072851 Oct 19 06:58:31.483132 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1103/2180] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:31.495654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:31.521574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:31.526705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:31.530866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:31.531779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:31.532960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:31.534251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:31.534877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:31.535420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:31.685614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:31.779722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-440cb25b-abd5-49a2-ae8a-2bece5a2f3ce tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.447495 Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1104/2181] 10.222.0.39 () {58 vars in 1173 bytes} [Wed Oct 19 06:58:31 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.040759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.043267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:32.043267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:32.043267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:32.043267 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd7d7f67-f423-4afd-8cee-15103a6fd0cc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 200 len: 1265 microversion: 2.25 time: 0.093542 Oct 19 06:58:32.043267 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1105/2182] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:31 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:32.058533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:32.058533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:32.066258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.066258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.066258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.066990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.067447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.067874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.218334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:32.226728 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f25fa08a-7879-4bd4-a93f-8e262674cf8e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1325 microversion: 2.1 time: 0.195124 Oct 19 06:58:32.228060 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1106/2183] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:32 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:32.233023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:32.233710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:32.242130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.242130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.242130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.242501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.242794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.243200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.273286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '015a9e0e3237439d83ab05470bcc14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493dfc15cb08458ba24012ec7f0949e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:32.273888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] flavor_id is None. Assuming migration. {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 06:58:32.274338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 06:58:32.841779 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0aa5a7e7-c21d-4585-b28e-6d21e7e2b37a tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/903f7668-3ac8-43d1-9823-51d3e3a1ffda" status: 202 len: 0 microversion: 2.1 time: 2.560075 Oct 19 06:58:32.846413 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1078/2184] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:58:30 2022] DELETE /compute/v2.1/os-floating-ips/903f7668-3ac8-43d1-9823-51d3e3a1ffda => generated 0 bytes in 2565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:58:32.852537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:32.853162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:32.862112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.862870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.864084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.866230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.884514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.885606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.896375 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af0bacba-2638-4a38-a63c-ee59a90fc250 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab/action" status: 202 len: 0 microversion: 2.1 time: 0.667672 Oct 19 06:58:32.899211 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1107/2185] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:58:32 2022] POST /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:58:32.906320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:32.941252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:32.960833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.servers [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Removing options 'limit' from query {{(pid=127568) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1500}} Oct 19 06:58:32.960833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:32.979749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.980359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.980871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:32.981673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:32.982202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:32.982702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:33.017207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:33.023725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:33.024358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:33.024858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:33.193874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:33.205042 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa27d253-5e7b-4315-ac84-0d7cc556dc29 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.356965 Oct 19 06:58:33.222894 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1079/2186] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:32 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:33.222894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7a5f4a1-bf7b-4b85-9f5e-f26228891bd5 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Calling method '.version_select at 0x7f6d68bec3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:33.443223 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9261fa7b-d1ad-491f-8120-263e57854655 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.541683 Oct 19 06:58:33.463958 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1108/2187] 10.222.0.39 () {58 vars in 1161 bytes} [Wed Oct 19 06:58:32 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:33.463958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:33.464276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:33.478116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:33.482812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:33.483317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:33.485238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:33.485767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:33.488462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:33.810642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:33.820677 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82479dce-9d44-4e08-88c2-4725b1452ec7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1472 microversion: 2.1 time: 0.364661 Oct 19 06:58:33.828610 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1109/2188] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:33 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:33.834711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:33.837792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: c979c511-6f7d-4d9b-8987-9862804d3a38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:33.854203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:33.854968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:33.855417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:33.857121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:33.859474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:33.860121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:33.894892 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] HTTP exception thrown: Instance c979c511-6f7d-4d9b-8987-9862804d3a38 could not be found. Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Request method failure captured: Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 HTTP/1.1 Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT55a_C9urZF88Eg7RIAjdrwsEibMPXpNmZesnBggXOyoTqoTxQRUxcMXk4gPYZHn6_-FAAjMBsFCsD5_clETOYVZg-3V0Nbd4eCvQ41Z-wjJGP975G07Ck6wJburEHtQTyi1szPxriT_-v6sWclmSeER4B3hZOrJ55jN_2gcxmpkDSo Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b43fcf22c22a4b0fa4705d5031c3f17c Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b43fcf22c22a4b0fa4705d5031c3f17c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b43fcf22c22a4b0fa4705d5031c3f17c Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-LiveAutoBlockMigrationV225Test-629457781-project Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 641a9af15ca24743baa3049fa9ad2e68 Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-629457781-project Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance c979c511-6f7d-4d9b-8987-9862804d3a38 could not be found. Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'c979c511-6f7d-4d9b-8987-9862804d3a38'} Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c979c511-6f7d-4d9b-8987-9862804d3a38 could not be found. Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c979c511-6f7d-4d9b-8987-9862804d3a38 could not be found. Oct 19 06:58:33.900711 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:33.906405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:33.906405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:33.906405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:33.906405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:33.906405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:33.906405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:58:33.906405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:58:33.906405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c979c511-6f7d-4d9b-8987-9862804d3a38 could not be found. Oct 19 06:58:33.906405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:33.910066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Returning 404 to user: Instance c979c511-6f7d-4d9b-8987-9862804d3a38 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:33.910066 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25ec5047-e204-46f1-a924-46e1d3b5f210 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38" status: 404 len: 111 microversion: 2.25 time: 0.079623 Oct 19 06:58:33.914205 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1110/2189] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:33 2022] GET /compute/v2.1/servers/c979c511-6f7d-4d9b-8987-9862804d3a38 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:58:33.922239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:33.928499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:33.939301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:33.948044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:33.948783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:33.949741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:33.950400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:33.951189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:34.299712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:34.336774 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f411fcab-3fa2-488a-b90e-cf1bf8213148 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1325 microversion: 2.1 time: 0.421235 Oct 19 06:58:34.343659 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1111/2190] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:33 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:34.355152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:34.379790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:34.385871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:34.393347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:34.393861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:34.394490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:34.395265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:34.396249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:34.396682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:34.441052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:34.481448 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0ae10641-c69f-4372-9073-6fa0f4e9ccf5 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.142999 Oct 19 06:58:34.485153 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1112/2191] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:58:34 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:34.498547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:34.501666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:34.514401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:34.515143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:34.515757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:34.517413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:34.525679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:34.526516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:35.128518 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7a5f4a1-bf7b-4b85-9f5e-f26228891bd5 tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/08c93ddf-c61f-4be4-a366-b9e16f5bbb0d" status: 202 len: 0 microversion: 2.1 time: 1.916933 Oct 19 06:58:35.129458 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1080/2192] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:58:33 2022] DELETE /compute/v2.1/os-floating-ips/08c93ddf-c61f-4be4-a366-b9e16f5bbb0d => generated 0 bytes in 1919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:58:35.134627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ddddab49-cbbf-49b4-acf2-cadd342b0977 req-ddd0637c-58d8-4475-907f-7f3c7892e88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4949732f-5c02-49ea-abdf-b5ad3fbc8448", "tag": "88b3ccba-3dbf-4b6a-8c42-07933009484a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:35.155675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ddddab49-cbbf-49b4-acf2-cadd342b0977 req-ddd0637c-58d8-4475-907f-7f3c7892e88d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:35.157870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ddddab49-cbbf-49b4-acf2-cadd342b0977 req-ddd0637c-58d8-4475-907f-7f3c7892e88d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:35.163007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ddddab49-cbbf-49b4-acf2-cadd342b0977 req-ddd0637c-58d8-4475-907f-7f3c7892e88d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:35.168595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:35.175929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:35.179347 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dae6bc06-a0a0-475b-843f-95d48d6c8012 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1575 microversion: 2.1 time: 0.692846 Oct 19 06:58:35.180472 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1113/2193] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:34 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1575 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:35.190296 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ddddab49-cbbf-49b4-acf2-cadd342b0977 req-ddd0637c-58d8-4475-907f-7f3c7892e88d service nova] Creating event network-changed:88b3ccba-3dbf-4b6a-8c42-07933009484a for instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 on n-h1-861333-10 Oct 19 06:58:35.191745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:35.197437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:35.208317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:35.209164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:35.209971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:35.210903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:35.211530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:35.212169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:35.212886 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ddddab49-cbbf-49b4-acf2-cadd342b0977 req-ddd0637c-58d8-4475-907f-7f3c7892e88d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075043 Oct 19 06:58:35.213879 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1081/2194] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:35.227808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:35.247147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:35.247717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.servers [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Removing options 'limit' from query {{(pid=127567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1500}} Oct 19 06:58:35.254944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:35.273282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:35.273779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:35.283002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:35.283979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:35.284504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:35.285173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:35.515274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:35.649724 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-733c97e0-c89f-4a4f-8238-a8c8cb3b220a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.430557 Oct 19 06:58:35.651892 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1082/2195] 10.222.0.39 () {58 vars in 1150 bytes} [Wed Oct 19 06:58:35 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:35.668084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:35.669183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:35.676011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:35.676863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:35.677477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:35.678394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:35.679035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:35.679641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:35.734671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:35.753209 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9812c41a-dfb7-4ce6-8c19-69a80cbd2b82 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.571347 Oct 19 06:58:35.768608 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1114/2196] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:35 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:35.785261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb29ce6e-2a97-499c-802b-3a8a5e9d07af tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] Calling method '.version_select at 0x7f6d64f484c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:36.493437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:36.505210 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a594309-f008-45e4-8889-044ee6dffe47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1472 microversion: 2.1 time: 0.851972 Oct 19 06:58:36.506677 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1083/2197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:35 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1472 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:36.512622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:36.513241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:36.537919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:36.540481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:36.541227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:36.543840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:36.544560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:36.545177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:36.830896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:36.841518 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d8342a9-b96a-4834-bac9-01c70b9b2f85 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1325 microversion: 2.1 time: 0.333647 Oct 19 06:58:36.858362 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1084/2198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:36 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1325 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:36.865898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:36.873393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:36.874071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:36.882418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:36.882959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:36.883403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:36.884219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:36.885319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:36.885754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:36.954680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:37.437604 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33c1bd90-e6f4-4321-ac35-8aefca686657 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.577899 Oct 19 06:58:37.444785 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1085/2199] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 06:58:36 2022] GET /compute/v2.1/servers => generated 1011 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:37.461205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:37.461827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:37.486638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:37.487156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:37.487612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:37.488355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:37.488817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:37.489254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:37.848478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:37.856220 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db5b7426-309a-4184-9ff5-85264c5bf653 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.410256 Oct 19 06:58:37.856992 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1086/2200] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:37 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:37.867429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:37.877905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:37.879044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:37.906796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:37.907329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:37.907775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:37.908540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:37.909032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:37.910281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:38.077841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:38.175868 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7edac0bb-14fb-44eb-a888-2800087148d9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.311951 Oct 19 06:58:38.176876 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1087/2201] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:58:37 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:38.181878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:38.182814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:38.191334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:38.192391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:38.193144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:38.194114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:38.194805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:38.195501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:38.376637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:38.384888 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-951b26a6-4070-4aea-b0ba-dde693e564c5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1472 microversion: 2.1 time: 0.206680 Oct 19 06:58:38.385798 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1088/2202] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:38 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1472 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:38.390659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:38.391169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:38.413447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:38.413961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:38.414414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:38.415151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:38.415615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:38.416050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:38.754824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:38.772316 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65ff4595-6560-453b-abd0-c1980f29ed7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1325 microversion: 2.1 time: 0.382186 Oct 19 06:58:38.772316 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1089/2203] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:38 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:38.784894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:38.790186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:38.790631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.servers [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Removing options 'limit' from query {{(pid=127567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1500}} Oct 19 06:58:38.791299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:38.805861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:38.806361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:38.806806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:38.807546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:38.808015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:38.808479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:38.858881 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c90ff13-15fe-4eda-a9b8-7fdc07dcdb23 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.088065 Oct 19 06:58:38.866335 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1090/2204] 10.222.0.39 () {58 vars in 1140 bytes} [Wed Oct 19 06:58:38 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:38.874829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:38.882001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:38.882677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-629625959', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:38.903147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:38.905147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:38.906208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:38.909562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:38.911165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:38.913194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:39.136738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:39.154372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:39.248924 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-648e57df-b1df-4ac3-89f5-58b22b28993c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-629625959" status: 200 len: 345 microversion: 2.1 time: 0.377510 Oct 19 06:58:39.257714 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1091/2205] 10.222.0.39 () {58 vars in 1240 bytes} [Wed Oct 19 06:58:38 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-629625959 => generated 345 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:39.257714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:39.258023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:39.264972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:39.265520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:39.265963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:39.266979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:39.268090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:39.269805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:39.529233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:39.539441 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd12356b-b085-42e4-8abb-ade876c738aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.288324 Oct 19 06:58:39.552198 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1092/2206] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:39 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:39.552198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2eb25774-6ea1-4193-87a9-e28290bbc84e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:39.570455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb25774-6ea1-4193-87a9-e28290bbc84e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:39.571985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb25774-6ea1-4193-87a9-e28290bbc84e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:39.575296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb25774-6ea1-4193-87a9-e28290bbc84e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:39.608052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2eb25774-6ea1-4193-87a9-e28290bbc84e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Going to try to stop instance {{(pid=127567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 06:58:39.885574 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2eb25774-6ea1-4193-87a9-e28290bbc84e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "POST /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401/action" status: 202 len: 0 microversion: 2.1 time: 0.344279 Oct 19 06:58:39.887033 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1093/2207] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:58:39 2022] POST /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:58:39.897539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:39.901308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:39.914463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:39.915443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:39.916135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:39.917105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:39.917794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:39.918454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:39.989351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:40.083018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:40.095041 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74ac5554-0135-429d-8db3-678783c15fe7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.205814 Oct 19 06:58:40.097200 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1094/2208] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:39 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:40.104377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ae2bc375-9d51-4463-b02e-251d462f5860 req-d724cf6c-2814-48ae-a3e4-f50a13e24607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c9f25f-c754-463e-8847-72c9e399ce82", "name": "network-vif-plugged", "status": "completed", "tag": "e02e6189-be26-48ff-b8a1-923763b464a0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:40.105308 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb29ce6e-2a97-499c-802b-3a8a5e9d07af tempest-FloatingIPDetailsTestJSON-1964986394 tempest-FloatingIPDetailsTestJSON-1964986394-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/642a74b7-8b9b-4fbb-923d-f4a3099f7093" status: 202 len: 0 microversion: 2.1 time: 4.334330 Oct 19 06:58:40.105889 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1115/2209] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 06:58:35 2022] DELETE /compute/v2.1/os-floating-ips/642a74b7-8b9b-4fbb-923d-f4a3099f7093 => generated 0 bytes in 4337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:58:40.112638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:40.113790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:40.131596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:40.132590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:40.136006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:40.137261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:40.137956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:40.138629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:40.151634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ae2bc375-9d51-4463-b02e-251d462f5860 req-d724cf6c-2814-48ae-a3e4-f50a13e24607 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:40.154293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ae2bc375-9d51-4463-b02e-251d462f5860 req-d724cf6c-2814-48ae-a3e4-f50a13e24607 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:40.155756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ae2bc375-9d51-4463-b02e-251d462f5860 req-d724cf6c-2814-48ae-a3e4-f50a13e24607 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:40.197036 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ae2bc375-9d51-4463-b02e-251d462f5860 req-d724cf6c-2814-48ae-a3e4-f50a13e24607 service nova] Creating event network-vif-plugged:e02e6189-be26-48ff-b8a1-923763b464a0 for instance 61c9f25f-c754-463e-8847-72c9e399ce82 on n-h1-861333-10 Oct 19 06:58:40.209895 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ae2bc375-9d51-4463-b02e-251d462f5860 req-d724cf6c-2814-48ae-a3e4-f50a13e24607 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108852 Oct 19 06:58:40.210904 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1095/2210] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:40.218542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:40.219422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:40.233353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:40.233353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:40.233353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:40.233353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:40.233353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:40.233353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:40.526201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:40.535513 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b699e0d3-e6db-4c45-a399-5ea00358ac5b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1325 microversion: 2.1 time: 0.427759 Oct 19 06:58:40.536695 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1116/2211] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:40 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1325 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:40.564802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:40.567271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:40.578908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:40.581192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:40.582860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:40.584159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:40.585890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:40.587024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:40.587949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:40.589337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:40.597600 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d0a2f27-447f-44c1-a4be-faed84ac69ff tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1521 microversion: 2.1 time: 0.385214 Oct 19 06:58:40.602605 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1096/2212] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:40 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:40.860360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:40.860946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:40.868292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:40.870240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:40.870964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:40.872702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:40.872702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:40.872702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:40.923494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:58:40.943332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:40.956670 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74de0603-0fa7-4db0-a79b-7cc304dc6a41 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.395785 Oct 19 06:58:40.957289 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1117/2213] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:40 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:41.127738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:41.129252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:41.152132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.153575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.155864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:41.155864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.157504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.157830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:41.241873 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee61a2e3-0d3a-47f8-a153-455b5ac4edd9 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 204 len: 0 microversion: 2.25 time: 0.385232 Oct 19 06:58:41.242636 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1097/2214] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 06:58:40 2022] DELETE /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 06:58:41.252161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:41.253106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:41.261211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.261900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.262559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:41.263878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.264564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.265177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:41.316961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:41.325274 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37b57570-89a7-439f-bf4c-a30301403a38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.206110 Oct 19 06:58:41.341172 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1118/2215] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:41 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:41.547513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:41.557306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:41.558848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:41.559036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:41.559929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:41.560170 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1ae8bae-a87d-4e8a-b522-a03fbf73be65 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1732 microversion: 2.25 time: 0.312900 Oct 19 06:58:41.560880 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1098/2216] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:41 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1732 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:58:41.567668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.568502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.569841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:41.570872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.573558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.574197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:41.631636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:41.632642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:41.639485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.640355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.641047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:41.642067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.642758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.643423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:41.750030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:41.754210 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82683adb-ba6d-4558-8422-becaaee1804c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1325 microversion: 2.1 time: 0.199063 Oct 19 06:58:41.754993 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1119/2217] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:41 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:41.980738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:41.981348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:41.991396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.991396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.991396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:41.991396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:41.991396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:41.991396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:42.020280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:42.036566 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20a44a34-2fdd-4deb-80a6-19c69d2882b1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1521 microversion: 2.1 time: 0.407958 Oct 19 06:58:42.054869 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1099/2218] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:41 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:42.235607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7d2ac5ae-f7e3-4755-b0d0-19493ebabfe8 req-8e4bcbe1-6e9d-45ff-a34d-d5c6ab08b46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166a88da-e0f9-45c5-97c0-fe97b62c1196", "name": "network-vif-plugged", "status": "completed", "tag": "f27df404-9b2d-4951-9435-7db64cf21318"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:42.258356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7d2ac5ae-f7e3-4755-b0d0-19493ebabfe8 req-8e4bcbe1-6e9d-45ff-a34d-d5c6ab08b46d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:42.259560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7d2ac5ae-f7e3-4755-b0d0-19493ebabfe8 req-8e4bcbe1-6e9d-45ff-a34d-d5c6ab08b46d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:42.260215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7d2ac5ae-f7e3-4755-b0d0-19493ebabfe8 req-8e4bcbe1-6e9d-45ff-a34d-d5c6ab08b46d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:42.282789 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7d2ac5ae-f7e3-4755-b0d0-19493ebabfe8 req-8e4bcbe1-6e9d-45ff-a34d-d5c6ab08b46d service nova] Creating event network-vif-plugged:f27df404-9b2d-4951-9435-7db64cf21318 for instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 on n-h2-861333-10 Oct 19 06:58:42.282789 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7d2ac5ae-f7e3-4755-b0d0-19493ebabfe8 req-8e4bcbe1-6e9d-45ff-a34d-d5c6ab08b46d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058134 Oct 19 06:58:42.283597 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1100/2219] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:58:42.349640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:42.350576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:42.352777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:42.357800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:42.358298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:42.358776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:42.359487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:42.359948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:42.360454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:42.384400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:42.398158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9677164-a240-488d-8a64-75996b53ea52 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.421213 Oct 19 06:58:42.401203 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1120/2220] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:41 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:42.589652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:42.590991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:42.611215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:42.613684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:42.614408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:42.615396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:42.616090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:42.618047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:42.827627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:42.839214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:42.841014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:42.842577 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-345bb9ca-59d8-45d3-853c-39921a1c39dd tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1732 microversion: 2.25 time: 0.258594 Oct 19 06:58:42.858759 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1121/2221] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:42 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1732 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:42.870997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:42.871887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:42.879969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:42.880774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:42.881430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:42.882433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:42.883052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:42.883836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.014569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:43.052125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:43.060528 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-608fccc7-2004-421e-8180-03e385c5fe96 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.716347 Oct 19 06:58:43.062983 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1101/2222] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:42 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:43.068611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:43.088820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:43.097194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.103064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.103064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.103064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.103064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.103064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.184010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:43.195718 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbd71e96-b419-46a2-a44a-a2207b43b980 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1521 microversion: 2.1 time: 0.329008 Oct 19 06:58:43.198168 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1122/2223] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:42 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:43.221774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:43.222382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:43.228710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.229444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.230103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.233645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.234390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.235146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.526294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:43.532795 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-262ab194-c4aa-4a51-bf06-fc5e3f2ce4ab tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1521 microversion: 2.1 time: 0.314870 Oct 19 06:58:43.536785 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1123/2224] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:43 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:43.550438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:43.552876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:43.569875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.570611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.571253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.572335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.573151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.573736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.618680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:43.631791 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-022c8ff5-28b7-42e0-8390-7321030d917f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1521 microversion: 2.1 time: 0.566778 Oct 19 06:58:43.632433 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1102/2225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:43 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1521 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:43.639152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-14e62940-e117-49e4-a4be-07dfd27b778e req-877c3dba-bb92-4809-b244-2d45a0ad38cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5705ad-60bd-4c15-969f-bb26a8fd5b60", "name": "network-vif-deleted", "tag": "11026df4-02a2-4f24-8043-6c02c90c96a3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:43.649857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-14e62940-e117-49e4-a4be-07dfd27b778e req-877c3dba-bb92-4809-b244-2d45a0ad38cb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.650716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-14e62940-e117-49e4-a4be-07dfd27b778e req-877c3dba-bb92-4809-b244-2d45a0ad38cb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.651495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-14e62940-e117-49e4-a4be-07dfd27b778e req-877c3dba-bb92-4809-b244-2d45a0ad38cb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.684294 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-14e62940-e117-49e4-a4be-07dfd27b778e req-877c3dba-bb92-4809-b244-2d45a0ad38cb service nova] Creating event network-vif-deleted:11026df4-02a2-4f24-8043-6c02c90c96a3 for instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 on n-h2-861333-10 Oct 19 06:58:43.691824 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-14e62940-e117-49e4-a4be-07dfd27b778e req-877c3dba-bb92-4809-b244-2d45a0ad38cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057325 Oct 19 06:58:43.693346 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1103/2226] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:43.703666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d21bbae0-6fd2-4f7f-acf4-f5178937e073 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-903476533", "metadata": {"": ""}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d21bbae0-6fd2-4f7f-acf4-f5178937e073 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action HTTP/1.1 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 106 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-903476533", "metadata": {"": ""}}} Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '61c9f25f-c754-463e-8847-72c9e399ce82', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-903476533', 'metadata': {'': ''}}}} Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'': ''} Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:58:43.706870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 06:58:43.712701 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:43.715866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d21bbae0-6fd2-4f7f-acf4-f5178937e073 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:43.718461 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d21bbae0-6fd2-4f7f-acf4-f5178937e073 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action" status: 400 len: 170 microversion: 2.1 time: 0.022274 Oct 19 06:58:43.731123 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1104/2227] 10.222.0.39 () {60 vars in 1279 bytes} [Wed Oct 19 06:58:43 2022] POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action => generated 170 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:58:43.731123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:43.732810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:43.740947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.741819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.742466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.743401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.744140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.744817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.880870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:43.891295 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-555350fe-434b-4e26-9b6c-3ff5b77e9db0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1308 microversion: 2.1 time: 0.345493 Oct 19 06:58:43.893489 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1124/2228] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:43 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:43.898722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:43.899590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:43.917269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.927258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.927258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:43.927258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:43.927258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:43.927258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.008155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.008865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.010240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.010911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lazy-loading 'fault' on Instance uuid 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:58:44.095906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:44.120804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:44.123177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:44.128080 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3bf2ac13-918d-410b-b149-0b9a737015ca tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 200 len: 1375 microversion: 2.25 time: 0.232924 Oct 19 06:58:44.144794 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1125/2229] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:43 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 1375 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:44.162275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:44.163039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:44.173889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.179084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.179084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.179084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.179084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.179084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.179692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:44.195192 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fe8d55c-df0e-4e99-b0a4-bc3491bd9b93 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1521 microversion: 2.1 time: 0.468398 Oct 19 06:58:44.196349 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1105/2230] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:43 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:44.229869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:44.230992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:44.246651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.248173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.248173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.248503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.248754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.253175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.405111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:44.435694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:44.443224 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-204058f0-f097-4623-8b62-41e593fbd6a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.296445 Oct 19 06:58:44.444085 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1126/2231] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:44 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:44.636846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:44.649463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-abcb0f4a-4678-4156-82e0-293324fa59bb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1521 microversion: 2.1 time: 0.424625 Oct 19 06:58:44.650992 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1106/2232] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:44 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:44.674029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0356be04-b4b9-48f6-a0c2-525eb78682ae tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-22246259", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:44.675324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:44.676657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0356be04-b4b9-48f6-a0c2-525eb78682ae tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action HTTP/1.1 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 617 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-22246259", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '61c9f25f-c754-463e-8847-72c9e399ce82', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-22246259', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:58:44.678865 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 06:58:44.682374 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:44.685345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0356be04-b4b9-48f6-a0c2-525eb78682ae tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:44.685345 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0356be04-b4b9-48f6-a0c2-525eb78682ae tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action" status: 400 len: 938 microversion: 2.1 time: 0.011283 Oct 19 06:58:44.685345 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1107/2233] 10.222.0.39 () {60 vars in 1279 bytes} [Wed Oct 19 06:58:44 2022] POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action => generated 938 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 06:58:44.690686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.691293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.691770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.692575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.693661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.696253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.701393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:44.702246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:44.711301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.711807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.712287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.713136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.714532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.715411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.899302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:44.912392 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28022454-d7ef-4062-8b46-e0e335066f90 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1521 microversion: 2.1 time: 0.246542 Oct 19 06:58:44.921293 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1127/2234] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:44 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:44.924240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:44.925914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:44.932359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.932812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.933258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:44.934663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:44.935370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:44.935856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.008577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:45.019852 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0dabaad-4b86-4b4e-baed-9d54d1ede4f9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1521 microversion: 2.1 time: 0.334235 Oct 19 06:58:45.021566 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1108/2235] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:44 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:45.046015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:45.046647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:45.053305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.054060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.054731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.055635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.056274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.056900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.061398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:45.095998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:45.106731 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3cca1b5-a88c-4bda-9aa3-ff7b5bba4ea3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1488 microversion: 2.1 time: 0.189362 Oct 19 06:58:45.111071 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1128/2236] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:44 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1488 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:45.136367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:45.136367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:45.151257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.152012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.152482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.153190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.153644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.154079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.181066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:58:45.335115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:45.372029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:45.384695 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42cf1274-8ab1-4825-adf1-cef2b2a62ec8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1521 microversion: 2.1 time: 0.342628 Oct 19 06:58:45.388637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1109/2237] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:45 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:45.394072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:45.400352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 3a5705ad-60bd-4c15-969f-bb26a8fd5b60] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:45.401652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.402342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.402988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.403711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.404229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.404687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.438197 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] HTTP exception thrown: Instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 could not be found. Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Request method failure captured: Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 HTTP/1.1 Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT55a_C9urZF88Eg7RIAjdrwsEibMPXpNmZesnBggXOyoTqoTxQRUxcMXk4gPYZHn6_-FAAjMBsFCsD5_clETOYVZg-3V0Nbd4eCvQ41Z-wjJGP975G07Ck6wJburEHtQTyi1szPxriT_-v6sWclmSeER4B3hZOrJ55jN_2gcxmpkDSo Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b43fcf22c22a4b0fa4705d5031c3f17c Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b43fcf22c22a4b0fa4705d5031c3f17c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b43fcf22c22a4b0fa4705d5031c3f17c Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-LiveAutoBlockMigrationV225Test-629457781-project Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 641a9af15ca24743baa3049fa9ad2e68 Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-629457781-project Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 could not be found. Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3a5705ad-60bd-4c15-969f-bb26a8fd5b60'} Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 could not be found. Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 could not be found. Oct 19 06:58:45.441711 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 could not be found. Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Returning 404 to user: Instance 3a5705ad-60bd-4c15-969f-bb26a8fd5b60 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:45.448206 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-881bc652-595a-4072-86f0-bede9ed46bfe tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60" status: 404 len: 111 microversion: 2.25 time: 0.053400 Oct 19 06:58:45.449211 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1110/2238] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:45 2022] GET /compute/v2.1/servers/3a5705ad-60bd-4c15-969f-bb26a8fd5b60 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:58:45.465106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95f26295-71ab-4137-b150-df8fb1dc43d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95f26295-71ab-4137-b150-df8fb1dc43d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action HTTP/1.1 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 285 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '61c9f25f-c754-463e-8847-72c9e399ce82', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:45.470696 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95f26295-71ab-4137-b150-df8fb1dc43d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95f26295-71ab-4137-b150-df8fb1dc43d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action" status: 400 len: 619 microversion: 2.1 time: 0.017417 Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1111/2239] 10.222.0.39 () {60 vars in 1279 bytes} [Wed Oct 19 06:58:45 2022] POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:58:45.484827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74269c0f-75b6-4d7b-b62a-2cd120785521 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '.version_select at 0x7f6d68ab34c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:45.544785 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72c33274-87cf-4198-8072-113abe8eae59 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 204 len: 0 microversion: 2.1 time: 0.415014 Oct 19 06:58:45.549162 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1129/2240] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:58:45 2022] DELETE /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 06:58:45.552055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:45.552867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:45.559421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.559421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.559719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.560596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.561053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.561488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.572433 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74269c0f-75b6-4d7b-b62a-2cd120785521 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797815594" status: 204 len: 0 microversion: 2.25 time: 0.092216 Oct 19 06:58:45.572433 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1112/2241] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 06:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797815594 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 06:58:45.579180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:45.579901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:45.588322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.589201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.589789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.590999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.591689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.592285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.770590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:45.780311 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b04421b-c6f1-4013-9712-a6e6781eabe3 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1521 microversion: 2.1 time: 0.207300 Oct 19 06:58:45.781666 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1113/2242] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:45 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:45.787395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:45.787978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:45.794464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.795225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.795668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.796615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.797081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.800775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.911641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:45.923682 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3c454d4-80a2-4dd8-bdc5-01b820d7d339 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.376590 Oct 19 06:58:45.928220 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1130/2243] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:45 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:45.940814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:45.941763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:45.952412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.952937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.953418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.954723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.955182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.955605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.962343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:45.972183 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f424ae4-6fb5-4249-b8d5-3dc6bf12391c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1494 microversion: 2.1 time: 0.188787 Oct 19 06:58:45.973479 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1114/2244] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:45 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1494 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:45.978506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:45.979325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:45.987538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.989874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.989874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:45.989874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:45.990601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:45.991240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:46.211846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:46.228383 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-955bbcd4-3c73-4352-9c72-e656ca2b32bb tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1521 microversion: 2.1 time: 0.253229 Oct 19 06:58:46.229709 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1115/2245] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:45 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:46.268889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:46.280234 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1fce98fe-1062-4db4-aaea-d88ad1105c97 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1521 microversion: 2.1 time: 0.354119 Oct 19 06:58:46.281380 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1131/2246] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:45 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:46.305149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e411f1d3-070d-4ba6-baef-a400deb69576 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-810080197"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:46.308052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e411f1d3-070d-4ba6-baef-a400deb69576 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:46.314264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e411f1d3-070d-4ba6-baef-a400deb69576 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:46.315004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e411f1d3-070d-4ba6-baef-a400deb69576 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:46.315633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e411f1d3-070d-4ba6-baef-a400deb69576 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:46.316400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e411f1d3-070d-4ba6-baef-a400deb69576 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:46.317064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e411f1d3-070d-4ba6-baef-a400deb69576 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:46.317498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e411f1d3-070d-4ba6-baef-a400deb69576 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:46.830807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:46.831309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:46.843702 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e411f1d3-070d-4ba6-baef-a400deb69576 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action" status: 202 len: 0 microversion: 2.1 time: 0.542442 Oct 19 06:58:46.844387 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1116/2247] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:58:46 2022] POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 06:58:46.861844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-784929315"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:46.864926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:46.865343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:46.868557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:46.870047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:46.871416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:46.872091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:46.873166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:46.896474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:46.897391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:46.898311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:46.899380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:46.900052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:46.900676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:46.942106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:58:46.952518 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Cannot 'createImage' instance 61c9f25f-c754-463e-8847-72c9e399ce82 while it is in task_state image_snapshot_pending Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action HTTP/1.1 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 84 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-784929315"}} Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'createImage' instance 61c9f25f-c754-463e-8847-72c9e399ce82 while it is in task_state image_snapshot_pending Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '61c9f25f-c754-463e-8847-72c9e399ce82', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-784929315'}}} Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 06:58:46.954937 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 61c9f25f-c754-463e-8847-72c9e399ce82 while it is in task_state image_snapshot_pending Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 61c9f25f-c754-463e-8847-72c9e399ce82 while it is in task_state image_snapshot_pending Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 409 to user: Cannot 'createImage' instance 61c9f25f-c754-463e-8847-72c9e399ce82 while it is in task_state image_snapshot_pending {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:46.961692 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fcdda9ea-35bb-4939-ba92-a37b9f9b24c1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action" status: 409 len: 167 microversion: 2.1 time: 0.101958 Oct 19 06:58:46.968740 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1117/2248] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:58:46 2022] POST /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82/action => generated 167 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:58:47.269385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:47.270291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:47.282807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.283300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.283741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:47.284475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.284980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.285445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:47.300581 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0cee3686-e63c-4658-99be-bf758d6b02af tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "DELETE /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 204 len: 0 microversion: 2.25 time: 0.473859 Oct 19 06:58:47.301501 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1132/2249] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 06:58:46 2022] DELETE /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 06:58:47.307090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7697375a-3dc1-43e4-8c7b-09cdcdd52900 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '.version_select at 0x7f6d64c38940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:47.427701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:47.434490 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f01296d-bd8e-43c5-9ebc-fd7fb7194404 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.463436 Oct 19 06:58:47.435067 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1118/2250] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:46 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:47.441574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:47.442848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:47.450148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.450642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.451088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:47.451801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.452302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.452739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:47.628991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:47.637925 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9351e0a0-bafb-45aa-8d0c-d2611567aafd tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1494 microversion: 2.1 time: 0.201137 Oct 19 06:58:47.639530 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1119/2251] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:47 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1494 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:47.646125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:47.647850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:47.656285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.656832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.657841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:47.658552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.659009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.659436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:47.674847 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7697375a-3dc1-43e4-8c7b-09cdcdd52900 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/images/168df9ee-54da-44fc-bf21-bcc8a5d4a0a3" status: 204 len: 0 microversion: 2.1 time: 0.372054 Oct 19 06:58:47.675493 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1133/2252] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:47 2022] DELETE /compute/v2.1/images/168df9ee-54da-44fc-bf21-bcc8a5d4a0a3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:58:47.685588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:47.685588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:47.693579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.694464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.695747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:47.696771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.697490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.698114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:47.834765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:47.843016 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42dd373c-5766-4394-b21f-7a9bb697450b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1521 microversion: 2.1 time: 0.202271 Oct 19 06:58:47.843597 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1120/2253] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:47 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:47.848362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:47.848973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:47.854870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.855363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.856093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:47.856853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:47.857501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:47.857942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:48.029509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:48.046918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:48.048930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:48.050766 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82f021bc-6ed5-45c0-9b5e-da43aaf7e6bc tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1549 microversion: 2.25 time: 0.370689 Oct 19 06:58:48.051587 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1134/2254] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:47 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1549 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:48.097958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:48.106500 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3d646ca-3603-4bea-8ba2-2c600ada5e57 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1533 microversion: 2.1 time: 0.261273 Oct 19 06:58:48.107079 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1121/2255] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:47 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1533 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:48.321807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-38268f0c-b063-4ce7-a825-4feed6c13279 req-5bcbab01-22bb-4c37-b45e-2ea3538daaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166a88da-e0f9-45c5-97c0-fe97b62c1196", "name": "network-vif-deleted", "tag": "f27df404-9b2d-4951-9435-7db64cf21318"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:48.339485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-38268f0c-b063-4ce7-a825-4feed6c13279 req-5bcbab01-22bb-4c37-b45e-2ea3538daaa5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:48.340042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-38268f0c-b063-4ce7-a825-4feed6c13279 req-5bcbab01-22bb-4c37-b45e-2ea3538daaa5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:48.340625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-38268f0c-b063-4ce7-a825-4feed6c13279 req-5bcbab01-22bb-4c37-b45e-2ea3538daaa5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:48.372415 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-38268f0c-b063-4ce7-a825-4feed6c13279 req-5bcbab01-22bb-4c37-b45e-2ea3538daaa5 service nova] Creating event network-vif-deleted:f27df404-9b2d-4951-9435-7db64cf21318 for instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 on n-h2-861333-10 Oct 19 06:58:48.386338 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-38268f0c-b063-4ce7-a825-4feed6c13279 req-5bcbab01-22bb-4c37-b45e-2ea3538daaa5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068041 Oct 19 06:58:48.388908 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1135/2256] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:48.460660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:48.464791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:48.480855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:48.481548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:48.482023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:48.483432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:48.483968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:48.484561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:48.649374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:48.661437 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a402c20-d5cb-4fca-aefe-9bd57bc132eb tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.207235 Oct 19 06:58:48.662888 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1122/2257] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:48 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:48.678911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:48.679634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:48.689040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:48.689604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:48.690041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:48.691307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:48.692850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:48.693622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:48.747883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:48.748397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:48.748816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:48.749510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lazy-loading 'fault' on Instance uuid 166a88da-e0f9-45c5-97c0-fe97b62c1196 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:58:48.797280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:48.806778 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca424735-a31a-4b50-9e5d-84f51bfff4a4 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 200 len: 1298 microversion: 2.1 time: 0.147095 Oct 19 06:58:48.807365 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1136/2258] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:48 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:48.867587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:48.868868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:48.875033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:48.875746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:48.876243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:48.876955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:48.877412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:48.878135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:48.992993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:49.054321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:49.062558 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d65a60c4-b1e3-4cc8-ba93-b594425b141e tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1521 microversion: 2.1 time: 0.200357 Oct 19 06:58:49.064941 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1123/2259] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:48 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:49.083929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:49.084571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:49.091269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.091882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.092588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.093301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.093761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.094484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.131117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:49.132071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:49.138497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.139182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.139897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.140850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.141538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.142730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.145049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.146117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.146571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.147034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lazy-loading 'fault' on Instance uuid df415a60-fbd8-49a7-b5c6-9c31df661ff6 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:58:49.197564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:49.208430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:49.209962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:49.211417 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3116c23-11cc-413a-a5ad-f8e7ce3180d7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 200 len: 1352 microversion: 2.25 time: 0.137545 Oct 19 06:58:49.212498 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1137/2260] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:49 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 1352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:49.300394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:49.308147 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a01006c9-a68f-4e2a-947d-b26dc6f23e64 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1539 microversion: 2.1 time: 0.180888 Oct 19 06:58:49.308738 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1124/2261] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:49 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1539 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:49.755222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45433642-51ec-4c60-a27c-bac370725789 tempest-ListImagesTestJSON-850401668 tempest-ListImagesTestJSON-850401668-project] Calling method '.version_select at 0x7f6d68a6d940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:49.764919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4305e9b3-bfc3-4bf1-8d90-047dd717499d tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Action: 'update', calling method: .version_select at 0x7f6d6513d1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:49.800933 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45433642-51ec-4c60-a27c-bac370725789 tempest-ListImagesTestJSON-850401668 tempest-ListImagesTestJSON-850401668-project] 10.222.0.39 "GET /compute/v2.1/images/bf91402f-43c2-455b-ba41-1073b9eae084" status: 200 len: 784 microversion: 2.1 time: 0.171215 Oct 19 06:58:49.801511 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1125/2262] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:58:49 2022] GET /compute/v2.1/images/bf91402f-43c2-455b-ba41-1073b9eae084 => generated 784 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:58:49.806094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:49.806708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:49.815121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.815480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.815924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.816648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.817109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.817541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.832499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4305e9b3-bfc3-4bf1-8d90-047dd717499d tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.833123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4305e9b3-bfc3-4bf1-8d90-047dd717499d tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.833566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4305e9b3-bfc3-4bf1-8d90-047dd717499d tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.834517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4305e9b3-bfc3-4bf1-8d90-047dd717499d tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.835184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4305e9b3-bfc3-4bf1-8d90-047dd717499d tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.835620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4305e9b3-bfc3-4bf1-8d90-047dd717499d tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.934098 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4305e9b3-bfc3-4bf1-8d90-047dd717499d tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/ef533fc243ac41ef8c73e6de8dc50bd4" status: 200 len: 148 microversion: 2.57 time: 0.424974 Oct 19 06:58:49.934729 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1138/2263] 10.222.0.39 () {62 vars in 1303 bytes} [Wed Oct 19 06:58:49 2022] PUT /compute/v2.1/os-quota-sets/ef533fc243ac41ef8c73e6de8dc50bd4 => generated 148 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:58:49.940605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f7c4621-7025-4934-9926-cab77c2007e9 tempest-ListImagesTestJSON-850401668 tempest-ListImagesTestJSON-850401668-project] Calling method '.version_select at 0x7f6d65088310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:49.956847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:49.965022 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4667c9a-ebcf-44c9-be40-1f3ce3b834db tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.162490 Oct 19 06:58:49.965594 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1126/2264] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:49 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:49.970558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:49.971156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:49.977634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.978145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.978580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.979294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:49.979754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:49.980221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:49.997464 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 HTTP/1.1 Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '166a88da-e0f9-45c5-97c0-fe97b62c1196'} Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:49.999136 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:50.003912 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:50.003912 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:50.003912 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:58:50.003912 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:58:50.003912 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:58:50.003912 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:50.003912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:50.003912 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a241e0c-9825-470d-b375-c487f10fc8a8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 404 len: 111 microversion: 2.1 time: 0.034041 Oct 19 06:58:50.003912 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1127/2265] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:49 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:58:50.005830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb1b6a43-fd8f-4cfe-9164-556b7a418dcf tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Calling method '.version_select at 0x7f6d68a56280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:50.024890 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f7c4621-7025-4934-9926-cab77c2007e9 tempest-ListImagesTestJSON-850401668 tempest-ListImagesTestJSON-850401668-project] 10.222.0.39 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.088692 Oct 19 06:58:50.025457 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1139/2266] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Oct 19 06:58:49 2022] GET /compute/v2.1/images => generated 445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:50.039716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db1ab44a-3517-4d7f-af21-28ce76f00257 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68ae8790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:50.078592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb1b6a43-fd8f-4cfe-9164-556b7a418dcf tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.079144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb1b6a43-fd8f-4cfe-9164-556b7a418dcf tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.080889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb1b6a43-fd8f-4cfe-9164-556b7a418dcf tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:50.080889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb1b6a43-fd8f-4cfe-9164-556b7a418dcf tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.081075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb1b6a43-fd8f-4cfe-9164-556b7a418dcf tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.081562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb1b6a43-fd8f-4cfe-9164-556b7a418dcf tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:50.103490 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb1b6a43-fd8f-4cfe-9164-556b7a418dcf tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/ef533fc243ac41ef8c73e6de8dc50bd4/detail" status: 200 len: 463 microversion: 2.57 time: 0.101308 Oct 19 06:58:50.114211 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1128/2267] 10.222.0.39 () {60 vars in 1304 bytes} [Wed Oct 19 06:58:50 2022] GET /compute/v2.1/os-quota-sets/ef533fc243ac41ef8c73e6de8dc50bd4/detail => generated 463 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:58:50.117552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0935f4a8-b123-404b-90ab-cc2a590e50bc tempest-ListImagesTestJSON-850401668 tempest-ListImagesTestJSON-850401668-project] Calling method '.version_select at 0x7f6d68a3ae50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:50.215115 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0935f4a8-b123-404b-90ab-cc2a590e50bc tempest-ListImagesTestJSON-850401668 tempest-ListImagesTestJSON-850401668-project] 10.222.0.39 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.109418 Oct 19 06:58:50.215865 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1129/2268] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 06:58:50 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:50.222866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:50.223738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:50.233163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.234536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.235211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:50.236867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.240536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.240536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:50.264387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:50.458832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:50.466941 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4190989e-f12f-4efe-a388-b665b7e8c80b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1521 microversion: 2.1 time: 0.249033 Oct 19 06:58:50.467577 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1130/2269] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:50 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:50.476147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:50.477062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: df415a60-fbd8-49a7-b5c6-9c31df661ff6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:50.483819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.484478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.490616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:50.490616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.490616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.490616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:50.501729 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] HTTP exception thrown: Instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 could not be found. Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Request method failure captured: Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 HTTP/1.1 Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT55a_C9urZF88Eg7RIAjdrwsEibMPXpNmZesnBggXOyoTqoTxQRUxcMXk4gPYZHn6_-FAAjMBsFCsD5_clETOYVZg-3V0Nbd4eCvQ41Z-wjJGP975G07Ck6wJburEHtQTyi1szPxriT_-v6sWclmSeER4B3hZOrJ55jN_2gcxmpkDSo Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b43fcf22c22a4b0fa4705d5031c3f17c Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b43fcf22c22a4b0fa4705d5031c3f17c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b43fcf22c22a4b0fa4705d5031c3f17c Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-LiveAutoBlockMigrationV225Test-629457781-project Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 641a9af15ca24743baa3049fa9ad2e68 Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-629457781-project Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 could not be found. Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'df415a60-fbd8-49a7-b5c6-9c31df661ff6'} Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 could not be found. Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 could not be found. Oct 19 06:58:50.503354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 could not be found. Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Returning 404 to user: Instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33d74066-a3b5-41c8-b435-70a8120357c7 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6" status: 404 len: 111 microversion: 2.25 time: 0.036061 Oct 19 06:58:50.512593 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1131/2270] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:50 2022] GET /compute/v2.1/servers/df415a60-fbd8-49a7-b5c6-9c31df661ff6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:58:50.513674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:50.513674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:50.521337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.521337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.521337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:50.522604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.522604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.523039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:50.684344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:50.693487 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1cf0683-c42c-42c8-8a94-88119f4d5eec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1534 microversion: 2.1 time: 0.187057 Oct 19 06:58:50.699564 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1132/2271] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:50 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1534 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:50.701167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Action: 'update', calling method: .version_select at 0x7f6d68a790d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:50.949585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.950073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.951774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:50.952627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:50.953033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:50.953465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.000127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.000829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.001577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.002549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.003006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.003434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.156013 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4fd90058-10c1-43f0-9219-f12ffe86a078 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/ef533fc243ac41ef8c73e6de8dc50bd4?user_id=e60c99a4044e4870b71bfe7038386406" status: 200 len: 148 microversion: 2.57 time: 0.459829 Oct 19 06:58:51.156593 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1133/2272] 10.222.0.39 () {62 vars in 1384 bytes} [Wed Oct 19 06:58:50 2022] PUT /compute/v2.1/os-quota-sets/ef533fc243ac41ef8c73e6de8dc50bd4?user_id=e60c99a4044e4870b71bfe7038386406 => generated 148 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:58:51.161463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0c806641-1753-40f4-926b-83241652143f req-6cff7b46-5760-428e-a888-6c950c74361c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df415a60-fbd8-49a7-b5c6-9c31df661ff6", "name": "network-vif-deleted", "tag": "a1017353-4223-41d8-8379-4e33f689a376"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:51.172193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c806641-1753-40f4-926b-83241652143f req-6cff7b46-5760-428e-a888-6c950c74361c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.172686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c806641-1753-40f4-926b-83241652143f req-6cff7b46-5760-428e-a888-6c950c74361c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.173874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c806641-1753-40f4-926b-83241652143f req-6cff7b46-5760-428e-a888-6c950c74361c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.185666 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0c806641-1753-40f4-926b-83241652143f req-6cff7b46-5760-428e-a888-6c950c74361c service nova] Creating event network-vif-deleted:a1017353-4223-41d8-8379-4e33f689a376 for instance df415a60-fbd8-49a7-b5c6-9c31df661ff6 on n-h2-861333-10 Oct 19 06:58:51.191529 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0c806641-1753-40f4-926b-83241652143f req-6cff7b46-5760-428e-a888-6c950c74361c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033791 Oct 19 06:58:51.193380 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1134/2273] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:51.198641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:51.201364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:51.205891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.206375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.206813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.207517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.207976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.208499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.240294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:58:51.380281 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db1ab44a-3517-4d7f-af21-28ce76f00257 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 204 len: 0 microversion: 2.1 time: 1.353389 Oct 19 06:58:51.380856 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1140/2274] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:50 2022] DELETE /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 0 bytes in 1355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:58:51.385604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:51.386243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:51.392369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.392850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.393339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.393972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.394427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.394852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.573952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:51.582046 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06cf6fc7-fd37-4b1c-b790-85d796f631c2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.200146 Oct 19 06:58:51.583312 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1141/2275] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:51 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:51.602919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9246a60-1127-4a3e-9d47-2a193ad93cb8 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] Calling method '.version_select at 0x7f6d64c42dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:51.641948 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5ad9f20-1477-42d3-a986-69fff7a3e763 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 204 len: 0 microversion: 2.25 time: 0.447014 Oct 19 06:58:51.642567 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1135/2276] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 06:58:51 2022] DELETE /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 06:58:51.648521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:51.649180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:51.655522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.656080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.656685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.657936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.658464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.659042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.683251 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9246a60-1127-4a3e-9d47-2a193ad93cb8 tempest-QuotasAdminTestV257-1085173297 tempest-QuotasAdminTestV257-1085173297-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/ef533fc243ac41ef8c73e6de8dc50bd4?user_id=e60c99a4044e4870b71bfe7038386406" status: 200 len: 190 microversion: 2.57 time: 0.083792 Oct 19 06:58:51.683837 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1142/2277] 10.222.0.39 () {60 vars in 1364 bytes} [Wed Oct 19 06:58:51 2022] GET /compute/v2.1/os-quota-sets/ef533fc243ac41ef8c73e6de8dc50bd4?user_id=e60c99a4044e4870b71bfe7038386406 => generated 190 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 06:58:51.685253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:58:51.689039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:51.689659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:51.696687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.697317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.697812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.701435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.701435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.701435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.867121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:51.875022 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-498ded4b-bf78-4660-86eb-11e02fb868d8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1498 microversion: 2.1 time: 0.189880 Oct 19 06:58:51.875587 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1143/2278] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:51 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1498 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:51.880201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:51.881037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:51.886988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.887953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.890912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.890912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:51.890912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:51.890912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:51.911642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:51.991972 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf298232-bf88-406a-b905-bdbb44a60000 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 204 len: 0 microversion: 2.1 time: 0.347605 Oct 19 06:58:51.992757 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1136/2279] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:58:51 2022] DELETE /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:58:52.003593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:52.005225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:52.013308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.014047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.014906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.016063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.017818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.018421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.035659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:52.045180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:52.046728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:52.048047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d732d9a-cf65-482e-93d2-e528896a339e tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1564 microversion: 2.25 time: 0.171374 Oct 19 06:58:52.049096 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1144/2280] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:51 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:52.053375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:52.058673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:52.059967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:52.065630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.066382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.067532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.068023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.068822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.069348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.098540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:52.134211 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8a181f5-b26e-44bd-bebe-34f5bf233505 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.084407 Oct 19 06:58:52.135797 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1145/2281] 10.222.0.39 () {58 vars in 1154 bytes} [Wed Oct 19 06:58:52 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:52.145913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1793198369", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:52.210560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:52.219987 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-196ccbce-c1ee-4140-a589-dca64fd77813 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1521 microversion: 2.1 time: 0.225790 Oct 19 06:58:52.220748 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1137/2282] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:51 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:52.222927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] validate_networks() for [('e0cbc4ff-6510-4cbb-bb14-0dd2e89f3fd3', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:58:52.225881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b35f6858-80fa-48d4-b5de-3e5b5e0d647b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:52.235609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b35f6858-80fa-48d4-b5de-3e5b5e0d647b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.235609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b35f6858-80fa-48d4-b5de-3e5b5e0d647b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.235609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b35f6858-80fa-48d4-b5de-3e5b5e0d647b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.265596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b35f6858-80fa-48d4-b5de-3e5b5e0d647b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Going to try to start instance {{(pid=127567) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 06:58:52.473629 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b35f6858-80fa-48d4-b5de-3e5b5e0d647b tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "POST /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401/action" status: 202 len: 0 microversion: 2.1 time: 0.251625 Oct 19 06:58:52.477618 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1138/2283] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:58:52 2022] POST /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:58:52.483638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:52.484488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:52.493144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.493959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.494705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.495960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.496647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.497320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.529912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:58:52.668991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:58:52.669486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:58:52.669873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:58:52.670293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:58:52.670700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:58:52.681067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.683720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.683720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.683720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.684521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.685125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.703893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:58:52.709659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Getting quotas for user f5b2575fb29940ab95fc8bb9dd177dd9 and project cc630548370e44edb240113421e5d95d. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:58:52.722485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:58:52.724809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:58:52.748406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:52.848030 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-109cf888-cc99-4609-8ba8-94fa3102662d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 204 len: 0 microversion: 2.1 time: 0.368569 Oct 19 06:58:52.850414 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1139/2284] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:58:52 2022] DELETE /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:58:52.856278 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81f60e80-c50f-455a-aa10-86e28a49d1ad tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715322 Oct 19 06:58:52.856925 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1146/2285] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:58:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:58:52.857300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:52.858386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:52.866530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.867379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.868316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.868462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:52.868996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:52.869917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.870598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.871573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.879147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.879147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.879147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:52.879147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:52.879147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:52.879592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:53.060421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:53.068471 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a87a17b-1315-4d81-baed-85379b5ab61a tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1507 microversion: 2.1 time: 0.218086 Oct 19 06:58:53.069014 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1140/2286] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:52 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:53.084596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:53.085199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:53.088417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:53.097597 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c3072ce-3dfe-4b54-9243-f64cb9a162a5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.239621 Oct 19 06:58:53.098491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:53.099044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:53.099485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:53.100465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:53.101109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:53.102021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:53.114643 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1147/2287] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:52 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:53.125063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba63e325-ee3c-4c32-8ad3-c3f8be09271f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:53.126326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba63e325-ee3c-4c32-8ad3-c3f8be09271f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:53.184156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba63e325-ee3c-4c32-8ad3-c3f8be09271f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:53.192304 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba63e325-ee3c-4c32-8ad3-c3f8be09271f tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1208 microversion: 2.1 time: 0.076316 Oct 19 06:58:53.193608 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1148/2288] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:53 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1208 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:53.211726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:53.212403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:53.225323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:53.227314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:53.227314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:53.227314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:53.227624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:53.227826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:53.267588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:53.276380 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0178ea19-019e-46d5-83ec-ca8dfa163cbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1527 microversion: 2.1 time: 0.196622 Oct 19 06:58:53.285257 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1141/2289] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:53 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1527 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:53.426418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:53.436423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:53.437945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:53.440659 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52f62398-0775-4f61-8ed0-c6e98398d6db tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1564 microversion: 2.25 time: 0.244743 Oct 19 06:58:53.441747 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1149/2290] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:53 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1564 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:54.092632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:54.093431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:54.099998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.100536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.101168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.102810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.103623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.104266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.127102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:54.128570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:54.139953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.140800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.143209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.143209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.143209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.143209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.194835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:54.333895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:54.335651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:58:54.345709 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a61007b-9aea-4c2c-a832-239c1abce231 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1507 microversion: 2.1 time: 0.255574 Oct 19 06:58:54.345948 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1142/2291] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:54 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:54.364277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:54.364277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:54.371625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.372422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.373104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.374105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.375284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.377156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.473804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:54.486131 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18b19816-b109-4b39-93cb-929c3c5d2342 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1204 microversion: 2.1 time: 0.138479 Oct 19 06:58:54.487653 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1143/2292] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:54 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1204 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:54.743394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:54.744003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:54.744003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:54.744003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.744003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.744003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.745129 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74bc4b3d-6aff-49a8-a736-91fde7c6309b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.387348 Oct 19 06:58:54.745558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.745693 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1150/2293] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:54 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:54.746101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.746101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e3345106-de66-49cb-a0b1-3daacc9b0e8a req-e79b3a66-6ddd-4498-9ca5-2aa9edfd6ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f4b644a-9003-441d-a9fe-e1c6a6db83c1", "name": "network-vif-deleted", "tag": "c3c575e8-a2aa-48e4-b018-4a01e5f71e1f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e3345106-de66-49cb-a0b1-3daacc9b0e8a req-e79b3a66-6ddd-4498-9ca5-2aa9edfd6ed4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e3345106-de66-49cb-a0b1-3daacc9b0e8a req-e79b3a66-6ddd-4498-9ca5-2aa9edfd6ed4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e3345106-de66-49cb-a0b1-3daacc9b0e8a req-e79b3a66-6ddd-4498-9ca5-2aa9edfd6ed4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e3345106-de66-49cb-a0b1-3daacc9b0e8a req-e79b3a66-6ddd-4498-9ca5-2aa9edfd6ed4 service nova] Creating event network-vif-deleted:c3c575e8-a2aa-48e4-b018-4a01e5f71e1f for instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 on n-h2-861333-10 Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e3345106-de66-49cb-a0b1-3daacc9b0e8a req-e79b3a66-6ddd-4498-9ca5-2aa9edfd6ed4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061792 Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1151/2294] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:54.748758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:54.748758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:54.748758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:54.760625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:54.762626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:54.765077 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ea2a161-5093-4a12-a2a1-7bf5fc2b2969 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1346 microversion: 2.25 time: 0.185641 Oct 19 06:58:54.765481 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1152/2295] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:54 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1346 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:54.785569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:54.793448 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-288fc913-b466-4d0c-ac5d-99674ffe982c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1527 microversion: 2.1 time: 0.304281 Oct 19 06:58:54.796302 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1144/2296] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:54 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:55.370506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:55.371752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:55.382459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:55.383030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:55.383571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:55.387140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:55.387140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:55.387140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:55.521823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:55.532041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:55.542835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:55.543729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:55.544436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:55.545374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:55.546039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:55.547213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:55.787368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:55.795875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:55.808579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8dca4224-6727-4532-8a28-15b27aef217c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1260 microversion: 2.1 time: 0.294234 Oct 19 06:58:55.812779 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f208fa05-d029-4f99-81e6-07a097dc9260 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1507 microversion: 2.1 time: 0.446626 Oct 19 06:58:55.817041 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1153/2297] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:55 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1507 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:55.827218 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1145/2298] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:55 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1260 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:55.831795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:55.844298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-752d0617-9885-4a73-9df4-68e7d388ee80 req-281a71f1-2225-4a15-9e38-f60c98ec2433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c9f25f-c754-463e-8847-72c9e399ce82", "name": "network-vif-deleted", "tag": "e02e6189-be26-48ff-b8a1-923763b464a0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:55.850011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:55.869665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:55.873276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:55.875346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:55.875701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-752d0617-9885-4a73-9df4-68e7d388ee80 req-281a71f1-2225-4a15-9e38-f60c98ec2433 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:55.882695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-752d0617-9885-4a73-9df4-68e7d388ee80 req-281a71f1-2225-4a15-9e38-f60c98ec2433 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:55.882695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-752d0617-9885-4a73-9df4-68e7d388ee80 req-281a71f1-2225-4a15-9e38-f60c98ec2433 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:55.882897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:55.882897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:55.882897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:55.925666 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-752d0617-9885-4a73-9df4-68e7d388ee80 req-281a71f1-2225-4a15-9e38-f60c98ec2433 service nova] Creating event network-vif-deleted:e02e6189-be26-48ff-b8a1-923763b464a0 for instance 61c9f25f-c754-463e-8847-72c9e399ce82 on n-h1-861333-10 Oct 19 06:58:55.944709 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-752d0617-9885-4a73-9df4-68e7d388ee80 req-281a71f1-2225-4a15-9e38-f60c98ec2433 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100819 Oct 19 06:58:55.947494 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1146/2299] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:58:55.962678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:55.963501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:55.970905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:55.971441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:55.972034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:55.972940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:55.973428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:55.974004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:56.035139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:56.035651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:56.036119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:56.036586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lazy-loading 'fault' on Instance uuid 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:58:56.129560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:56.138302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:56.140899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641a9af15ca24743baa3049fa9ad2e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43fcf22c22a4b0fa4705d5031c3f17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:56.142929 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b1acdb7-6473-481e-ba2d-1b9b32885e25 tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 200 len: 1351 microversion: 2.25 time: 0.192322 Oct 19 06:58:56.157174 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1147/2300] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:55 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 1351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:58:56.168884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:56.169832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:56.177062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:56.177757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:56.178359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:56.179234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:56.179846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:56.180489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:56.186103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:56.197541 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b4081f5-0e72-4ed5-81b3-cbf2dffc47ae tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.379200 Oct 19 06:58:56.214045 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1154/2301] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:55 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:56.623760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:56.632501 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4377ec26-9cfe-4b66-9dfa-30686aea9b55 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 200 len: 1310 microversion: 2.1 time: 0.473708 Oct 19 06:58:56.633273 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1148/2302] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:56 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 1310 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:56.707721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a45b57e7-5007-4ce2-bd78-fdef418851c0 req-3651eee8-cedc-4900-bbe7-a326e1456072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac94d23-f2b1-4845-8e83-16cdbd84ca27", "name": "network-vif-deleted", "tag": "c7d56b40-d00e-4dd3-902c-0debbf325b61"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:56.725604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a45b57e7-5007-4ce2-bd78-fdef418851c0 req-3651eee8-cedc-4900-bbe7-a326e1456072 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:56.728016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a45b57e7-5007-4ce2-bd78-fdef418851c0 req-3651eee8-cedc-4900-bbe7-a326e1456072 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:56.728679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a45b57e7-5007-4ce2-bd78-fdef418851c0 req-3651eee8-cedc-4900-bbe7-a326e1456072 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:56.753334 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a45b57e7-5007-4ce2-bd78-fdef418851c0 req-3651eee8-cedc-4900-bbe7-a326e1456072 service nova] Creating event network-vif-deleted:c7d56b40-d00e-4dd3-902c-0debbf325b61 for instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 on n-h2-861333-10 Oct 19 06:58:56.764023 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a45b57e7-5007-4ce2-bd78-fdef418851c0 req-3651eee8-cedc-4900-bbe7-a326e1456072 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060493 Oct 19 06:58:56.766441 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1155/2303] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:58:56.848951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:56.849785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:56.854326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:56.855170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:56.866069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:56.866557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:56.866661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:56.866992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:56.867736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:56.868223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:56.869654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:56.870353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:56.871634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:56.874903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:56.875742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:56.878338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.210032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:57.220835 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0fd70dd5-6979-467d-9fab-353664f28386 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1308 microversion: 2.1 time: 0.370222 Oct 19 06:58:57.242463 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1156/2304] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:56 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:57.242463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:57.242463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] [instance: 4f4b644a-9003-441d-a9fe-e1c6a6db83c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:57.250622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.250802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.251670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.252890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.255895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.263412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.263540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:57.268577 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f29a8cdf-f037-4120-8541-f7e17db863df tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1511 microversion: 2.1 time: 0.424406 Oct 19 06:58:57.285359 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1149/2305] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:56 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:57.297009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:57.297948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:57.305639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.306505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.306995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.307070 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] HTTP exception thrown: Instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 could not be found. Oct 19 06:58:57.307780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.308439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.309025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Request method failure captured: Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 HTTP/1.1 Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT55a_C9urZF88Eg7RIAjdrwsEibMPXpNmZesnBggXOyoTqoTxQRUxcMXk4gPYZHn6_-FAAjMBsFCsD5_clETOYVZg-3V0Nbd4eCvQ41Z-wjJGP975G07Ck6wJburEHtQTyi1szPxriT_-v6sWclmSeER4B3hZOrJ55jN_2gcxmpkDSo Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b43fcf22c22a4b0fa4705d5031c3f17c Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43fcf22c22a4b0fa4705d5031c3f17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b43fcf22c22a4b0fa4705d5031c3f17c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b43fcf22c22a4b0fa4705d5031c3f17c Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-629457781 Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-LiveAutoBlockMigrationV225Test-629457781-project Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 641a9af15ca24743baa3049fa9ad2e68 Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-629457781-project Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 could not be found. Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4f4b644a-9003-441d-a9fe-e1c6a6db83c1'} Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 could not be found. Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 could not be found. Oct 19 06:58:57.309727 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.313578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:57.313578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.313578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:57.313578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:57.313578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:57.313578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:58:57.313578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:58:57.313578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 could not be found. Oct 19 06:58:57.313578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.314193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] Returning 404 to user: Instance 4f4b644a-9003-441d-a9fe-e1c6a6db83c1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:57.319683 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-278a5af3-21f1-4c6e-ba71-332ef684b37d tempest-LiveAutoBlockMigrationV225Test-629457781 tempest-LiveAutoBlockMigrationV225Test-629457781-project] 10.222.0.39 "GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1" status: 404 len: 111 microversion: 2.25 time: 0.079969 Oct 19 06:58:57.320619 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1157/2306] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:58:57 2022] GET /compute/v2.1/servers/4f4b644a-9003-441d-a9fe-e1c6a6db83c1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 06:58:57.325822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:57.333753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:57.334248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.servers [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Removing options 'limit' from query {{(pid=127568) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1500}} Oct 19 06:58:57.335028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:57.336234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.337413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.338008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.338937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.339398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.341514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.348152 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a996a39-35da-4669-8a7a-72b32c8c098d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.023059 Oct 19 06:58:57.349345 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1158/2307] 10.222.0.39 () {58 vars in 1140 bytes} [Wed Oct 19 06:58:57 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 06:58:57.426337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:57.431969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:57.449927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.450678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.451259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.452328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.453089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.453745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.716553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:57.724645 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3a8729a-2bad-40f1-9203-dc8c9fa356e7 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.438006 Oct 19 06:58:57.740293 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1150/2308] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:57 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:57.745365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:57.746498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:57.776140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.777173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.777819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.778736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.779331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.779908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.831150 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 HTTP/1.1 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '61c9f25f-c754-463e-8847-72c9e399ce82'} Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.834263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d6ffbd7-bfef-446c-931b-12ca878c9e1a tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 404 len: 111 microversion: 2.1 time: 0.094962 Oct 19 06:58:57.847061 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1151/2309] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:57 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:58:57.849522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f144d7f5-2d0e-4a36-a47d-d3b76bd13e7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'create', calling method: .version_select at 0x7f6d68a31dc0>, body: {"keypair": {"name": "tempest-keypair-1952968650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnXvXnbUBhXkuccpPdy1tsl2uo4gyZyBNG7AHHYvTCIs4lzaS69xg/f4fTGlZkeWUaRx/CkZU+mpCLw+S4CImjgieSMb/D0AyPtLMSTxAP7E97Pa36WfQy7IZKWqUlhtg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:57.867535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f144d7f5-2d0e-4a36-a47d-d3b76bd13e7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Getting quotas for project 8fd6bbb748b5440fb72fb253477b4180. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:58:57.875337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f144d7f5-2d0e-4a36-a47d-d3b76bd13e7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Getting quotas for user 2fe41984e17744dfa71d2ce82d1023e3 and project 8fd6bbb748b5440fb72fb253477b4180. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:58:57.927239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:57.935129 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89c603f2-dafd-400f-87fb-d6dbac34e10c tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1511 microversion: 2.1 time: 0.566953 Oct 19 06:58:57.935907 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1159/2310] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:57 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1511 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:57.958722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:57.959826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:57.963661 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f144d7f5-2d0e-4a36-a47d-d3b76bd13e7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118629 Oct 19 06:58:57.968295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.969110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.969877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:57.970597 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1152/2311] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 06:58:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:58:57.971505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:57.972361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:57.973198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:58.258982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:58.259603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:58.267448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:58.267940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:58.268400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:58.269109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:58.269562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:58.269990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:58.457012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:58.500258 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42aada8f-7487-4703-8403-5fa30afc58c0 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6" status: 200 len: 1512 microversion: 2.1 time: 0.534615 Oct 19 06:58:58.501230 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1160/2312] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:57 2022] GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 => generated 1512 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:58.539843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:58.541453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:58.559843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:58.563108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:58.583241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:58.583535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:58.584026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:58.586557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:58.595721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:58.620320 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1d56667-0652-4689-baf8-9765f02368c8 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1308 microversion: 2.1 time: 0.365166 Oct 19 06:58:58.633514 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1153/2313] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:58 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1308 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:58.747557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:58.748282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:58:58.758749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:58.760652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:58.761121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:58.763354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:58.763858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:58.764325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:59.366358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:59.378785 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e108306-404f-40c1-b136-2b3bc52edc01 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1512 microversion: 2.1 time: 0.850570 Oct 19 06:58:59.382356 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1161/2314] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:58 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1512 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:58:59.405224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:58:59.409621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:59.412167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:58:59.469274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:58:59.479784 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-198ebde1-75e0-4696-af1e-632ca81e89d5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.736274 Oct 19 06:58:59.481161 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1154/2315] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:58 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:58:59.608968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:59.609591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:59.610135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:59.611628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:58:59.612187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:58:59.612733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:58:59.661583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-392658037", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:58:59.825589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:58:59.912133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:58:59.994597 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d4d762b-e438-486e-83cc-f317a6fa3de8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.597068 Oct 19 06:58:59.996539 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1162/2316] 10.222.0.39 () {58 vars in 1154 bytes} [Wed Oct 19 06:58:59 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:59:00.002081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:00.003594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:00.012502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.013003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.013443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.014157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.014990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.015943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.242710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:00.246415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:00.251584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:00.251584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:00.251584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:00.259850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.260582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.261204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.263761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.265106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.265733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.287922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:00.296926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:00.313126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:00.315942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:00.478137 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72926b68-e68d-43ce-ad71-60702e2f533b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967161 Oct 19 06:59:00.480060 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1155/2317] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:58:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:59:00.495010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:00.500654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:00.501546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:00.504810 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66d5feb8-c6c4-4617-8b4e-2e3fa35a57fc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1308 microversion: 2.1 time: 0.507005 Oct 19 06:59:00.509853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.510590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.511186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.512053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.512766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.513359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.529950 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1163/2318] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:58:59 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:00.535561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-144975cc-610d-49b6-aadb-3bba05c28ff3 req-ee72e2c6-dd76-44ba-8cbe-defdf1bbb78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9333da8c-37f7-46fa-b2b6-7d973f40a27b", "tag": "7526c077-db7e-4147-9101-80b218e5af61"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:00.547725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-144975cc-610d-49b6-aadb-3bba05c28ff3 req-ee72e2c6-dd76-44ba-8cbe-defdf1bbb78e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.548818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-144975cc-610d-49b6-aadb-3bba05c28ff3 req-ee72e2c6-dd76-44ba-8cbe-defdf1bbb78e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.549254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-144975cc-610d-49b6-aadb-3bba05c28ff3 req-ee72e2c6-dd76-44ba-8cbe-defdf1bbb78e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.562024 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-144975cc-610d-49b6-aadb-3bba05c28ff3 req-ee72e2c6-dd76-44ba-8cbe-defdf1bbb78e service nova] Creating event network-changed:7526c077-db7e-4147-9101-80b218e5af61 for instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b on n-h2-861333-10 Oct 19 06:59:00.568491 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-144975cc-610d-49b6-aadb-3bba05c28ff3 req-ee72e2c6-dd76-44ba-8cbe-defdf1bbb78e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036925 Oct 19 06:59:00.570024 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1164/2319] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:00.577413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4548ae72-026a-4944-a439-87a901b9702e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:00.579132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4548ae72-026a-4944-a439-87a901b9702e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:00.806145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:00.820008 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb987052-ffcd-4b76-91e6-5bdccc3a03d2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1511 microversion: 2.1 time: 0.330068 Oct 19 06:59:00.832206 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1156/2320] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:00 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:00.832206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:00.832206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:00.836788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.837480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.838094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.840693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.841399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.841990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.856894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4548ae72-026a-4944-a439-87a901b9702e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:00.867096 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4548ae72-026a-4944-a439-87a901b9702e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1216 microversion: 2.1 time: 0.295310 Oct 19 06:59:00.867975 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1165/2321] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:00 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1216 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:00.875109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:00.876262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:00.884347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.885022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.885741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:00.886763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:00.887399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:00.888032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:01.011145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:01.027397 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-567bc1a9-51b8-4ea3-9c81-875c79fe9663 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.204767 Oct 19 06:59:01.028000 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1157/2322] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:00 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:01.181352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:01.199085 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0119fa66-c48b-4f69-957f-b355e8e94bdf tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6" status: 200 len: 1512 microversion: 2.1 time: 0.326786 Oct 19 06:59:01.228542 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1166/2323] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:00 2022] GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:01.245590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:01.248075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:01.260639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:01.261573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:01.262345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:01.263397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:01.264721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:01.265275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:01.532979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:01.533478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:01.534802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:01.551843 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a8e2302-dc53-4acb-aed8-f5e5c9698f98 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1512 microversion: 2.1 time: 0.310886 Oct 19 06:59:01.552472 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1158/2324] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:01 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:01.562544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:01.565149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:01.566228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:01.567168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:01.567974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:01.568688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:01.578858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:01.586220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:01.597287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:01.609255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:01.609742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:01.610180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:01.611492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:01.611949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:01.612398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:01.667384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:01.737607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:01.746284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:01.746971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:01.748150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:01.977698 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cba6c52d-8086-4da2-9072-71a74be66822 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.403424 Oct 19 06:59:01.978988 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1159/2325] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:59:01 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:01.988622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cc9a381-bb47-47e4-9c79-703d23f4197d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:01.989510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9cc9a381-bb47-47e4-9c79-703d23f4197d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:02.102187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9cc9a381-bb47-47e4-9c79-703d23f4197d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:02.112720 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9cc9a381-bb47-47e4-9c79-703d23f4197d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1216 microversion: 2.1 time: 0.131885 Oct 19 06:59:02.122064 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1160/2326] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:01 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1216 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:02.132976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:02.138733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:02.139636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:02.350510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:02.351037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:02.351485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:02.352285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:02.352788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:02.353683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:02.488915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:02.607666 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8aecf2d2-f691-4331-8118-74167959b7e9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1011 microversion: 2.1 time: 0.492777 Oct 19 06:59:02.608320 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1161/2327] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 06:59:02 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1011 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:02.617439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:02.617439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:02.623427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:02.623934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:02.626084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:02.626084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:02.626084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:02.626084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:02.629268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:02.683277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:02.694740 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f8eb820-9ab7-41cf-9fa2-8a52fa049ad6 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1308 microversion: 2.1 time: 1.170551 Oct 19 06:59:02.714522 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1167/2328] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:01 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1308 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:02.725496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:02.740777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:02.742662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:02.762571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:02.770146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:02.770835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:02.771788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:02.772410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:02.772990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:02.940217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:02.957660 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2afa3060-e1d0-4a88-ab8c-ae131f56d962 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1477 microversion: 2.1 time: 0.348222 Oct 19 06:59:02.960289 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1162/2329] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:02 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:02.966484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1877068598", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:03.013076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:03.045844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] validate_networks() for [('9e8a498f-1e98-47fb-92fa-47fd5d4c664f', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:59:03.181114 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d7c9fa0-79ae-4c0f-9eb4-8abd37ae39c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.465373 Oct 19 06:59:03.183928 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1168/2330] 10.222.0.39 () {58 vars in 1212 bytes} [Wed Oct 19 06:59:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:03.198170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:03.199135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:03.225784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:03.226321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:03.226753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:03.233495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:03.234134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:03.236354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:03.480560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:03.491420 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dcd6b7b4-3d1f-4184-ab5f-a791aee74cfc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1268 microversion: 2.1 time: 0.305016 Oct 19 06:59:03.492007 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1169/2331] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:03 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1268 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:03.503230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:03.518619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:03.519464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:03.524899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:03.525652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:03.526237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:03.527005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:03.527606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:03.528030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:03.618226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:03.667421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:03.690029 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2677c207-83ca-4c29-b77c-110483045c99 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.190797 Oct 19 06:59:03.690941 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1170/2332] 10.222.0.39 () {58 vars in 1196 bytes} [Wed Oct 19 06:59:03 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:03.705782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:03.714634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:03.714634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'name': '-629625959', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:03.719396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:03.720516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:03.721136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:03.722205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:03.722802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:03.723481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:03.884263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:04.036971 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de9d99fe-ee37-4278-97ba-8d376f659d87 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?name=-629625959" status: 200 len: 345 microversion: 2.1 time: 0.337596 Oct 19 06:59:04.041547 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1171/2333] 10.222.0.39 () {58 vars in 1156 bytes} [Wed Oct 19 06:59:03 2022] GET /compute/v2.1/servers?name=-629625959 => generated 345 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:59:04.044410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:04.045022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:04.052322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.052815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.053418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.054191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.054815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.055295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.066517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:04.067951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:04.069945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:04.071753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:04.073150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:04.092679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.093500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.098097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.098097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.098097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.098721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.143538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Getting quotas for project 8fd6bbb748b5440fb72fb253477b4180. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:04.153768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Getting quotas for user 2fe41984e17744dfa71d2ce82d1023e3 and project 8fd6bbb748b5440fb72fb253477b4180. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:04.173192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:04.177449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:04.199634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:04.409362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:04.423860 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12e246af-8f83-4b65-b84e-d1b92ae5c9d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1308 microversion: 2.1 time: 0.377841 Oct 19 06:59:04.424811 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1172/2334] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:04 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:04.430639 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed8ab70f-5221-43d2-ae93-57765dc0fce6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.463091 Oct 19 06:59:04.430639 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1163/2335] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:59:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:59:04.441439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:04.450604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:04.452826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:04.466329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:04.468881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.473465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:04.473941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.474593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.475480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.476076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.476702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.481947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.482617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.483359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.484325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.484965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.485605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.622420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:04.783568 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-922e1883-5d51-427e-98fc-e274c579fc81 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.356338 Oct 19 06:59:04.784524 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1164/2336] 10.222.0.39 () {58 vars in 1154 bytes} [Wed Oct 19 06:59:04 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:04.798502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9a7ade2e-d0fa-43a8-a2b2-cf67746dee05 req-6ce14f80-075e-4f60-80c6-ff85eaa64c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6467606f-c64d-4472-aeb1-4e30dbd9a9ab", "name": "network-vif-unplugged", "status": "completed", "tag": "77095c95-cb01-4107-b1ee-3dbfefb01f4c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:04.807729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a7ade2e-d0fa-43a8-a2b2-cf67746dee05 req-6ce14f80-075e-4f60-80c6-ff85eaa64c83 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.808327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a7ade2e-d0fa-43a8-a2b2-cf67746dee05 req-6ce14f80-075e-4f60-80c6-ff85eaa64c83 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.808842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a7ade2e-d0fa-43a8-a2b2-cf67746dee05 req-6ce14f80-075e-4f60-80c6-ff85eaa64c83 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.822485 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9a7ade2e-d0fa-43a8-a2b2-cf67746dee05 req-6ce14f80-075e-4f60-80c6-ff85eaa64c83 service nova] Creating event network-vif-unplugged:77095c95-cb01-4107-b1ee-3dbfefb01f4c for instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab on n-h1-861333-10 Oct 19 06:59:04.828450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-9a7ade2e-d0fa-43a8-a2b2-cf67746dee05 req-6ce14f80-075e-4f60-80c6-ff85eaa64c83 service nova] Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:59:04.840245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9a7ade2e-d0fa-43a8-a2b2-cf67746dee05 req-6ce14f80-075e-4f60-80c6-ff85eaa64c83 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047390 Oct 19 06:59:04.841304 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1165/2337] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:04.846810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-626b25db-aa0d-4273-96a6-55d778929bf1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:04.847600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-626b25db-aa0d-4273-96a6-55d778929bf1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:04.935699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:04.956437 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a2d62ee-48f3-4fc1-8081-c206249aff81 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1476 microversion: 2.1 time: 0.503214 Oct 19 06:59:04.957517 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1173/2338] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:04 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1476 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:04.963287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:04.963900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:04.979015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.984002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.984002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:04.984002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:04.984002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:04.984002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:05.143234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:05.152552 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27f967be-3607-405a-b071-c484f5af7793 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1274 microversion: 2.1 time: 0.193824 Oct 19 06:59:05.153573 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1174/2339] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:04 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:05.161692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:05.171797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:05.174025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-62962595', 'deleted': False, 'project_id': '294676299e874aa9a6ef62eedc6a73b6'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:05.180048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:05.181025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:05.181661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:05.182649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:05.183447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:05.184013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:05.315101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-626b25db-aa0d-4273-96a6-55d778929bf1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:05.316810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:05.330658 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-626b25db-aa0d-4273-96a6-55d778929bf1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1225 microversion: 2.1 time: 0.487979 Oct 19 06:59:05.332580 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1166/2340] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:04 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1225 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:05.397662 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ded347cf-7e4c-4b9c-b249-98c234647dd8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-62962595" status: 200 len: 345 microversion: 2.1 time: 0.242335 Oct 19 06:59:05.398233 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1175/2341] 10.222.0.39 () {58 vars in 1226 bytes} [Wed Oct 19 06:59:05 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-62962595 => generated 345 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:05.419966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:05.420777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:05.430358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:05.433280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:05.433280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:05.433280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:05.433280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:05.433280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:05.458123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:05.459470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:05.467831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:05.468337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:05.468843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:05.468920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:05.469525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:05.472431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:05.473256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:05.807988 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58362698-2222-4ddc-95fb-22d03a0feef8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 204 len: 0 microversion: 2.1 time: 0.400110 Oct 19 06:59:05.808618 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1167/2342] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:05 2022] DELETE /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:05.817835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:05.818565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:05.827657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:05.827657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:05.827657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:05.827657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:05.827657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:05.827657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:05.981954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:05.990166 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0d47cb8-f924-4838-9509-2d9e5ac54373 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1518 microversion: 2.1 time: 0.177116 Oct 19 06:59:05.993269 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1168/2343] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:05 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:05.995786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:05.996686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:06.003399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:06.003948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:06.004775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:06.005479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:06.006039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:06.006364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:06.020376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:06.029421 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d71c97b5-5e01-4f73-8990-834c2033b9df tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1308 microversion: 2.1 time: 0.575776 Oct 19 06:59:06.030008 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1176/2344] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:05 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1308 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:06.162739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:06.171321 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4a67076-06da-435e-ad4f-cdba4dcf5797 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1476 microversion: 2.1 time: 0.179482 Oct 19 06:59:06.172010 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1169/2345] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:05 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:06.190589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:06.191608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:06.197867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:06.198364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:06.198809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:06.199522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:06.199985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:06.200466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:06.335143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:06.343081 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4636e90-c2fe-4c00-a6e4-e88e52f54210 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1274 microversion: 2.1 time: 0.157421 Oct 19 06:59:06.343658 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1177/2346] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:06 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:06.354766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:06.355729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:06.363197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:06.363697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:06.364474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:06.365394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:06.366327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:06.366771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:06.441978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:06.469316 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4ee1e9b-60be-4003-8d92-215715fb0959 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1277 microversion: 2.1 time: 0.102109 Oct 19 06:59:06.469316 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1170/2347] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:06 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:06.869791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d70b807f-77a5-498e-b504-685d31d75063 req-5c7eab4b-a9db-4c64-8e7d-1db026034e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6467606f-c64d-4472-aeb1-4e30dbd9a9ab", "tag": "77095c95-cb01-4107-b1ee-3dbfefb01f4c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:06.871519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d70b807f-77a5-498e-b504-685d31d75063 req-5c7eab4b-a9db-4c64-8e7d-1db026034e13 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:06.872159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d70b807f-77a5-498e-b504-685d31d75063 req-5c7eab4b-a9db-4c64-8e7d-1db026034e13 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:06.872475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d70b807f-77a5-498e-b504-685d31d75063 req-5c7eab4b-a9db-4c64-8e7d-1db026034e13 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:06.884989 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d70b807f-77a5-498e-b504-685d31d75063 req-5c7eab4b-a9db-4c64-8e7d-1db026034e13 service nova] Creating event network-changed:77095c95-cb01-4107-b1ee-3dbfefb01f4c for instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab on n-h1-861333-10 Oct 19 06:59:06.891070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-d70b807f-77a5-498e-b504-685d31d75063 req-5c7eab4b-a9db-4c64-8e7d-1db026034e13 service nova] Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:59:06.902429 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d70b807f-77a5-498e-b504-685d31d75063 req-5c7eab4b-a9db-4c64-8e7d-1db026034e13 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044996 Oct 19 06:59:06.903357 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1178/2348] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:07.016058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:07.017352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:07.025731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.026315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.026819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.027594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.028140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.028654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.054413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:07.055844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:07.062371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.063142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.063784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.066808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.066808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.066808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.364537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:07.375339 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7698d4f7-7059-4a73-8bbd-1f96e7a6f43f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1518 microversion: 2.1 time: 0.362970 Oct 19 06:59:07.378199 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1171/2349] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:07 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1518 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:07.384623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:07.386232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:07.396404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.397217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.397998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.399110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.400742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.401440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.721535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:07.734031 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b37b1260-1f90-45ae-bcac-5da61f3c28bc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1308 microversion: 2.1 time: 0.681971 Oct 19 06:59:07.737479 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1179/2350] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:07 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1308 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:07.742995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:07.743932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:07.777015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.777753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.782550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.782550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.782550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.782550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.918366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:07.934629 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-125d9846-ef4f-413d-b3ce-d76e6892c4a0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1274 microversion: 2.1 time: 0.195087 Oct 19 06:59:07.939729 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1180/2351] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:07 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:07.960243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:07.961310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:07.969702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.972481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.973185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.975363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:07.976946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:07.977601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:07.991610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:08.007682 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d088110-f0cd-4f88-826b-097c393107e2 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1476 microversion: 2.1 time: 0.627040 Oct 19 06:59:08.030740 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1172/2352] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:07 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1476 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:08.111785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba842396-9270-4164-a89e-5557d924ead8 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Action: 'create', calling method: .version_select at 0x7f6d647aaf70>, body: {"keypair": {"name": "tempest-keypair-1449285316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABUjHekK7ww6+0qP+xIzpG5rBlMb5a02DbaNEqEjeM1Q7ttJIaJqjPwfcDCU7veYLuVqQqhwrCRUbgTAfsbqNnFo5qSGk/dKYRlmF1Hh5oJSPyIH2fONcG9d1Lj4GdYfQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:08.137660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ba842396-9270-4164-a89e-5557d924ead8 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Getting quotas for project 53f346704c1c44249ba3ab23c91469c0. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:08.142171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ba842396-9270-4164-a89e-5557d924ead8 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Getting quotas for user 193730cf6d2040ba81ca9c88fe8b141c and project 53f346704c1c44249ba3ab23c91469c0. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:08.238317 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba842396-9270-4164-a89e-5557d924ead8 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.205660 Oct 19 06:59:08.239408 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1173/2353] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 06:59:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:08.403074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:08.403694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:08.411312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:08.411776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:08.413257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:08.414530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:08.417749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:08.418768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:08.474596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:08.482461 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b05fb07-571d-43b7-9ca3-cc36ba32a9dd tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1283 microversion: 2.1 time: 0.541019 Oct 19 06:59:08.496867 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1181/2354] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:07 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1283 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:08.744757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:08.758919 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3f6f994-d344-404e-b6dd-3a0f631e1317 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1476 microversion: 2.1 time: 0.359805 Oct 19 06:59:08.760188 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1174/2355] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:08 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1476 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:08.764908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:08.765645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:08.778033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:08.779110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:08.779748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:08.781410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:08.782091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:08.782785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:08.923519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1572b554-6a2a-4995-b9cc-4b503e13ff91 req-29c85da2-9e83-4af4-bb97-a21288e825df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab2ea78-908d-4061-8e08-27b47f475760", "name": "network-vif-deleted", "tag": "3a639a80-ec51-48cd-9023-5e4a4e7a5d2f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:08.937577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1572b554-6a2a-4995-b9cc-4b503e13ff91 req-29c85da2-9e83-4af4-bb97-a21288e825df service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:08.940948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1572b554-6a2a-4995-b9cc-4b503e13ff91 req-29c85da2-9e83-4af4-bb97-a21288e825df service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:08.940948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1572b554-6a2a-4995-b9cc-4b503e13ff91 req-29c85da2-9e83-4af4-bb97-a21288e825df service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:08.952182 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1572b554-6a2a-4995-b9cc-4b503e13ff91 req-29c85da2-9e83-4af4-bb97-a21288e825df service nova] Creating event network-vif-deleted:3a639a80-ec51-48cd-9023-5e4a4e7a5d2f for instance 7ab2ea78-908d-4061-8e08-27b47f475760 on n-h1-861333-10 Oct 19 06:59:08.960053 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1572b554-6a2a-4995-b9cc-4b503e13ff91 req-29c85da2-9e83-4af4-bb97-a21288e825df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040175 Oct 19 06:59:08.961373 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1175/2356] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:59:08.971954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:08.975635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:08.981274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:08.981974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:08.982565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:08.983454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:08.984063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:08.984657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:09.046841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:09.053635 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f70e458a-93f3-4c87-b12d-c56fa9143fa1 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1308 microversion: 2.1 time: 0.292744 Oct 19 06:59:09.054236 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1182/2357] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:08 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:09.059144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:09.065745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:09.074351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:09.074862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:09.075318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:09.076142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:09.076679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:09.077113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:09.403090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:09.418535 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffdf96eb-93db-4d9c-9e2a-ad67e9f417b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1474 microversion: 2.1 time: 0.362316 Oct 19 06:59:09.423891 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1183/2358] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:09 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:09.507152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:09.507873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:09.536080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:09.536679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:09.537286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:09.539100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:09.541364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:09.541820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:09.640789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:09.654134 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41b0cff4-9c49-407b-81d2-bb14344699ad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1316 microversion: 2.1 time: 0.687909 Oct 19 06:59:09.655270 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1176/2359] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:08 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:09.663976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0ad707c9-63bc-4b96-8e1f-0c7b99f8e6f2 req-3ca76810-64d1-42be-9a31-5fb757922e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9333da8c-37f7-46fa-b2b6-7d973f40a27b", "name": "network-vif-plugged", "status": "completed", "tag": "7526c077-db7e-4147-9101-80b218e5af61"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:09.677532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0ad707c9-63bc-4b96-8e1f-0c7b99f8e6f2 req-3ca76810-64d1-42be-9a31-5fb757922e5e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:09.678292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0ad707c9-63bc-4b96-8e1f-0c7b99f8e6f2 req-3ca76810-64d1-42be-9a31-5fb757922e5e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:09.679572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0ad707c9-63bc-4b96-8e1f-0c7b99f8e6f2 req-3ca76810-64d1-42be-9a31-5fb757922e5e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:09.692709 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0ad707c9-63bc-4b96-8e1f-0c7b99f8e6f2 req-3ca76810-64d1-42be-9a31-5fb757922e5e service nova] Creating event network-vif-plugged:7526c077-db7e-4147-9101-80b218e5af61 for instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b on n-h2-861333-10 Oct 19 06:59:09.698640 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0ad707c9-63bc-4b96-8e1f-0c7b99f8e6f2 req-3ca76810-64d1-42be-9a31-5fb757922e5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041902 Oct 19 06:59:09.700885 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1177/2360] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:09.785986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:09.788704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:09.797404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:09.799130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:09.799983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:09.800970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:09.801582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:09.802155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:09.874706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:09.875927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:09.876748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:09.877501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lazy-loading 'fault' on Instance uuid 7ab2ea78-908d-4061-8e08-27b47f475760 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:09.971191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:09.986591 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f7e3810-fb4e-444a-b8ae-8b54839e4ab2 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 200 len: 1311 microversion: 2.1 time: 0.205494 Oct 19 06:59:09.997889 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1178/2361] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:09 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 1311 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:10.017196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:10.028244 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea70ac35-1365-4b91-9841-ce689a859c07 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1325 microversion: 2.1 time: 0.526150 Oct 19 06:59:10.029555 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1184/2362] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:09 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1325 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:10.082528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:10.083490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:10.094160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:10.098184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:10.098934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:10.099960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:10.100636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:10.101257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:10.443303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:10.443916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:10.450009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:10.450759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:10.451383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:10.452267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:10.452863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:10.453479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:10.643621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:10.679227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:10.687111 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b07b3bd-f1ae-40d5-8086-99281ff239af tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1308 microversion: 2.1 time: 0.610168 Oct 19 06:59:10.690289 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70d77cb3-e3e4-450e-a61c-ca6682ee517a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1471 microversion: 2.1 time: 0.251334 Oct 19 06:59:10.691334 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1185/2363] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:10 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:10.693039 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1179/2364] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:10 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1308 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:10.706802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:10.707578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:10.726304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43a52b07-07fc-4f01-afcd-7691abecde1d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:10.726832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43a52b07-07fc-4f01-afcd-7691abecde1d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:10.733865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a52b07-07fc-4f01-afcd-7691abecde1d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:10.734154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:10.734684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:10.735143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:10.735826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a52b07-07fc-4f01-afcd-7691abecde1d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:10.735938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:10.736475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:10.742318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a52b07-07fc-4f01-afcd-7691abecde1d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:10.743284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a52b07-07fc-4f01-afcd-7691abecde1d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:10.743895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a52b07-07fc-4f01-afcd-7691abecde1d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:10.744503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a52b07-07fc-4f01-afcd-7691abecde1d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:10.744616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:10.822569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:10.862910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=22 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:11.020226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:11.030321 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e782269e-83b9-4bd2-843f-f0a6bb3c0cb8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1316 microversion: 2.1 time: 0.337620 Oct 19 06:59:11.041519 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1186/2365] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:10 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:11.052091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:11.052992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 7ab2ea78-908d-4061-8e08-27b47f475760] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:11.060301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.061213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.061666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.063266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.064469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.064924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.113412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:11.116205 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] HTTP exception thrown: Instance 7ab2ea78-908d-4061-8e08-27b47f475760 could not be found. Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Request method failure captured: Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 HTTP/1.1 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT5_ifrciZBpKdqV_lojElLZLefhvgx14l5TiRIiCKwSB1XzN0fjXhFyGAz0iGi5yKUx25wWePVe5Ry_DOnSgZe9v_ULgCxspnlZVG8Ivp1Z81bIF4cry9zSaaseJyQVR6CtofBsU-QtT0pm9VgKS3Gx651APeRumDKnlG7Jhn2mO33Q Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 294676299e874aa9a6ef62eedc6a73b6 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ListServerFiltersTestJSON-2016191119 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/294676299e874aa9a6ef62eedc6a73b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/294676299e874aa9a6ef62eedc6a73b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/294676299e874aa9a6ef62eedc6a73b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_294676299e874aa9a6ef62eedc6a73b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ListServerFiltersTestJSON-2016191119 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 294676299e874aa9a6ef62eedc6a73b6 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2016191119 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ListServerFiltersTestJSON-2016191119-project Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8b725b4abc3e4717aae64ecccfa75f98 Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ListServerFiltersTestJSON-2016191119-project Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 7ab2ea78-908d-4061-8e08-27b47f475760 could not be found. Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '7ab2ea78-908d-4061-8e08-27b47f475760'} Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab2ea78-908d-4061-8e08-27b47f475760 could not be found. Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab2ea78-908d-4061-8e08-27b47f475760 could not be found. Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:11.118339 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:11.126638 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:11.126638 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:11.126638 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:11.126638 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:11.126638 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:11.126638 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab2ea78-908d-4061-8e08-27b47f475760 could not be found. Oct 19 06:59:11.126638 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:11.126638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Returning 404 to user: Instance 7ab2ea78-908d-4061-8e08-27b47f475760 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:11.126638 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f17e894-5afb-4202-a1da-2d23b8ec2eb9 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760" status: 404 len: 111 microversion: 2.1 time: 0.080410 Oct 19 06:59:11.128444 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1187/2366] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:11 2022] GET /compute/v2.1/servers/7ab2ea78-908d-4061-8e08-27b47f475760 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:11.133680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:11.134917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:11.145152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.145683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.146130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.146846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.147306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.147783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.343877 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43a52b07-07fc-4f01-afcd-7691abecde1d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "POST /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab/action" status: 202 len: 0 microversion: 2.1 time: 0.621288 Oct 19 06:59:11.347142 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1180/2367] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:59:10 2022] POST /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:59:11.361438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:11.363063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:11.377355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.378127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.378793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.379711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.380394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.381311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.440448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:11.458828 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fefda64e-118a-4b12-8305-4fab80939b54 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1325 microversion: 2.1 time: 0.329188 Oct 19 06:59:11.459191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:11.460188 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1188/2368] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:11 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:11.468908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-94278dde-1ac2-41a3-b5b4-d06e6d250f34 req-467269a7-54e4-4a7c-870c-d61148111406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05fec950-716c-4339-8de8-f7aa8c1e8b59", "tag": "d7b77af1-f570-4be6-80a4-f59540977e4e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:11.503837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-94278dde-1ac2-41a3-b5b4-d06e6d250f34 req-467269a7-54e4-4a7c-870c-d61148111406 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.504759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-94278dde-1ac2-41a3-b5b4-d06e6d250f34 req-467269a7-54e4-4a7c-870c-d61148111406 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.505378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-94278dde-1ac2-41a3-b5b4-d06e6d250f34 req-467269a7-54e4-4a7c-870c-d61148111406 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.526289 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-94278dde-1ac2-41a3-b5b4-d06e6d250f34 req-467269a7-54e4-4a7c-870c-d61148111406 service nova] Creating event network-changed:d7b77af1-f570-4be6-80a4-f59540977e4e for instance 05fec950-716c-4339-8de8-f7aa8c1e8b59 on n-h1-861333-10 Oct 19 06:59:11.533003 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-94278dde-1ac2-41a3-b5b4-d06e6d250f34 req-467269a7-54e4-4a7c-870c-d61148111406 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070694 Oct 19 06:59:11.534219 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1189/2369] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:11.542029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:11.542968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:11.551185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.551681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.552271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.552989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.553444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.554034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.841878 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc0c49f1-8107-44bd-905d-0b7358b3520f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6" status: 204 len: 0 microversion: 2.1 time: 0.492252 Oct 19 06:59:11.843751 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1181/2370] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:11 2022] DELETE /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:11.850651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:11.853381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:11.875719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.882025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.882025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:11.882025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:11.882025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:11.882025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:12.047325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:12.060883 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9bdfbb6a-0b1f-4cbd-86c8-de9e697ee411 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.524791 Oct 19 06:59:12.068806 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1190/2371] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:11 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:12.076343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:12.077394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:12.105631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:12.107025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:12.109576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:12.111008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:12.111721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:12.112516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:12.401296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:12.409442 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e75b42c-e6cd-4c67-99aa-ff8e9bebe205 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1489 microversion: 2.1 time: 0.564369 Oct 19 06:59:12.410583 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1182/2372] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:11 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1489 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:12.416026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:12.419935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:12.432240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:12.443617 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a96bc2bc-c271-4306-b4df-20bd7bb757f8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6" status: 200 len: 1518 microversion: 2.1 time: 0.373470 Oct 19 06:59:12.443811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:12.444218 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1191/2373] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:12 2022] GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 => generated 1518 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:12.449805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:12.450281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:12.451026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:12.451361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2bf6259-2512-43ed-bbc7-8cf819fa746c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1215308661"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:12.451498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:12.452125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:12.465174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2bf6259-2512-43ed-bbc7-8cf819fa746c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:12.472354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2bf6259-2512-43ed-bbc7-8cf819fa746c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:12.473048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2bf6259-2512-43ed-bbc7-8cf819fa746c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:12.473741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2bf6259-2512-43ed-bbc7-8cf819fa746c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:12.476803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2bf6259-2512-43ed-bbc7-8cf819fa746c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:12.477613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2bf6259-2512-43ed-bbc7-8cf819fa746c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:12.478245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2bf6259-2512-43ed-bbc7-8cf819fa746c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:12.836941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:12.847109 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1da5e84d-db91-47f4-872f-3c7928f38b22 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1316 microversion: 2.1 time: 0.435012 Oct 19 06:59:12.849240 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1183/2374] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:12 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:12.855310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:12.856662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:12.866089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:12.866840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:12.867926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:12.868715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:12.869813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:12.870631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.035486 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2bf6259-2512-43ed-bbc7-8cf819fa746c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "POST /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b/action" status: 202 len: 0 microversion: 2.1 time: 0.589876 Oct 19 06:59:13.041823 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1192/2375] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:59:12 2022] POST /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 06:59:13.049329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4eee3bb8-476f-4f18-9a17-12c5eeed18fe req-3c4856a6-75f2-4032-aad1-e082f63eca72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6467606f-c64d-4472-aeb1-4e30dbd9a9ab", "name": "network-vif-plugged", "status": "completed", "tag": "77095c95-cb01-4107-b1ee-3dbfefb01f4c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:13.063057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4eee3bb8-476f-4f18-9a17-12c5eeed18fe req-3c4856a6-75f2-4032-aad1-e082f63eca72 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.064811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4eee3bb8-476f-4f18-9a17-12c5eeed18fe req-3c4856a6-75f2-4032-aad1-e082f63eca72 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.070663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4eee3bb8-476f-4f18-9a17-12c5eeed18fe req-3c4856a6-75f2-4032-aad1-e082f63eca72 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.082140 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4eee3bb8-476f-4f18-9a17-12c5eeed18fe req-3c4856a6-75f2-4032-aad1-e082f63eca72 service nova] Creating event network-vif-plugged:77095c95-cb01-4107-b1ee-3dbfefb01f4c for instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab on n-h1-861333-10 Oct 19 06:59:13.089454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-4eee3bb8-476f-4f18-9a17-12c5eeed18fe req-3c4856a6-75f2-4032-aad1-e082f63eca72 service nova] Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:59:13.110978 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4eee3bb8-476f-4f18-9a17-12c5eeed18fe req-3c4856a6-75f2-4032-aad1-e082f63eca72 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065336 Oct 19 06:59:13.113111 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1193/2376] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:13.122874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01875fe6-0f4a-4a84-aa88-bd0be71d12a2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d645d38b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:13.186550 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01875fe6-0f4a-4a84-aa88-bd0be71d12a2 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7" status: 200 len: 1412 microversion: 2.1 time: 0.069966 Oct 19 06:59:13.197182 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1194/2377] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:13 2022] GET /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:13.203268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-73e75c70-fa9c-4ec0-a4ba-c5f9cc04bdc1 req-f7d86a0c-f933-4b1e-b641-4cf3ff4584db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "745e880d-2135-4f8b-98fe-7d5596f3cffa", "tag": "a0c4a317-f506-4ed2-8d99-93ccf62949b1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:13.215814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:13.217819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-73e75c70-fa9c-4ec0-a4ba-c5f9cc04bdc1 req-f7d86a0c-f933-4b1e-b641-4cf3ff4584db service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.218597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-73e75c70-fa9c-4ec0-a4ba-c5f9cc04bdc1 req-f7d86a0c-f933-4b1e-b641-4cf3ff4584db service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.219207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-73e75c70-fa9c-4ec0-a4ba-c5f9cc04bdc1 req-f7d86a0c-f933-4b1e-b641-4cf3ff4584db service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.229770 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02dc2316-5000-4eb0-a65b-20218d910e36 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1325 microversion: 2.1 time: 0.379262 Oct 19 06:59:13.230637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1184/2378] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:12 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1325 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:13.240963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:13.243964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:13.253697 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-73e75c70-fa9c-4ec0-a4ba-c5f9cc04bdc1 req-f7d86a0c-f933-4b1e-b641-4cf3ff4584db service nova] Creating event network-changed:a0c4a317-f506-4ed2-8d99-93ccf62949b1 for instance 745e880d-2135-4f8b-98fe-7d5596f3cffa on n-h2-861333-10 Oct 19 06:59:13.256906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.260671 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-73e75c70-fa9c-4ec0-a4ba-c5f9cc04bdc1 req-f7d86a0c-f933-4b1e-b641-4cf3ff4584db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061996 Oct 19 06:59:13.261925 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1195/2379] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:13.262518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.262994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.263906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.264562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.265166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.285066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f168ff7b-0369-44a2-93f3-35b23498f360 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64636430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:13.349744 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f168ff7b-0369-44a2-93f3-35b23498f360 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7" status: 200 len: 1412 microversion: 2.1 time: 0.082616 Oct 19 06:59:13.359912 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1196/2380] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:13 2022] GET /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:13.367353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a7de2e8-1fea-40f8-aef7-16649a91d42c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d645d3160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:13.632807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:13.656867 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63b8bfad-993e-478b-b703-84b7e17752e8 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.411627 Oct 19 06:59:13.656867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1185/2381] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:13 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:13.656867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:13.658264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:13.659298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Searching by: {'deleted': False, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:13.668028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.668853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.670142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.670618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.671266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.671892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.678912 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a7de2e8-1fea-40f8-aef7-16649a91d42c tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7" status: 204 len: 0 microversion: 2.1 time: 0.317005 Oct 19 06:59:13.680648 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1197/2382] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:13 2022] DELETE /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:13.685559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:13.686585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:13.695848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.696814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.697543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.698445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.699097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.699733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.704637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:13.745220 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba3a2f4d-f5cb-41ea-9f21-b4ccb38c3910 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.099163 Oct 19 06:59:13.745807 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1186/2383] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 06:59:13 2022] GET /compute/v2.1/servers => generated 334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:13.752486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d0473f1-e3be-4be5-a619-05dcd8689fea tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d68b8c820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:13.804967 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7d0473f1-e3be-4be5-a619-05dcd8689fea tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Image not found. Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d0473f1-e3be-4be5-a619-05dcd8689fea tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7 HTTP/1.1 Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '95188350-aa35-4c1c-85aa-ceefee02dce7'} Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 95188350-aa35-4c1c-85aa-ceefee02dce7 Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 06:59:13.847430 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 95188350-aa35-4c1c-85aa-ceefee02dce7 could not be found. Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d0473f1-e3be-4be5-a619-05dcd8689fea tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d0473f1-e3be-4be5-a619-05dcd8689fea tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7" status: 404 len: 62 microversion: 2.1 time: 0.102755 Oct 19 06:59:13.851373 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1187/2384] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:13 2022] GET /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7 => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:59:13.859817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:13.872395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:13.878223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Searching by: {'deleted': False, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:13.884221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.885027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.885763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.886767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.889480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.889480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:13.916531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:13.955563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=41 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:13.962511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:13.968893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:13.969661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:13.970681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:14.061691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:14.070310 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7273cb8e-76ec-4322-99b0-a5a9b958e631 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6" status: 200 len: 1518 microversion: 2.1 time: 0.388377 Oct 19 06:59:14.071532 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1198/2385] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:13 2022] GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 => generated 1518 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:14.089359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a2386de5-388b-428d-a1a5-dfe8b1804280"}], "security_groups": [{"name": "tempest-securitygroup--201613129"}], "key_name": "tempest-keypair-1449285316", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:14.112198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:14.350841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] validate_networks() for [('a2386de5-388b-428d-a1a5-dfe8b1804280', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:59:14.358499 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1e19b76-822c-4fdd-bd20-0557a5897cb9 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.504700 Oct 19 06:59:14.359088 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1188/2386] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 06:59:13 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:14.364450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:14.365437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:14.380396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:14.381133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:14.381722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:14.382652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:14.386103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:14.386621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.025271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:15.036470 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1019ca52-0b3a-4c1e-9529-1d5c18af266a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1501 microversion: 2.1 time: 0.676123 Oct 19 06:59:15.037684 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1189/2387] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:14 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1501 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:15.045263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:15.046212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:15.054829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.056382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.057092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.058065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.058770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.060815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.240887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:15.241342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:15.241947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:15.242364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:15.242768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:15.254637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.255315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.255828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.256689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.257350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.257772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.267499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=17 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:15.279685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Getting quotas for project 53f346704c1c44249ba3ab23c91469c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:15.284573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Getting quotas for user 193730cf6d2040ba81ca9c88fe8b141c and project 53f346704c1c44249ba3ab23c91469c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:15.303387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:15.308808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:15.315178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:15.324175 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f73823e4-8900-4f63-8d94-a835a4e15bf5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1316 microversion: 2.1 time: 0.285098 Oct 19 06:59:15.325785 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1190/2388] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:15 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:15.331977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:15.333627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:15.346361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.347149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.351249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.351249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.351249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.351249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.466635 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-578ff6ef-09e6-4301-90ed-8f5d087b461c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.381189 Oct 19 06:59:15.468839 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1199/2389] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:59:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:59:15.475342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-55365b60-5b1d-4a25-bf53-06c999fdfe61 req-5162e23a-0d0e-4bb2-9736-49a1955c3f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19d2a23-24c7-4a4f-95c4-8b64f4519cd6", "name": "network-vif-deleted", "tag": "00462ba1-6947-4079-8eca-16f73bbb2f23"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:15.489278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-55365b60-5b1d-4a25-bf53-06c999fdfe61 req-5162e23a-0d0e-4bb2-9736-49a1955c3f03 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.490629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-55365b60-5b1d-4a25-bf53-06c999fdfe61 req-5162e23a-0d0e-4bb2-9736-49a1955c3f03 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.491620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-55365b60-5b1d-4a25-bf53-06c999fdfe61 req-5162e23a-0d0e-4bb2-9736-49a1955c3f03 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.522221 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-55365b60-5b1d-4a25-bf53-06c999fdfe61 req-5162e23a-0d0e-4bb2-9736-49a1955c3f03 service nova] Creating event network-vif-deleted:00462ba1-6947-4079-8eca-16f73bbb2f23 for instance a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 on n-h2-861333-10 Oct 19 06:59:15.529024 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-55365b60-5b1d-4a25-bf53-06c999fdfe61 req-5162e23a-0d0e-4bb2-9736-49a1955c3f03 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058601 Oct 19 06:59:15.531553 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1200/2390] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:15.543513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3445cb0d-f493-46f0-ade7-e4dac649c58d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:15.557985 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3445cb0d-f493-46f0-ade7-e4dac649c58d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019227 Oct 19 06:59:15.564244 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1201/2391] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 06:59:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:15.573264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:15.574744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:15.584020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.584554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.584992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.589144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.589623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.590053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.605870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:15.617140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d012f1a-fd09-41bd-a2cd-78f82a384bf4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1325 microversion: 2.1 time: 0.290096 Oct 19 06:59:15.620339 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1191/2392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:15 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:15.630257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:15.632153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:15.639609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.640586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.641259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.642341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.643071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.643761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.682566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:15.682566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:15.683041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:15.683710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lazy-loading 'fault' on Instance uuid a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:15.791480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:15.792697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:15.802307 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a82d6e3b-01b4-440d-97aa-05ebb291ca5d tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6" status: 200 len: 1311 microversion: 2.1 time: 0.180615 Oct 19 06:59:15.816137 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1192/2393] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:15 2022] GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:15.816326 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bbc40120-c9fc-4ccf-93f5-a0ed76ecd024 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.238078 Oct 19 06:59:15.816326 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1202/2394] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:15 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:15.816481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f761e8fd-d6f6-49d9-bc33-2d2840546199 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:15.816481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f761e8fd-d6f6-49d9-bc33-2d2840546199 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:15.888621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f761e8fd-d6f6-49d9-bc33-2d2840546199 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:15.896980 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f761e8fd-d6f6-49d9-bc33-2d2840546199 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1226 microversion: 2.1 time: 0.092186 Oct 19 06:59:15.897497 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1193/2395] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:15 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:16.063085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:16.063880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:16.071292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.071768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.072382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.074539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.075156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.075745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.125870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:16.127022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:16.143826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.147413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.148040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.149047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.149782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.150375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.186471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:16.206588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:16.302308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:16.311955 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22ff5e21-e5b4-40ca-817e-f555f6fe0be5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1507 microversion: 2.1 time: 0.252684 Oct 19 06:59:16.312749 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1203/2396] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:16 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:16.349576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:16.350203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:16.358255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.359171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.359761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.361161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.361778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.362358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.541313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:16.632246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:16.650680 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14b5400a-1db3-4bc9-98b6-569a983aa5b7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1316 microversion: 2.1 time: 0.305691 Oct 19 06:59:16.651883 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1204/2397] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:16 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:16.668694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:16.669307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:16.673935 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a879c37-64fe-45d7-b6fe-21d69c058521 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 204 len: 0 microversion: 2.1 time: 0.549156 Oct 19 06:59:16.676272 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1194/2398] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:16 2022] DELETE /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 06:59:16.687267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:16.688783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.689310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.689417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:16.689766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.690486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.692203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.692648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.702523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.702523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.705129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.706003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.709853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.710426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.930343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:16.943449 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37123397-38de-4fb5-8848-4b906a9b24d7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1325 microversion: 2.1 time: 0.290077 Oct 19 06:59:16.944599 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1205/2399] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:16 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1325 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:16.964357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:16.964975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:16.973553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.974056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.974503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:16.975222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:16.975685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:16.976140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.007959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:17.022972 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f08e843-fd2b-426b-b747-8b0fdc2538dc tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1700 microversion: 2.1 time: 0.341469 Oct 19 06:59:17.024539 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1195/2400] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:16 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1700 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:17.031177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:17.036985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: a19d2a23-24c7-4a4f-95c4-8b64f4519cd6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:17.058319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.059186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.059862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.060821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.061492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.062161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.079155 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] HTTP exception thrown: Instance a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 could not be found. Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Request method failure captured: Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 HTTP/1.1 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT5_ifrciZBpKdqV_lojElLZLefhvgx14l5TiRIiCKwSB1XzN0fjXhFyGAz0iGi5yKUx25wWePVe5Ry_DOnSgZe9v_ULgCxspnlZVG8Ivp1Z81bIF4cry9zSaaseJyQVR6CtofBsU-QtT0pm9VgKS3Gx651APeRumDKnlG7Jhn2mO33Q Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 294676299e874aa9a6ef62eedc6a73b6 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServerFiltersTestJSON-2016191119 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/294676299e874aa9a6ef62eedc6a73b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/294676299e874aa9a6ef62eedc6a73b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/294676299e874aa9a6ef62eedc6a73b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_294676299e874aa9a6ef62eedc6a73b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ListServerFiltersTestJSON-2016191119 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 294676299e874aa9a6ef62eedc6a73b6 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2016191119 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ListServerFiltersTestJSON-2016191119-project Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 8b725b4abc3e4717aae64ecccfa75f98 Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ListServerFiltersTestJSON-2016191119-project Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 could not be found. Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'a19d2a23-24c7-4a4f-95c4-8b64f4519cd6'} Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 could not be found. Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 could not be found. Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:17.082826 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:17.086022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:17.086022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:17.086022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:17.086022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:17.086022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:17.086022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 could not be found. Oct 19 06:59:17.086022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:17.088663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Returning 404 to user: Instance a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:17.089970 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f41a052e-100e-43a2-bb66-fbe4b0bb6923 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6" status: 404 len: 111 microversion: 2.1 time: 0.062362 Oct 19 06:59:17.091532 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1196/2401] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:17 2022] GET /compute/v2.1/servers/a19d2a23-24c7-4a4f-95c4-8b64f4519cd6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:17.098567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:17.100495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:17.107344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.108394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.109048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.110045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.110746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.111403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.216657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:17.233934 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f19e3c8-6100-4fa7-9b5b-9d5a093dfb01 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.287545 Oct 19 06:59:17.238106 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1206/2402] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:16 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:17.241056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:17.241800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:17.258723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.259298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.260144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.260842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.261562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.262160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.283544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:17.294461 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ed4ccc5-7aa4-4410-9792-76a672637358 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1230 microversion: 2.1 time: 0.200852 Oct 19 06:59:17.295799 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1197/2403] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:17 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1230 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:17.296929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:17.336084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:17.336727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:17.350683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.351320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.351766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.352842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.353533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.354432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.525954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:17.550893 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eeca3203-b333-4aea-84a9-56c2f3d011f7 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1489 microversion: 2.1 time: 0.203860 Oct 19 06:59:17.551752 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1198/2404] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:17 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1489 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:17.559173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-24295bca-8c5e-491a-b431-a7c1e632fc85 req-ea9b96f2-1637-4c9a-9866-333304591db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05fec950-716c-4339-8de8-f7aa8c1e8b59", "name": "network-vif-plugged", "status": "completed", "tag": "d7b77af1-f570-4be6-80a4-f59540977e4e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:17.577257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-24295bca-8c5e-491a-b431-a7c1e632fc85 req-ea9b96f2-1637-4c9a-9866-333304591db7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.577967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-24295bca-8c5e-491a-b431-a7c1e632fc85 req-ea9b96f2-1637-4c9a-9866-333304591db7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.578581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-24295bca-8c5e-491a-b431-a7c1e632fc85 req-ea9b96f2-1637-4c9a-9866-333304591db7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.599202 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a176a6c8-bc71-4663-a3f4-42b742322c65 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 204 len: 0 microversion: 2.1 time: 0.361455 Oct 19 06:59:17.601635 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1207/2405] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:17 2022] DELETE /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:17.610149 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-24295bca-8c5e-491a-b431-a7c1e632fc85 req-ea9b96f2-1637-4c9a-9866-333304591db7 service nova] Creating event network-vif-plugged:d7b77af1-f570-4be6-80a4-f59540977e4e for instance 05fec950-716c-4339-8de8-f7aa8c1e8b59 on n-h1-861333-10 Oct 19 06:59:17.611292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:17.612222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:17.616686 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-24295bca-8c5e-491a-b431-a7c1e632fc85 req-ea9b96f2-1637-4c9a-9866-333304591db7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061208 Oct 19 06:59:17.618057 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1199/2406] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:17.621905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.622580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.623095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.624001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.624742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.625355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.625886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:17.627403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:17.634006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.634493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.635146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.635867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.636492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.639209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.658043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:17.667277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:17.945922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:17.953697 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5810afe3-5e83-4ec8-8e16-c7a6d8262cd4 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1517 microversion: 2.1 time: 0.334025 Oct 19 06:59:17.954364 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1200/2407] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:17 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1517 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:17.958864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:17.959615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:17.965956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.966461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.966901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.967607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.968067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.968530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.972772 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-233a77c5-9c3d-40e3-aafe-71d16e3a6a04 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 204 len: 0 microversion: 2.1 time: 0.368674 Oct 19 06:59:17.973357 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1208/2408] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:17 2022] DELETE /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:17.980699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:17.980699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:17.987244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.987244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.987244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:17.987664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:17.989168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:17.991093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.175536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:18.186478 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b5ce065-587b-4142-8102-aae190e9f9ff tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1325 microversion: 2.1 time: 0.211807 Oct 19 06:59:18.196091 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1209/2409] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:17 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:18.200978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15f65bcb-71ad-4697-9fcb-921adb2d47f9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d6479bdc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:18.251326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:18.259726 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5001d8ac-4e58-45e0-a2ca-1abf5158b092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1316 microversion: 2.1 time: 0.304378 Oct 19 06:59:18.260334 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1201/2410] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:17 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:18.265773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:18.267171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:18.274222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.274950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.275610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.276553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.277689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.278358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.300901 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-15f65bcb-71ad-4697-9fcb-921adb2d47f9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Image not found. Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15f65bcb-71ad-4697-9fcb-921adb2d47f9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7 HTTP/1.1 Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: exception: Image not found. Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '95188350-aa35-4c1c-85aa-ceefee02dce7'} Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 95188350-aa35-4c1c-85aa-ceefee02dce7 to delete Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 95188350-aa35-4c1c-85aa-ceefee02dce7 could not be found. Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:18.304781 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15f65bcb-71ad-4697-9fcb-921adb2d47f9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15f65bcb-71ad-4697-9fcb-921adb2d47f9 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7" status: 404 len: 62 microversion: 2.1 time: 0.109082 Oct 19 06:59:18.309252 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1210/2411] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:18 2022] DELETE /compute/v2.1/images/95188350-aa35-4c1c-85aa-ceefee02dce7 => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:59:18.314979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:18.315591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:18.325842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.326640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.327270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.328631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.328741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.329655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.463459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:18.472392 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-485303bd-6c89-45c1-8222-1ed479f5339a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.161362 Oct 19 06:59:18.474358 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1211/2412] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:18 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:18.474567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:18.477515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:18.477998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:18.482484 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-423f6eed-7799-4e71-8820-b859cdc73e52 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1700 microversion: 2.1 time: 0.220803 Oct 19 06:59:18.483233 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1202/2413] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:18 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1700 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:18.483760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.484269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.484705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.485405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.485917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.486338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.489117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:18.489732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:18.495466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.495951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.497585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.498300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.498916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.499504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.512299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:18.597429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:18.608068 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b66849ff-48f6-49e2-8d92-295428b6f672 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1230 microversion: 2.1 time: 0.123318 Oct 19 06:59:18.609685 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1203/2414] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:18 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1230 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:18.614941 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.compute.api [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Instance is already in deleting state, ignoring this request Oct 19 06:59:18.616342 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54ef4dde-8273-42a7-bc3c-81fa2e7e1868 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 204 len: 0 microversion: 2.1 time: 0.142381 Oct 19 06:59:18.617520 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1212/2415] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:18 2022] DELETE /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:18.627790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:18.628700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:18.635805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.636440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.636890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.637662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.638284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.638876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.843464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:18.852011 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b61abef6-3325-44cb-b1e2-828f35bc089a tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1495 microversion: 2.1 time: 0.230364 Oct 19 06:59:18.852736 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1204/2416] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:18 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1495 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:18.979335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:18.980351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:18.992334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.993050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.993494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:18.994206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:18.994694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:18.995128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.209445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:19.210560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:19.217792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.218013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:19.218656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.219264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.220517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.220980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.221415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.228134 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c39a2320-a3b2-4d8b-8211-6c06730b546f tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1517 microversion: 2.1 time: 0.252776 Oct 19 06:59:19.243324 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1213/2417] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:18 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:19.287694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:19.288468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:19.294530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.295085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.295526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.296405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.296865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.297437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.443263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:19.453108 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bac0f8dd-f669-485e-bfab-ef7cf1d0c765 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1325 microversion: 2.1 time: 0.247406 Oct 19 06:59:19.468885 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1205/2418] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:19 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1325 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:19.497851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:19.498566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:19.534845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.537330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.541210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.541210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.541869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.544438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.590811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:19.600286 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf44ea42-ef73-4487-b312-ec7be6d343fd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1316 microversion: 2.1 time: 0.317450 Oct 19 06:59:19.612128 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1214/2419] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:19 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:19.612128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:19.612128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:19.616460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.617079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.624857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.627583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.628232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.628779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.757505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:19.768955 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03501c9a-8701-43d0-9362-ab6fa859d90d tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.277572 Oct 19 06:59:19.789967 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1206/2420] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:19 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:19.796519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:19.797576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:19.803859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.804671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.805383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.806205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.806869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.807458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.923274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:19.935904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:19.945971 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-307cf85d-8ea5-432e-9d0d-643a2c603974 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1222 microversion: 2.1 time: 0.153501 Oct 19 06:59:19.951105 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1207/2421] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:19 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:19.957754 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bfe0e0bf-46cc-4ac1-8c53-8ceb75ab409d tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1700 microversion: 2.1 time: 0.355292 Oct 19 06:59:19.964702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-eef62eeb-52e8-4daf-be2f-e91876246bee req-3ccd1047-a885-4cbd-8266-461429cad854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745e880d-2135-4f8b-98fe-7d5596f3cffa", "name": "network-vif-plugged", "status": "completed", "tag": "a0c4a317-f506-4ed2-8d99-93ccf62949b1"}, {"server_uuid": "9333da8c-37f7-46fa-b2b6-7d973f40a27b", "name": "network-vif-plugged", "status": "completed", "tag": "7526c077-db7e-4147-9101-80b218e5af61"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:19.964831 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1215/2422] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:19 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1700 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:19.982116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:19.984593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:19.995263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.996364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:19.997573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:19.998488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eef62eeb-52e8-4daf-be2f-e91876246bee req-3ccd1047-a885-4cbd-8266-461429cad854 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.998884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:19.999542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.001637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:20.004250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eef62eeb-52e8-4daf-be2f-e91876246bee req-3ccd1047-a885-4cbd-8266-461429cad854 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.004914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eef62eeb-52e8-4daf-be2f-e91876246bee req-3ccd1047-a885-4cbd-8266-461429cad854 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:20.037767 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-eef62eeb-52e8-4daf-be2f-e91876246bee req-3ccd1047-a885-4cbd-8266-461429cad854 service nova] Creating event network-vif-plugged:a0c4a317-f506-4ed2-8d99-93ccf62949b1 for instance 745e880d-2135-4f8b-98fe-7d5596f3cffa on n-h2-861333-10 Oct 19 06:59:20.038601 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-eef62eeb-52e8-4daf-be2f-e91876246bee req-3ccd1047-a885-4cbd-8266-461429cad854 service nova] Creating event network-vif-plugged:7526c077-db7e-4147-9101-80b218e5af61 for instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b on n-h2-861333-10 Oct 19 06:59:20.047342 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-eef62eeb-52e8-4daf-be2f-e91876246bee req-3ccd1047-a885-4cbd-8266-461429cad854 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093721 Oct 19 06:59:20.059761 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1208/2423] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:20.253973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:20.254986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:20.262724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:20.263558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.264004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:20.264765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:20.265231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.265664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:20.320935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:20.329747 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a45ab55b-cb88-4bc7-b4c2-fbff7a96cb36 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1495 microversion: 2.1 time: 0.363636 Oct 19 06:59:20.345039 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1216/2424] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:19 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1495 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:20.477554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:20.478236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:20.485106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:20.486162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.486765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:20.487626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:20.492455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.492455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:20.704408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:20.715239 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82d3dd73-69c6-47a3-98cd-51fb62b6e97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1325 microversion: 2.1 time: 0.241920 Oct 19 06:59:20.728786 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1217/2425] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:20 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1325 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:20.743951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:20.746581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:20.765469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:20.765469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.765469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:20.765469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:20.765469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.765469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:20.866346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:20.877952 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d037649e-139e-4eb4-84d6-5928007a51e3 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1517 microversion: 2.1 time: 0.629946 Oct 19 06:59:20.880409 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1209/2426] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:20 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1517 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:20.896245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:20.897474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:20.906744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:20.907987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.908684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:20.909579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:20.911715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:20.913322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.025971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:21.037254 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28f90601-42f5-4884-b4e1-752b4bdff614 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1316 microversion: 2.1 time: 0.307071 Oct 19 06:59:21.042800 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1218/2427] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:20 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:21.063302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:21.063302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:21.082546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.089853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.091746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.092530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.093151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.097251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.288029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:21.304774 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06d6fd11-8285-4806-8944-b91672b77022 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1222 microversion: 2.1 time: 0.254775 Oct 19 06:59:21.320373 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1219/2428] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:21 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1222 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:21.330746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:21.336850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:21.344316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.345674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.346337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.347246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.348907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.349550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.473169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:21.481752 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06fe6cc1-80e5-4c12-96fe-7b8ac36f6cd3 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1632 microversion: 2.1 time: 0.159414 Oct 19 06:59:21.486850 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1220/2429] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:21 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1632 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:21.504645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-08527939-344f-4b2d-8918-77c1b6678605 req-b51420cd-7ec0-41d1-95b2-ed888c76e7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4949732f-5c02-49ea-abdf-b5ad3fbc8448", "name": "network-vif-deleted", "tag": "88b3ccba-3dbf-4b6a-8c42-07933009484a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:21.506750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:21.518580 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd87a77c-5465-4472-b151-b8a3dcc0bcb5 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.636929 Oct 19 06:59:21.519170 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1210/2430] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:20 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:21.538970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:21.539526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:21.553797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.558013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.558013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.565470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.566221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.566387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.569976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-08527939-344f-4b2d-8918-77c1b6678605 req-b51420cd-7ec0-41d1-95b2-ed888c76e7d2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.570768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-08527939-344f-4b2d-8918-77c1b6678605 req-b51420cd-7ec0-41d1-95b2-ed888c76e7d2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.572762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-08527939-344f-4b2d-8918-77c1b6678605 req-b51420cd-7ec0-41d1-95b2-ed888c76e7d2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.615558 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-08527939-344f-4b2d-8918-77c1b6678605 req-b51420cd-7ec0-41d1-95b2-ed888c76e7d2 service nova] Creating event network-vif-deleted:88b3ccba-3dbf-4b6a-8c42-07933009484a for instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 on n-h1-861333-10 Oct 19 06:59:21.622603 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-08527939-344f-4b2d-8918-77c1b6678605 req-b51420cd-7ec0-41d1-95b2-ed888c76e7d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134135 Oct 19 06:59:21.628819 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1221/2431] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:21.632681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:21.643652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e2c7ea55-84dd-4c16-ac5d-18c2839d6d8e req-acc660e5-598e-43ee-8d03-ec0aad58d6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9333da8c-37f7-46fa-b2b6-7d973f40a27b", "name": "network-vif-deleted", "tag": "7526c077-db7e-4147-9101-80b218e5af61"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:21.689206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e2c7ea55-84dd-4c16-ac5d-18c2839d6d8e req-acc660e5-598e-43ee-8d03-ec0aad58d6ea service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.689698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e2c7ea55-84dd-4c16-ac5d-18c2839d6d8e req-acc660e5-598e-43ee-8d03-ec0aad58d6ea service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.702018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e2c7ea55-84dd-4c16-ac5d-18c2839d6d8e req-acc660e5-598e-43ee-8d03-ec0aad58d6ea service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.761826 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e2c7ea55-84dd-4c16-ac5d-18c2839d6d8e req-acc660e5-598e-43ee-8d03-ec0aad58d6ea service nova] Creating event network-vif-deleted:7526c077-db7e-4147-9101-80b218e5af61 for instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b on n-h2-861333-10 Oct 19 06:59:21.773753 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e2c7ea55-84dd-4c16-ac5d-18c2839d6d8e req-acc660e5-598e-43ee-8d03-ec0aad58d6ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143163 Oct 19 06:59:21.777877 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1222/2432] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:21.787410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:21.796303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:21.804284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.804778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.808221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.808974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.809446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.809875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.832987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b2575fb29940ab95fc8bb9dd177dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc630548370e44edb240113421e5d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:21.843799 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d740b3c0-5382-415f-a038-3a500803af97 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 200 len: 1453 microversion: 2.1 time: 0.322792 Oct 19 06:59:21.844676 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1211/2433] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:21 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 1453 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:21.907566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:21.908817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:21.920452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.921248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.921869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:21.922762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:21.925899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:21.926368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.031229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:22.045373 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee40acf7-125b-4e4d-90af-5d0ce78f0456 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1475 microversion: 2.1 time: 0.143170 Oct 19 06:59:22.045891 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1212/2434] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:21 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1475 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:22.067104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:22.072554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:22.073731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:22.079176 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f72abd44-0202-4996-a149-3121863f71d4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1521 microversion: 2.1 time: 0.296025 Oct 19 06:59:22.079176 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1223/2435] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:21 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:22.083013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.083577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.083999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.084820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.085747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.086210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.095379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7ce0ec08-09d5-4012-b2a5-221e67eab6ce req-9b9c454d-56e2-4bdd-aa15-9dbd4ebd2bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6467606f-c64d-4472-aeb1-4e30dbd9a9ab", "name": "network-vif-unplugged", "status": "completed", "tag": "77095c95-cb01-4107-b1ee-3dbfefb01f4c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:22.128568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7ce0ec08-09d5-4012-b2a5-221e67eab6ce req-9b9c454d-56e2-4bdd-aa15-9dbd4ebd2bb5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.129322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7ce0ec08-09d5-4012-b2a5-221e67eab6ce req-9b9c454d-56e2-4bdd-aa15-9dbd4ebd2bb5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.129964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7ce0ec08-09d5-4012-b2a5-221e67eab6ce req-9b9c454d-56e2-4bdd-aa15-9dbd4ebd2bb5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.144545 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7ce0ec08-09d5-4012-b2a5-221e67eab6ce req-9b9c454d-56e2-4bdd-aa15-9dbd4ebd2bb5 service nova] Creating event network-vif-unplugged:77095c95-cb01-4107-b1ee-3dbfefb01f4c for instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab on n-h2-861333-10 Oct 19 06:59:22.147934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:22.151890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-7ce0ec08-09d5-4012-b2a5-221e67eab6ce req-9b9c454d-56e2-4bdd-aa15-9dbd4ebd2bb5 service nova] Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:59:22.164991 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7ce0ec08-09d5-4012-b2a5-221e67eab6ce req-9b9c454d-56e2-4bdd-aa15-9dbd4ebd2bb5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075107 Oct 19 06:59:22.166485 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1224/2436] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:22.172389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:22.173896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:22.181411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.182650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.183394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.184743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.185998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.186667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.410710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:22.419260 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15adde8e-697b-4361-b166-b6c58856054e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1466 microversion: 2.1 time: 0.352031 Oct 19 06:59:22.422621 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1213/2437] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:22 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1466 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:22.431714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:22.435837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:22.446101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:22.448221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.452042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.452771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.453859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.455522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.456155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.466446 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79252f8c-d178-40ea-9de1-f62424cb9ff4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1521 microversion: 2.1 time: 0.297650 Oct 19 06:59:22.468894 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1225/2438] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:22 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:22.732250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:22.741495 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a0d5e38-880e-4b2f-8fe1-f4238ffead46 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1286 microversion: 2.1 time: 0.317132 Oct 19 06:59:22.752180 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1214/2439] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:22 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1286 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:22.752180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce3ed67d-8172-456a-97b5-a3b89f9aef92 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1919012967"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:22.752180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce3ed67d-8172-456a-97b5-a3b89f9aef92 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:22.760829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3ed67d-8172-456a-97b5-a3b89f9aef92 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.761830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3ed67d-8172-456a-97b5-a3b89f9aef92 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.762509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3ed67d-8172-456a-97b5-a3b89f9aef92 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.763496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3ed67d-8172-456a-97b5-a3b89f9aef92 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.764167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3ed67d-8172-456a-97b5-a3b89f9aef92 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.764819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3ed67d-8172-456a-97b5-a3b89f9aef92 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.825125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4ebb9cb-cba4-41e5-b118-cacca58d3237 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:22.826262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4ebb9cb-cba4-41e5-b118-cacca58d3237 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:22.833917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ebb9cb-cba4-41e5-b118-cacca58d3237 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.834614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ebb9cb-cba4-41e5-b118-cacca58d3237 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.835297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ebb9cb-cba4-41e5-b118-cacca58d3237 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:22.860046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ebb9cb-cba4-41e5-b118-cacca58d3237 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:22.860046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ebb9cb-cba4-41e5-b118-cacca58d3237 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:22.860046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ebb9cb-cba4-41e5-b118-cacca58d3237 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.335152 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4ebb9cb-cba4-41e5-b118-cacca58d3237 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1619 microversion: 2.1 time: 0.853565 Oct 19 06:59:23.336164 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1226/2440] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:22 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1619 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:23.341269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:23.342118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:23.360068 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce3ed67d-8172-456a-97b5-a3b89f9aef92 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa/action" status: 202 len: 0 microversion: 2.1 time: 0.616030 Oct 19 06:59:23.362524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.363445 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1215/2441] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 06:59:22 2022] POST /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 06:59:23.364507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.366365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.369770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.376994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.376994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.380048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:23.380815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:23.387618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.388385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.388996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.389780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.390550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.390993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.433632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.434459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.435864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.436573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lazy-loading 'fault' on Instance uuid 4949732f-5c02-49ea-abdf-b5ad3fbc8448 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:23.536412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25848ed5bded46faa0176778a6eb100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5f1db3c5044e68bc7b8525196441dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:23.544373 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-481bb7a9-7a16-481b-8077-32fdb1a86941 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 200 len: 1359 microversion: 2.1 time: 0.206711 Oct 19 06:59:23.545219 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1227/2442] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:23 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:23.550599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:23.551526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 9333da8c-37f7-46fa-b2b6-7d973f40a27b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:23.564200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.564200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.564200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.564200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.564200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.565290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.581831 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b could not be found. Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b HTTP/1.1 Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b could not be found. Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9333da8c-37f7-46fa-b2b6-7d973f40a27b'} Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b could not be found. Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b could not be found. Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.583505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:23.586813 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:23.586813 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:23.586813 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:23.586813 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:23.586813 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b could not be found. Oct 19 06:59:23.586813 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.586813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance 9333da8c-37f7-46fa-b2b6-7d973f40a27b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:23.586813 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90bfff8a-c66f-4251-afdd-7757ce580ffa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b" status: 404 len: 111 microversion: 2.1 time: 0.039698 Oct 19 06:59:23.588212 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1228/2443] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:23 2022] GET /compute/v2.1/servers/9333da8c-37f7-46fa-b2b6-7d973f40a27b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:23.596033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:23.596033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:23.601304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.601800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.602246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.602950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.603411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.603844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.643391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.644338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.644708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.645165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lazy-loading 'fault' on Instance uuid 4d3b7f20-85db-4e78-bb43-118ccd5ef401 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:23.700351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b725b4abc3e4717aae64ecccfa75f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294676299e874aa9a6ef62eedc6a73b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:23.714198 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3dc01f5-069e-42ee-92ad-67acc65170f1 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 200 len: 1310 microversion: 2.1 time: 0.124712 Oct 19 06:59:23.714917 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1229/2444] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:23 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 1310 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:23.733806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ab1f819-d509-499a-ad6f-63babbfbe954 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Action: 'create', calling method: .version_select at 0x7f6d641031f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-245353028", "policies": ["affinity"]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:23.755765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3ab1f819-d509-499a-ad6f-63babbfbe954 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:23.766213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3ab1f819-d509-499a-ad6f-63babbfbe954 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:23.769052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:23.885852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3ab1f819-d509-499a-ad6f-63babbfbe954 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:23.890825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3ab1f819-d509-499a-ad6f-63babbfbe954 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:23.897938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:23.900495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=21 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:23.903623 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ab1f819-d509-499a-ad6f-63babbfbe954 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.187439 Oct 19 06:59:23.904475 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1230/2445] 10.222.0.39 () {60 vars in 1174 bytes} [Wed Oct 19 06:59:23 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:23.909158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e46a32f8-ed8b-4a48-9580-8bdbdacc2b7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '.version_select at 0x7f6d641034c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:23.920587 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a614305d-e1f9-478b-ad4c-5f69fb07e361 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.554805 Oct 19 06:59:23.921568 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1216/2446] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:23 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:23.933018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:23.933822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:23.942439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.947465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.947465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.947465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.947465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.947465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.964415 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 HTTP/1.1 Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '166a88da-e0f9-45c5-97c0-fe97b62c1196'} Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:23.969471 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:23.977307 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0abf908-86fc-41e2-8c48-932b63d617b3 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 404 len: 111 microversion: 2.1 time: 0.052961 Oct 19 06:59:23.979395 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1217/2447] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:23 2022] DELETE /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:23.985162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:23.986728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:23.994105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.995307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.995982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:23.997211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:23.997874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:23.998509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.124736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:24.133949 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-920ba78c-cdb7-497e-8a78-fd0f56f0672c tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1284 microversion: 2.1 time: 0.153259 Oct 19 06:59:24.140990 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1218/2448] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:23 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:24.146368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8b096c01-be48-445b-8f1a-808818558806 req-8f7b1304-821a-4beb-a5aa-7f6622cf3362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3b7f20-85db-4e78-bb43-118ccd5ef401", "name": "network-vif-deleted", "tag": "0404710e-510e-48fa-be5e-029723586840"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:24.155743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8b096c01-be48-445b-8f1a-808818558806 req-8f7b1304-821a-4beb-a5aa-7f6622cf3362 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.156287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8b096c01-be48-445b-8f1a-808818558806 req-8f7b1304-821a-4beb-a5aa-7f6622cf3362 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.159189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8b096c01-be48-445b-8f1a-808818558806 req-8f7b1304-821a-4beb-a5aa-7f6622cf3362 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.170509 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8b096c01-be48-445b-8f1a-808818558806 req-8f7b1304-821a-4beb-a5aa-7f6622cf3362 service nova] Creating event network-vif-deleted:0404710e-510e-48fa-be5e-029723586840 for instance 4d3b7f20-85db-4e78-bb43-118ccd5ef401 on n-h1-861333-10 Oct 19 06:59:24.175415 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8b096c01-be48-445b-8f1a-808818558806 req-8f7b1304-821a-4beb-a5aa-7f6622cf3362 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033252 Oct 19 06:59:24.176005 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1219/2449] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:24.181018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.181842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 166a88da-e0f9-45c5-97c0-fe97b62c1196] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:24.187899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.188406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.188880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.189583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.190047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.190465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.207937 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 HTTP/1.1 Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '166a88da-e0f9-45c5-97c0-fe97b62c1196'} Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.216758 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.220588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.220588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.220588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:24.220588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:24.220588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. Oct 19 06:59:24.220588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.221579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance 166a88da-e0f9-45c5-97c0-fe97b62c1196 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:24.221879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-171c6d30-aeeb-4a2c-9a01-190bac3c8c74 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196" status: 404 len: 111 microversion: 2.1 time: 0.044763 Oct 19 06:59:24.222615 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1220/2450] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:24 2022] GET /compute/v2.1/servers/166a88da-e0f9-45c5-97c0-fe97b62c1196 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:24.229147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-215157921", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3f1302cc-65fa-4253-b491-ad55b0ce99a4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:24.289733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:59:24.367440 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e46a32f8-ed8b-4a48-9580-8bdbdacc2b7d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/images/1d1e9c2d-c618-4be2-9e9b-5a191475af26" status: 204 len: 0 microversion: 2.1 time: 0.461477 Oct 19 06:59:24.368091 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1231/2451] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:23 2022] DELETE /compute/v2.1/images/1d1e9c2d-c618-4be2-9e9b-5a191475af26 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:24.376512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcaf8fd8-1973-492d-9a34-25813997e7b5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d640d8550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.402884 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bcaf8fd8-1973-492d-9a34-25813997e7b5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Image not found. Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcaf8fd8-1973-492d-9a34-25813997e7b5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 HTTP/1.1 Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: exception: Image not found. Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '570a689e-c143-48d7-bfc1-4a9a075a58c1'} Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 570a689e-c143-48d7-bfc1-4a9a075a58c1 to delete Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 570a689e-c143-48d7-bfc1-4a9a075a58c1 could not be found. Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.404787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcaf8fd8-1973-492d-9a34-25813997e7b5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bcaf8fd8-1973-492d-9a34-25813997e7b5 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1" status: 404 len: 62 microversion: 2.1 time: 0.036771 Oct 19 06:59:24.409622 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1232/2452] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:24 2022] DELETE /compute/v2.1/images/570a689e-c143-48d7-bfc1-4a9a075a58c1 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:59:24.416535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e06a6b7-2d8b-4349-b116-164232b3d460 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '.version_select at 0x7f6d640498b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.449988 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-7e06a6b7-2d8b-4349-b116-164232b3d460 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Image not found. Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e06a6b7-2d8b-4349-b116-164232b3d460 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/images/1d1e9c2d-c618-4be2-9e9b-5a191475af26 HTTP/1.1 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: exception: Image not found. Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1d1e9c2d-c618-4be2-9e9b-5a191475af26'} Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1d1e9c2d-c618-4be2-9e9b-5a191475af26 Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 06:59:24.452435 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1d1e9c2d-c618-4be2-9e9b-5a191475af26 could not be found. Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 06:59:24.456729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.461608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e06a6b7-2d8b-4349-b116-164232b3d460 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:24.462472 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e06a6b7-2d8b-4349-b116-164232b3d460 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/images/1d1e9c2d-c618-4be2-9e9b-5a191475af26" status: 404 len: 62 microversion: 2.1 time: 0.054832 Oct 19 06:59:24.463067 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1233/2453] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:24 2022] GET /compute/v2.1/images/1d1e9c2d-c618-4be2-9e9b-5a191475af26 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:59:24.474256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.474889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:24.483480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.483975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.484460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.485172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.485789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.486209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.500652 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 HTTP/1.1 Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'eac94d23-f2b1-4845-8e83-16cdbd84ca27'} Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:24.502937 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:24.506792 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6f95cf6-d935-4852-847f-028418b99973 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 404 len: 111 microversion: 2.1 time: 0.038347 Oct 19 06:59:24.508013 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1234/2454] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:24 2022] DELETE /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:24.513484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.514092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:24.520614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.521097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.521556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.522248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.522700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.523118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.725996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:24.734377 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-355bd967-7128-44be-bcb4-d651e723b87b tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1533 microversion: 2.1 time: 0.225296 Oct 19 06:59:24.734949 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1235/2455] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:24 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1533 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:24.739548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.740187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: eac94d23-f2b1-4845-8e83-16cdbd84ca27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:24.749842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.749842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.749842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.752981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.753929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.754589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.772733 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 HTTP/1.1 Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'eac94d23-f2b1-4845-8e83-16cdbd84ca27'} Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.774271 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance eac94d23-f2b1-4845-8e83-16cdbd84ca27 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c52674e9-d2e6-42c6-981f-d97602ef0437 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27" status: 404 len: 111 microversion: 2.1 time: 0.039757 Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1236/2456] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:24 2022] GET /compute/v2.1/servers/eac94d23-f2b1-4845-8e83-16cdbd84ca27 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:24.782327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.782896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] [instance: 4949732f-5c02-49ea-abdf-b5ad3fbc8448] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:24.789269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.790161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.790602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.791762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.792255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.792690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.809469 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] HTTP exception thrown: Instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 could not be found. Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Request method failure captured: Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 HTTP/1.1 Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT5_ql1aElQBX_K18uFCQ3pRzsdhIxBtrQactLzW0YTu6k4bcMBYw84xTVNkkhFxYzjuykeqdVCwLHaLSbRuoHQeidpqKOxKejcjGDGoaRW8c_m0Z8CGavFTqvlBqV_y8KE39NO1Rg6T8NxfCvmyluzcyd5CzRWsSWAo7F_G3lOgoclc Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: af5f1db3c5044e68bc7b8525196441dc Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1494619790 Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/af5f1db3c5044e68bc7b8525196441dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af5f1db3c5044e68bc7b8525196441dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af5f1db3c5044e68bc7b8525196441dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_af5f1db3c5044e68bc7b8525196441dc", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1494619790 Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: af5f1db3c5044e68bc7b8525196441dc Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1494619790 Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1494619790-project Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 25848ed5bded46faa0176778a6eb100f Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1494619790-project Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 could not be found. Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4949732f-5c02-49ea-abdf-b5ad3fbc8448'} Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 could not be found. Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 could not be found. Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.811143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 could not be found. Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Returning 404 to user: Instance 4949732f-5c02-49ea-abdf-b5ad3fbc8448 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10244c89-766e-4c3c-bca5-dd54ca20b093 tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448" status: 404 len: 111 microversion: 2.1 time: 0.034855 Oct 19 06:59:24.815405 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1237/2457] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:24 2022] GET /compute/v2.1/servers/4949732f-5c02-49ea-abdf-b5ad3fbc8448 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:24.818294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.818906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] [instance: 4d3b7f20-85db-4e78-bb43-118ccd5ef401] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:24.824834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.825326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.825766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.826465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.826921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.827349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.843931 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] HTTP exception thrown: Instance 4d3b7f20-85db-4e78-bb43-118ccd5ef401 could not be found. Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Request method failure captured: Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 HTTP/1.1 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT5_ifrciZBpKdqV_lojElLZLefhvgx14l5TiRIiCKwSB1XzN0fjXhFyGAz0iGi5yKUx25wWePVe5Ry_DOnSgZe9v_ULgCxspnlZVG8Ivp1Z81bIF4cry9zSaaseJyQVR6CtofBsU-QtT0pm9VgKS3Gx651APeRumDKnlG7Jhn2mO33Q Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 294676299e874aa9a6ef62eedc6a73b6 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ListServerFiltersTestJSON-2016191119 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/294676299e874aa9a6ef62eedc6a73b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/294676299e874aa9a6ef62eedc6a73b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/294676299e874aa9a6ef62eedc6a73b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_294676299e874aa9a6ef62eedc6a73b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ListServerFiltersTestJSON-2016191119 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 294676299e874aa9a6ef62eedc6a73b6 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2016191119 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ListServerFiltersTestJSON-2016191119-project Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8b725b4abc3e4717aae64ecccfa75f98 Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ListServerFiltersTestJSON-2016191119-project Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 4d3b7f20-85db-4e78-bb43-118ccd5ef401 could not be found. Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4d3b7f20-85db-4e78-bb43-118ccd5ef401'} Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3b7f20-85db-4e78-bb43-118ccd5ef401 could not be found. Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3b7f20-85db-4e78-bb43-118ccd5ef401 could not be found. Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.845561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.849608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.849608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.849608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.849608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:24.849608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:24.849608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3b7f20-85db-4e78-bb43-118ccd5ef401 could not be found. Oct 19 06:59:24.849608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.849608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] Returning 404 to user: Instance 4d3b7f20-85db-4e78-bb43-118ccd5ef401 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:24.849608 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c08163e3-a4d9-4b66-aedf-9545fe39b4c8 tempest-ListServerFiltersTestJSON-2016191119 tempest-ListServerFiltersTestJSON-2016191119-project] 10.222.0.39 "GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401" status: 404 len: 111 microversion: 2.1 time: 0.032331 Oct 19 06:59:24.850787 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1238/2458] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:24 2022] GET /compute/v2.1/servers/4d3b7f20-85db-4e78-bb43-118ccd5ef401 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:24.855537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f14c550-372b-4805-b97c-6584421e0402 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64049e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.870474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:24.871415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:24.872342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:24.872906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:24.873493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:24.888434 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1f14c550-372b-4805-b97c-6584421e0402 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Image not found. Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f14c550-372b-4805-b97c-6584421e0402 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 HTTP/1.1 Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: exception: Image not found. Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'ec09972e-3443-44b2-9654-d9735b5c6e75'} Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ec09972e-3443-44b2-9654-d9735b5c6e75 to delete Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ec09972e-3443-44b2-9654-d9735b5c6e75 could not be found. Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.890150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f14c550-372b-4805-b97c-6584421e0402 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f14c550-372b-4805-b97c-6584421e0402 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75" status: 404 len: 62 microversion: 2.1 time: 0.039615 Oct 19 06:59:24.898878 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1239/2459] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:24 2022] DELETE /compute/v2.1/images/ec09972e-3443-44b2-9654-d9735b5c6e75 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:59:24.900232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3fac12f7-9d27-411d-afb9-9d964f888ada tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] Calling method '.version_select at 0x7f6d641034c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.940409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.941725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.942426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.943418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:24.944066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:24.944707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:24.966206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:24.972356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:24.975358 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3fac12f7-9d27-411d-afb9-9d964f888ada tempest-ServersTestJSON-1494619790 tempest-ServersTestJSON-1494619790-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-924072454" status: 202 len: 0 microversion: 2.1 time: 0.080334 Oct 19 06:59:24.976529 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1240/2460] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 06:59:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-924072454 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:59:24.982755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:24.982755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:24.987130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Going to run 2 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:24.990542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:24.999112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.000812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.003479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.004254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.009289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.011122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.033521 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce HTTP/1.1 Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1e9ce9b7-76c3-46e8-8de2-b50c0e126dce'} Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:25.035745 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.038864 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.041659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:25.043044 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08c71c36-8086-4ae0-add1-20649074e810 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 404 len: 111 microversion: 2.1 time: 0.065458 Oct 19 06:59:25.043784 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1241/2461] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:24 2022] DELETE /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:25.051082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:25.051951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:25.059439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.061154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.061806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.063188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.064508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.065171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.132730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127567) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 19 06:59:25.178338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:25.189686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:25.314478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:25.321460 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c967ab2f-9bdc-42c9-8fe5-2e2948459605 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.276305 Oct 19 06:59:25.322224 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1242/2462] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:25 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:25.327143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:25.327948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:25.340012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.340679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.341264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.342094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.342619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.343108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.358496 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce HTTP/1.1 Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1e9ce9b7-76c3-46e8-8de2-b50c0e126dce'} Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.360457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.368578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:25.368578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:25.368578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:25.368578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:25.368578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. Oct 19 06:59:25.368578 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.368578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance 1e9ce9b7-76c3-46e8-8de2-b50c0e126dce could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:25.368578 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3b8bc2a-c17c-48dc-8b3d-58ad0e1a42d0 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce" status: 404 len: 111 microversion: 2.1 time: 0.039119 Oct 19 06:59:25.368578 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1243/2463] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:25 2022] GET /compute/v2.1/servers/1e9ce9b7-76c3-46e8-8de2-b50c0e126dce => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:25.372870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:25.373615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:25.380858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.381873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.382763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.383681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.384382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.385007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.392927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:25.400784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:25.427978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:25.431201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=d5cdaae7-d4cb-4347-a879-9b98c1747932,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:25.604752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:25.612089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:25.618907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:25.648185 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea2d64db-b7a5-41ff-8cda-c5c411b7bd00 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1351 microversion: 2.1 time: 0.266832 Oct 19 06:59:25.648185 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1244/2464] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:25 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1351 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:25.648185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84e4d3ed-067e-46d1-a0fc-ea81020bfc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64049700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:25.670043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:25.689997 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-84e4d3ed-067e-46d1-a0fc-ea81020bfc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Image not found. Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84e4d3ed-067e-46d1-a0fc-ea81020bfc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c HTTP/1.1 Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: exception: Image not found. Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '14625103-e1dd-4c45-852f-55e9322ecb0c'} Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 14625103-e1dd-4c45-852f-55e9322ecb0c to delete Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14625103-e1dd-4c45-852f-55e9322ecb0c could not be found. Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.691924 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84e4d3ed-067e-46d1-a0fc-ea81020bfc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:25.695391 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84e4d3ed-067e-46d1-a0fc-ea81020bfc94 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c" status: 404 len: 62 microversion: 2.1 time: 0.058979 Oct 19 06:59:25.698226 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1245/2465] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:25 2022] DELETE /compute/v2.1/images/14625103-e1dd-4c45-852f-55e9322ecb0c => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:59:25.770172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:25.781737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:25.849153 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a128d363-dab8-4347-ae59-0e1717a26f66 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.625637 Oct 19 06:59:25.849920 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1221/2466] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:59:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 1627 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 19 06:59:25.857299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:25.858019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:25.864416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.865093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.865681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.866702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.867304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.867877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.888676 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 HTTP/1.1 Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '8e405aee-9ae5-4c1c-a013-11fb09e48684'} Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:25.894144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0269dac1-01ca-4db4-adec-600804e2d79e tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 404 len: 111 microversion: 2.1 time: 0.043129 Oct 19 06:59:25.897526 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1222/2467] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:25 2022] DELETE /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:25.903666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:25.904295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:25.913700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.914456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.914969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.915835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:25.916334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:25.916763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:25.961948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1083365152", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:26.042572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:59:26.305515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:26.314554 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c884d2f8-3522-4f13-9bc6-3f1104dfe00c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1539 microversion: 2.1 time: 0.417583 Oct 19 06:59:26.315313 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1223/2468] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:25 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1539 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:26.333734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:26.339171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:26.341429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Searching by: {'deleted': False, 'project_id': 'a6f0b288d116428981f07801b48d1cc8'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:26.365224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:26.365899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:26.366510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:26.367303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:26.367799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:26.368885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:26.401850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:26.430381 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2881b779-0623-4229-a5d3-997256a9d46a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.100679 Oct 19 06:59:26.431169 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1224/2469] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 06:59:26 2022] GET /compute/v2.1/servers => generated 1001 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:26.444459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:26.444459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:26.444459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:26.444459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:26.444459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:26.444806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:26.444806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: 8e405aee-9ae5-4c1c-a013-11fb09e48684] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:26.449185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:26.449673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:26.450109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:26.451070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:26.451583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:26.451722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:26.452125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:26.452380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:26.452863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:26.453574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:26.454028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:26.454476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:26.471580 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 HTTP/1.1 Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '8e405aee-9ae5-4c1c-a013-11fb09e48684'} Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:26.473267 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:26.478048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:26.478048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:26.478048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:26.478048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:26.478048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. Oct 19 06:59:26.478048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:26.478048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance 8e405aee-9ae5-4c1c-a013-11fb09e48684 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:26.478048 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9922f14-9fd8-490a-9f0f-0050a8b4a3aa tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684" status: 404 len: 111 microversion: 2.1 time: 0.042299 Oct 19 06:59:26.478048 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1225/2470] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:26 2022] GET /compute/v2.1/servers/8e405aee-9ae5-4c1c-a013-11fb09e48684 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:26.480376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-93ab10b0-de0b-4497-9992-d54f119b977f req-03ec60d9-d0c9-4e10-bd46-a9bf6feca8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6467606f-c64d-4472-aeb1-4e30dbd9a9ab", "tag": "77095c95-cb01-4107-b1ee-3dbfefb01f4c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:26.493761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-93ab10b0-de0b-4497-9992-d54f119b977f req-03ec60d9-d0c9-4e10-bd46-a9bf6feca8e0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:26.494277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-93ab10b0-de0b-4497-9992-d54f119b977f req-03ec60d9-d0c9-4e10-bd46-a9bf6feca8e0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:26.494885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-93ab10b0-de0b-4497-9992-d54f119b977f req-03ec60d9-d0c9-4e10-bd46-a9bf6feca8e0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:26.503025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Getting quotas for project 4b63168bfe4941ac8e4fbf19ed21860e. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:26.510830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Getting quotas for user 042331c92e794909925dcfde9e576afd and project 4b63168bfe4941ac8e4fbf19ed21860e. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:26.528908 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-93ab10b0-de0b-4497-9992-d54f119b977f req-03ec60d9-d0c9-4e10-bd46-a9bf6feca8e0 service nova] Creating event network-changed:77095c95-cb01-4107-b1ee-3dbfefb01f4c for instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab on n-h2-861333-10 Oct 19 06:59:26.534378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:26.534378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:26.545120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-93ab10b0-de0b-4497-9992-d54f119b977f req-03ec60d9-d0c9-4e10-bd46-a9bf6feca8e0 service nova] Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 06:59:26.563096 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-93ab10b0-de0b-4497-9992-d54f119b977f req-03ec60d9-d0c9-4e10-bd46-a9bf6feca8e0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085045 Oct 19 06:59:26.563353 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1226/2471] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:26.572505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:26.573649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:26.595265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:26.598822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:26.599386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:26.600329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:26.601030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:26.603732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:26.716847 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87428cb8-a312-4752-985c-9bbc7ee76642 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016935 Oct 19 06:59:26.718262 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1246/2472] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:59:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:59:26.724581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-262d4fad-f143-48e0-83a9-2b59729b092c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:26.725829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-262d4fad-f143-48e0-83a9-2b59729b092c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:27.241035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-262d4fad-f143-48e0-83a9-2b59729b092c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:27.250991 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-262d4fad-f143-48e0-83a9-2b59729b092c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1218 microversion: 2.1 time: 0.531343 Oct 19 06:59:27.309540 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1247/2473] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:26 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1218 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:27.336783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-085c98ed-0d9e-4c5b-9b5f-a05f65affb24 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '.version_select at 0x7f6d64075af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:27.384158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-085c98ed-0d9e-4c5b-9b5f-a05f65affb24 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Image not found. Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-085c98ed-0d9e-4c5b-9b5f-a05f65affb24 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 HTTP/1.1 Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: exception: Image not found. Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'eb262c0a-d60a-4581-b354-b8630b21d695'} Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eb262c0a-d60a-4581-b354-b8630b21d695 to delete Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eb262c0a-d60a-4581-b354-b8630b21d695 could not be found. Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:27.388997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-085c98ed-0d9e-4c5b-9b5f-a05f65affb24 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-085c98ed-0d9e-4c5b-9b5f-a05f65affb24 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695" status: 404 len: 62 microversion: 2.1 time: 0.083792 Oct 19 06:59:27.397034 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1248/2474] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:27 2022] DELETE /compute/v2.1/images/eb262c0a-d60a-4581-b354-b8630b21d695 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 06:59:27.426500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:27.431211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:27.446644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:27.454944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:27.454944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:27.454944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:27.454944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:27.454944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:27.553832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:27.566170 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efe52a4e-ae8c-42c8-8a88-1e55e9bd5e25 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1470 microversion: 2.1 time: 0.998147 Oct 19 06:59:27.567655 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1227/2475] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:26 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1470 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:27.574044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76d76994-7897-41f0-aea4-fef9d19b01f9 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:27.575217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76d76994-7897-41f0-aea4-fef9d19b01f9 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:27.715398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76d76994-7897-41f0-aea4-fef9d19b01f9 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:27.731678 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76d76994-7897-41f0-aea4-fef9d19b01f9 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1219 microversion: 2.1 time: 0.162532 Oct 19 06:59:27.732767 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1228/2476] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:27 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:27.768073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:27.770113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:27.781671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:27.782545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:27.783142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:27.784037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:27.784668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:27.785104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.001114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:28.009544 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2196e84b-7d05-42e2-b934-4aed15b9b5b0 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1351 microversion: 2.1 time: 0.607767 Oct 19 06:59:28.010309 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1249/2477] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:27 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1351 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:28.015016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:28.015513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:28.021469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.022131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.022712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.023551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.024184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.024796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.039639 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c HTTP/1.1 Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'd5584f2a-692a-4897-b1af-adeb2bdcbf4c'} Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:28.041408 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.044980 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.046468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:28.047537 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd1103a5-4a9b-4e5a-b5f0-952aab477a43 tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 404 len: 111 microversion: 2.1 time: 0.036160 Oct 19 06:59:28.049406 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1250/2478] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:28 2022] DELETE /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:28.057163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:28.058174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] [instance: d5584f2a-692a-4897-b1af-adeb2bdcbf4c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:28.066031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.066784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.067641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.068639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.069311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.069990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.089792 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] HTTP exception thrown: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Request method failure captured: Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c HTTP/1.1 Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT57n7gAbnyOJ8Mbg1lkfC5z6B4IGsQFA8h2WZPk5O3gFkkxCQPGIRCUrKAdLWMP2bCkpv8ClXgi3OJI_4kIaEDpVobKfN955TUoVL1IBvQes_PKGSIf5jcbXs6ArGFag0HiniQ9hzdUYgHh_B9RNpsjAYryw-EgKvvbHKcqCk3vbzow Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc630548370e44edb240113421e5d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc630548370e44edb240113421e5d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc630548370e44edb240113421e5d95d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-966766212 Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cc630548370e44edb240113421e5d95d Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-966766212 Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f5b2575fb29940ab95fc8bb9dd177dd9 Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-966766212-project Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'd5584f2a-692a-4897-b1af-adeb2bdcbf4c'} Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.092002 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:28.095643 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:28.095643 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:28.095643 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:28.095643 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:28.095643 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. Oct 19 06:59:28.095643 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:28.097794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] Returning 404 to user: Instance d5584f2a-692a-4897-b1af-adeb2bdcbf4c could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:28.101906 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-861738e0-1f21-43ce-a631-651c05c0a0cc tempest-ImagesTestJSON-966766212 tempest-ImagesTestJSON-966766212-project] 10.222.0.39 "GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c" status: 404 len: 111 microversion: 2.1 time: 0.045564 Oct 19 06:59:28.101906 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1251/2479] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:28 2022] GET /compute/v2.1/servers/d5584f2a-692a-4897-b1af-adeb2bdcbf4c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:28.265553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:28.278986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eafcc08b-bb2b-4569-a830-5c81db04d5cd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:28.279526 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fcdd4070-2b03-4972-909f-f41039256587 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1521 microversion: 2.1 time: 0.544542 Oct 19 06:59:28.280304 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1229/2480] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:27 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:28.280849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eafcc08b-bb2b-4569-a830-5c81db04d5cd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:28.306692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:28.307516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:28.318869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.319877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.320473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.321183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.321840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.322451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.399275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:28.416025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eafcc08b-bb2b-4569-a830-5c81db04d5cd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:28.427144 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eafcc08b-bb2b-4569-a830-5c81db04d5cd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1218 microversion: 2.1 time: 0.152233 Oct 19 06:59:28.445232 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1252/2481] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:28 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:28.474518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:28.578063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-268229ef-2ccc-46a6-a053-2d1f128c2f81 req-2cec251b-63c5-4086-8852-4f163404b334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c819be30-137d-4b9f-86e5-326b10ec2e35", "tag": "0fa2c090-9b54-478b-8e71-8ca186582741"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:28.609904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-268229ef-2ccc-46a6-a053-2d1f128c2f81 req-2cec251b-63c5-4086-8852-4f163404b334 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.609904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-268229ef-2ccc-46a6-a053-2d1f128c2f81 req-2cec251b-63c5-4086-8852-4f163404b334 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.609904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-268229ef-2ccc-46a6-a053-2d1f128c2f81 req-2cec251b-63c5-4086-8852-4f163404b334 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.622739 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-268229ef-2ccc-46a6-a053-2d1f128c2f81 req-2cec251b-63c5-4086-8852-4f163404b334 service nova] Creating event network-changed:0fa2c090-9b54-478b-8e71-8ca186582741 for instance c819be30-137d-4b9f-86e5-326b10ec2e35 on n-h1-861333-10 Oct 19 06:59:28.636412 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-268229ef-2ccc-46a6-a053-2d1f128c2f81 req-2cec251b-63c5-4086-8852-4f163404b334 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061999 Oct 19 06:59:28.638862 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1253/2482] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:59:28.646171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:28.657093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:28.666246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.666938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.667532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.668469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.669077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.669824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.834254 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b918b052-a2eb-4027-a0d5-aa07e24dab6c tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 204 len: 0 microversion: 2.1 time: 0.530391 Oct 19 06:59:28.838140 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1230/2483] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:28 2022] DELETE /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:28.845715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:28.853042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:28.865926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.869467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.869928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.870658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:28.871120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:28.871552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:28.969687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:28.978750 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-578707b4-0f31-4341-a1fa-2e7a73de4f34 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1215 microversion: 2.1 time: 0.139088 Oct 19 06:59:28.996961 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1231/2484] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:28 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:29.004081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:29.010693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:29.015062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.015732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.016506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.018120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.018736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.019314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.022520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:29.032459 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aec157f4-8d0a-4e55-9278-a42db8f09dd1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1463 microversion: 2.1 time: 0.391863 Oct 19 06:59:29.037901 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1254/2485] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:28 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1463 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:29.059885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:29.060454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:29.067337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.068151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.068839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.069848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.070521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.071160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.203163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:29.216911 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c9d483a-d494-4a64-85b1-759454451858 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1527 microversion: 2.1 time: 0.218021 Oct 19 06:59:29.218284 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1232/2486] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:28 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1527 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:29.514129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:29.528241 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f75c2a4-df2a-47fc-81af-eaa8c15e2d36 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1351 microversion: 2.1 time: 0.472540 Oct 19 06:59:29.532933 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1255/2487] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:29 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1351 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:29.547700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-041d799a-4def-4364-85e3-fc9d21939721 req-7c4ca07f-e47b-44c0-bce9-8e9bc049aa08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745e880d-2135-4f8b-98fe-7d5596f3cffa", "name": "network-vif-plugged", "status": "completed", "tag": "a0c4a317-f506-4ed2-8d99-93ccf62949b1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:29.576887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-041d799a-4def-4364-85e3-fc9d21939721 req-7c4ca07f-e47b-44c0-bce9-8e9bc049aa08 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.577625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-041d799a-4def-4364-85e3-fc9d21939721 req-7c4ca07f-e47b-44c0-bce9-8e9bc049aa08 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.578354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-041d799a-4def-4364-85e3-fc9d21939721 req-7c4ca07f-e47b-44c0-bce9-8e9bc049aa08 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.595056 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-041d799a-4def-4364-85e3-fc9d21939721 req-7c4ca07f-e47b-44c0-bce9-8e9bc049aa08 service nova] Creating event network-vif-plugged:a0c4a317-f506-4ed2-8d99-93ccf62949b1 for instance 745e880d-2135-4f8b-98fe-7d5596f3cffa on n-h2-861333-10 Oct 19 06:59:29.599231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb3254b3-672f-4620-b401-090a548da701 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:29.600437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb3254b3-672f-4620-b401-090a548da701 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:29.601100 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-041d799a-4def-4364-85e3-fc9d21939721 req-7c4ca07f-e47b-44c0-bce9-8e9bc049aa08 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067922 Oct 19 06:59:29.602244 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1256/2488] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:29.609123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:29.610993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:29.615984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3254b3-672f-4620-b401-090a548da701 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.617045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3254b3-672f-4620-b401-090a548da701 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.619161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3254b3-672f-4620-b401-090a548da701 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.619161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3254b3-672f-4620-b401-090a548da701 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.619357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.619589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3254b3-672f-4620-b401-090a548da701 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.620193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.620550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3254b3-672f-4620-b401-090a548da701 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.620889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.621676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.622530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.623040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.737216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:29.751741 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c44996c-1be8-438a-8a0b-ec247b9185cf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1214 microversion: 2.1 time: 0.146621 Oct 19 06:59:29.753322 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1257/2489] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:29 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:29.858622 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb3254b3-672f-4620-b401-090a548da701 tempest-MigrationsAdminTest-1719357456 tempest-MigrationsAdminTest-1719357456-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1616 microversion: 2.1 time: 0.638061 Oct 19 06:59:29.862255 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1233/2490] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:29 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1616 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:29.892930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:29.893668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:29.902862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.902862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.902862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.902862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:29.902862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:29.903876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:29.945100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:29.949151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:30.003391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:30.004016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:30.013248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.016251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.017464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.018394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.019029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.022676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.116058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:30.126685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dd40bc9-eded-4663-9ad4-d398b41d8009 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1215 microversion: 2.1 time: 0.127632 Oct 19 06:59:30.132149 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1234/2491] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:29 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:30.246115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:30.247015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:30.262140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.262910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.263549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.264618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.265420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.265860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.306147 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0387239-7aa9-4478-8c62-df02a7c5937a tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 204 len: 0 microversion: 2.1 time: 0.417567 Oct 19 06:59:30.308660 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1258/2492] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:29 2022] DELETE /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:30.316939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:30.317836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:30.327768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.328588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.330085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.331513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.339983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.339983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.431761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:30.440513 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bc3f637-965c-4226-b534-f915fb1d04a8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1527 microversion: 2.1 time: 0.198720 Oct 19 06:59:30.452292 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1235/2493] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:30 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1527 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:30.558479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:30.559599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:30.567385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.568402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.569055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.570033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.570592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.571279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.853249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:30.874784 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0519f755-cfd0-4232-9eae-0f4fdf490546 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1351 microversion: 2.1 time: 0.320204 Oct 19 06:59:30.879282 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1236/2494] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:30 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1351 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:30.884588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:30.885550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:30.900699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.902412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.902889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.903656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:30.904174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:30.904569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:30.984887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:30.999571 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d988507-ea03-45d3-ac75-0581e0c5533f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1214 microversion: 2.1 time: 0.115638 Oct 19 06:59:31.002867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:31.012516 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1237/2495] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:30 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:31.019613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f8a5992-9e1e-4a0d-92e4-d409708178df tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1469 microversion: 2.1 time: 0.707600 Oct 19 06:59:31.020611 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1259/2496] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:30 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1469 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:31.155848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:31.157819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:31.169381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:31.170608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:31.171795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:31.173858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:31.174776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:31.175633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:31.294997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:31.311502 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3792fcc-d041-4f8c-8a4c-eff3ae00c338 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1215 microversion: 2.1 time: 0.163842 Oct 19 06:59:31.312734 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1238/2497] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:31 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:31.467956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:31.468606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:31.475936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:31.478677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:31.478677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:31.478677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:31.478677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:31.478677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:31.827661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-424e048e-f6bf-493d-bffc-a1d09b069762 req-94b84fce-1e87-4475-a5e7-bf8e86765991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6467606f-c64d-4472-aeb1-4e30dbd9a9ab", "name": "network-vif-plugged", "status": "completed", "tag": "77095c95-cb01-4107-b1ee-3dbfefb01f4c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:31.846748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-424e048e-f6bf-493d-bffc-a1d09b069762 req-94b84fce-1e87-4475-a5e7-bf8e86765991 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:31.847260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-424e048e-f6bf-493d-bffc-a1d09b069762 req-94b84fce-1e87-4475-a5e7-bf8e86765991 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:31.847676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-424e048e-f6bf-493d-bffc-a1d09b069762 req-94b84fce-1e87-4475-a5e7-bf8e86765991 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:31.859291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:31.874569 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-424e048e-f6bf-493d-bffc-a1d09b069762 req-94b84fce-1e87-4475-a5e7-bf8e86765991 service nova] Creating event network-vif-plugged:77095c95-cb01-4107-b1ee-3dbfefb01f4c for instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab on n-h2-861333-10 Oct 19 06:59:31.880389 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d1448e8-fd8e-4c23-972b-54050a4143b1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1527 microversion: 2.1 time: 0.415986 Oct 19 06:59:31.881679 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1260/2498] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:31 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1527 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:31.887704 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-424e048e-f6bf-493d-bffc-a1d09b069762 req-94b84fce-1e87-4475-a5e7-bf8e86765991 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063576 Oct 19 06:59:31.891620 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1239/2499] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:31.906806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:31.908501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:31.920178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:31.921376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:31.922491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:31.924602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:31.927324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:31.928726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.029754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:32.030762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:32.041100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:32.044515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:32.044515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.044515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:32.044515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:32.046193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.220828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:32.238471 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1160db2-014f-48f6-8d16-64b4292402d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1214 microversion: 2.1 time: 0.217089 Oct 19 06:59:32.239640 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1240/2500] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:32 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:32.249723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:32.251142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:32.267741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:32.271596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:32.272419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.273643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:32.274312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:32.275537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.584137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:32.600389 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49dc44c4-2a78-4245-b71e-b39c158a8676 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1469 microversion: 2.1 time: 0.359200 Oct 19 06:59:32.602601 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1241/2501] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:32 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:32.608368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:32.609166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:32.615514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:32.616223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:32.616915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.617872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:32.618493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:32.619639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.727481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:32.737817 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49676514-0a32-40f9-8f10-a69d88ec75ab tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1271 microversion: 2.1 time: 0.133990 Oct 19 06:59:32.738954 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1242/2502] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:32 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:32.745676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d17032b7-81cc-45a5-9f11-db38a6a832fd req-499e2a2c-2394-4553-b486-9c652d3f6e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745e880d-2135-4f8b-98fe-7d5596f3cffa", "name": "network-vif-deleted", "tag": "a0c4a317-f506-4ed2-8d99-93ccf62949b1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:32.758754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d17032b7-81cc-45a5-9f11-db38a6a832fd req-499e2a2c-2394-4553-b486-9c652d3f6e89 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:32.759522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d17032b7-81cc-45a5-9f11-db38a6a832fd req-499e2a2c-2394-4553-b486-9c652d3f6e89 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:32.760300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d17032b7-81cc-45a5-9f11-db38a6a832fd req-499e2a2c-2394-4553-b486-9c652d3f6e89 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.776475 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d17032b7-81cc-45a5-9f11-db38a6a832fd req-499e2a2c-2394-4553-b486-9c652d3f6e89 service nova] Creating event network-vif-deleted:a0c4a317-f506-4ed2-8d99-93ccf62949b1 for instance 745e880d-2135-4f8b-98fe-7d5596f3cffa on n-h2-861333-10 Oct 19 06:59:32.782002 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d17032b7-81cc-45a5-9f11-db38a6a832fd req-499e2a2c-2394-4553-b486-9c652d3f6e89 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040939 Oct 19 06:59:32.782747 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1243/2503] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:32.926123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:32.927006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:32.935505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:32.936855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:32.937579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.938532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:32.940603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:32.941871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:32.947564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:32.963899 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53c6c419-4da5-4db5-8d2a-e9ffdcb72ab1 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1351 microversion: 2.1 time: 1.060323 Oct 19 06:59:32.964910 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1261/2504] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:31 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1351 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:33.049850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:33.061685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee08d14f-998b-4d68-8085-3237159fb7cf tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1485 microversion: 2.1 time: 0.149477 Oct 19 06:59:33.082744 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1244/2505] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:32 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1485 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:33.263055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:33.267208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:33.276053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:33.276587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:33.277031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:33.277756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:33.285261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:33.285509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:33.624264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:33.625820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:33.645011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:33.647967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:33.649287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:33.650331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:33.652455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:33.653163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:33.918307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:33.932640 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e794373a-fc6c-43f4-b556-347cb00db2ab tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1270 microversion: 2.1 time: 0.670592 Oct 19 06:59:33.933904 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1262/2506] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:33 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1270 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:33.946359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:33.946975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:33.982330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:33.983611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:33.984239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:33.985309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:33.985948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:33.986518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:34.179303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:34.193260 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-385813ee-8d96-4c0f-8791-8e9c1c811021 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1469 microversion: 2.1 time: 0.574070 Oct 19 06:59:34.194219 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1245/2507] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:33 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1469 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:34.200680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a6ef7f8b-3f48-42e6-9a73-99d429ee2c83 req-f0e5c12c-ea09-4aa1-b047-fc1c81746234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c819be30-137d-4b9f-86e5-326b10ec2e35", "name": "network-vif-plugged", "status": "completed", "tag": "0fa2c090-9b54-478b-8e71-8ca186582741"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:34.225808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6ef7f8b-3f48-42e6-9a73-99d429ee2c83 req-f0e5c12c-ea09-4aa1-b047-fc1c81746234 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:34.226303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6ef7f8b-3f48-42e6-9a73-99d429ee2c83 req-f0e5c12c-ea09-4aa1-b047-fc1c81746234 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:34.226744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6ef7f8b-3f48-42e6-9a73-99d429ee2c83 req-f0e5c12c-ea09-4aa1-b047-fc1c81746234 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:34.252939 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a6ef7f8b-3f48-42e6-9a73-99d429ee2c83 req-f0e5c12c-ea09-4aa1-b047-fc1c81746234 service nova] Creating event network-vif-plugged:0fa2c090-9b54-478b-8e71-8ca186582741 for instance c819be30-137d-4b9f-86e5-326b10ec2e35 on n-h1-861333-10 Oct 19 06:59:34.262274 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a6ef7f8b-3f48-42e6-9a73-99d429ee2c83 req-f0e5c12c-ea09-4aa1-b047-fc1c81746234 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066626 Oct 19 06:59:34.264446 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1246/2508] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:34.277565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:34.278584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:34.293885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:34.294590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:34.301351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:34.301351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:34.301351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:34.301351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:34.351236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:34.361843 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-702960f7-a0d5-4849-8d15-63a325717ed7 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1277 microversion: 2.1 time: 0.426666 Oct 19 06:59:34.364454 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1263/2509] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:33 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1277 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:34.370383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:34.377297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:34.393553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:34.395381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:34.395881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:34.396342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:34.397056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:34.397505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:34.397929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:34.474820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:34.475336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:34.475787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:34.476492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lazy-loading 'fault' on Instance uuid 745e880d-2135-4f8b-98fe-7d5596f3cffa {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:34.846839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:34.855567 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b96d29a8-4bb9-4fa0-971a-d873d0078fc8 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 200 len: 1315 microversion: 2.1 time: 0.490077 Oct 19 06:59:34.856177 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1264/2510] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:34 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:34.961934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:34.963023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:34.983967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:34.984836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:34.985287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:34.989226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:34.989696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:34.990297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:35.131782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:35.141915 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76d5294a-707d-4f47-a680-6c3c224bf013 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1351 microversion: 2.1 time: 0.875090 Oct 19 06:59:35.142419 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1247/2511] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:34 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1351 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:35.155477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:35.212294 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a576be6e-bccf-473b-91ad-183e393e3763 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1288 microversion: 2.1 time: 0.256597 Oct 19 06:59:35.220991 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1265/2512] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:34 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1288 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:35.221736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:35.222504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:35.241234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:35.241983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:35.245534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:35.246528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:35.247156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:35.249233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:35.388133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:35.392895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:35.403638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:35.404393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:35.404997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:35.413026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:35.413737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:35.414316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:35.567441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:35.576688 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d0f7fcf-a525-42e3-8dee-5865d62f8cfb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1277 microversion: 2.1 time: 0.193195 Oct 19 06:59:35.580122 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1266/2513] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:35 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:35.650557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:35.665651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:35.665651 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23be9f08-6b6f-4475-a818-ac0314cc7dc1 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1469 microversion: 2.1 time: 0.446982 Oct 19 06:59:35.665651 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1248/2514] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:35 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1469 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:35.880787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:35.881761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:35.898245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:35.898924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:35.899630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:35.900584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:35.902779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:35.903449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:35.927743 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa HTTP/1.1 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '745e880d-2135-4f8b-98fe-7d5596f3cffa'} Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:35.929962 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:35.934062 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:35.934062 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:35.934062 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:35.934062 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:35.934062 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:35.934062 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:35.934062 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 06:59:35.934062 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 06:59:35.935601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:35.938076 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afcba221-030b-4722-9d11-4b439ba78044 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 404 len: 111 microversion: 2.1 time: 0.062413 Oct 19 06:59:35.940145 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1267/2515] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:35 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:36.075464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0c7f529a-b678-402e-b003-5f579df32faa req-c28fed1d-e039-4242-8c42-03630c2f5f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6467606f-c64d-4472-aeb1-4e30dbd9a9ab", "name": "network-vif-deleted", "tag": "77095c95-cb01-4107-b1ee-3dbfefb01f4c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:36.096309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-260603923", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:36.097596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c7f529a-b678-402e-b003-5f579df32faa req-c28fed1d-e039-4242-8c42-03630c2f5f85 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:36.098342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c7f529a-b678-402e-b003-5f579df32faa req-c28fed1d-e039-4242-8c42-03630c2f5f85 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:36.099068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c7f529a-b678-402e-b003-5f579df32faa req-c28fed1d-e039-4242-8c42-03630c2f5f85 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:36.122935 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0c7f529a-b678-402e-b003-5f579df32faa req-c28fed1d-e039-4242-8c42-03630c2f5f85 service nova] Creating event network-vif-deleted:77095c95-cb01-4107-b1ee-3dbfefb01f4c for instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab on n-h2-861333-10 Oct 19 06:59:36.129301 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0c7f529a-b678-402e-b003-5f579df32faa req-c28fed1d-e039-4242-8c42-03630c2f5f85 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059850 Oct 19 06:59:36.130087 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1249/2516] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:59:36.172602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:36.174097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:36.193488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:36.194221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:36.194948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:36.195931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:36.196625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:36.197208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:36.198094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] validate_networks() for [('9e8a498f-1e98-47fb-92fa-47fd5d4c664f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:59:36.386092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:36.460376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:36.526793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:36.539827 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8230046-8397-432e-8c55-1b4ae09989aa tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1351 microversion: 2.1 time: 0.372378 Oct 19 06:59:36.556313 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1250/2517] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:36 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1351 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:36.565057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:36.565880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:36.574665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:36.575458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:36.576078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:36.577285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:36.577908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:36.578769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:36.731448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:36.759885 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-413f69c5-78d9-4015-a347-158164b0cf30 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1276 microversion: 2.1 time: 0.199569 Oct 19 06:59:36.760692 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1251/2518] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:36 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:36.779694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:36.781869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:36.810931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:36.812624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:36.813369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:36.815940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:36.824398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:36.824985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:36.946393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:36.959426 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec0bb2a7-bb17-4341-a0fa-f0356e6de8bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1277 microversion: 2.1 time: 0.196110 Oct 19 06:59:36.962363 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1252/2519] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:36 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:36.969172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:36.970736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:36.977505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:36.980206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:36.981181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:36.982208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:36.983173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:36.983819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:36.984471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:37.049021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:37.049770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:37.050394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:37.051012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lazy-loading 'fault' on Instance uuid 6467606f-c64d-4472-aeb1-4e30dbd9a9ab {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:37.161484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:37.170903 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef08e0c9-fca6-4ce9-a8e6-f25a366dea39 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 200 len: 1303 microversion: 2.1 time: 0.207232 Oct 19 06:59:37.185057 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1253/2520] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:36 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 1303 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:37.564564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:37.565882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:37.573008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:37.573516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:37.577590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:37.577590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:37.577590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:37.577590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:37.733334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=27 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:37.832011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:37.843397 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c59ba4a-baa8-44c3-80ea-a7f155dbd82f tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1541 microversion: 2.1 time: 0.284035 Oct 19 06:59:37.844012 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1254/2521] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:37 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1541 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:37.855651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:37.858640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:37.871101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:37.877326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:37.878007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:37.878965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:37.879589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:37.880213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.069126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:38.079742 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fae46b2-ff00-4ac5-98b4-fe391ca9a02c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1276 microversion: 2.1 time: 0.230962 Oct 19 06:59:38.096595 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1255/2522] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:37 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:38.102399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78b32d7a-946d-4d98-ab4a-59084fbd25e2 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:38.103202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78b32d7a-946d-4d98-ab4a-59084fbd25e2 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:38.110376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b32d7a-946d-4d98-ab4a-59084fbd25e2 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.113989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b32d7a-946d-4d98-ab4a-59084fbd25e2 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.113989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b32d7a-946d-4d98-ab4a-59084fbd25e2 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.113989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b32d7a-946d-4d98-ab4a-59084fbd25e2 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.113989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b32d7a-946d-4d98-ab4a-59084fbd25e2 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.113989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b32d7a-946d-4d98-ab4a-59084fbd25e2 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.287567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:38.289255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:38.290453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:38.291233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:38.292460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:38.311101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.314162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.314162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.315843 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78b32d7a-946d-4d98-ab4a-59084fbd25e2 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217993 Oct 19 06:59:38.316355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.317081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.317713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.323824 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1256/2523] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 06:59:38 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:38.328584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:38.329722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:38.341187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.344214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.348452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.348452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.348452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.348452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.353754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Getting quotas for project 8fd6bbb748b5440fb72fb253477b4180. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:38.367254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Getting quotas for user 2fe41984e17744dfa71d2ce82d1023e3 and project 8fd6bbb748b5440fb72fb253477b4180. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:38.408310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:38.412230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:38.550671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:38.566607 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2435d85-6687-4902-97fb-2b2a49e8b053 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1277 microversion: 2.1 time: 0.241433 Oct 19 06:59:38.568392 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1257/2524] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:38 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:38.573104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:38.583895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 6467606f-c64d-4472-aeb1-4e30dbd9a9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:38.589073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.589787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.594456 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-083e6f3e-4685-4096-8f1b-0f8aee1e6dbb tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.503818 Oct 19 06:59:38.598794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.600446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.602240 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1268/2525] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:59:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:59:38.606851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.607328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38d048c0-8236-4d99-9cfc-e05f7df11fa6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:38.607948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-38d048c0-8236-4d99-9cfc-e05f7df11fa6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:38.608304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.641506 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] HTTP exception thrown: Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab could not be found. Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Request method failure captured: Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab HTTP/1.1 Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT575Qj8SyWLHfqMJFN82d229CAu6HFmDWzjD0wVlUEt_tCXdNRc7zLyxNzs7J5rJvk9XLcybZrvOVp4W8KLFG9nskFJNdN2X1Bs0fWrQXLw8oVqa1XJ0jtQsjj33VkwDMK2wmhEtixfsTBSlhgD8XfYJTWxcpyWW8Rjh7m2X57TvC8I Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d80c925de0b447909ae6fbfe56e61dda Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-MigrationsAdminTest-748893206 Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d80c925de0b447909ae6fbfe56e61dda", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-MigrationsAdminTest-748893206 Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d80c925de0b447909ae6fbfe56e61dda Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MigrationsAdminTest-748893206 Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-MigrationsAdminTest-748893206-project Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 631a2a90a44a40b2bd751a4feaf69d0f Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-MigrationsAdminTest-748893206-project Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab could not be found. Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '6467606f-c64d-4472-aeb1-4e30dbd9a9ab'} Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab could not be found. Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab could not be found. Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:38.643801 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:38.648224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:38.648224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:38.648224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:38.648224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:38.648224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:38.648224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab could not be found. Oct 19 06:59:38.648224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:38.648224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Returning 404 to user: Instance 6467606f-c64d-4472-aeb1-4e30dbd9a9ab could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:38.648224 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e4bda9f-a112-4a03-9e65-d3b521127b38 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab" status: 404 len: 111 microversion: 2.1 time: 0.076887 Oct 19 06:59:38.655757 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1258/2526] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:38 2022] GET /compute/v2.1/servers/6467606f-c64d-4472-aeb1-4e30dbd9a9ab => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:38.661619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:38.662228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:38.677659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.678179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.678688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.679508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:38.680037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:38.684057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:38.743949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:38.817504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38d048c0-8236-4d99-9cfc-e05f7df11fa6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:38.827612 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38d048c0-8236-4d99-9cfc-e05f7df11fa6 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1224 microversion: 2.1 time: 0.224034 Oct 19 06:59:38.847305 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1269/2527] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:38 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1224 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:39.108784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:39.109572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:39.122240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:39.125913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:39.127413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:39.129972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:39.131196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:39.131864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:39.172520 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46019357-68f5-42c2-ba82-ec6f174ad740 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "DELETE /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 204 len: 0 microversion: 2.1 time: 0.514835 Oct 19 06:59:39.187257 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1259/2528] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:38 2022] DELETE /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:39.212446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:39.218965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:39.252898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:39.253707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:39.254155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:39.255101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:39.255748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:39.258126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:39.577470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:39.592343 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-80d9b83d-5a70-4ddf-8276-f3bec0f129c1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1276 microversion: 2.1 time: 0.487482 Oct 19 06:59:39.608570 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1270/2529] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:39 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1276 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:39.615116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:39.616388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:39.629459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:39.630869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:39.631887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:39.633693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:39.634293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:39.640504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:39.920054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:39.929245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec7422ff-3fd4-4a8a-8829-2931dbd68a87 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1535 microversion: 2.1 time: 0.737549 Oct 19 06:59:39.929942 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1260/2530] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:39 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1535 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:39.947281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:39.950557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:39.951297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:39.959827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:39.959984 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19554b4d-7b07-4308-92cb-7ad9151f56b2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1319 microversion: 2.1 time: 0.348353 Oct 19 06:59:39.960573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:39.961089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:39.962583 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1271/2531] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:39 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:39.969041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:39.970812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:39.971283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:40.495504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:40.504011 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c8cc2580-9db5-4ca4-bc05-144b7b318524 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1228 microversion: 2.1 time: 0.558511 Oct 19 06:59:40.504967 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1261/2532] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:39 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1228 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:40.621021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:40.621995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:40.630354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:40.631426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:40.632083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:40.633695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:40.634431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:40.634927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:40.952547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:40.954000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:40.960654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:40.961312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:40.961813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:40.963187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:40.963863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:40.964488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:41.350740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:41.361804 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4096ec08-e39b-4b60-97a4-398aa467227d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 0.744599 Oct 19 06:59:41.378183 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1272/2533] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:40 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:41.392793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:41.393434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:41.411461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:41.414454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:41.415093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:41.421457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:41.421457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:41.421457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:41.564987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:41.577146 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c764fbb-fbac-4513-b056-9f5f47fbeab4 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1535 microversion: 2.1 time: 0.627850 Oct 19 06:59:41.577909 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1262/2534] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:40 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1535 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:41.583732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:41.585569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:41.592554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:41.593361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:41.594132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:41.596388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:41.597349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:41.597949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:41.735122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:41.754925 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bdc18773-54a3-40b1-b00c-4a5315e03ce7 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1276 microversion: 2.1 time: 0.175272 Oct 19 06:59:41.755897 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1263/2535] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:41 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:41.975500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:41.986158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8de8f148-e054-416c-9c22-b39210899f1e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1319 microversion: 2.1 time: 0.606363 Oct 19 06:59:41.990036 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1273/2536] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:41 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1319 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:42.100708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c629c0e4-eb74-4ec6-8e34-6f67e3336ab5 req-76741ed0-634d-4b7a-8ffc-495fe46c4fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5cdaae7-d4cb-4347-a879-9b98c1747932", "tag": "8a955975-1b4c-4908-abd4-81ab7291df58"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:42.116058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c629c0e4-eb74-4ec6-8e34-6f67e3336ab5 req-76741ed0-634d-4b7a-8ffc-495fe46c4fe4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:42.128833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c629c0e4-eb74-4ec6-8e34-6f67e3336ab5 req-76741ed0-634d-4b7a-8ffc-495fe46c4fe4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:42.129525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c629c0e4-eb74-4ec6-8e34-6f67e3336ab5 req-76741ed0-634d-4b7a-8ffc-495fe46c4fe4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:42.155073 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c629c0e4-eb74-4ec6-8e34-6f67e3336ab5 req-76741ed0-634d-4b7a-8ffc-495fe46c4fe4 service nova] Creating event network-changed:8a955975-1b4c-4908-abd4-81ab7291df58 for instance d5cdaae7-d4cb-4347-a879-9b98c1747932 on n-h2-861333-10 Oct 19 06:59:42.161059 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c629c0e4-eb74-4ec6-8e34-6f67e3336ab5 req-76741ed0-634d-4b7a-8ffc-495fe46c4fe4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063761 Oct 19 06:59:42.161657 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1264/2537] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:59:42.393458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:42.394680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:42.400927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:42.401430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:42.402232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:42.403160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:42.404042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:42.404042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:42.591599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b8912a0c-8a68-4999-a0f8-1ed218737f11 req-28132bb4-488c-44a9-918e-8b0d6badfe70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c819be30-137d-4b9f-86e5-326b10ec2e35", "tag": "0fa2c090-9b54-478b-8e71-8ca186582741"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:42.612786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b8912a0c-8a68-4999-a0f8-1ed218737f11 req-28132bb4-488c-44a9-918e-8b0d6badfe70 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:42.614843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b8912a0c-8a68-4999-a0f8-1ed218737f11 req-28132bb4-488c-44a9-918e-8b0d6badfe70 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:42.623289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b8912a0c-8a68-4999-a0f8-1ed218737f11 req-28132bb4-488c-44a9-918e-8b0d6badfe70 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:42.642467 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b8912a0c-8a68-4999-a0f8-1ed218737f11 req-28132bb4-488c-44a9-918e-8b0d6badfe70 service nova] Creating event network-changed:0fa2c090-9b54-478b-8e71-8ca186582741 for instance c819be30-137d-4b9f-86e5-326b10ec2e35 on n-h1-861333-10 Oct 19 06:59:42.652551 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b8912a0c-8a68-4999-a0f8-1ed218737f11 req-28132bb4-488c-44a9-918e-8b0d6badfe70 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065479 Oct 19 06:59:42.654713 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1265/2538] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:59:42.670120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:42.673411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:42.690686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:42.691485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:42.701551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:42.705173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:42.705839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:42.706430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:42.756466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:42.867767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:42.881206 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a15de864-8720-40d1-abc7-ce6c9afc0afa tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1493 microversion: 2.1 time: 0.225056 Oct 19 06:59:42.882217 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1266/2539] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:42 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1493 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:42.890992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:42.893764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:42.926072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:42.926576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:42.927019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:42.932969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:42.933403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:42.933850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:43.092414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:43.101456 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc84984a-89b8-41ce-a99e-6cd06f49b5e9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1282 microversion: 2.1 time: 0.218051 Oct 19 06:59:43.118115 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1267/2540] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:42 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1282 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:43.130804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:43.135732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:43.149275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:43.160952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:43.160952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:43.160952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:43.160952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:43.160952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:43.494603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:43.513730 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d75eb587-e9f8-45bc-b99d-674151022892 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 1.125977 Oct 19 06:59:43.518358 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1274/2541] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:42 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:43.912131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:43.913205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:43.928225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:43.934148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:43.934967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:43.941134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:43.943035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:43.952895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:43.978111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:43.995090 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b698a76-9b64-4805-85c2-38751ee6c35c tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1319 microversion: 2.1 time: 0.875669 Oct 19 06:59:44.000208 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1268/2542] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:43 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1319 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:44.062835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:44.063440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:44.064729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:44.065368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lazy-loading 'fault' on Instance uuid 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:44.072125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:44.136692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:44.137304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:44.154919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:44.155665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:44.156290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:44.157163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:44.157833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:44.158414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:44.172593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:44.180797 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ecabf2c-b6da-43fa-a62a-89c7c8060578 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 200 len: 1369 microversion: 2.1 time: 0.275011 Oct 19 06:59:44.185158 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1275/2543] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:43 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 1369 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:44.540977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:44.541692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:44.550904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:44.551406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:44.551839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:44.552578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:44.553279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:44.553929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:44.708966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:44.718721 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9ba888a-ec2d-44cc-97ca-9c88ce26c3d1 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1282 microversion: 2.1 time: 0.585363 Oct 19 06:59:44.718721 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1269/2544] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:44 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1282 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:44.761478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2c22da6f-bfc0-4490-8924-761766b18dcb req-2fe85c9c-b9cf-42eb-b06c-ee39d8bb0449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327ba1a3-a8b5-41c4-b255-1fe00ce5f005", "name": "network-vif-deleted", "tag": "d625756d-d7ae-40fb-a597-39024348ca41"}, {"name": "network-changed", "server_uuid": "c21a145d-a541-49b2-bdab-c4c8a86b77a8", "tag": "ac067cf3-fdf0-4f63-8595-c03c413defcb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:44.790612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c22da6f-bfc0-4490-8924-761766b18dcb req-2fe85c9c-b9cf-42eb-b06c-ee39d8bb0449 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:44.791137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c22da6f-bfc0-4490-8924-761766b18dcb req-2fe85c9c-b9cf-42eb-b06c-ee39d8bb0449 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:44.791590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c22da6f-bfc0-4490-8924-761766b18dcb req-2fe85c9c-b9cf-42eb-b06c-ee39d8bb0449 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:44.831953 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2c22da6f-bfc0-4490-8924-761766b18dcb req-2fe85c9c-b9cf-42eb-b06c-ee39d8bb0449 service nova] Creating event network-vif-deleted:d625756d-d7ae-40fb-a597-39024348ca41 for instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 on n-h1-861333-10 Oct 19 06:59:44.840609 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2c22da6f-bfc0-4490-8924-761766b18dcb req-2fe85c9c-b9cf-42eb-b06c-ee39d8bb0449 service nova] Creating event network-changed:ac067cf3-fdf0-4f63-8595-c03c413defcb for instance c21a145d-a541-49b2-bdab-c4c8a86b77a8 on n-h2-861333-10 Oct 19 06:59:44.865455 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2c22da6f-bfc0-4490-8924-761766b18dcb req-2fe85c9c-b9cf-42eb-b06c-ee39d8bb0449 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.124869 Oct 19 06:59:44.866339 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1270/2545] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:45.259902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1760170898", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:45.369657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:45.371458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:45.371458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:45.372243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:45.373343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:45.401217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:45.402141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:45.403645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:45.404980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:45.406277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:45.410576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:45.439428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Getting quotas for project 373a4054a3c945e5ac865f1335359229. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:45.446774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Getting quotas for user f72a3960f88a4a4ab39857a7b1a8f2c0 and project 373a4054a3c945e5ac865f1335359229. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:45.466643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:45.470204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:45.569877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:45.603125 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-160a6e25-8b80-4bcd-ae0f-c545d6c00c71 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 1.065199 Oct 19 06:59:45.620082 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1276/2546] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:44 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:45.625710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:45.627258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:45.634673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:45.635503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:45.636134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:45.637016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:45.637934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:45.638403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:45.660903 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c1225d5-e80e-4030-8be5-5102c4219b16 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.776027 Oct 19 06:59:45.661596 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1271/2547] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 06:59:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 06:59:45.676661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-96311ca4-bd69-463a-aa41-d3695f857a51 req-e0fc5e48-a53b-4845-b401-86960bfd73e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3643b581-f3e9-4281-9fc0-80424ba41658", "tag": "72d920f7-ef25-4437-b1f6-2b3ca1c0fffb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:45.702640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-96311ca4-bd69-463a-aa41-d3695f857a51 req-e0fc5e48-a53b-4845-b401-86960bfd73e6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:45.705021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-96311ca4-bd69-463a-aa41-d3695f857a51 req-e0fc5e48-a53b-4845-b401-86960bfd73e6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:45.705475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-96311ca4-bd69-463a-aa41-d3695f857a51 req-e0fc5e48-a53b-4845-b401-86960bfd73e6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:45.722828 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-96311ca4-bd69-463a-aa41-d3695f857a51 req-e0fc5e48-a53b-4845-b401-86960bfd73e6 service nova] Creating event network-changed:72d920f7-ef25-4437-b1f6-2b3ca1c0fffb for instance 3643b581-f3e9-4281-9fc0-80424ba41658 on n-h2-861333-10 Oct 19 06:59:45.728919 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-96311ca4-bd69-463a-aa41-d3695f857a51 req-e0fc5e48-a53b-4845-b401-86960bfd73e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064966 Oct 19 06:59:45.729870 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1272/2548] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:45.737609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:45.738490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 327ba1a3-a8b5-41c4-b255-1fe00ce5f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:45.746491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:45.746898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:45.747348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:45.748552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:45.748998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:45.749533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:45.771320 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] HTTP exception thrown: Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 could not be found. Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Request method failure captured: Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 HTTP/1.1 Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT575Qj8SyWLHfqMJFN82d229CAu6HFmDWzjD0wVlUEt_tCXdNRc7zLyxNzs7J5rJvk9XLcybZrvOVp4W8KLFG9nskFJNdN2X1Bs0fWrQXLw8oVqa1XJ0jtQsjj33VkwDMK2wmhEtixfsTBSlhgD8XfYJTWxcpyWW8Rjh7m2X57TvC8I Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d80c925de0b447909ae6fbfe56e61dda Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-MigrationsAdminTest-748893206 Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d80c925de0b447909ae6fbfe56e61dda", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-MigrationsAdminTest-748893206 Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d80c925de0b447909ae6fbfe56e61dda Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MigrationsAdminTest-748893206 Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-MigrationsAdminTest-748893206-project Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 631a2a90a44a40b2bd751a4feaf69d0f Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-MigrationsAdminTest-748893206-project Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 could not be found. Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '327ba1a3-a8b5-41c4-b255-1fe00ce5f005'} Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 could not be found. Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 could not be found. Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:45.771518 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:45.775665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:45.775665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:45.775665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:45.775665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:45.775665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:45.775665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 could not be found. Oct 19 06:59:45.775665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:45.777176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Returning 404 to user: Instance 327ba1a3-a8b5-41c4-b255-1fe00ce5f005 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:45.778605 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-557cf06e-d294-479b-a224-31e356d98774 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005" status: 404 len: 111 microversion: 2.1 time: 0.047303 Oct 19 06:59:45.779326 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1273/2549] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:45 2022] GET /compute/v2.1/servers/327ba1a3-a8b5-41c4-b255-1fe00ce5f005 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 06:59:45.788322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98197052-5ab6-4d26-835b-67e32664f5db tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:45.790028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98197052-5ab6-4d26-835b-67e32664f5db tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:45.997972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:46.006901 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9a8871c-e4ce-4487-aaea-5276516eae90 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1319 microversion: 2.1 time: 0.385288 Oct 19 06:59:46.008195 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1277/2550] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:45 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:46.037004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:46.037004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:46.053100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:46.053602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:46.054039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:46.054755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:46.055211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:46.055636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:46.098536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98197052-5ab6-4d26-835b-67e32664f5db tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:46.114366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98197052-5ab6-4d26-835b-67e32664f5db tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:46.118303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98197052-5ab6-4d26-835b-67e32664f5db tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:46.122595 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98197052-5ab6-4d26-835b-67e32664f5db tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1281 microversion: 2.47 time: 0.337982 Oct 19 06:59:46.124852 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1274/2551] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:45 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:59:46.135262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8acdcb21-b8a0-4df7-807b-23a23f6d875b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '.version_select at 0x7f6d64b3c670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:46.279086 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8acdcb21-b8a0-4df7-807b-23a23f6d875b tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615809835" status: 202 len: 0 microversion: 2.1 time: 0.149496 Oct 19 06:59:46.285959 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1275/2552] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 06:59:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615809835 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 06:59:46.285959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c819cd67-9301-4d42-ad3b-162ae526f1ac tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d6485ed30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:46.351602 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c819cd67-9301-4d42-ad3b-162ae526f1ac tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/58abfda2-469c-4e56-b3c9-3bd87ed4ad6b" status: 200 len: 662 microversion: 2.1 time: 0.070500 Oct 19 06:59:46.362349 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1276/2553] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:46 2022] GET /compute/v2.1/images/58abfda2-469c-4e56-b3c9-3bd87ed4ad6b => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:46.367738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fe0def4-4cb1-4bf7-99a2-064ea4154070 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64e1ed30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:46.439906 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fe0def4-4cb1-4bf7-99a2-064ea4154070 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/58abfda2-469c-4e56-b3c9-3bd87ed4ad6b" status: 200 len: 662 microversion: 2.1 time: 0.077155 Oct 19 06:59:46.440970 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1277/2554] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:46 2022] GET /compute/v2.1/images/58abfda2-469c-4e56-b3c9-3bd87ed4ad6b => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:59:46.466131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:46.474538 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dcffb616-3429-4895-843e-beba1ae92994 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.452453 Oct 19 06:59:46.481308 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1278/2555] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:46 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:46.626737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:46.627408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:46.635414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:46.636030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:46.636373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:46.637085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:46.637545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:46.637977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:46.972756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:46.986616 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ef81079-3b60-4e23-aa69-c9ed070d5c2d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 0.362932 Oct 19 06:59:47.004268 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1278/2556] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:46 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:47.035398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:47.036031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:47.048780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:47.053913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:47.054373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:47.055124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:47.055596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:47.056032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:47.156565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:47.158098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:47.164920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:47.165673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:47.166276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:47.167190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:47.167684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:47.168145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:47.369935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:47.378884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:47.380510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:47.381921 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f05b2b0-6b79-4ef5-8306-69c90a1088b5 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1285 microversion: 2.47 time: 0.229174 Oct 19 06:59:47.382775 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1279/2557] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:47 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 06:59:47.498796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:47.499403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:47.505576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:47.506060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:47.506496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:47.507221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:47.507675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:47.508097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:47.530262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:47.539592 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5170276-ca5e-4ef7-85c6-e84ee33afe16 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1319 microversion: 2.1 time: 0.509446 Oct 19 06:59:47.540192 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1279/2558] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:47 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:47.765689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:47.767600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:47.768472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:47.774763 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fec392ca-442d-4d8c-8ea8-a85f3e9bcaa4 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.280057 Oct 19 06:59:47.775254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:47.776718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:47.777321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:47.778357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:47.778974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:47.779726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:47.789874 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1280/2559] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:47 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:47.824822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:48.009930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:48.010553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:48.017800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.018488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.019087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.019949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.020594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.021195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.194745 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52846e59-b908-4cfe-9acb-88c39fce6efd tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 204 len: 0 microversion: 2.1 time: 0.431175 Oct 19 06:59:48.196190 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1280/2560] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:47 2022] DELETE /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:48.215192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:48.216322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:48.238491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.238929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.239374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.240165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.240631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.241061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.252140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:48.262619 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb093f75-3902-4530-b0c3-5ac6ea69ab00 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 0.256701 Oct 19 06:59:48.269000 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1281/2561] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:48 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:48.328236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-312aae6d-e768-43ca-8bc3-9dd3bdb518d9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64965af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:48.338368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:48.389562 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-312aae6d-e768-43ca-8bc3-9dd3bdb518d9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/256703dd-7d85-4d61-85a4-082349e076de" status: 200 len: 662 microversion: 2.1 time: 0.065380 Oct 19 06:59:48.391577 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1282/2562] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:48 2022] GET /compute/v2.1/images/256703dd-7d85-4d61-85a4-082349e076de => generated 662 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:48.405171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5533c3fb-97d6-489d-8ff6-69a9e683352d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64b3c1f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:48.460944 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5533c3fb-97d6-489d-8ff6-69a9e683352d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/256703dd-7d85-4d61-85a4-082349e076de" status: 200 len: 662 microversion: 2.1 time: 0.059687 Oct 19 06:59:48.462107 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1283/2563] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:48 2022] GET /compute/v2.1/images/256703dd-7d85-4d61-85a4-082349e076de => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:48.467504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:48.468344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:48.478223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.478736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.479174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.480423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.481053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.481654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.568943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:48.579316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:48.584023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:48.584023 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-122c1a41-a45a-43e8-8a7e-bf4461bd0aa1 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1333 microversion: 2.47 time: 0.118917 Oct 19 06:59:48.584023 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1284/2564] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:48 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:59:48.630605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:48.638496 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2cce41e-f6da-44fb-98e5-7626f45edd21 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1469 microversion: 2.1 time: 0.437404 Oct 19 06:59:48.639083 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1281/2565] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:48 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1469 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:48.651889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-985302588", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "58376649-8982-48f2-be79-3a79c6cfb460"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:48.652049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:48.653248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:48.661979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.662613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.663259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.664315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.704571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.705181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.739718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] validate_networks() for [('58376649-8982-48f2-be79-3a79c6cfb460', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:59:48.822336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=32 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:48.866092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:48.876069 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4747d0ff-a192-4e90-a912-413c48c35de2 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1319 microversion: 2.1 time: 0.230704 Oct 19 06:59:48.880715 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1282/2566] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:48 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:48.881881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-bfb9657e-0e90-4c47-8562-0d45a59989d5 req-820ad746-c0fb-4925-83bd-eb4a4dedaf5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cffcb6bd-4300-41e5-82ed-87bdc674276d", "tag": "f6407f4d-aecd-4eb6-ad9e-d0ae922831bf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:48.892908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bfb9657e-0e90-4c47-8562-0d45a59989d5 req-820ad746-c0fb-4925-83bd-eb4a4dedaf5b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.893431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bfb9657e-0e90-4c47-8562-0d45a59989d5 req-820ad746-c0fb-4925-83bd-eb4a4dedaf5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.894048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bfb9657e-0e90-4c47-8562-0d45a59989d5 req-820ad746-c0fb-4925-83bd-eb4a4dedaf5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.911512 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-bfb9657e-0e90-4c47-8562-0d45a59989d5 req-820ad746-c0fb-4925-83bd-eb4a4dedaf5b service nova] Creating event network-changed:f6407f4d-aecd-4eb6-ad9e-d0ae922831bf for instance cffcb6bd-4300-41e5-82ed-87bdc674276d on n-h1-861333-10 Oct 19 06:59:48.917767 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-bfb9657e-0e90-4c47-8562-0d45a59989d5 req-820ad746-c0fb-4925-83bd-eb4a4dedaf5b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039506 Oct 19 06:59:48.918766 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1283/2567] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:48.927429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:48.928186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:48.937949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.938539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.939023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:48.939724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:48.940239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:48.940664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.207530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:49.208128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:49.208735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:49.209399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:49.209971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:49.223690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.224867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.226920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.227932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.228655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.229143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.251415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Getting quotas for project 5635c3d71ece423f811956a3c5b549c4. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:49.257919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Getting quotas for user 1d64c821b95f4122b1941b7a5223f0a4 and project 5635c3d71ece423f811956a3c5b549c4. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:49.271857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Going to run 2 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:49.274389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 87b0126f-3e1a-4048-b711-39377e5b8fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:49.380698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=87b0126f-3e1a-4048-b711-39377e5b8fcd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:49.436341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:49.452802 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-937751b3-6aab-4af0-807f-54c169123c28 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.532326 Oct 19 06:59:49.453386 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1284/2568] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:48 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:49.453521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:49.459104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:49.459714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:49.465746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.466439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.467081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.467961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.468482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.469117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.552838 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9fadb2f-e280-4073-86fd-f76b2a19e3e2 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967681 Oct 19 06:59:49.553711 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1285/2569] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:59:49.564742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:49.570491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:49.571267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Searching by: {'deleted': False, 'project_id': '5635c3d71ece423f811956a3c5b549c4'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:49.589360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.589855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.590298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.591025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.591478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.592123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.643071 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c79d50d-b73b-48e0-8c39-7125da2edd18 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.082030 Oct 19 06:59:49.643382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:49.643666 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1286/2570] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 06:59:49 2022] GET /compute/v2.1/servers => generated 675 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 06:59:49.655286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:49.656225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:49.656368 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a169d937-68ce-48b8-9260-e96eb7d25181 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 0.196670 Oct 19 06:59:49.657236 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1285/2571] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:49 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:49.663623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.664413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.664986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.665817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.666404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.667112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.667304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b918e326-aca5-4996-a18c-6d73e55caaf4 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:49.667925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b918e326-aca5-4996-a18c-6d73e55caaf4 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:49.797265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:49.812212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:49.817247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:49.822289 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b2cd6db-0e50-4fc4-af2f-0770b9a93987 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1333 microversion: 2.47 time: 0.169655 Oct 19 06:59:49.824317 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1287/2572] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:49 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1333 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:59:49.837126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:49.841517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:49.865414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.866100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.866613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.868969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.868969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.868969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.895593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b918e326-aca5-4996-a18c-6d73e55caaf4 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:49.907040 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b918e326-aca5-4996-a18c-6d73e55caaf4 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1219 microversion: 2.1 time: 0.245336 Oct 19 06:59:49.908636 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1286/2573] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:49 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1219 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:49.913486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:49.918418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:49.933888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.934564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.935146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:49.936012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:49.941310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:49.941310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:50.455542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:50.475479 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4639f46a-8853-4f11-8a76-645ed5583848 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1469 microversion: 2.1 time: 0.640387 Oct 19 06:59:50.477785 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1288/2574] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:49 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1469 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:50.492804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:50.496332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:50.514904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:50.515623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:50.516316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:50.518040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:50.518726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:50.519359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:50.728455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:50.739985 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7182b69-7338-4658-b34f-3f4e6c451de3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1319 microversion: 2.1 time: 0.830093 Oct 19 06:59:50.740704 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1287/2575] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:49 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1319 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:50.747200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:50.755662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:50.771448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:50.772219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:50.772890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:50.773801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:50.774447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:50.775060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:50.848641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:50.856768 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d40add8e-f38d-462b-b4ba-da39709a0ebc tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.376779 Oct 19 06:59:50.857930 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1289/2576] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:50 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:50.865417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46a829b9-e53a-4ccd-9e9d-5d5f096dc4be tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d649a6790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:50.942496 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46a829b9-e53a-4ccd-9e9d-5d5f096dc4be tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/1c8db80b-b205-4f66-8a6c-a07d1c7d1cd5" status: 200 len: 662 microversion: 2.1 time: 0.081953 Oct 19 06:59:50.942496 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1290/2577] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:50 2022] GET /compute/v2.1/images/1c8db80b-b205-4f66-8a6c-a07d1c7d1cd5 => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:50.955403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:50.956552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:50.967522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:50.977346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:50.977346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:50.977346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:50.977346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:50.977346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:51.055684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:51.063866 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b3b2d91-79e3-455b-9f2e-715bd1c904e4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 0.321187 Oct 19 06:59:51.064476 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1288/2578] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:50 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:51.069416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d57436d3-6d05-4a80-a496-449f209e1e4c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:51.070120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d57436d3-6d05-4a80-a496-449f209e1e4c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:51.112410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:51.122476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:51.124251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:51.125421 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18553b2f-c9f2-4d21-b5c5-2888f13aa167 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1339 microversion: 2.47 time: 0.183512 Oct 19 06:59:51.126190 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1291/2579] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:50 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1339 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:59:51.131149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f270d332-d4a0-49c3-9922-ad592cfc475f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d6485e670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:51.210221 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f270d332-d4a0-49c3-9922-ad592cfc475f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/1c8db80b-b205-4f66-8a6c-a07d1c7d1cd5" status: 200 len: 662 microversion: 2.1 time: 0.082504 Oct 19 06:59:51.210819 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1292/2580] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 06:59:51 2022] GET /compute/v2.1/images/1c8db80b-b205-4f66-8a6c-a07d1c7d1cd5 => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:51.213616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d57436d3-6d05-4a80-a496-449f209e1e4c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:51.228829 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d57436d3-6d05-4a80-a496-449f209e1e4c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1219 microversion: 2.1 time: 0.160251 Oct 19 06:59:51.231269 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1289/2581] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:51 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:51.312014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ed25752a-a114-45bd-ae0a-db081f98037d req-c6c85c30-66a3-48ed-8a9f-7d3fb5720e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf886d10-4fa6-4a13-a48e-d0e90d602b8f", "name": "network-vif-deleted", "tag": "6f00e575-44f1-4568-8060-a0deaaa1aadb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:51.329943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ed25752a-a114-45bd-ae0a-db081f98037d req-c6c85c30-66a3-48ed-8a9f-7d3fb5720e9a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:51.331197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ed25752a-a114-45bd-ae0a-db081f98037d req-c6c85c30-66a3-48ed-8a9f-7d3fb5720e9a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:51.331197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ed25752a-a114-45bd-ae0a-db081f98037d req-c6c85c30-66a3-48ed-8a9f-7d3fb5720e9a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:51.356822 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ed25752a-a114-45bd-ae0a-db081f98037d req-c6c85c30-66a3-48ed-8a9f-7d3fb5720e9a service nova] Creating event network-vif-deleted:6f00e575-44f1-4568-8060-a0deaaa1aadb for instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f on n-h1-861333-10 Oct 19 06:59:51.366918 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ed25752a-a114-45bd-ae0a-db081f98037d req-c6c85c30-66a3-48ed-8a9f-7d3fb5720e9a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060013 Oct 19 06:59:51.370424 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1293/2582] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:51.386793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1076592471", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:51.450396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:59:51.508121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:51.509928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:51.518790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:51.520129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:51.520802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:51.521668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:51.522426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:51.523333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:51.652074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:51.668778 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23db47a0-994a-4808-af2b-c1e4637c5e93 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1427 microversion: 2.1 time: 0.167019 Oct 19 06:59:51.670003 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1294/2583] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:51 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1427 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:51.763697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:51.764438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:51.774795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:51.775266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:51.775344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:51.776307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:51.779076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:51.779076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:51.779238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:51.779238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:51.780767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:51.783449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:51.784898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:51.788448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:51.789411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:51.790706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:51.791612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:51.792246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:51.793977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:51.853230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Getting quotas for project 4c12e540806a4482a3b3c2f2e4c96d75. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:51.869125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Getting quotas for user 8d0c669a9c954108a75045073e26e6f5 and project 4c12e540806a4482a3b3c2f2e4c96d75. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:51.897969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:51.901839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:52.044062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:52.045155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:52.052827 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2d5452f-119f-4e63-9ffb-6dc31798ddf5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1319 microversion: 2.1 time: 0.293852 Oct 19 06:59:52.056206 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1295/2584] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:51 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:52.061708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:52.062499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:52.070932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.071630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.072304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.073575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.074185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.075209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.112699 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62f5e03a-0b0b-49c9-a533-567875bec286 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729756 Oct 19 06:59:52.116433 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1290/2585] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:59:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:59:52.125565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:52.126248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:52.140383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.144775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.148058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.149033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.149667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.152849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.334566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:52.342633 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d359a9a6-4c3e-47a9-a604-d934012657ce tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.285150 Oct 19 06:59:52.360463 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1296/2586] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:52 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:52.369208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:52.370885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:52.378592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.379262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.380470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.381796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.382713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.383318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.402157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:52.417038 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a58c7fee-216b-421e-b42d-5fb163e78d26 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 0.295910 Oct 19 06:59:52.418451 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1291/2587] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:52 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:52.429772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1724069072", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:52.444194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:52.512216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:59:52.564284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:52.574109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:52.575801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:52.577526 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f133102e-6c70-4234-8992-2a8e49cca548 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1339 microversion: 2.47 time: 0.214769 Oct 19 06:59:52.578457 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1297/2588] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:52 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1339 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:59:52.594241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e60af365-36e0-4830-97b9-66b03e1f058c req-b2259cfc-c9e8-459a-a5c4-fd1aec8005e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21a145d-a541-49b2-bdab-c4c8a86b77a8", "name": "network-vif-plugged", "status": "completed", "tag": "ac067cf3-fdf0-4f63-8595-c03c413defcb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:52.614237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e60af365-36e0-4830-97b9-66b03e1f058c req-b2259cfc-c9e8-459a-a5c4-fd1aec8005e9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.614937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e60af365-36e0-4830-97b9-66b03e1f058c req-b2259cfc-c9e8-459a-a5c4-fd1aec8005e9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.615512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e60af365-36e0-4830-97b9-66b03e1f058c req-b2259cfc-c9e8-459a-a5c4-fd1aec8005e9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.631309 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e60af365-36e0-4830-97b9-66b03e1f058c req-b2259cfc-c9e8-459a-a5c4-fd1aec8005e9 service nova] Creating event network-vif-plugged:ac067cf3-fdf0-4f63-8595-c03c413defcb for instance c21a145d-a541-49b2-bdab-c4c8a86b77a8 on n-h2-861333-10 Oct 19 06:59:52.639759 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e60af365-36e0-4830-97b9-66b03e1f058c req-b2259cfc-c9e8-459a-a5c4-fd1aec8005e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059868 Oct 19 06:59:52.641114 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1298/2589] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:52.648715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:52.649778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:52.658338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.659048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.659635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.660863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.661151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.662468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.750714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:52.761967 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fbe58089-f24c-4245-bd57-7afbac3a590b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1223 microversion: 2.1 time: 0.117820 Oct 19 06:59:52.777535 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1299/2590] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:52 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:52.786749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:52.788032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:52.794668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.795488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.796152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.797133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.797970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.798675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.841962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:52.842466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:52.842916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:52.844570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lazy-loading 'fault' on Instance uuid bf886d10-4fa6-4a13-a48e-d0e90d602b8f {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:52.967367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:52.978798 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cce9ec8c-3d76-4a30-b7ce-699a932a5e47 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 200 len: 1303 microversion: 2.1 time: 0.199425 Oct 19 06:59:52.979868 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1300/2591] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:52 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 1303 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:53.081679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:53.083452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:53.089506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.090148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.090677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.091463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.091989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.092514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.116523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:53.117086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:53.117435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:53.121398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:53.124756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:53.145068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.145565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.146044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.146866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.147333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.147899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.171968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Getting quotas for project 4c12e540806a4482a3b3c2f2e4c96d75. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:53.178970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Getting quotas for user 8d0c669a9c954108a75045073e26e6f5 and project 4c12e540806a4482a3b3c2f2e4c96d75. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:53.196263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:53.198665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:53.301872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:53.311030 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81a2ac24-2879-4570-b5be-dcc642c864bc tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1319 microversion: 2.1 time: 0.233273 Oct 19 06:59:53.312032 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1301/2592] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:53 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:53.351388 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76ea620e-dbb5-491e-a2a0-a73c095e3670 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928755 Oct 19 06:59:53.357841 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1292/2593] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 06:59:53.363748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-783f564b-aeca-4c36-b9f2-601dbc8b864a tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:53.364435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-783f564b-aeca-4c36-b9f2-601dbc8b864a tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:53.377125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:53.377714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:53.415819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.416555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.417944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.421110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.421783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.423315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.495753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-783f564b-aeca-4c36-b9f2-601dbc8b864a tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:53.504016 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-783f564b-aeca-4c36-b9f2-601dbc8b864a tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1218 microversion: 2.1 time: 0.144729 Oct 19 06:59:53.505185 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1302/2594] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:53 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:53.510524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:53.511285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:53.526004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.529273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.529273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.529273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.529273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.529273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.648330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:53.667424 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4ea2467-fda4-45e0-8c99-afb51ac34967 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.297101 Oct 19 06:59:53.668369 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1293/2595] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:53 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:53.674056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:53.674886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:53.681673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.682491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.683096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.683966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.684776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.685503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.736928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:53.750782 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f97c0af4-3728-4b6c-9585-9c12704beb4c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 0.244377 Oct 19 06:59:53.752817 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1303/2596] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:53 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:53.762473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:53.788917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:53.789540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:53.797043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.797043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.797314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.798308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.798924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.799508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.824305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:53.830977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:53.832494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:53.833661 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-98de57eb-7ccb-4232-a790-397dfe2c3923 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1360 microversion: 2.47 time: 0.163963 Oct 19 06:59:53.834227 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1294/2597] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:53 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:59:53.860360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9d31d4e-7892-4232-8343-b9d1f1f239a4 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-123033521"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:53.862916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9d31d4e-7892-4232-8343-b9d1f1f239a4 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:53.869740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d31d4e-7892-4232-8343-b9d1f1f239a4 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.870666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d31d4e-7892-4232-8343-b9d1f1f239a4 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.871304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d31d4e-7892-4232-8343-b9d1f1f239a4 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.872436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d31d4e-7892-4232-8343-b9d1f1f239a4 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:53.873327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d31d4e-7892-4232-8343-b9d1f1f239a4 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:53.873770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9d31d4e-7892-4232-8343-b9d1f1f239a4 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:53.911944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:53.933305 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0424c353-b660-4bd4-adc1-f801e82da907 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1271 microversion: 2.1 time: 0.146767 Oct 19 06:59:53.940465 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1304/2598] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:53 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:54.004778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:54.005512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: bf886d10-4fa6-4a13-a48e-d0e90d602b8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:54.015996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.032207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.033915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.035482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.037383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.038366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.058322 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] HTTP exception thrown: Instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f could not be found. Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Request method failure captured: Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f HTTP/1.1 Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT575Qj8SyWLHfqMJFN82d229CAu6HFmDWzjD0wVlUEt_tCXdNRc7zLyxNzs7J5rJvk9XLcybZrvOVp4W8KLFG9nskFJNdN2X1Bs0fWrQXLw8oVqa1XJ0jtQsjj33VkwDMK2wmhEtixfsTBSlhgD8XfYJTWxcpyWW8Rjh7m2X57TvC8I Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d80c925de0b447909ae6fbfe56e61dda Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-MigrationsAdminTest-748893206 Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d80c925de0b447909ae6fbfe56e61dda", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-MigrationsAdminTest-748893206 Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d80c925de0b447909ae6fbfe56e61dda Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MigrationsAdminTest-748893206 Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-MigrationsAdminTest-748893206-project Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 631a2a90a44a40b2bd751a4feaf69d0f Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-MigrationsAdminTest-748893206-project Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f could not be found. Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'bf886d10-4fa6-4a13-a48e-d0e90d602b8f'} Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f could not be found. Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f could not be found. Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:54.060004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f could not be found. Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Returning 404 to user: Instance bf886d10-4fa6-4a13-a48e-d0e90d602b8f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44bc9c79-cddb-4978-a2f1-0181ab571968 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f" status: 404 len: 111 microversion: 2.1 time: 0.061487 Oct 19 06:59:54.065079 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1305/2599] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:53 2022] GET /compute/v2.1/servers/bf886d10-4fa6-4a13-a48e-d0e90d602b8f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 06:59:54.070549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:54.071121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:54.078031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.078662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.079208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.080156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.080622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.081219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.128734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:54.338023 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9d31d4e-7892-4232-8343-b9d1f1f239a4 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "POST /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616/action" status: 202 len: 52 microversion: 2.47 time: 0.481475 Oct 19 06:59:54.345532 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1295/2600] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 06:59:53 2022] POST /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616/action => generated 52 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Oct 19 06:59:54.354965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:54.355672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:54.362436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.362862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.363305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.364014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.364498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.364934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.563558 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6257e3e-c83b-402c-8624-07dd14943c78 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 204 len: 0 microversion: 2.1 time: 0.496341 Oct 19 06:59:54.564168 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1306/2601] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 06:59:54 2022] DELETE /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 06:59:54.569862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:54.570544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:54.577157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.577659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.578400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.579149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.579707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.580371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.593885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:54.607102 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-516074ca-98d2-499b-930c-e86c184c01d1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1469 microversion: 2.1 time: 0.255973 Oct 19 06:59:54.607999 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1296/2602] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:54 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:54.611748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 06:59:54.614011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:54.615018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:54.622659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.623734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.624219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.625220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.625853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.626490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.711892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:54.719428 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2034b91e-b3bf-4ed5-b1fd-3d71e2a5e49b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1222 microversion: 2.1 time: 0.110151 Oct 19 06:59:54.720601 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1297/2603] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:54 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:54.725004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:54.725600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:54.731427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.737780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.737780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.737780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.737780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.737780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:54.895453 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc316fcb-bbdf-4302-ac84-66b61b61eb20 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 204 len: 0 microversion: 2.47 time: 0.329258 Oct 19 06:59:54.896156 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1307/2604] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 06:59:54 2022] DELETE /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 06:59:54.959269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:54.967559 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b95bf0ec-7e9f-4313-a89f-67dc0c4ec9b3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1466 microversion: 2.1 time: 0.245937 Oct 19 06:59:54.968283 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1298/2605] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:54 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1466 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:54.974992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0453cfba-fab1-4d23-9f81-2cda96650847 req-0db3987f-695d-4f35-841b-2a72c3f1fc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cdaae7-d4cb-4347-a879-9b98c1747932", "name": "network-vif-plugged", "status": "completed", "tag": "8a955975-1b4c-4908-abd4-81ab7291df58"}, {"server_uuid": "3643b581-f3e9-4281-9fc0-80424ba41658", "name": "network-vif-plugged", "status": "completed", "tag": "72d920f7-ef25-4437-b1f6-2b3ca1c0fffb"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:54.992277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0453cfba-fab1-4d23-9f81-2cda96650847 req-0db3987f-695d-4f35-841b-2a72c3f1fc4f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:54.997189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0453cfba-fab1-4d23-9f81-2cda96650847 req-0db3987f-695d-4f35-841b-2a72c3f1fc4f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:54.997835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0453cfba-fab1-4d23-9f81-2cda96650847 req-0db3987f-695d-4f35-841b-2a72c3f1fc4f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.012265 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0453cfba-fab1-4d23-9f81-2cda96650847 req-0db3987f-695d-4f35-841b-2a72c3f1fc4f service nova] Creating event network-vif-plugged:8a955975-1b4c-4908-abd4-81ab7291df58 for instance d5cdaae7-d4cb-4347-a879-9b98c1747932 on n-h2-861333-10 Oct 19 06:59:55.012768 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0453cfba-fab1-4d23-9f81-2cda96650847 req-0db3987f-695d-4f35-841b-2a72c3f1fc4f service nova] Creating event network-vif-plugged:72d920f7-ef25-4437-b1f6-2b3ca1c0fffb for instance 3643b581-f3e9-4281-9fc0-80424ba41658 on n-h2-861333-10 Oct 19 06:59:55.019900 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0453cfba-fab1-4d23-9f81-2cda96650847 req-0db3987f-695d-4f35-841b-2a72c3f1fc4f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049481 Oct 19 06:59:55.025999 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1299/2606] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:55.035776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:55.036702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:55.044688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.045470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.046123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.046985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.047587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.048242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.094902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-471882237", "block_migration": true, "disk_over_commit": false}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:55.098500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:55.117435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.118084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.118528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.119258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.119722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.120170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.156773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lazy-loading 'flavor' on Instance uuid c21a145d-a541-49b2-bdab-c4c8a86b77a8 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:55.172950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Going to try to live migrate instance to tempest-host-471882237 {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 06:59:55.180614 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] HTTP exception thrown: Compute host tempest-host-471882237 could not be found. Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Request method failure captured: Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8/action HTTP/1.1 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 106 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6BNNHf4na82s5OCbSLGiFheejmPJshTRs8TQKrXIz6aHuMdmlYAzKz9kQnypjm-xJ3R65pSFiflGd33Rv4h2-7nIiARZlkq22VyT54rDGN5Wi569Ib4UcVWURZXgXOsXYJGMTaSLgX9F3e0RJhBfjarBstOOnY6qc3sE44djjK0HvA Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d48af9d08e9e44ec954fe4c3a90492b0 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveMigrationNegativeTest-399411732 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d48af9d08e9e44ec954fe4c3a90492b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d48af9d08e9e44ec954fe4c3a90492b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d48af9d08e9e44ec954fe4c3a90492b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d48af9d08e9e44ec954fe4c3a90492b0", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-LiveMigrationNegativeTest-399411732 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d48af9d08e9e44ec954fe4c3a90492b0 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-399411732 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-LiveMigrationNegativeTest-399411732-project-admin Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f03cf4a36fec4957a7eac3a47a2b0551 Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-LiveMigrationNegativeTest-399411732-project-admin Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: {"os-migrateLive": {"host": "tempest-host-471882237", "block_migration": true, "disk_over_commit": false}} Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: exception: Compute host tempest-host-471882237 could not be found. Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c21a145d-a541-49b2-bdab-c4c8a86b77a8', 'body': {'os-migrateLive': {'host': 'tempest-host-471882237', 'block_migration': True, 'disk_over_commit': False}}} Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 19 06:59:55.192971 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-471882237 could not be found. Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-471882237 could not be found. Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-471882237 could not be found. Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Returning 400 to user: Compute host tempest-host-471882237 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac81460a-592f-40c8-8269-359043116fd7 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8/action" status: 400 len: 99 microversion: 2.1 time: 0.296206 Oct 19 06:59:55.196323 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1308/2607] 10.222.0.39 () {60 vars in 1279 bytes} [Wed Oct 19 06:59:54 2022] POST /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8/action => generated 99 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 06:59:55.203469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:55.203469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:55.209147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.209685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.210292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.211007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.211475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.212007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.314663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:55.322658 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61a151a3-7cb6-42a8-9395-3b01e83e597e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.295224 Oct 19 06:59:55.339014 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1300/2608] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:55 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:55.339014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:55.339014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:55.339014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.339014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.339014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.339014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.339014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.339014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.354765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:55.363294 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b47c8e38-d236-458e-8f58-38881cf5b8e2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 0.166792 Oct 19 06:59:55.373628 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1309/2609] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:55 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:55.379269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:55.379939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:55.387443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.388347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.388879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.389669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.390266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.391704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.451559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:55.461496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:55.463000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:55.464581 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0975f13e-8df9-4359-9387-8798abdda4cc tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1366 microversion: 2.47 time: 0.140004 Oct 19 06:59:55.465449 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1301/2610] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:55 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:59:55.466981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:55.470744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:55.470883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:55.470993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:55.476760 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-577a4dfb-814b-4f1e-ae1f-f84529a3a276 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1271 microversion: 2.1 time: 0.101818 Oct 19 06:59:55.477220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.477797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.478226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.478921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.479372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.479795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.488170 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1310/2611] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:55 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:55.684431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:55.693238 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17f4d77d-d8e6-47ac-9f83-72907d425b7b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1469 microversion: 2.1 time: 0.226645 Oct 19 06:59:55.694013 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1302/2612] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:55 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1469 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:55.743891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:55.744778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:55.754503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.755258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.759841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.759841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:55.759841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:55.759841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:55.811174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-565779779", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:55.833317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:55.841037 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35390b16-9466-435e-b2a0-3d5f0697d7ce tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1222 microversion: 2.1 time: 0.102096 Oct 19 06:59:55.841606 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1311/2613] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:55 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:55.867461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 06:59:55.992368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:55.992909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:55.999800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.000436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.000934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.002528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.003027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.003484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.077681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 06:59:56.078173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 06:59:56.078758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 06:59:56.079230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 06:59:56.080276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 06:59:56.092981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.093470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.093901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.094932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.095570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.096328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.139527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Getting quotas for project 4b63168bfe4941ac8e4fbf19ed21860e. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 06:59:56.146423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:56.146572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Getting quotas for user 042331c92e794909925dcfde9e576afd and project 4b63168bfe4941ac8e4fbf19ed21860e. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 06:59:56.154762 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0bac226-425a-4657-a5d4-c215ffce854e tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1466 microversion: 2.1 time: 0.166679 Oct 19 06:59:56.155338 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1312/2614] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:55 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1466 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:56.162006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 06:59:56.166333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 06:59:56.318672 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1373badf-e132-432c-a745-103954b072f5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511656 Oct 19 06:59:56.319380 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1303/2615] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 06:59:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 06:59:56.334396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85ba883b-cf6a-4825-81f2-c074760cac5d tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:56.336305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85ba883b-cf6a-4825-81f2-c074760cac5d tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:56.347276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:56.347899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:56.356920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.357609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.358151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.359040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.359755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.360403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.478783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-85ba883b-cf6a-4825-81f2-c074760cac5d tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:56.490527 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85ba883b-cf6a-4825-81f2-c074760cac5d tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1218 microversion: 2.1 time: 0.162826 Oct 19 06:59:56.491646 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1313/2616] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:56 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:56.497697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:56.500185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:56.509902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.510545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.511294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.512369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.512970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.513858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.699437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:56.707662 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5685887-71b9-4b4c-87b5-2006e0aceb4e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1318 microversion: 2.1 time: 0.214839 Oct 19 06:59:56.708361 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1314/2617] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:56 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:56.713545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:56.714406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:56.721599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.722196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.723056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.723906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.724720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.725223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.806273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:56.808298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:56.816355 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d98beab-c9bd-495f-b8ea-38f77d738678 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.473952 Oct 19 06:59:56.819236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:56.821035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:56.832366 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d3add96-72a5-46c4-b0fa-844463ebcef3 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1366 microversion: 2.47 time: 0.113055 Oct 19 06:59:56.832914 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1304/2618] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:56 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:56.838290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:56.839129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:56.846826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.847598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.847733 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1315/2619] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:56 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:59:56.848384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.849102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.849561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.849990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.866652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:56.868391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:56.876646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.877353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.878100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:56.879544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:56.880095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:56.880672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:57.041774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:57.053497 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dfd39886-a9c3-4407-b2dd-57f1ce526846 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1214 microversion: 2.1 time: 0.190505 Oct 19 06:59:57.054094 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1316/2620] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:56 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:57.185035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:57.188281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:57.201789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:57.202289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:57.202738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:57.203448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:57.203912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:57.210536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:57.318971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:57.326840 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b4864ff-4580-4cda-892f-5b1bec911767 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1271 microversion: 2.1 time: 0.492507 Oct 19 06:59:57.327429 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1305/2621] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:56 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1271 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:57.474821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:57.482684 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f593e7fb-57c3-422f-8b64-0ea2e4e41aa6 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1466 microversion: 2.1 time: 0.309578 Oct 19 06:59:57.483259 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1317/2622] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:57 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1466 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:57.508296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0e8fbb07-6f49-4c42-931d-04f30d639a99 req-c75e1734-6563-4faf-be38-27e80279d5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1879dd80-bc43-4b3b-bf52-85a4745444fa", "name": "network-vif-deleted", "tag": "4a79685b-a244-4153-b0c2-b8a3f4fe3abc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:57.519432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0e8fbb07-6f49-4c42-931d-04f30d639a99 req-c75e1734-6563-4faf-be38-27e80279d5c6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:57.524828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0e8fbb07-6f49-4c42-931d-04f30d639a99 req-c75e1734-6563-4faf-be38-27e80279d5c6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:57.524828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0e8fbb07-6f49-4c42-931d-04f30d639a99 req-c75e1734-6563-4faf-be38-27e80279d5c6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:57.525015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f6de896-c7b7-4993-ae4c-c0c2d4204d25 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:57.525015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f6de896-c7b7-4993-ae4c-c0c2d4204d25 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:57.533080 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0e8fbb07-6f49-4c42-931d-04f30d639a99 req-c75e1734-6563-4faf-be38-27e80279d5c6 service nova] Creating event network-vif-deleted:4a79685b-a244-4153-b0c2-b8a3f4fe3abc for instance 1879dd80-bc43-4b3b-bf52-85a4745444fa on n-h1-861333-10 Oct 19 06:59:57.538004 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0e8fbb07-6f49-4c42-931d-04f30d639a99 req-c75e1734-6563-4faf-be38-27e80279d5c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033436 Oct 19 06:59:57.538581 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1306/2623] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:57.583939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f6de896-c7b7-4993-ae4c-c0c2d4204d25 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:57.595132 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f6de896-c7b7-4993-ae4c-c0c2d4204d25 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1218 microversion: 2.1 time: 0.078033 Oct 19 06:59:57.595723 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1318/2624] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:57 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:57.737453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:57.738263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:57.745592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:57.746310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:57.746758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:57.747464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:57.747918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:57.748780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:57.840723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:57.841836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:57.850294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:57.851247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:57.851851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:57.852902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:57.853587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:57.854070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.049326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:58.060328 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-146bbf77-37f6-49ce-b315-ec13d2e1775e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.224549 Oct 19 06:59:58.061482 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1319/2625] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:57 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:58.067506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:58.068339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:58.075339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.076022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:58.076392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.077060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.077998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.078669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.079343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.087552 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca6d607e-03b6-4f3d-a4e3-b74ad233eb6a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1468 microversion: 2.1 time: 0.355005 Oct 19 06:59:58.088552 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1307/2626] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:57 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1468 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:58.094997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:58.095552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:58.103670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.104209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.117285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.118234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.118726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.119180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.196265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:58.226142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:58.242588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:58.249113 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12350b10-59d0-423f-b13f-5aac91e5f4f9 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1366 microversion: 2.47 time: 0.186460 Oct 19 06:59:58.252205 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1320/2627] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:58 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 06:59:58.260032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:58.264078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:58.265974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:58.277337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.280820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.281285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.282102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.283108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.287758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.287888 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dab139c4-f7e7-412f-8bae-8d0d4c175b25 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1270 microversion: 2.1 time: 0.194738 Oct 19 06:59:58.287888 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1308/2628] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:58 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:58.352477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:58.352659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:58.360355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.361592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.362110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.363358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.364046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.364689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.513691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:58.523072 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5329c32d-a99e-4d0e-b883-40f21172244d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1279 microversion: 2.1 time: 0.176204 Oct 19 06:59:58.533197 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1309/2629] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:58 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 06:59:58.712166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b86a8dfa-e85d-4edd-89e9-db1acc397489 req-45c692a9-b974-4db5-8b60-c189a4290dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b0126f-3e1a-4048-b711-39377e5b8fcd", "tag": "718ea078-4589-44cc-ac8b-e26680e78877"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 06:59:58.734170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b86a8dfa-e85d-4edd-89e9-db1acc397489 req-45c692a9-b974-4db5-8b60-c189a4290dd6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.734521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b86a8dfa-e85d-4edd-89e9-db1acc397489 req-45c692a9-b974-4db5-8b60-c189a4290dd6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.735028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b86a8dfa-e85d-4edd-89e9-db1acc397489 req-45c692a9-b974-4db5-8b60-c189a4290dd6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.763205 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b86a8dfa-e85d-4edd-89e9-db1acc397489 req-45c692a9-b974-4db5-8b60-c189a4290dd6 service nova] Creating event network-changed:718ea078-4589-44cc-ac8b-e26680e78877 for instance 87b0126f-3e1a-4048-b711-39377e5b8fcd on n-h2-861333-10 Oct 19 06:59:58.799983 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b86a8dfa-e85d-4edd-89e9-db1acc397489 req-45c692a9-b974-4db5-8b60-c189a4290dd6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261660 Oct 19 06:59:58.801149 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1310/2630] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 06:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 06:59:58.822686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:58.826846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:58.843949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.844796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.848247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.850276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.850927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.854764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.915920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.916456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.916895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.917349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lazy-loading 'fault' on Instance uuid 1879dd80-bc43-4b3b-bf52-85a4745444fa {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:58.921329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:58.933898 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f2ff4dc-ba79-40ee-9d5b-805da80f5f34 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932" status: 200 len: 1467 microversion: 2.1 time: 0.677804 Oct 19 06:59:58.951485 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1321/2631] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:58 2022] GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932 => generated 1467 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:58.957639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:58.958198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:58.964444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.965134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.965747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:58.966609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:58.967299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:58.968005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.064235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631a2a90a44a40b2bd751a4feaf69d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c925de0b447909ae6fbfe56e61dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:59.064842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:59.076718 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2de607c-79f8-47ad-b9e8-3bcd6a6da9f1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1214 microversion: 2.1 time: 0.123767 Oct 19 06:59:59.078660 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1322/2632] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:58 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:59.087463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:59.095137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:59.106779 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3547f585-3069-4f26-bce9-0af1d5b3cbe3 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 200 len: 1300 microversion: 2.1 time: 0.294912 Oct 19 06:59:59.106955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Searching by: {'reservation_id': 'r-a6fgiv0n', 'deleted': False, 'project_id': 'a6f0b288d116428981f07801b48d1cc8'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 06:59:59.112513 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1311/2633] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:58 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 1300 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:59.134587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.142555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.143238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.144300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.146012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:59.146168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.146541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.153716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:59.171577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.184726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.185494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.187800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.190908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.193036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.250837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 06:59:59.390894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 06:59:59.550098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:59.575174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.579060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.584049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.749750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:59.758530 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3cadcf7-9ded-4539-ba13-591b68668225 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.643136 Oct 19 06:59:59.766064 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1312/2634] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:59 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:59.770889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:59.771509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:59.787949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.790076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.794224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.795100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.795664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.796236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.852460 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89f6d489-2e6d-4678-bfa5-d50d49dcd702 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?reservation_id=r-a6fgiv0n" status: 200 len: 2928 microversion: 2.1 time: 0.768734 Oct 19 06:59:59.853059 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1323/2635] 10.222.0.39 () {58 vars in 1197 bytes} [Wed Oct 19 06:59:59 2022] GET /compute/v2.1/servers/detail?reservation_id=r-a6fgiv0n => generated 2928 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 06:59:59.863293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 06:59:59.863293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 06:59:59.871540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.875839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.875839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.875839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.878742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.880947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.904406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 06:59:59.904406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 06:59:59.904406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 06:59:59.907122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lazy-loading 'fault' on Instance uuid 3304337e-bef9-4cf2-8d51-2211baf45616 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 06:59:59.976023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 06:59:59.985363 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c869c4a-dea0-420e-a847-7b3254ecaa7c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1278 microversion: 2.1 time: 0.131119 Oct 19 06:59:59.986817 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1324/2636] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:59 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:00.009135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:00.013128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:00.027192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.030455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.031178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.034574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.036060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.036947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.119850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:00.150000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:00.156599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:00.159503 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f0c3ba4-e841-4017-9535-8a807b86057f tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1371 microversion: 2.47 time: 0.392262 Oct 19 07:00:00.160417 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1313/2637] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 06:59:59 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:00:00.169309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cbc3df81-f2d4-4cc0-a33b-952fddc6d090 req-2641c12d-654a-4d97-a592-7c2a0402c649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cffcb6bd-4300-41e5-82ed-87bdc674276d", "name": "network-vif-plugged", "status": "completed", "tag": "f6407f4d-aecd-4eb6-ad9e-d0ae922831bf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:00.186555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cbc3df81-f2d4-4cc0-a33b-952fddc6d090 req-2641c12d-654a-4d97-a592-7c2a0402c649 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.187062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cbc3df81-f2d4-4cc0-a33b-952fddc6d090 req-2641c12d-654a-4d97-a592-7c2a0402c649 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.187507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cbc3df81-f2d4-4cc0-a33b-952fddc6d090 req-2641c12d-654a-4d97-a592-7c2a0402c649 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.208082 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cbc3df81-f2d4-4cc0-a33b-952fddc6d090 req-2641c12d-654a-4d97-a592-7c2a0402c649 service nova] Creating event network-vif-plugged:f6407f4d-aecd-4eb6-ad9e-d0ae922831bf for instance cffcb6bd-4300-41e5-82ed-87bdc674276d on n-h1-861333-10 Oct 19 07:00:00.226549 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cbc3df81-f2d4-4cc0-a33b-952fddc6d090 req-2641c12d-654a-4d97-a592-7c2a0402c649 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062664 Oct 19 07:00:00.227557 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1314/2638] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:00.241674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64c079b4-94a3-42c9-a425-9ed37cffacd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:00.305610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.server_groups [None req-64c079b4-94a3-42c9-a425-9ed37cffacd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Querying cell 2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) for 2 instances {{(pid=127568) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 07:00:00.306349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64c079b4-94a3-42c9-a425-9ed37cffacd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.307149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64c079b4-94a3-42c9-a425-9ed37cffacd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.307883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64c079b4-94a3-42c9-a425-9ed37cffacd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.377192 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64c079b4-94a3-42c9-a425-9ed37cffacd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/3f1302cc-65fa-4253-b491-ad55b0ce99a4" status: 200 len: 265 microversion: 2.1 time: 0.148321 Oct 19 07:00:00.378102 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1315/2639] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 07:00:00 2022] GET /compute/v2.1/os-server-groups/3f1302cc-65fa-4253-b491-ad55b0ce99a4 => generated 265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:00.387623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:00.389441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:00.407489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.407899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.408372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.409090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.409552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.409989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.567485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:00.567839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:00.587912 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e6adba9-0c9e-42a1-9b5c-f056c3180857 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1319 microversion: 2.1 time: 0.590849 Oct 19 07:00:00.587912 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1325/2640] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 06:59:59 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:00.598263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:00.599250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73b851f5-b4eb-475f-85a1-a84868d8068e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1270 microversion: 2.1 time: 0.220075 Oct 19 07:00:00.601550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] [instance: 1879dd80-bc43-4b3b-bf52-85a4745444fa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:00.613661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:00.620502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.627898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.628707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.629700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.633162 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1316/2641] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:00 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:00.638438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.640023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.641949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-695c0367-f5d6-465d-808b-4a13f8edad41 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:00.642569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-695c0367-f5d6-465d-808b-4a13f8edad41 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:00.665153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695c0367-f5d6-465d-808b-4a13f8edad41 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.665654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695c0367-f5d6-465d-808b-4a13f8edad41 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.666101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695c0367-f5d6-465d-808b-4a13f8edad41 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.667983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695c0367-f5d6-465d-808b-4a13f8edad41 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.668498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695c0367-f5d6-465d-808b-4a13f8edad41 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.670097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695c0367-f5d6-465d-808b-4a13f8edad41 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.676474 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] HTTP exception thrown: Instance 1879dd80-bc43-4b3b-bf52-85a4745444fa could not be found. Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Request method failure captured: Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa HTTP/1.1 Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT575Qj8SyWLHfqMJFN82d229CAu6HFmDWzjD0wVlUEt_tCXdNRc7zLyxNzs7J5rJvk9XLcybZrvOVp4W8KLFG9nskFJNdN2X1Bs0fWrQXLw8oVqa1XJ0jtQsjj33VkwDMK2wmhEtixfsTBSlhgD8XfYJTWxcpyWW8Rjh7m2X57TvC8I Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d80c925de0b447909ae6fbfe56e61dda Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-MigrationsAdminTest-748893206 Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d80c925de0b447909ae6fbfe56e61dda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d80c925de0b447909ae6fbfe56e61dda", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-MigrationsAdminTest-748893206 Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d80c925de0b447909ae6fbfe56e61dda Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MigrationsAdminTest-748893206 Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-MigrationsAdminTest-748893206-project Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 631a2a90a44a40b2bd751a4feaf69d0f Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-MigrationsAdminTest-748893206-project Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 1879dd80-bc43-4b3b-bf52-85a4745444fa could not be found. Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '1879dd80-bc43-4b3b-bf52-85a4745444fa'} Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1879dd80-bc43-4b3b-bf52-85a4745444fa could not be found. Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1879dd80-bc43-4b3b-bf52-85a4745444fa could not be found. Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:00.678918 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:00.682651 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:00.682651 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:00.682651 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:00.682651 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:00.682651 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:00.682651 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1879dd80-bc43-4b3b-bf52-85a4745444fa could not be found. Oct 19 07:00:00.682651 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:00.694134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] Returning 404 to user: Instance 1879dd80-bc43-4b3b-bf52-85a4745444fa could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:00.699740 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cce0e20f-eebb-47d2-b61f-d17a6c831049 tempest-MigrationsAdminTest-748893206 tempest-MigrationsAdminTest-748893206-project] 10.222.0.39 "GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa" status: 404 len: 111 microversion: 2.1 time: 0.107972 Oct 19 07:00:00.710020 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1326/2642] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:00 2022] GET /compute/v2.1/servers/1879dd80-bc43-4b3b-bf52-85a4745444fa => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:00.790108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:00.791214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:00.802391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.804696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.806718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.810977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.812375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.813039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.900084 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-695c0367-f5d6-465d-808b-4a13f8edad41 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1621 microversion: 2.1 time: 0.263308 Oct 19 07:00:00.911771 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1317/2643] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:00 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1621 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:00.930233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c3a4c77-aa53-4236-858d-ccf9ce67b659 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:00.935467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c3a4c77-aa53-4236-858d-ccf9ce67b659 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:00.944892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c3a4c77-aa53-4236-858d-ccf9ce67b659 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.945833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c3a4c77-aa53-4236-858d-ccf9ce67b659 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.946570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c3a4c77-aa53-4236-858d-ccf9ce67b659 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:00.947284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c3a4c77-aa53-4236-858d-ccf9ce67b659 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:00.947777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c3a4c77-aa53-4236-858d-ccf9ce67b659 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:00.949013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c3a4c77-aa53-4236-858d-ccf9ce67b659 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.110957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:01.132289 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3be9f8f-1be8-4e7a-808b-a8134348c2ec tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1324 microversion: 2.1 time: 0.334634 Oct 19 07:00:01.132289 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1327/2644] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:00 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:01.132289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:01.132289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:01.138294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:01.140059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:01.140803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.143021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:01.144411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:01.145370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.245476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:01.246327 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ecbabcb-7e7e-4915-9beb-8401a222ab22 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1276 microversion: 2.1 time: 0.123788 Oct 19 07:00:01.247428 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1328/2645] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:01 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:01.255126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:01.255747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:01.266216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:01.273463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:01.273463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.273463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:01.273463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:01.273463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.291102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:01.306930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:01.307426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:01.307880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.308361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lazy-loading 'fault' on Instance uuid 3304337e-bef9-4cf2-8d51-2211baf45616 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:01.353228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:01.363203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:01.365108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f72a3960f88a4a4ab39857a7b1a8f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373a4054a3c945e5ac865f1335359229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:01.367772 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5b5be8d-8ec8-45c3-b562-a49ff5d63949 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 200 len: 1371 microversion: 2.47 time: 0.117986 Oct 19 07:00:01.378781 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c3a4c77-aa53-4236-858d-ccf9ce67b659 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932" status: 200 len: 1620 microversion: 2.1 time: 0.453049 Oct 19 07:00:01.379344 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1318/2646] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:00 2022] GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932 => generated 1620 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:01.380559 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1329/2647] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:00:01 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 1371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:00:01.413872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c91419d-84b8-4525-b3c2-77984f60c5b3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Action: 'create', calling method: .version_select at 0x7f6d689c48b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-219986553", "policies": ["anti-affinity"]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:01.437083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0c91419d-84b8-4525-b3c2-77984f60c5b3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:01.443166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0c91419d-84b8-4525-b3c2-77984f60c5b3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:01.611938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:01.612832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:01.614659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0c91419d-84b8-4525-b3c2-77984f60c5b3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:01.619735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:01.620252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:01.620687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.621389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:01.621841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:01.622260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.624969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0c91419d-84b8-4525-b3c2-77984f60c5b3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:01.645324 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c91419d-84b8-4525-b3c2-77984f60c5b3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.236275 Oct 19 07:00:01.646864 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1330/2648] 10.222.0.39 () {60 vars in 1174 bytes} [Wed Oct 19 07:00:01 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:01.653157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:01.654139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:01.662221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:01.663224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:01.663824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.664744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:01.665397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:01.666498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:01.755527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:01.768226 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-503e9239-d105-489b-8397-72f85d58bbc8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1270 microversion: 2.1 time: 0.119598 Oct 19 07:00:01.769463 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1331/2649] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:01 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:01.792896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1666620083", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cbc3012e-aa9e-4a3a-ac7e-dac5cf061c7e"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:01.852647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:00:02.238777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:02.249072 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67f1fed1-bb72-4c0c-8831-4c633d6e9c49 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1319 microversion: 2.1 time: 0.642040 Oct 19 07:00:02.250221 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1319/2650] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:01 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1319 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:02.271302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-34d909e8-80fa-4284-8a50-043a920693b0 req-4ce492c3-4ffa-44d1-83f2-1f957e936ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83bd721-b423-47b5-969e-9dcb73715bd4", "tag": "590d91ab-87aa-4327-950f-26e3c0efee47"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:02.281218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-34d909e8-80fa-4284-8a50-043a920693b0 req-4ce492c3-4ffa-44d1-83f2-1f957e936ef5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:02.281993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-34d909e8-80fa-4284-8a50-043a920693b0 req-4ce492c3-4ffa-44d1-83f2-1f957e936ef5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:02.282954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-34d909e8-80fa-4284-8a50-043a920693b0 req-4ce492c3-4ffa-44d1-83f2-1f957e936ef5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:02.294900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:00:02.295325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:00:02.295435 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-34d909e8-80fa-4284-8a50-043a920693b0 req-4ce492c3-4ffa-44d1-83f2-1f957e936ef5 service nova] Creating event network-changed:590d91ab-87aa-4327-950f-26e3c0efee47 for instance e83bd721-b423-47b5-969e-9dcb73715bd4 on n-h1-861333-10 Oct 19 07:00:02.295799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:00:02.296233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:00:02.296648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:00:02.300801 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-34d909e8-80fa-4284-8a50-043a920693b0 req-4ce492c3-4ffa-44d1-83f2-1f957e936ef5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033931 Oct 19 07:00:02.303201 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1320/2651] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:02.306465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:02.307346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:02.314594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:02.315076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:02.315516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:02.316252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:02.316711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:02.317141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:02.324588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:02.325075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:02.325513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:02.326238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:02.327095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:02.327095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:02.349372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:02.357095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:02.375493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Going to run 2 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:00:02.378568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 97939c70-1ac7-4626-8d23-50bfa0d115d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:00:02.615441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:02.624415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:02.769492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:02.785113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:02.809845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=97939c70-1ac7-4626-8d23-50bfa0d115d9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:00:02.920517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:02.930380 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-931418a5-1aaa-46a5-b8de-3f8b2df60081 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1520 microversion: 2.1 time: 0.627782 Oct 19 07:00:02.931487 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1321/2652] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:02 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1520 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:02.936359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:02.937418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:02.963588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:02.965664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:02.967409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:02.968419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:02.969278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:02.969876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:02.990839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:02.998787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:03.116922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:03.126977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:03.133575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:03.178243 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f519fc09-fc83-4fc4-9574-ade92ad48676 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.389398 Oct 19 07:00:03.181885 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1332/2653] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:00:01 2022] POST /compute/v2.1/servers => generated 32 bytes in 1391 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 19 07:00:03.191059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:03.191059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] [instance: 3304337e-bef9-4cf2-8d51-2211baf45616] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:03.194628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.195130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.195633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:03.196389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.197149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.197592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:03.232584 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] HTTP exception thrown: Instance 3304337e-bef9-4cf2-8d51-2211baf45616 could not be found. Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Request method failure captured: Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 HTTP/1.1 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6Bga9qGFekTSUDcbSRz7deVKgqHyNXNVMqmKjJ1J7onHcMHwPPX-1Jl5WKOt6heg43btCwvizXDLqusbSMz4i3tX9O3kGkX4kXcRg-BAczRGsfIsmwhqJbpNF5lDpW61cV-8ddtb9kT3MdqUAWba0JBXp-5gHxGHbs3pw7ULeebQs4 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.47 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 373a4054a3c945e5ac865f1335359229 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAaction247Test-499744119 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/373a4054a3c945e5ac865f1335359229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/373a4054a3c945e5ac865f1335359229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/373a4054a3c945e5ac865f1335359229"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_373a4054a3c945e5ac865f1335359229", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAaction247Test-499744119 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 373a4054a3c945e5ac865f1335359229 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAaction247Test-499744119 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersAaction247Test-499744119-project Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f72a3960f88a4a4ab39857a7b1a8f2c0 Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAaction247Test-499744119-project Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3304337e-bef9-4cf2-8d51-2211baf45616 could not be found. Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3304337e-bef9-4cf2-8d51-2211baf45616'} Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3304337e-bef9-4cf2-8d51-2211baf45616 could not be found. Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3304337e-bef9-4cf2-8d51-2211baf45616 could not be found. Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:03.244317 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3304337e-bef9-4cf2-8d51-2211baf45616 could not be found. Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] Returning 404 to user: Instance 3304337e-bef9-4cf2-8d51-2211baf45616 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4688e5c-b747-4318-aaa4-4c29c8d9e9e6 tempest-ServersAaction247Test-499744119 tempest-ServersAaction247Test-499744119-project] 10.222.0.39 "GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616" status: 404 len: 111 microversion: 2.47 time: 0.064650 Oct 19 07:00:03.248060 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1333/2654] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:00:03 2022] GET /compute/v2.1/servers/3304337e-bef9-4cf2-8d51-2211baf45616 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:00:03.259685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0a8c6c73-b119-4e56-a78b-e530e419abe1 req-7475b1e3-37df-47e3-9aac-5f98deaa086c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c", "tag": "e9ea764b-95e8-4aeb-ae74-818b2898ceb8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:03.284866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a8c6c73-b119-4e56-a78b-e530e419abe1 req-7475b1e3-37df-47e3-9aac-5f98deaa086c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.285354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a8c6c73-b119-4e56-a78b-e530e419abe1 req-7475b1e3-37df-47e3-9aac-5f98deaa086c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.286155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a8c6c73-b119-4e56-a78b-e530e419abe1 req-7475b1e3-37df-47e3-9aac-5f98deaa086c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:03.316491 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0a8c6c73-b119-4e56-a78b-e530e419abe1 req-7475b1e3-37df-47e3-9aac-5f98deaa086c service nova] Creating event network-changed:e9ea764b-95e8-4aeb-ae74-818b2898ceb8 for instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c on n-h2-861333-10 Oct 19 07:00:03.329985 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0a8c6c73-b119-4e56-a78b-e530e419abe1 req-7475b1e3-37df-47e3-9aac-5f98deaa086c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082118 Oct 19 07:00:03.331068 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1334/2655] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:03.355923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:03.359732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:03.381513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.382146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.382744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:03.383669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.384790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.384790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:03.498243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:03.519525 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3a64c82-bdb1-45b1-bae2-49bac6dd4343 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1276 microversion: 2.1 time: 0.186832 Oct 19 07:00:03.520082 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1335/2656] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:03 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:03.525017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:03.525649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:03.535279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.536484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.537727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:03.539243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.541876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.542453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:03.587369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:00:03.759356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:03.790478 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e21bc925-a599-427c-aea6-81c6618f505b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 0.839428 Oct 19 07:00:03.792795 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1322/2657] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:02 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:03.798796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:03.808327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:03.809488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Searching by: {'deleted': False, 'project_id': 'a6f0b288d116428981f07801b48d1cc8'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:00:03.829051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.830445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.831084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:03.835123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.835123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.835123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:03.901714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:00:03.972080 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d9bd619-ba44-46c7-b0be-5428664bd472 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.177781 Oct 19 07:00:03.976163 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1323/2658] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 07:00:03 2022] GET /compute/v2.1/servers => generated 1663 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:03.980276 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee84609a-7355-48d7-a109-85f5a080e91e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 204 len: 0 microversion: 2.1 time: 0.458797 Oct 19 07:00:03.984564 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1336/2659] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:03 2022] DELETE /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:00:03.986486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:03.989120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:03.997982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:03.998192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:03.998785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:03.998954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:04.000238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:04.001299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:04.001913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:04.002486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:04.013904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:04.014892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:04.015540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:04.016444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:04.018496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:04.019113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:04.303194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:04.315583 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b39bbd99-e2ad-43a6-bf28-73dd44f585a0 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1526 microversion: 2.1 time: 0.321632 Oct 19 07:00:04.316853 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1337/2660] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:03 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1526 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:04.323185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87ac3aa3-fc73-49e7-be00-2f3bb08bcdd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:04.324191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87ac3aa3-fc73-49e7-be00-2f3bb08bcdd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:04.412507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87ac3aa3-fc73-49e7-be00-2f3bb08bcdd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:04.419967 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87ac3aa3-fc73-49e7-be00-2f3bb08bcdd6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1219 microversion: 2.1 time: 0.100979 Oct 19 07:00:04.435172 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1338/2661] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:04 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:04.477054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:04.487657 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11cf4a70-15fc-4096-bf6b-fb1804759728 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1319 microversion: 2.1 time: 0.510235 Oct 19 07:00:04.488820 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1324/2662] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:03 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:04.547251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:04.548795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:04.559316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:04.559897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:04.561635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:04.567986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:04.567986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:04.567986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:04.804701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:04.806498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:04.847121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:04.847121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:04.847121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:04.847121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:04.847121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:04.847121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:04.847121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:04.908424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:04.918068 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbb3776f-057b-40cc-9e2a-70ea227d00f4 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.378956 Oct 19 07:00:04.919310 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1339/2663] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:04 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:05.107247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:05.117447 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2cc4fbc-7e17-4bde-a807-0d16e18838c4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 0.322321 Oct 19 07:00:05.134113 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1325/2664] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:04 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:05.343500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:05.344931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:05.367132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:05.367894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:05.370498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:05.371458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:05.373084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:05.374109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:05.432370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e12eeb32-0024-4896-943e-9e2d3b5365c1 req-38fab7fa-ffc7-4d86-851a-b02c22ae3332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e163a6-ba79-4799-b148-8577e4e1f14f", "tag": "6e7b73ff-17d4-48fe-88e8-152bb9294036"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:05.450803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e12eeb32-0024-4896-943e-9e2d3b5365c1 req-38fab7fa-ffc7-4d86-851a-b02c22ae3332 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:05.451552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e12eeb32-0024-4896-943e-9e2d3b5365c1 req-38fab7fa-ffc7-4d86-851a-b02c22ae3332 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:05.452634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e12eeb32-0024-4896-943e-9e2d3b5365c1 req-38fab7fa-ffc7-4d86-851a-b02c22ae3332 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:05.481439 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e12eeb32-0024-4896-943e-9e2d3b5365c1 req-38fab7fa-ffc7-4d86-851a-b02c22ae3332 service nova] Creating event network-changed:6e7b73ff-17d4-48fe-88e8-152bb9294036 for instance c0e163a6-ba79-4799-b148-8577e4e1f14f on n-h1-861333-10 Oct 19 07:00:05.493280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e12eeb32-0024-4896-943e-9e2d3b5365c1 req-38fab7fa-ffc7-4d86-851a-b02c22ae3332 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068157 Oct 19 07:00:05.497667 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1326/2665] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:00:05.513635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4330a45-35c0-43c3-a3d6-b5ff7440fef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:05.520464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c4330a45-35c0-43c3-a3d6-b5ff7440fef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:05.641493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:05.657152 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62360d83-cc80-44cb-a409-c94495075ba9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1526 microversion: 2.1 time: 0.316916 Oct 19 07:00:05.658736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c4330a45-35c0-43c3-a3d6-b5ff7440fef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:05.658993 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1340/2666] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:05 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1526 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:05.667407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:05.669610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:05.670284 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4330a45-35c0-43c3-a3d6-b5ff7440fef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1219 microversion: 2.1 time: 0.174021 Oct 19 07:00:05.671357 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1327/2667] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:05 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:05.698095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:05.700199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:05.700801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:05.705273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:05.705945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:05.707579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:05.934106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3b8eb54a-68cc-4fa8-a896-2c78433f7225 req-67936fc7-269d-4d97-9677-7286109cbf99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b0126f-3e1a-4048-b711-39377e5b8fcd", "name": "network-vif-plugged", "status": "completed", "tag": "718ea078-4589-44cc-ac8b-e26680e78877"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:05.970074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b8eb54a-68cc-4fa8-a896-2c78433f7225 req-67936fc7-269d-4d97-9677-7286109cbf99 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:05.971237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b8eb54a-68cc-4fa8-a896-2c78433f7225 req-67936fc7-269d-4d97-9677-7286109cbf99 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:05.972851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b8eb54a-68cc-4fa8-a896-2c78433f7225 req-67936fc7-269d-4d97-9677-7286109cbf99 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:05.988486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:05.990459 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3b8eb54a-68cc-4fa8-a896-2c78433f7225 req-67936fc7-269d-4d97-9677-7286109cbf99 service nova] Creating event network-vif-plugged:718ea078-4589-44cc-ac8b-e26680e78877 for instance 87b0126f-3e1a-4048-b711-39377e5b8fcd on n-h2-861333-10 Oct 19 07:00:05.994542 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3b8eb54a-68cc-4fa8-a896-2c78433f7225 req-67936fc7-269d-4d97-9677-7286109cbf99 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075955 Oct 19 07:00:05.996811 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1328/2668] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:00:06.006606 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cdaf0346-39c1-4abc-a173-3c5000eeca02 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1319 microversion: 2.1 time: 0.346448 Oct 19 07:00:06.008743 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1341/2669] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:05 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:06.025638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:06.033039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5aedbf67-ca58-4342-a039-f4183e259de6 req-f9d362a3-84ba-4d18-8453-16eb946b04f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa97282c-7684-4a7d-adda-93824d280396", "tag": "88cf8b90-3b8b-4740-8a10-c40de2fdda79"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:06.033841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:06.052524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5aedbf67-ca58-4342-a039-f4183e259de6 req-f9d362a3-84ba-4d18-8453-16eb946b04f5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:06.053897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5aedbf67-ca58-4342-a039-f4183e259de6 req-f9d362a3-84ba-4d18-8453-16eb946b04f5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:06.054515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5aedbf67-ca58-4342-a039-f4183e259de6 req-f9d362a3-84ba-4d18-8453-16eb946b04f5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:06.068851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:06.070031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:06.071731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:06.075182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:06.080306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:06.080905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:06.082015 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5aedbf67-ca58-4342-a039-f4183e259de6 req-f9d362a3-84ba-4d18-8453-16eb946b04f5 service nova] Creating event network-changed:88cf8b90-3b8b-4740-8a10-c40de2fdda79 for instance aa97282c-7684-4a7d-adda-93824d280396 on n-h1-861333-10 Oct 19 07:00:06.089917 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5aedbf67-ca58-4342-a039-f4183e259de6 req-f9d362a3-84ba-4d18-8453-16eb946b04f5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061062 Oct 19 07:00:06.092997 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1342/2670] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:06.142809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:06.143792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:06.157296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:06.157651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:06.158149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:06.158872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:06.159339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:06.159772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:06.889072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:06.897951 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3db1b631-324d-4144-a30e-5489707f9378 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.898649 Oct 19 07:00:06.916782 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1329/2671] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:05 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:06.929755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:06.932523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:06.943037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:06.943704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:06.943968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:06.946025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:06.946499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:06.947404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:07.271844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:07.289948 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77c6f93c-47cf-4230-8002-43f02298864d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 1.151428 Oct 19 07:00:07.306240 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1343/2672] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:06 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:07.313085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:07.314594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:07.321807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:07.322958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:07.324655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:07.325581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:07.326245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:07.327349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:07.363059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:07.371781 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-384f6c47-0ee9-4ef0-bb2d-7c2b01e9c91d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1526 microversion: 2.1 time: 0.453791 Oct 19 07:00:07.375015 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1330/2673] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:06 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1526 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:07.383905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:07.384793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:07.410622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:07.416984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:07.416984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:07.416984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:07.416984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:07.416984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:07.491261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:07.508694 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-632d14ba-fe0f-43b7-91a5-8c4a82c68975 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1271 microversion: 2.1 time: 0.200521 Oct 19 07:00:07.509425 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1344/2674] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:07 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:07.825585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:07.833584 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81a471d0-5706-4345-b089-c74b77956b45 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1319 microversion: 2.1 time: 0.457345 Oct 19 07:00:07.847876 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1331/2675] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:07 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:07.942365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:07.943751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:07.961099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:07.963858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:07.964559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:07.965451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:07.983533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:07.984277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.013552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1d6bdc48-c1b8-41a2-b53d-26f641339844 req-f1c63b5d-d572-47be-8c80-fd1b56a5ff4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83bd721-b423-47b5-969e-9dcb73715bd4", "name": "network-vif-plugged", "status": "completed", "tag": "590d91ab-87aa-4327-950f-26e3c0efee47"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:08.027382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1d6bdc48-c1b8-41a2-b53d-26f641339844 req-f1c63b5d-d572-47be-8c80-fd1b56a5ff4e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.028202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1d6bdc48-c1b8-41a2-b53d-26f641339844 req-f1c63b5d-d572-47be-8c80-fd1b56a5ff4e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.028951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1d6bdc48-c1b8-41a2-b53d-26f641339844 req-f1c63b5d-d572-47be-8c80-fd1b56a5ff4e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.043246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:08.045979 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1d6bdc48-c1b8-41a2-b53d-26f641339844 req-f1c63b5d-d572-47be-8c80-fd1b56a5ff4e service nova] Creating event network-vif-plugged:590d91ab-87aa-4327-950f-26e3c0efee47 for instance e83bd721-b423-47b5-969e-9dcb73715bd4 on n-h1-861333-10 Oct 19 07:00:08.054365 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1d6bdc48-c1b8-41a2-b53d-26f641339844 req-f1c63b5d-d572-47be-8c80-fd1b56a5ff4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044807 Oct 19 07:00:08.060490 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1332/2676] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:00:08.216953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d6aee1b-d66b-4c9d-9953-9e34dc52a875 tempest-QuotaClassesAdmin257Test-1483599987 tempest-QuotaClassesAdmin257Test-1483599987-project-admin] Calling method '.version_select at 0x7f6d5fa9c160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:08.250468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:08.263198 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be483f11-2ea0-4cec-a654-cbd4f58c4dcb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.335231 Oct 19 07:00:08.280041 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1345/2677] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:07 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:08.291036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f5d53491-0dc4-42d4-9027-0254868a3ca6 req-6b41c4f0-8410-404a-ae60-8398df239314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cffcb6bd-4300-41e5-82ed-87bdc674276d", "name": "network-vif-deleted", "tag": "f6407f4d-aecd-4eb6-ad9e-d0ae922831bf"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:08.294232 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d6aee1b-d66b-4c9d-9953-9e34dc52a875 tempest-QuotaClassesAdmin257Test-1483599987 tempest-QuotaClassesAdmin257Test-1483599987-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.222251 Oct 19 07:00:08.304221 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1333/2678] 10.222.0.39 () {60 vars in 1226 bytes} [Wed Oct 19 07:00:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:00:08.314987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ce9bc6a-a5fc-4c9e-a9b0-5f4ccbd2331e tempest-QuotaClassesAdmin257Test-1483599987 tempest-QuotaClassesAdmin257Test-1483599987-project-admin] Action: 'update', calling method: .version_select at 0x7f6d5fa9cc10>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:08.315219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f5d53491-0dc4-42d4-9027-0254868a3ca6 req-6b41c4f0-8410-404a-ae60-8398df239314 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.315571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f5d53491-0dc4-42d4-9027-0254868a3ca6 req-6b41c4f0-8410-404a-ae60-8398df239314 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.316077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f5d53491-0dc4-42d4-9027-0254868a3ca6 req-6b41c4f0-8410-404a-ae60-8398df239314 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.339566 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f5d53491-0dc4-42d4-9027-0254868a3ca6 req-6b41c4f0-8410-404a-ae60-8398df239314 service nova] Creating event network-vif-deleted:f6407f4d-aecd-4eb6-ad9e-d0ae922831bf for instance cffcb6bd-4300-41e5-82ed-87bdc674276d on n-h1-861333-10 Oct 19 07:00:08.350019 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f5d53491-0dc4-42d4-9027-0254868a3ca6 req-6b41c4f0-8410-404a-ae60-8398df239314 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065725 Oct 19 07:00:08.351306 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1346/2679] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:08.358162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:08.359063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:08.366126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.366840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.367283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.367980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.368466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.368899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.536757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:08.546190 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-365c3b6b-b245-4643-9c8a-727c7a672701 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 0.193415 Oct 19 07:00:08.547465 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1347/2680] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:08 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:08.552293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:08.553198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:08.558997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.559478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.559913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.560624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.561146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.561568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.599889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.600416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.600863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.601319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lazy-loading 'fault' on Instance uuid cffcb6bd-4300-41e5-82ed-87bdc674276d {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:08.660576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:08.673069 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-647df9b6-6fcb-4503-b26f-2cd083c5ed87 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1314 microversion: 2.1 time: 0.124208 Oct 19 07:00:08.674264 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1348/2681] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:08 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1314 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:08.680394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:08.682026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:08.691116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.691540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.692181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.693053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.693507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.693938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.698477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:08.761492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:08.770314 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1bca9687-b5ed-4959-8f68-d514befa31a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1279 microversion: 2.1 time: 0.093626 Oct 19 07:00:08.770899 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1349/2682] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:08 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:08.862126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:08.862774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:08.868876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.869367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.869810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:08.870509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:08.870966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:08.871393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.000217 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ce9bc6a-a5fc-4c9e-a9b0-5f4ccbd2331e tempest-QuotaClassesAdmin257Test-1483599987 tempest-QuotaClassesAdmin257Test-1483599987-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.694071 Oct 19 07:00:09.007094 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1334/2683] 10.222.0.39 () {62 vars in 1247 bytes} [Wed Oct 19 07:00:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:00:09.011788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3972601b-9a5f-4609-aa11-3558ff67ed2f tempest-QuotaClassesAdmin257Test-1483599987 tempest-QuotaClassesAdmin257Test-1483599987-project-admin] Calling method '.version_select at 0x7f6d5fa9c700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:09.013440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:09.021799 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07d6061b-f97f-4905-8c7f-52be0f877457 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1319 microversion: 2.1 time: 0.163726 Oct 19 07:00:09.022862 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1350/2684] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:08 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:09.035644 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3972601b-9a5f-4609-aa11-3558ff67ed2f tempest-QuotaClassesAdmin257Test-1483599987 tempest-QuotaClassesAdmin257Test-1483599987-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.027241 Oct 19 07:00:09.037384 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1335/2685] 10.222.0.39 () {60 vars in 1226 bytes} [Wed Oct 19 07:00:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:00:09.049690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2406ae70-603e-43b8-8f13-807cc20c81fc tempest-QuotaClassesAdmin257Test-1483599987 tempest-QuotaClassesAdmin257Test-1483599987-project-admin] Action: 'update', calling method: .version_select at 0x7f6d64eeeee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:09.287050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:09.287787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:09.294714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:09.295244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:09.295678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.296403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:09.296857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:09.297283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.533838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:09.541954 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8be229c1-f844-4e37-a046-b45147b93fa8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.258757 Oct 19 07:00:09.542694 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1336/2686] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:09 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:09.571054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:09.572024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:09.578793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:09.579578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:09.580094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.580969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:09.581526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:09.582021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.654097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=55 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:09.658041 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2406ae70-603e-43b8-8f13-807cc20c81fc tempest-QuotaClassesAdmin257Test-1483599987 tempest-QuotaClassesAdmin257Test-1483599987-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.612121 Oct 19 07:00:09.658737 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1351/2687] 10.222.0.39 () {62 vars in 1247 bytes} [Wed Oct 19 07:00:09 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:00:09.701046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:09.701751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:09.709567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:09.710056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:09.710532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.711247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:09.711708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:09.712173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.761471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:09.761970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:09.762569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.763035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lazy-loading 'fault' on Instance uuid cffcb6bd-4300-41e5-82ed-87bdc674276d {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:09.827648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:09.837940 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42a5a863-042d-4fe6-bf5d-a58fe7c6c1c9 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1314 microversion: 2.1 time: 0.140497 Oct 19 07:00:09.838847 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1352/2688] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:09 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:09.844020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:09.848573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:09.854519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:09.855239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:09.856274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.856992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:09.857455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:09.857916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:09.918417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:09.928098 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-564b1505-22f7-4c9e-8bc4-e6e8dee26a85 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 0.361198 Oct 19 07:00:09.929411 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1337/2689] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:09 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:09.959640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:09.972696 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6c37014-f544-4f62-9e4f-c840416c48b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1279 microversion: 2.1 time: 0.132760 Oct 19 07:00:09.973419 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1353/2690] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:09 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:10.053140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:10.053140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:10.063325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:10.064354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:10.065344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:10.066412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:10.067130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:10.067769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:10.105467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ff713be3-b525-45e9-a4da-4d2286a7aa0f req-91767f87-7067-42e1-b925-d883c6df4788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c", "name": "network-vif-plugged", "status": "completed", "tag": "e9ea764b-95e8-4aeb-ae74-818b2898ceb8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:10.125766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff713be3-b525-45e9-a4da-4d2286a7aa0f req-91767f87-7067-42e1-b925-d883c6df4788 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:10.126956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff713be3-b525-45e9-a4da-4d2286a7aa0f req-91767f87-7067-42e1-b925-d883c6df4788 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:10.128022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff713be3-b525-45e9-a4da-4d2286a7aa0f req-91767f87-7067-42e1-b925-d883c6df4788 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:10.151975 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ff713be3-b525-45e9-a4da-4d2286a7aa0f req-91767f87-7067-42e1-b925-d883c6df4788 service nova] Creating event network-vif-plugged:e9ea764b-95e8-4aeb-ae74-818b2898ceb8 for instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c on n-h2-861333-10 Oct 19 07:00:10.159716 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ff713be3-b525-45e9-a4da-4d2286a7aa0f req-91767f87-7067-42e1-b925-d883c6df4788 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059302 Oct 19 07:00:10.160973 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1354/2691] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:00:10.513726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:10.525694 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90ce4461-f1fd-4db3-9b50-170364782292 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1319 microversion: 2.1 time: 0.482684 Oct 19 07:00:10.526908 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1338/2692] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:10 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:10.569285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:10.570089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:10.578309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:10.583653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:10.586444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:10.587904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:10.589058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:10.590217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:10.862295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:10.862913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:10.869077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:10.869968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:10.870638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:10.871592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:10.872316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:10.872975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:10.914777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:10.915548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:10.915713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:10.918523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lazy-loading 'fault' on Instance uuid cffcb6bd-4300-41e5-82ed-87bdc674276d {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:10.935588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:10.950141 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6ba8a99-d35a-4e2c-8ab3-c147d3beb2f8 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.387102 Oct 19 07:00:10.968546 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1355/2693] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:10 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:10.983989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:10.984648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:11.002352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:11.002862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:11.003910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:11.006442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:11.006442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:11.006442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:11.403804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:11.429222 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00626eb0-756d-4dc1-a501-112ec1818912 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 0.459362 Oct 19 07:00:11.432937 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1356/2694] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:10 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:11.441802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:11.442930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:11.450888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:11.451774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:11.452458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:11.453445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:11.454120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:11.455960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:11.594911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe41984e17744dfa71d2ce82d1023e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd6bbb748b5440fb72fb253477b4180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:11.618132 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66b6718a-260f-4f86-9b1b-b326c078ff75 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 200 len: 1314 microversion: 2.1 time: 0.760164 Oct 19 07:00:11.619285 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1339/2695] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:10 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:11.632164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:11.636233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:11.656247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:11.657145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:11.658339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:11.659228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:11.661358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:11.661797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:11.801660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:11.810625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5f68b3c-ea3f-4ae8-8f17-ec76e9239c55 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1319 microversion: 2.1 time: 0.376371 Oct 19 07:00:11.811560 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1357/2696] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:11 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:11.978996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:11.987291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:11.990762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:11.991449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:11.992980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:11.997216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:11.997979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:11.998910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.140856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:12.161798 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-089b15fc-e02f-44cf-bbc2-e86fb20fb3aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1319 microversion: 2.1 time: 0.540734 Oct 19 07:00:12.162388 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1340/2697] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:11 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:12.338912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:12.411522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:12.422041 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-777d78d9-6a41-4cd9-8556-facf8d17d581 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.448393 Oct 19 07:00:12.424154 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1358/2698] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:11 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:12.454097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:12.454790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:12.461948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.462734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.463600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.464391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.464867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.465302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.644683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:12.645655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: cffcb6bd-4300-41e5-82ed-87bdc674276d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:12.652557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.653327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.654013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.654954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.655628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.656486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.671378 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Instance cffcb6bd-4300-41e5-82ed-87bdc674276d could not be found. Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d HTTP/1.1 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance cffcb6bd-4300-41e5-82ed-87bdc674276d could not be found. Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'cffcb6bd-4300-41e5-82ed-87bdc674276d'} Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cffcb6bd-4300-41e5-82ed-87bdc674276d could not be found. Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cffcb6bd-4300-41e5-82ed-87bdc674276d could not be found. Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.674004 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cffcb6bd-4300-41e5-82ed-87bdc674276d could not be found. Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Instance cffcb6bd-4300-41e5-82ed-87bdc674276d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8738f928-1e58-4d26-a21b-00bd84b39776 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d" status: 404 len: 111 microversion: 2.1 time: 0.037540 Oct 19 07:00:12.681265 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1359/2699] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:12 2022] GET /compute/v2.1/servers/cffcb6bd-4300-41e5-82ed-87bdc674276d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:12.687654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a12b0108-6947-4787-9df9-1815093d788e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '.version_select at 0x7f6d5fba94c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:12.710655 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a12b0108-6947-4787-9df9-1815093d788e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Image not found. Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a12b0108-6947-4787-9df9-1815093d788e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/1d1e9c2d-c618-4be2-9e9b-5a191475af26 HTTP/1.1 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '1d1e9c2d-c618-4be2-9e9b-5a191475af26'} Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1d1e9c2d-c618-4be2-9e9b-5a191475af26 to delete Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1d1e9c2d-c618-4be2-9e9b-5a191475af26 could not be found. Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:12.712531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:00:12.716049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.718916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a12b0108-6947-4787-9df9-1815093d788e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:12.719782 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a12b0108-6947-4787-9df9-1815093d788e tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/images/1d1e9c2d-c618-4be2-9e9b-5a191475af26" status: 404 len: 62 microversion: 2.1 time: 0.035839 Oct 19 07:00:12.720907 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1360/2700] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:12 2022] DELETE /compute/v2.1/images/1d1e9c2d-c618-4be2-9e9b-5a191475af26 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:00:12.728709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:12.729412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:12.737360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.738142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.738861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.739897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.740696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.741350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.757482 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa HTTP/1.1 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '745e880d-2135-4f8b-98fe-7d5596f3cffa'} Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:12.759445 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.763038 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.764844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:12.767152 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed8b12be-1a72-494b-867e-c7e5ea848276 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 404 len: 111 microversion: 2.1 time: 0.040930 Oct 19 07:00:12.767152 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1361/2701] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:12 2022] DELETE /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:00:12.778894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:12.784533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 745e880d-2135-4f8b-98fe-7d5596f3cffa] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:12.793618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.794117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.794557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.795343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.795803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.796318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.812075 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa HTTP/1.1 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '745e880d-2135-4f8b-98fe-7d5596f3cffa'} Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.814352 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Instance 745e880d-2135-4f8b-98fe-7d5596f3cffa could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:12.818574 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e51c1212-d114-4d3f-8a67-b59683f39e59 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa" status: 404 len: 111 microversion: 2.1 time: 0.040529 Oct 19 07:00:12.819786 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1362/2702] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:12 2022] GET /compute/v2.1/servers/745e880d-2135-4f8b-98fe-7d5596f3cffa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:12.824744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a9aceb2-6d66-4018-9510-4f449490fc14 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '.version_select at 0x7f6d5fbf3310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:12.852134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:12.861299 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ae09e34-904a-4887-a40f-cff3e7ba7a6d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 0.411297 Oct 19 07:00:12.864148 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1341/2703] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:12 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:12.882086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:12.882086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:12.888906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.889410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.889890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.890759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:12.891212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:12.891632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:12.904776 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a9aceb2-6d66-4018-9510-4f449490fc14 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952968650" status: 202 len: 0 microversion: 2.1 time: 0.083043 Oct 19 07:00:12.905632 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1363/2704] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:00:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952968650 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:00:13.190212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:13.191396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:13.218451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:13.218582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:13.218996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:13.219746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:13.220267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:13.220698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:13.291952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:13.301994 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2af2b5fc-f37d-4214-80e9-17461d7eae1d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1319 microversion: 2.1 time: 0.438403 Oct 19 07:00:13.308957 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1342/2705] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:12 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:13.447691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:13.448600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:13.457626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:13.458353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:13.458986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:13.459966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:13.460886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:13.461478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:13.555084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:13.566639 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92d1b949-7d87-4e74-9cdc-ec7cb5a1f0ab tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 200 len: 1506 microversion: 2.1 time: 0.383835 Oct 19 07:00:13.577084 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1364/2706] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:13 2022] GET /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:13.590465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:13.591647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 87b0126f-3e1a-4048-b711-39377e5b8fcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:13.599183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:13.600005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:13.600732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:13.601640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:13.602576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:13.603257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:13.846781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:13.860180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:13.869899 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85369b76-ffbe-4f3a-b964-2f2fedb2c94f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.427150 Oct 19 07:00:13.877717 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1343/2707] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:13 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:13.883470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-408cea24-6d74-4085-8f0b-b120065210b9 req-f3f824ad-ee35-42be-b56c-01d2b77b986c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97939c70-1ac7-4626-8d23-50bfa0d115d9", "tag": "7e3fe6c4-e18b-454b-a9e4-35869a7da8ab"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:13.901721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-408cea24-6d74-4085-8f0b-b120065210b9 req-f3f824ad-ee35-42be-b56c-01d2b77b986c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:13.912899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-408cea24-6d74-4085-8f0b-b120065210b9 req-f3f824ad-ee35-42be-b56c-01d2b77b986c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:13.913625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-408cea24-6d74-4085-8f0b-b120065210b9 req-f3f824ad-ee35-42be-b56c-01d2b77b986c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:13.933154 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-408cea24-6d74-4085-8f0b-b120065210b9 req-f3f824ad-ee35-42be-b56c-01d2b77b986c service nova] Creating event network-changed:7e3fe6c4-e18b-454b-a9e4-35869a7da8ab for instance 97939c70-1ac7-4626-8d23-50bfa0d115d9 on n-h2-861333-10 Oct 19 07:00:13.938154 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-408cea24-6d74-4085-8f0b-b120065210b9 req-f3f824ad-ee35-42be-b56c-01d2b77b986c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058982 Oct 19 07:00:13.941079 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1344/2708] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:13.959331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:13.961515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:13.979278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:13.982067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:13.983122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:13.984897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:13.986895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:13.987532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:14.183034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:14.196651 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8554b0b1-a217-48e4-9bd2-af09ca532b06 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/87b0126f-3e1a-4048-b711-39377e5b8fcd" status: 200 len: 1506 microversion: 2.1 time: 0.610432 Oct 19 07:00:14.198179 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1365/2709] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:13 2022] GET /compute/v2.1/servers/87b0126f-3e1a-4048-b711-39377e5b8fcd => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:14.241570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:14.244910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 87b0126f-3e1a-4048-b711-39377e5b8fcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:14.257446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=8,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:14.259124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:14.259622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:14.260062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:14.262806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:14.264914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:14.266690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:14.325943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 87b0126f-3e1a-4048-b711-39377e5b8fcd] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:00:14.623358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:14.635615 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7009c45b-7475-4f8d-b9bd-98c1db6460cc tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 0.691198 Oct 19 07:00:14.638942 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1345/2710] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:13 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:14.646821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:14.647763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:14.672658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:14.674141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:14.675957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:14.679142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:14.679837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:14.680383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:14.772786 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f42f044-0195-4227-b49d-5ec189bfcdba tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/87b0126f-3e1a-4048-b711-39377e5b8fcd" status: 204 len: 0 microversion: 2.1 time: 0.543185 Oct 19 07:00:14.775333 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1366/2711] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:14 2022] DELETE /compute/v2.1/servers/87b0126f-3e1a-4048-b711-39377e5b8fcd => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:00:15.078580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:15.095766 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6624f792-696b-44a3-bdfd-5e4c2a2d427d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1319 microversion: 2.1 time: 0.453940 Oct 19 07:00:15.097031 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1346/2712] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:14 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:15.104039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9fe57388-b08d-47b1-96a1-8dce701a3545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '.version_select at 0x7f6d64eaf4c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:15.136680 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9fe57388-b08d-47b1-96a1-8dce701a3545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Image not found. Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9fe57388-b08d-47b1-96a1-8dce701a3545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/168df9ee-54da-44fc-bf21-bcc8a5d4a0a3 HTTP/1.1 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: exception: Image not found. Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '168df9ee-54da-44fc-bf21-bcc8a5d4a0a3'} Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 168df9ee-54da-44fc-bf21-bcc8a5d4a0a3 to delete Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 168df9ee-54da-44fc-bf21-bcc8a5d4a0a3 could not be found. Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:15.139165 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:00:15.142784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.146736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9fe57388-b08d-47b1-96a1-8dce701a3545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:15.149100 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9fe57388-b08d-47b1-96a1-8dce701a3545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/images/168df9ee-54da-44fc-bf21-bcc8a5d4a0a3" status: 404 len: 62 microversion: 2.1 time: 0.049330 Oct 19 07:00:15.150058 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1347/2713] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:15 2022] DELETE /compute/v2.1/images/168df9ee-54da-44fc-bf21-bcc8a5d4a0a3 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:00:15.155993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:15.157148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:15.167773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.168643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.169332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.170248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.170990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.174366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.205498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: e83bd721-b423-47b5-969e-9dcb73715bd4] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:00:15.306377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-aae93a66-4a66-4f3c-a39b-8711824930bb req-b76d062c-8683-4e7d-8196-6e099cdb91ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e163a6-ba79-4799-b148-8577e4e1f14f", "name": "network-vif-plugged", "status": "completed", "tag": "6e7b73ff-17d4-48fe-88e8-152bb9294036"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:15.318098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aae93a66-4a66-4f3c-a39b-8711824930bb req-b76d062c-8683-4e7d-8196-6e099cdb91ce service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.318775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aae93a66-4a66-4f3c-a39b-8711824930bb req-b76d062c-8683-4e7d-8196-6e099cdb91ce service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.319367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aae93a66-4a66-4f3c-a39b-8711824930bb req-b76d062c-8683-4e7d-8196-6e099cdb91ce service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.335071 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-aae93a66-4a66-4f3c-a39b-8711824930bb req-b76d062c-8683-4e7d-8196-6e099cdb91ce service nova] Creating event network-vif-plugged:6e7b73ff-17d4-48fe-88e8-152bb9294036 for instance c0e163a6-ba79-4799-b148-8577e4e1f14f on n-h1-861333-10 Oct 19 07:00:15.346346 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-aae93a66-4a66-4f3c-a39b-8711824930bb req-b76d062c-8683-4e7d-8196-6e099cdb91ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.571227 Oct 19 07:00:15.348275 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1367/2714] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:15.355128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:15.368846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:15.377037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.377579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.378028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.378740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.379204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.379813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.555916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:15.565450 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ffb65c50-9bbe-47fd-a1d8-edb0b3717a1a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.215536 Oct 19 07:00:15.566314 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1368/2715] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:15 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:15.580487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:15.581318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:15.587397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.587979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.588667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.589447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.589975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.590505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.599490 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b95830b1-5196-4ba4-835d-81201237dc01 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4" status: 204 len: 0 microversion: 2.1 time: 0.447943 Oct 19 07:00:15.613065 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1348/2716] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:15 2022] DELETE /compute/v2.1/servers/e83bd721-b423-47b5-969e-9dcb73715bd4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:00:15.639685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 HTTP/1.1 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '61c9f25f-c754-463e-8847-72c9e399ce82'} Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:15.641757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.646740 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.650640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:15.654868 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55d70e9f-a9d2-475c-b1ec-3991c882f97d tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "DELETE /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 404 len: 111 microversion: 2.1 time: 0.087260 Oct 19 07:00:15.658166 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1369/2717] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:15 2022] DELETE /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:15.665170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:15.665956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:15.667754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:15.669546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] [instance: 61c9f25f-c754-463e-8847-72c9e399ce82] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:15.678655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.679174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.679618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.683847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.684836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.685334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.686219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.686600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.688406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.690388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:15.692275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:15.692985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:15.718963 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] HTTP exception thrown: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Request method failure captured: Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 HTTP/1.1 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AH06XtXnAthSX5YFonIFKU8tDObqK9yeCGYOM7aT4GpT26XUK5sCii7h7nUpD49cEqG9aARav45kCmhD6cK-iD1EfbM98Ja13lJHEwpHF2XWuqrR_QWITj80cNi9WPl_Akd4n5z6g_jC172esxC2YktlhkTRRrHuiCgvx3kk285Ig Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8fd6bbb748b5440fb72fb253477b4180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8fd6bbb748b5440fb72fb253477b4180", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8fd6bbb748b5440fb72fb253477b4180 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2fe41984e17744dfa71d2ce82d1023e3 Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2083129660-project Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '61c9f25f-c754-463e-8847-72c9e399ce82'} Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.723356 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:15.726716 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.726716 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:15.726716 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:15.726716 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:15.726716 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:15.726716 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:15.726716 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. Oct 19 07:00:15.726716 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:15.729841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] Returning 404 to user: Instance 61c9f25f-c754-463e-8847-72c9e399ce82 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:15.731826 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4aaacf7-bc7a-4380-b8e5-33d6c7ba1545 tempest-ImagesOneServerNegativeTestJSON-2083129660 tempest-ImagesOneServerNegativeTestJSON-2083129660-project] 10.222.0.39 "GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82" status: 404 len: 111 microversion: 2.1 time: 0.069637 Oct 19 07:00:15.732838 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1370/2718] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:15 2022] GET /compute/v2.1/servers/61c9f25f-c754-463e-8847-72c9e399ce82 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:15.785920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1285679848", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "58376649-8982-48f2-be79-3a79c6cfb460"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:15.852025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] validate_networks() for [('58376649-8982-48f2-be79-3a79c6cfb460', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:00:16.305482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:00:16.306134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:00:16.307168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:00:16.307757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:00:16.308199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:00:16.321719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:16.322611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:16.324568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:16.324568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:16.324568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:16.325027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:16.348268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Getting quotas for project 5635c3d71ece423f811956a3c5b549c4. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:16.355399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Getting quotas for user 1d64c821b95f4122b1941b7a5223f0a4 and project 5635c3d71ece423f811956a3c5b549c4. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:16.370393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Going to run 2 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:00:16.373475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: ef88ce10-b961-440c-b62d-0d55b1b6996c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:00:16.540955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=ef88ce10-b961-440c-b62d-0d55b1b6996c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:00:16.577225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:16.589375 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19d4e1d8-06d6-455b-b990-4f871f305a86 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 0.932298 Oct 19 07:00:16.589969 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1349/2719] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:15 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:16.605220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:16.605849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:16.641601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:16.642123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:16.642560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:16.643321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:16.644653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:16.645324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:16.746606 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7efed1e5-91a5-4d79-92a2-8dcf1fde1c56 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.966093 Oct 19 07:00:16.747532 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1371/2720] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:00:15 2022] POST /compute/v2.1/servers => generated 32 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 19 07:00:16.756769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dba4aa28-2031-4777-b555-ef8d09db2103 req-9714f3f0-d9f6-48ca-ab4f-e3f89db12f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3ea51c-9562-44a5-b313-a11890f07cf1", "tag": "80a29399-b219-4238-8163-034c06e4ed8c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:16.772404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dba4aa28-2031-4777-b555-ef8d09db2103 req-9714f3f0-d9f6-48ca-ab4f-e3f89db12f29 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:16.773188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dba4aa28-2031-4777-b555-ef8d09db2103 req-9714f3f0-d9f6-48ca-ab4f-e3f89db12f29 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:16.774089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dba4aa28-2031-4777-b555-ef8d09db2103 req-9714f3f0-d9f6-48ca-ab4f-e3f89db12f29 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:16.780908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:16.793296 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dba4aa28-2031-4777-b555-ef8d09db2103 req-9714f3f0-d9f6-48ca-ab4f-e3f89db12f29 service nova] Creating event network-changed:80a29399-b219-4238-8163-034c06e4ed8c for instance 0f3ea51c-9562-44a5-b313-a11890f07cf1 on n-h1-861333-10 Oct 19 07:00:16.799077 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dba4aa28-2031-4777-b555-ef8d09db2103 req-9714f3f0-d9f6-48ca-ab4f-e3f89db12f29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049280 Oct 19 07:00:16.800066 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1372/2721] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:16.806858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:16.807875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:16.819363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:16.820140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:16.820867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:16.821856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:16.822577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:16.823356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.125560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:17.137503 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd546b69-7e08-4932-8776-2eeac5d01cb0 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.334429 Oct 19 07:00:17.142150 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1373/2722] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:16 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:17.158171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:17.163480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:17.164295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Searching by: {'deleted': False, 'project_id': '5635c3d71ece423f811956a3c5b549c4'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:00:17.211739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:17.213724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:17.215147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.216389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:17.217977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:17.219510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.262540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:00:17.299826 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9c42827-0dae-4f6c-9afd-d39dd7523f75 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.160258 Oct 19 07:00:17.310667 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1374/2723] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 07:00:17 2022] GET /compute/v2.1/servers => generated 1335 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:17.432503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:17.444955 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5342a413-74e4-4eeb-adcf-e42b6ba0676a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1319 microversion: 2.1 time: 0.853528 Oct 19 07:00:17.445572 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1350/2724] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:16 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1319 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:17.474632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6739ff47-5aa7-4d19-abef-ad251773533a tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:17.475356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6739ff47-5aa7-4d19-abef-ad251773533a tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:17.528032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18bf147d-970e-4115-8f0b-fae34d9e7064 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Action: 'update', calling method: .version_select at 0x7f6d64f01040>, body: {"quota_set": {"ram": "5120"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:17.633187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18bf147d-970e-4115-8f0b-fae34d9e7064 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:17.633686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18bf147d-970e-4115-8f0b-fae34d9e7064 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:17.634134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18bf147d-970e-4115-8f0b-fae34d9e7064 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.634912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18bf147d-970e-4115-8f0b-fae34d9e7064 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:17.635369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18bf147d-970e-4115-8f0b-fae34d9e7064 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:17.635795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18bf147d-970e-4115-8f0b-fae34d9e7064 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.647775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6739ff47-5aa7-4d19-abef-ad251773533a tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:17.659423 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6739ff47-5aa7-4d19-abef-ad251773533a tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1218 microversion: 2.1 time: 0.212671 Oct 19 07:00:17.660359 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1351/2725] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:17 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:17.671967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:17.673045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:17.680974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:17.682221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:17.683074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.683936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:17.684773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:17.685366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.790011 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18bf147d-970e-4115-8f0b-fae34d9e7064 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/b09d17025db340d595559aec2673613c" status: 200 len: 240 microversion: 2.36 time: 0.477413 Oct 19 07:00:17.801764 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1375/2726] 10.222.0.39 () {62 vars in 1303 bytes} [Wed Oct 19 07:00:17 2022] PUT /compute/v2.1/os-quota-sets/b09d17025db340d595559aec2673613c => generated 240 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:00:17.815690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6b7e0d5-8796-479e-ba95-56321d0845e5 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Calling method '.version_select at 0x7f6d64aa2700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:17.890082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6b7e0d5-8796-479e-ba95-56321d0845e5 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:17.890580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6b7e0d5-8796-479e-ba95-56321d0845e5 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:17.891029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6b7e0d5-8796-479e-ba95-56321d0845e5 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.894079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6b7e0d5-8796-479e-ba95-56321d0845e5 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:17.894079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6b7e0d5-8796-479e-ba95-56321d0845e5 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:17.894079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6b7e0d5-8796-479e-ba95-56321d0845e5 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.913694 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6b7e0d5-8796-479e-ba95-56321d0845e5 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/b09d17025db340d595559aec2673613c/detail" status: 200 len: 672 microversion: 2.36 time: 0.106301 Oct 19 07:00:17.916883 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1376/2727] 10.222.0.39 () {60 vars in 1304 bytes} [Wed Oct 19 07:00:17 2022] GET /compute/v2.1/os-quota-sets/b09d17025db340d595559aec2673613c/detail => generated 672 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:00:17.919572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b19fc3a7-ecaa-49f6-b97f-91444b294ac9 req-6e52ebdd-7fa0-4b0d-ac25-c206d8e77093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa97282c-7684-4a7d-adda-93824d280396", "name": "network-vif-plugged", "status": "completed", "tag": "88cf8b90-3b8b-4740-8a10-c40de2fdda79"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:17.947666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b19fc3a7-ecaa-49f6-b97f-91444b294ac9 req-6e52ebdd-7fa0-4b0d-ac25-c206d8e77093 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:17.949115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b19fc3a7-ecaa-49f6-b97f-91444b294ac9 req-6e52ebdd-7fa0-4b0d-ac25-c206d8e77093 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:17.959845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b19fc3a7-ecaa-49f6-b97f-91444b294ac9 req-6e52ebdd-7fa0-4b0d-ac25-c206d8e77093 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:17.983257 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b19fc3a7-ecaa-49f6-b97f-91444b294ac9 req-6e52ebdd-7fa0-4b0d-ac25-c206d8e77093 service nova] Creating event network-vif-plugged:88cf8b90-3b8b-4740-8a10-c40de2fdda79 for instance aa97282c-7684-4a7d-adda-93824d280396 on n-h1-861333-10 Oct 19 07:00:17.991212 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b19fc3a7-ecaa-49f6-b97f-91444b294ac9 req-6e52ebdd-7fa0-4b0d-ac25-c206d8e77093 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075159 Oct 19 07:00:17.995542 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1377/2728] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:18.138900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:18.150837 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93bfd042-8ee5-490b-8461-c92b2fe00e94 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1318 microversion: 2.1 time: 0.488636 Oct 19 07:00:18.167370 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1352/2729] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:17 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:18.180363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:18.180980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:18.191582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:18.192471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:18.193372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:18.194537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:18.195536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:18.196813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:18.228545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Action: 'update', calling method: .version_select at 0x7f6d6501b550>, body: {"quota_set": {"ram": "2048"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:18.334684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:18.335399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:18.336584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:18.337654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:18.339060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:18.339938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:18.356098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:18.386373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:18.386881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:18.387330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:18.388066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:18.388724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:18.389319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:18.396973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:18.427508 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-078c83ac-e560-4510-95bd-d04a28f6726b tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.269409 Oct 19 07:00:18.427980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=8,nova_api:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:18.430538 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1378/2730] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:18 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:18.472957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:18.473987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:18.494393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:18.495377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:18.496718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:18.497513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:18.497981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:18.498425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:18.609434 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffe3377c-26f6-42d5-ada1-3b9b095f647a tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/b09d17025db340d595559aec2673613c?user_id=884ebe0fab814646a3ac94121888cc04" status: 200 len: 240 microversion: 2.36 time: 0.385468 Oct 19 07:00:18.616547 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1353/2731] 10.222.0.39 () {62 vars in 1384 bytes} [Wed Oct 19 07:00:18 2022] PUT /compute/v2.1/os-quota-sets/b09d17025db340d595559aec2673613c?user_id=884ebe0fab814646a3ac94121888cc04 => generated 240 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 07:00:18.625153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ffe1fa6-a7f2-44fe-a118-11fc42decb69 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] Calling method '.version_select at 0x7f6d640ef160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:18.788341 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ffe1fa6-a7f2-44fe-a118-11fc42decb69 tempest-QuotasAdminTestV236-1827118431 tempest-QuotasAdminTestV236-1827118431-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/b09d17025db340d595559aec2673613c?user_id=884ebe0fab814646a3ac94121888cc04" status: 200 len: 282 microversion: 2.36 time: 0.165708 Oct 19 07:00:18.797159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:18.799954 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1354/2732] 10.222.0.39 () {60 vars in 1364 bytes} [Wed Oct 19 07:00:18 2022] GET /compute/v2.1/os-quota-sets/b09d17025db340d595559aec2673613c?user_id=884ebe0fab814646a3ac94121888cc04 => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:00:18.809358 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f56ea1e1-4c95-46b0-8bbc-512ce01c5e93 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1319 microversion: 2.1 time: 0.342135 Oct 19 07:00:18.811411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df86642f-9b1f-4f7a-bdba-5fbb766d3663 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:18.819433 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1379/2733] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:18 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:18.832310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df86642f-9b1f-4f7a-bdba-5fbb766d3663 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:18.893160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bee028eb-f962-41ec-b479-2d121442ccf2 req-2cb2a9a4-ac48-4088-b46a-08a0c1f9ddb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b0126f-3e1a-4048-b711-39377e5b8fcd", "name": "network-vif-deleted", "tag": "718ea078-4589-44cc-ac8b-e26680e78877"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:18.926243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bee028eb-f962-41ec-b479-2d121442ccf2 req-2cb2a9a4-ac48-4088-b46a-08a0c1f9ddb2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:18.927019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bee028eb-f962-41ec-b479-2d121442ccf2 req-2cb2a9a4-ac48-4088-b46a-08a0c1f9ddb2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:18.927453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bee028eb-f962-41ec-b479-2d121442ccf2 req-2cb2a9a4-ac48-4088-b46a-08a0c1f9ddb2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:18.942155 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bee028eb-f962-41ec-b479-2d121442ccf2 req-2cb2a9a4-ac48-4088-b46a-08a0c1f9ddb2 service nova] Creating event network-vif-deleted:718ea078-4589-44cc-ac8b-e26680e78877 for instance 87b0126f-3e1a-4048-b711-39377e5b8fcd on n-h2-861333-10 Oct 19 07:00:18.948585 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bee028eb-f962-41ec-b479-2d121442ccf2 req-2cb2a9a4-ac48-4088-b46a-08a0c1f9ddb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059959 Oct 19 07:00:18.949714 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1380/2734] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:00:19.064231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:19.064935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:19.084135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.085072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.085537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.086353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.086833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.087276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.133259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:00:19.370944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-df86642f-9b1f-4f7a-bdba-5fbb766d3663 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:19.388810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=55,nova_cell0:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:19.390847 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df86642f-9b1f-4f7a-bdba-5fbb766d3663 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1218 microversion: 2.1 time: 0.583480 Oct 19 07:00:19.391437 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1355/2735] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:18 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1218 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:19.401314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:19.402151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:19.412436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.414491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.414491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.414491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.414875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.415588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.498625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bab39c8a-c25d-4d36-8e67-2b79fef72fdc tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 204 len: 0 microversion: 2.1 time: 0.438898 Oct 19 07:00:19.507294 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1381/2736] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:19 2022] DELETE /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:00:19.518666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:19.521205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:19.532898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.533886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.534595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.535568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.536752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.537396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.702864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:19.725008 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec3a7bd2-f4e5-4d69-9308-b1d7ab9e9fa3 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.216041 Oct 19 07:00:19.726309 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1382/2737] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:19 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:19.734465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:19.736511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:19.744408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.745086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.746339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.747386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.749341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.750508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.913171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:19.922112 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ee438a3-ac16-4d00-abfd-8b40ead9d5fd tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1665 microversion: 2.1 time: 0.194493 Oct 19 07:00:19.922704 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1383/2738] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:19 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1665 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:19.927921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:19.928557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:19.935188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.935684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.936140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.937039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:19.937507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:19.937984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:19.999479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:20.013954 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b4e05aa-053c-4f2d-8e5e-268781254fae tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1468 microversion: 2.1 time: 0.616645 Oct 19 07:00:20.015235 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1356/2739] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:19 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1468 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:20.042096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:20.042919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:20.051052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:20.053848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:20.054541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:20.055571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:20.056364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:20.057441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:20.150317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:20.161554 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73932244-7e37-42f9-8631-12a10656c15f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1319 microversion: 2.1 time: 0.237221 Oct 19 07:00:20.163667 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1384/2740] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:19 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:20.415129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:20.415903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:20.422767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:20.423701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:20.424392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:20.425321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:20.426070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:20.426719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:20.544815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:20.556483 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-306ae283-10b0-4ec0-96a8-2b3e8060f14b tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1270 microversion: 2.1 time: 0.145214 Oct 19 07:00:20.557068 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1385/2741] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:20 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1270 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:20.754699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:20.756145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:20.762618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:20.763344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:20.763950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:20.764804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:20.765439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:20.765881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:20.807041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:20.817248 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4d94aa1-3bd3-4dc4-a9b3-677cb6b2f32f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1468 microversion: 2.1 time: 0.780567 Oct 19 07:00:20.818412 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1357/2742] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:20 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1468 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:20.841145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e19e7bd3-d302-4f0d-8ca1-e4b5fd9161bf tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1294634220"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:20.844054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e19e7bd3-d302-4f0d-8ca1-e4b5fd9161bf tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:20.851603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e19e7bd3-d302-4f0d-8ca1-e4b5fd9161bf tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:20.852398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e19e7bd3-d302-4f0d-8ca1-e4b5fd9161bf tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:20.853075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e19e7bd3-d302-4f0d-8ca1-e4b5fd9161bf tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:20.854035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e19e7bd3-d302-4f0d-8ca1-e4b5fd9161bf tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:20.854754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e19e7bd3-d302-4f0d-8ca1-e4b5fd9161bf tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:20.855261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e19e7bd3-d302-4f0d-8ca1-e4b5fd9161bf tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:21.139939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:21.151350 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e028768-77cf-48dc-9944-21fe4978c505 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1318 microversion: 2.1 time: 0.401949 Oct 19 07:00:21.152163 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1386/2743] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:20 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:21.172878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:21.173985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:21.196053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:21.207522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:21.208380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:21.209485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:21.210034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:21.210657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:21.547342 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e19e7bd3-d302-4f0d-8ca1-e4b5fd9161bf tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "POST /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c/action" status: 202 len: 0 microversion: 2.1 time: 0.709491 Oct 19 07:00:21.548006 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1358/2744] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:00:20 2022] POST /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 07:00:21.565351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:21.572683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:21.589230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:21.589747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:21.590313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:21.590894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:21.591354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:21.591788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:21.663207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:21.682453 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db62f71b-19bc-4484-8af9-6595a21820ac tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1665 microversion: 2.1 time: 0.528231 Oct 19 07:00:21.698317 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1387/2745] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:21 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1665 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:21.971505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1215375532", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:22.068739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] validate_networks() for [('818fb9ba-07b2-4d4a-b733-3d665dc25aa2', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:00:23.105395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:23.122676 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-09dc3395-b8c5-4dcf-9783-198522bd3d64 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1319 microversion: 2.1 time: 1.560865 Oct 19 07:00:23.124761 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1359/2746] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:21 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1319 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:23.130000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a07859d-b353-493b-a1f5-05cbb6bc3a17 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d642d14c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:23.207209 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a07859d-b353-493b-a1f5-05cbb6bc3a17 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.080915 Oct 19 07:00:23.208759 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1360/2747] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:23 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:23.219149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:23.220812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:23.231486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:23.232405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:23.233016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:23.233966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:23.234578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:23.238664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:23.542580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:00:23.544007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:00:23.544702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:00:23.545280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:00:23.545881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:00:23.559699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:23.560466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:23.561071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:23.562150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:23.562774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:23.563554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:23.570955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:23.582164 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1bafa7f-95fc-4015-9547-448c4ee0d5de tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1276 microversion: 2.1 time: 0.370579 Oct 19 07:00:23.584372 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1361/2748] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:23 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1276 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:23.596782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:23.597880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:23.629249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:23.630061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:23.632363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:23.636200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:23.639445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:23.640468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:23.647017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Getting quotas for project 9816fcfed2354664a054e1b3e146019c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:23.674787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Getting quotas for user 185d0e907b2e4c75916459859c5c8c22 and project 9816fcfed2354664a054e1b3e146019c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:23.701167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:23.705232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:00:23.707557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:00:23.935482 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6702f9d0-6b73-48a0-b1de-4f5da95477bf tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.235836 Oct 19 07:00:23.936075 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1388/2749] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:00:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:00:23.958340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c0787fb3-d469-4854-a1ea-402b64a80ac5 req-4280e069-7e96-4c46-8523-ae8d98f1acc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83bd721-b423-47b5-969e-9dcb73715bd4", "name": "network-vif-deleted", "tag": "590d91ab-87aa-4327-950f-26e3c0efee47"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:23.982651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c0787fb3-d469-4854-a1ea-402b64a80ac5 req-4280e069-7e96-4c46-8523-ae8d98f1acc5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:23.983119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c0787fb3-d469-4854-a1ea-402b64a80ac5 req-4280e069-7e96-4c46-8523-ae8d98f1acc5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:23.987835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c0787fb3-d469-4854-a1ea-402b64a80ac5 req-4280e069-7e96-4c46-8523-ae8d98f1acc5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.009247 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c0787fb3-d469-4854-a1ea-402b64a80ac5 req-4280e069-7e96-4c46-8523-ae8d98f1acc5 service nova] Creating event network-vif-deleted:590d91ab-87aa-4327-950f-26e3c0efee47 for instance e83bd721-b423-47b5-969e-9dcb73715bd4 on n-h1-861333-10 Oct 19 07:00:24.019733 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c0787fb3-d469-4854-a1ea-402b64a80ac5 req-4280e069-7e96-4c46-8523-ae8d98f1acc5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069931 Oct 19 07:00:24.023793 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1389/2750] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:24.036475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a51da864-fc68-4d34-8894-9a8be56d2ce0 req-13ec773d-443e-4ef6-bf04-ad4246ea398b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3ea51c-9562-44a5-b313-a11890f07cf1", "name": "network-vif-plugged", "status": "completed", "tag": "80a29399-b219-4238-8163-034c06e4ed8c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:24.057574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a51da864-fc68-4d34-8894-9a8be56d2ce0 req-13ec773d-443e-4ef6-bf04-ad4246ea398b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.059086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a51da864-fc68-4d34-8894-9a8be56d2ce0 req-13ec773d-443e-4ef6-bf04-ad4246ea398b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.061176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a51da864-fc68-4d34-8894-9a8be56d2ce0 req-13ec773d-443e-4ef6-bf04-ad4246ea398b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.079115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:24.088580 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4086f4da-2149-45c0-8bb1-72d91bf62f2f tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1467 microversion: 2.1 time: 0.502926 Oct 19 07:00:24.089632 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a51da864-fc68-4d34-8894-9a8be56d2ce0 req-13ec773d-443e-4ef6-bf04-ad4246ea398b service nova] Creating event network-vif-plugged:80a29399-b219-4238-8163-034c06e4ed8c for instance 0f3ea51c-9562-44a5-b313-a11890f07cf1 on n-h1-861333-10 Oct 19 07:00:24.092952 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1362/2751] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:23 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1467 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:24.101490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:24.106995 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a51da864-fc68-4d34-8894-9a8be56d2ce0 req-13ec773d-443e-4ef6-bf04-ad4246ea398b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078010 Oct 19 07:00:24.108196 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1390/2752] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:24.111809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:24.115551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-de880b66-26f8-4c37-b377-2a1ac27c4ce6 req-1fa853bb-5aa9-465c-8c13-2f2d4d9838b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c819be30-137d-4b9f-86e5-326b10ec2e35", "name": "network-vif-deleted", "tag": "0fa2c090-9b54-478b-8e71-8ca186582741"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:24.131760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.132304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.132757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.133481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.133948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.134385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.149831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de880b66-26f8-4c37-b377-2a1ac27c4ce6 req-1fa853bb-5aa9-465c-8c13-2f2d4d9838b9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.150411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de880b66-26f8-4c37-b377-2a1ac27c4ce6 req-1fa853bb-5aa9-465c-8c13-2f2d4d9838b9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.150855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de880b66-26f8-4c37-b377-2a1ac27c4ce6 req-1fa853bb-5aa9-465c-8c13-2f2d4d9838b9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.175688 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-de880b66-26f8-4c37-b377-2a1ac27c4ce6 req-1fa853bb-5aa9-465c-8c13-2f2d4d9838b9 service nova] Creating event network-vif-deleted:0fa2c090-9b54-478b-8e71-8ca186582741 for instance c819be30-137d-4b9f-86e5-326b10ec2e35 on n-h1-861333-10 Oct 19 07:00:24.190764 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-de880b66-26f8-4c37-b377-2a1ac27c4ce6 req-1fa853bb-5aa9-465c-8c13-2f2d4d9838b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078998 Oct 19 07:00:24.193802 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1391/2753] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:24.230276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6302e889-2fcb-48c9-9b65-8d317ee9fa66 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:24.232123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6302e889-2fcb-48c9-9b65-8d317ee9fa66 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:24.253135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.253902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.254569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.255584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lazy-loading 'fault' on Instance uuid c819be30-137d-4b9f-86e5-326b10ec2e35 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:24.387056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6302e889-2fcb-48c9-9b65-8d317ee9fa66 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:24.395593 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6302e889-2fcb-48c9-9b65-8d317ee9fa66 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1224 microversion: 2.1 time: 0.185059 Oct 19 07:00:24.398664 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1392/2754] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:24 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1224 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:24.410128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:24.412238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:24.426985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.427766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.429558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.430512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.434998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.436190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.471789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lazy-loading 'flavor' on Instance uuid aa97282c-7684-4a7d-adda-93824d280396 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:24.476124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:24.556503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193730cf6d2040ba81ca9c88fe8b141c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f346704c1c44249ba3ab23c91469c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:24.573281 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13fbddd2-0efc-495d-b3e5-dc09d4bec2db tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 200 len: 1316 microversion: 2.1 time: 0.476007 Oct 19 07:00:24.579239 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1363/2755] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:24 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:24.590388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:24.609146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:24.625480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.637975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.637975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.637975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.637975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.637975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.764038 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01abeaeb-e1dc-449c-ae18-0d57532b7b25 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396/action" status: 202 len: 0 microversion: 2.1 time: 0.363861 Oct 19 07:00:24.765083 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1393/2756] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:00:24 2022] POST /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:00:24.782417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a743c713-a2a7-4639-9ecd-7b903d0be30d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fb514c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:24.853149 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a743c713-a2a7-4639-9ecd-7b903d0be30d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.086712 Oct 19 07:00:24.868745 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1394/2757] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:24 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:24.883010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:24.884302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:24.913995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.913995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.915287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:24.916315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:24.916807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:24.917264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:25.121781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:25.143449 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f033805-b1f8-4c1b-9d32-1612c8897f11 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1276 microversion: 2.1 time: 0.273297 Oct 19 07:00:25.146614 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1395/2758] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:24 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:25.160231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:25.161304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:25.178137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:25.182190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:25.182784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:25.183695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:25.184290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:25.184737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:25.270886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:25.288815 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c179654-cec1-4b77-b41d-b26d1d497225 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1319 microversion: 2.1 time: 0.708098 Oct 19 07:00:25.292605 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1364/2759] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:24 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:25.424668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9fc4a37-84dc-4e4c-b238-43804563e855 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:25.425151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9fc4a37-84dc-4e4c-b238-43804563e855 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:25.552935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:25.577709 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc9b0d86-9240-4160-9e01-079ab18753cb tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1475 microversion: 2.1 time: 0.412948 Oct 19 07:00:25.594624 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1396/2760] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:25 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1475 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:25.617061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:25.618309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] [instance: c819be30-137d-4b9f-86e5-326b10ec2e35] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:25.669364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:25.671026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:25.674786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:25.675878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:25.676556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:25.677144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:25.743409 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] HTTP exception thrown: Instance c819be30-137d-4b9f-86e5-326b10ec2e35 could not be found. Oct 19 07:00:25.744732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9fc4a37-84dc-4e4c-b238-43804563e855 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Request method failure captured: Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 HTTP/1.1 Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6A7IgKqg5aygewx6bAy9GHqM4tFtQiNlXZEwXLjvG1TRY2EDIDLUloC7P7wwCxRiIthTkK6tijbbaXOr8o3mCgLrOccWFnbWEfBPdRLogfHQE_IiRJujZH_hnq4LAkCVWqj5tpdjXvJ4lLXpOhr28TEMmVwUTBZ7DVw8FXbN8-flAw Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 53f346704c1c44249ba3ab23c91469c0 Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestFqdnHostnames-1208799638 Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/53f346704c1c44249ba3ab23c91469c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53f346704c1c44249ba3ab23c91469c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53f346704c1c44249ba3ab23c91469c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_53f346704c1c44249ba3ab23c91469c0", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestFqdnHostnames-1208799638 Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 53f346704c1c44249ba3ab23c91469c0 Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1208799638 Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestFqdnHostnames-1208799638-project Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 193730cf6d2040ba81ca9c88fe8b141c Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestFqdnHostnames-1208799638-project Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance c819be30-137d-4b9f-86e5-326b10ec2e35 could not be found. Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c819be30-137d-4b9f-86e5-326b10ec2e35'} Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c819be30-137d-4b9f-86e5-326b10ec2e35 could not be found. Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c819be30-137d-4b9f-86e5-326b10ec2e35 could not be found. Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:25.745211 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c819be30-137d-4b9f-86e5-326b10ec2e35 could not be found. Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Returning 404 to user: Instance c819be30-137d-4b9f-86e5-326b10ec2e35 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d5b4ce1-ff8d-46db-bcc0-61e3de9e4235 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35" status: 404 len: 111 microversion: 2.1 time: 0.141967 Oct 19 07:00:25.749486 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1397/2761] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:25 2022] GET /compute/v2.1/servers/c819be30-137d-4b9f-86e5-326b10ec2e35 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:25.766497 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9fc4a37-84dc-4e4c-b238-43804563e855 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1224 microversion: 2.1 time: 0.347256 Oct 19 07:00:25.772183 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1365/2762] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:25 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1224 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:25.778226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8618ae7-4327-4560-a2a1-ead98bccbc40 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] Calling method '.version_select at 0x7f6d5fb03310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:25.869719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f214956-22fd-4198-b0ef-7a76c598eb2d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fa9c550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:25.909180 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8618ae7-4327-4560-a2a1-ead98bccbc40 tempest-ServersTestFqdnHostnames-1208799638 tempest-ServersTestFqdnHostnames-1208799638-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449285316" status: 202 len: 0 microversion: 2.1 time: 0.155198 Oct 19 07:00:25.913422 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1398/2763] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449285316 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:00:25.967885 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f214956-22fd-4198-b0ef-7a76c598eb2d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.102232 Oct 19 07:00:25.969926 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1366/2764] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:25 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:26.171676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:26.172732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:26.191712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:26.192084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:26.192561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:26.193265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:26.200134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:26.202166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:26.325966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:26.327432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:26.351923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:26.365098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:26.368899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:26.370200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:26.370804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:26.382970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:26.836997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:26.844661 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf453e06-2b50-4ef6-b1f1-59ed6fd037b1 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1318 microversion: 2.1 time: 0.677030 Oct 19 07:00:26.858197 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1399/2765] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:26 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:26.871012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-eecdcecf-46b5-491f-93e5-8a249ed0471f req-7bac61c8-1e6e-4ed7-a6ad-23c0db07837a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97939c70-1ac7-4626-8d23-50bfa0d115d9", "name": "network-vif-plugged", "status": "completed", "tag": "7e3fe6c4-e18b-454b-a9e4-35869a7da8ab"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:26.898051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eecdcecf-46b5-491f-93e5-8a249ed0471f req-7bac61c8-1e6e-4ed7-a6ad-23c0db07837a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:26.898789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eecdcecf-46b5-491f-93e5-8a249ed0471f req-7bac61c8-1e6e-4ed7-a6ad-23c0db07837a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:26.899415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eecdcecf-46b5-491f-93e5-8a249ed0471f req-7bac61c8-1e6e-4ed7-a6ad-23c0db07837a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:26.926906 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-eecdcecf-46b5-491f-93e5-8a249ed0471f req-7bac61c8-1e6e-4ed7-a6ad-23c0db07837a service nova] Creating event network-vif-plugged:7e3fe6c4-e18b-454b-a9e4-35869a7da8ab for instance 97939c70-1ac7-4626-8d23-50bfa0d115d9 on n-h2-861333-10 Oct 19 07:00:26.946145 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-eecdcecf-46b5-491f-93e5-8a249ed0471f req-7bac61c8-1e6e-4ed7-a6ad-23c0db07837a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086236 Oct 19 07:00:26.947383 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1400/2766] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:26.952829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:26.953873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:26.967726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:26.971554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:26.972410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:26.973407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:26.975668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:26.978480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:27.384501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:27.386707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:27.399217 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-122f220e-124a-42e0-965f-ab9f7d648ab6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1319 microversion: 2.1 time: 1.080987 Oct 19 07:00:27.399861 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1367/2767] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:26 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1319 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:27.403842 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8443102c-c4dd-40b1-8630-144eac57c21e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1458 microversion: 2.1 time: 0.454986 Oct 19 07:00:27.406130 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1401/2768] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:26 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1458 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:27.413754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36821d2e-68bb-43a2-8897-d37c4be08e72 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fbbc8b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:27.426962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:27.427602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:27.441687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:27.443407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:27.446739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:27.449251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:27.449918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:27.451505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:27.491309 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36821d2e-68bb-43a2-8897-d37c4be08e72 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.081068 Oct 19 07:00:27.493633 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1402/2769] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:27 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:27.529643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98082229-eb9c-4622-9460-03c2343c12c9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:27.531764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98082229-eb9c-4622-9460-03c2343c12c9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:27.558615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98082229-eb9c-4622-9460-03c2343c12c9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:27.562528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98082229-eb9c-4622-9460-03c2343c12c9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:27.563678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98082229-eb9c-4622-9460-03c2343c12c9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:27.566049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98082229-eb9c-4622-9460-03c2343c12c9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:27.569789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98082229-eb9c-4622-9460-03c2343c12c9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:27.570550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98082229-eb9c-4622-9460-03c2343c12c9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:28.090435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:28.111370 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45a685eb-0cda-4090-9a29-06e81021627e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1276 microversion: 2.1 time: 0.710332 Oct 19 07:00:28.137864 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1368/2770] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:27 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1276 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:28.152706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:28.156153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:28.176961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:28.179094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:28.183703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:28.185067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:28.187825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:28.194426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:28.403216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:28.527469 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98082229-eb9c-4622-9460-03c2343c12c9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1611 microversion: 2.1 time: 1.032698 Oct 19 07:00:28.531391 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1403/2771] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:27 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1611 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:28.575214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:28.575843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:28.587057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:28.587559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:28.591601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:28.592418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:28.593069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:28.596829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:28.920539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:28.933243 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc1c4e3c-d186-46e3-8043-0a70045e11db tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1468 microversion: 2.1 time: 0.370717 Oct 19 07:00:28.949471 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1404/2772] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:28 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:28.965340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b512d4ee-2599-41ea-aa50-d183cf7be074 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fb514c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:29.050149 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b512d4ee-2599-41ea-aa50-d183cf7be074 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.099317 Oct 19 07:00:29.051266 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1405/2773] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:28 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:29.064202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98eed7e1-7bcd-4a7a-a2cd-74d67ce4822c tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:29.073348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98eed7e1-7bcd-4a7a-a2cd-74d67ce4822c tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.075511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98eed7e1-7bcd-4a7a-a2cd-74d67ce4822c tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.080320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98eed7e1-7bcd-4a7a-a2cd-74d67ce4822c tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.081412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98eed7e1-7bcd-4a7a-a2cd-74d67ce4822c tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.082048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98eed7e1-7bcd-4a7a-a2cd-74d67ce4822c tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.082674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98eed7e1-7bcd-4a7a-a2cd-74d67ce4822c tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.144195 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98eed7e1-7bcd-4a7a-a2cd-74d67ce4822c tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.091615 Oct 19 07:00:29.156778 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1406/2774] 10.222.0.39 () {58 vars in 1176 bytes} [Wed Oct 19 07:00:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:29.167514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:29.169858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 97939c70-1ac7-4626-8d23-50bfa0d115d9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:29.183696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.185387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.186754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.188920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.189558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.190897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.541782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:29.556410 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e69d83d4-be01-4061-b421-9feede0d8e85 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9" status: 200 len: 1319 microversion: 2.1 time: 0.397558 Oct 19 07:00:29.559044 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1407/2775] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:29 2022] GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9 => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:29.570224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:29.572984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:29.586317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.587064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.589318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.591674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.592556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.593636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.712830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:29.724688 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-251c4d7c-1a9e-488e-8304-933d1b774afa tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1282 microversion: 2.1 time: 0.163446 Oct 19 07:00:29.725280 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1408/2776] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:29 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:29.759011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-10", "block_migration": true, "disk_over_commit": false}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:29.761674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:29.769964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.770553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.771008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.771769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.772562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.773007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.827869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Lazy-loading 'flavor' on Instance uuid aa97282c-7684-4a7d-adda-93824d280396 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:29.855308 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance aa97282c-7684-4a7d-adda-93824d280396 while it is in vm_state suspended Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Request method failure captured: Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396/action HTTP/1.1 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 98 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6BNNHf4na82s5OCbSLGiFheejmPJshTRs8TQKrXIz6aHuMdmlYAzKz9kQnypjm-xJ3R65pSFiflGd33Rv4h2-7nIiARZlkq22VyT54rDGN5Wi569Ib4UcVWURZXgXOsXYJGMTaSLgX9F3e0RJhBfjarBstOOnY6qc3sE44djjK0HvA Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d48af9d08e9e44ec954fe4c3a90492b0 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveMigrationNegativeTest-399411732 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d48af9d08e9e44ec954fe4c3a90492b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d48af9d08e9e44ec954fe4c3a90492b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d48af9d08e9e44ec954fe4c3a90492b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d48af9d08e9e44ec954fe4c3a90492b0", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-LiveMigrationNegativeTest-399411732 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d48af9d08e9e44ec954fe4c3a90492b0 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-399411732 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-LiveMigrationNegativeTest-399411732-project-admin Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f03cf4a36fec4957a7eac3a47a2b0551 Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-LiveMigrationNegativeTest-399411732-project-admin Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: {"os-migrateLive": {"host": "n-h2-861333-10", "block_migration": true, "disk_over_commit": false}} Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'os-migrateLive' instance aa97282c-7684-4a7d-adda-93824d280396 while it is in vm_state suspended Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'aa97282c-7684-4a7d-adda-93824d280396', 'body': {'os-migrateLive': {'host': 'n-h2-861333-10', 'block_migration': True, 'disk_over_commit': False}}} Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aa97282c-7684-4a7d-adda-93824d280396 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:29.857230 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance aa97282c-7684-4a7d-adda-93824d280396 while it is in vm_state suspended Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance aa97282c-7684-4a7d-adda-93824d280396 while it is in vm_state suspended Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance aa97282c-7684-4a7d-adda-93824d280396 while it is in vm_state suspended {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8f2e5f6-99e0-4667-b9ac-f7d38fe186e9 tempest-LiveMigrationNegativeTest-399411732 tempest-LiveMigrationNegativeTest-399411732-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396/action" status: 409 len: 155 microversion: 2.1 time: 0.103761 Oct 19 07:00:29.868910 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1409/2777] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:00:29 2022] POST /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396/action => generated 155 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:00:29.873019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-84c600df-a7b9-4f92-81fd-0a598b4aab82 req-cf97cb94-3959-49c9-8c0e-7508c65eea6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c", "name": "network-vif-plugged", "status": "completed", "tag": "e9ea764b-95e8-4aeb-ae74-818b2898ceb8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:29.895252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-84c600df-a7b9-4f92-81fd-0a598b4aab82 req-cf97cb94-3959-49c9-8c0e-7508c65eea6f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.895749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-84c600df-a7b9-4f92-81fd-0a598b4aab82 req-cf97cb94-3959-49c9-8c0e-7508c65eea6f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.903338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-84c600df-a7b9-4f92-81fd-0a598b4aab82 req-cf97cb94-3959-49c9-8c0e-7508c65eea6f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.934422 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-84c600df-a7b9-4f92-81fd-0a598b4aab82 req-cf97cb94-3959-49c9-8c0e-7508c65eea6f service nova] Creating event network-vif-plugged:e9ea764b-95e8-4aeb-ae74-818b2898ceb8 for instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c on n-h2-861333-10 Oct 19 07:00:29.940510 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-84c600df-a7b9-4f92-81fd-0a598b4aab82 req-cf97cb94-3959-49c9-8c0e-7508c65eea6f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077602 Oct 19 07:00:29.941913 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1410/2778] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:29.949694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:29.950628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:29.959964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.960749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.961768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.964556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:29.964556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:29.964556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:29.998345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:00:30.274016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:30.284331 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e79a9f3-64f6-49d0-9122-fdc3bbceedd8 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1318 microversion: 2.1 time: 2.145088 Oct 19 07:00:30.300394 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1369/2779] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:28 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1318 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:30.306961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12db641e-13bf-4a21-8775-f864069e06c2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64103280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:30.335305 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6be01ca0-612c-4dca-98fc-37479ba31b11 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 204 len: 0 microversion: 2.1 time: 0.391067 Oct 19 07:00:30.335983 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1411/2780] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:29 2022] DELETE /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:00:30.346124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:30.346983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:30.358422 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12db641e-13bf-4a21-8775-f864069e06c2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.056613 Oct 19 07:00:30.366986 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1370/2781] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:30 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:30.367165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:30.367165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:30.367165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:30.367165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:30.367165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:30.367165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:30.586646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:30.589834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 97939c70-1ac7-4626-8d23-50bfa0d115d9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:30.601255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:30.601746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:30.602184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:30.602904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:30.603361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:30.603784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:30.621179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:30.634090 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1c19512-a5e1-4998-9bdd-cdceb676c15a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1464 microversion: 2.1 time: 0.293413 Oct 19 07:00:30.634722 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1412/2782] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:30 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1464 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:30.746850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:30.759211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:30.759211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:30.761369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:30.764148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:30.770211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:30.770845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:30.771376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:30.870712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:30.878306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:30.884045 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13c05957-8e6b-497f-a879-85a293fd544f tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1282 microversion: 2.1 time: 0.141094 Oct 19 07:00:30.885943 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1413/2783] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:30 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:31.186212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:31.198057 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4bc7a977-4f83-48b7-96a7-8ce6bb12807b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9" status: 200 len: 1469 microversion: 2.1 time: 0.613542 Oct 19 07:00:31.200300 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1371/2784] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:30 2022] GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9 => generated 1469 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:31.228675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:31.234606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:31.242149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Searching by: {'reservation_id': 'r-lkmj6g48', 'deleted': False, 'project_id': 'a6f0b288d116428981f07801b48d1cc8'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:00:31.259911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:31.266830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:31.268838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:31.269680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:31.270161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:31.270594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:31.311625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:31.313632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:31.324899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:31.325734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:31.326439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:31.327399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:31.328213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:31.328884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:31.417853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:00:31.529746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:31.537410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:31.538135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:31.538797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:31.790271 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-112d37f3-67a3-41b4-980a-ce0e5fc26093 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?reservation_id=r-lkmj6g48" status: 200 len: 2930 microversion: 2.1 time: 0.564928 Oct 19 07:00:31.790271 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1414/2785] 10.222.0.39 () {58 vars in 1197 bytes} [Wed Oct 19 07:00:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-lkmj6g48 => generated 2930 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:31.807812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-904e9a77-9553-4134-812f-566d0401609e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fb99a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:31.870133 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-904e9a77-9553-4134-812f-566d0401609e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.078210 Oct 19 07:00:31.871187 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1415/2786] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:31 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:31.877314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-435a1fda-2d87-4c77-b3ed-cf879d0c2b88 req-3c344816-8197-4c8c-a832-0d92b36f6a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fec70db-d4c5-486a-89cf-15d5a41e95d0", "tag": "2d001924-043a-4f1c-95a7-e43b5bfe4f93"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:32.087735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:32.111374 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ec5c4b6-9c1a-48c8-83ef-dd3ecea245d9 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1318 microversion: 2.1 time: 0.806719 Oct 19 07:00:32.124652 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1372/2787] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:31 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:32.134792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:32.135774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:32.143626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:32.144514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:32.145203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:32.146229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:32.146937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:32.147592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:32.363340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-435a1fda-2d87-4c77-b3ed-cf879d0c2b88 req-3c344816-8197-4c8c-a832-0d92b36f6a74 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:32.364144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-435a1fda-2d87-4c77-b3ed-cf879d0c2b88 req-3c344816-8197-4c8c-a832-0d92b36f6a74 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:32.365020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-435a1fda-2d87-4c77-b3ed-cf879d0c2b88 req-3c344816-8197-4c8c-a832-0d92b36f6a74 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:32.377812 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-435a1fda-2d87-4c77-b3ed-cf879d0c2b88 req-3c344816-8197-4c8c-a832-0d92b36f6a74 service nova] Creating event network-changed:2d001924-043a-4f1c-95a7-e43b5bfe4f93 for instance 9fec70db-d4c5-486a-89cf-15d5a41e95d0 on n-h2-861333-10 Oct 19 07:00:32.387276 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-435a1fda-2d87-4c77-b3ed-cf879d0c2b88 req-3c344816-8197-4c8c-a832-0d92b36f6a74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.511606 Oct 19 07:00:32.389241 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1416/2788] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:32.404424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5344e4c8-6f26-497b-b161-33c3edfa4a86 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:32.475601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.server_groups [None req-5344e4c8-6f26-497b-b161-33c3edfa4a86 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Querying cell 2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) for 2 instances {{(pid=127567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 07:00:32.479697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5344e4c8-6f26-497b-b161-33c3edfa4a86 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:32.482299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5344e4c8-6f26-497b-b161-33c3edfa4a86 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:32.484969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5344e4c8-6f26-497b-b161-33c3edfa4a86 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:32.566765 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5344e4c8-6f26-497b-b161-33c3edfa4a86 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/cbc3012e-aa9e-4a3a-ac7e-dac5cf061c7e" status: 200 len: 270 microversion: 2.1 time: 0.175022 Oct 19 07:00:32.568514 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1417/2789] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 07:00:32 2022] GET /compute/v2.1/os-server-groups/cbc3012e-aa9e-4a3a-ac7e-dac5cf061c7e => generated 270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:32.572941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:32.574076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:32.582489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:32.583362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:32.584082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:32.585078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:32.585784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:32.586430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:32.982064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:32.987405 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35618343-154a-4d9b-bcb5-417739fd84df tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1464 microversion: 2.1 time: 0.860361 Oct 19 07:00:32.990506 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1373/2790] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:32 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1464 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:33.005830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f30c537b-0bb8-492c-9a0b-b620391eb2aa tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:33.006711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f30c537b-0bb8-492c-9a0b-b620391eb2aa tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:33.022391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f30c537b-0bb8-492c-9a0b-b620391eb2aa tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:33.023105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f30c537b-0bb8-492c-9a0b-b620391eb2aa tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:33.025355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f30c537b-0bb8-492c-9a0b-b620391eb2aa tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:33.028944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f30c537b-0bb8-492c-9a0b-b620391eb2aa tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:33.029629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f30c537b-0bb8-492c-9a0b-b620391eb2aa tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:33.030301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f30c537b-0bb8-492c-9a0b-b620391eb2aa tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:33.051374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:33.151548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:33.159329 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7c0d39a-f974-4be2-8bfd-49cb551bdb98 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.590570 Oct 19 07:00:33.164876 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1418/2791] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:32 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:33.168765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c354a45-5da9-4482-b470-3700096bc179 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fb06550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:33.248700 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c354a45-5da9-4482-b470-3700096bc179 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.081296 Oct 19 07:00:33.251090 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1419/2792] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:33 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:33.260546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:33.261188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:33.268258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:33.268737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:33.269732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:33.270642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:33.271290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:33.272786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:33.586457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:33.602726 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb4d84bc-119e-4fd6-ad55-19d24dfb8682 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1318 microversion: 2.1 time: 0.349890 Oct 19 07:00:33.603313 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1420/2793] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:33 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-459f7c3f-520d-4280-98a3-4021ee731538 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1422 microversion: 2.1 time: 0.163998 Oct 19 07:00:34.176771 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1421/2794] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:34 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1422 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:34.182753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dcaeb73d-ddda-41f4-82a3-cdc176d3775d req-04fac25f-152f-42b7-9d2b-7d24090fd4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa97282c-7684-4a7d-adda-93824d280396", "name": "network-vif-deleted", "tag": "88cf8b90-3b8b-4740-8a10-c40de2fdda79"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:34.195331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dcaeb73d-ddda-41f4-82a3-cdc176d3775d req-04fac25f-152f-42b7-9d2b-7d24090fd4f8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.195962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dcaeb73d-ddda-41f4-82a3-cdc176d3775d req-04fac25f-152f-42b7-9d2b-7d24090fd4f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.196909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dcaeb73d-ddda-41f4-82a3-cdc176d3775d req-04fac25f-152f-42b7-9d2b-7d24090fd4f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:34.210686 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dcaeb73d-ddda-41f4-82a3-cdc176d3775d req-04fac25f-152f-42b7-9d2b-7d24090fd4f8 service nova] Creating event network-vif-deleted:88cf8b90-3b8b-4740-8a10-c40de2fdda79 for instance aa97282c-7684-4a7d-adda-93824d280396 on n-h1-861333-10 Oct 19 07:00:34.220347 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dcaeb73d-ddda-41f4-82a3-cdc176d3775d req-04fac25f-152f-42b7-9d2b-7d24090fd4f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042281 Oct 19 07:00:34.221565 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1422/2795] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:34.227908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:34.228813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:34.238490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.241322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.242583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:34.243644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.244514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.245263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:34.398047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f30c537b-0bb8-492c-9a0b-b620391eb2aa tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1621 microversion: 2.1 time: 1.375282 Oct 19 07:00:34.427894 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1374/2796] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:32 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1621 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:34.448253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b31732e3-c985-4430-a82d-6fc4318e8411 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64781310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:34.525136 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b31732e3-c985-4430-a82d-6fc4318e8411 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.096046 Oct 19 07:00:34.530112 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1375/2797] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:34 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:34.535939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3f8dc63-a8cf-4eca-a09f-3ef1c36e2964 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:34.536756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3f8dc63-a8cf-4eca-a09f-3ef1c36e2964 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] [instance: 97939c70-1ac7-4626-8d23-50bfa0d115d9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:34.546963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f8dc63-a8cf-4eca-a09f-3ef1c36e2964 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.547778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f8dc63-a8cf-4eca-a09f-3ef1c36e2964 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.549626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f8dc63-a8cf-4eca-a09f-3ef1c36e2964 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:34.550938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f8dc63-a8cf-4eca-a09f-3ef1c36e2964 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.552213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f8dc63-a8cf-4eca-a09f-3ef1c36e2964 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.552824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3f8dc63-a8cf-4eca-a09f-3ef1c36e2964 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:34.714132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:34.724202 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73d9420a-eb1a-488d-b5dc-9b657c257eb1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.501238 Oct 19 07:00:34.730587 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1423/2798] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:34 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:34.739641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d63787c4-37c0-4783-987f-043cebf95fd7 req-eb95440b-3b95-49b2-9a5f-18712f038f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88ce10-b961-440c-b62d-0d55b1b6996c", "tag": "d016431f-949c-48dd-b7b6-18c3d910610b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:34.766369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d63787c4-37c0-4783-987f-043cebf95fd7 req-eb95440b-3b95-49b2-9a5f-18712f038f49 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.767351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d63787c4-37c0-4783-987f-043cebf95fd7 req-eb95440b-3b95-49b2-9a5f-18712f038f49 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.767941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d63787c4-37c0-4783-987f-043cebf95fd7 req-eb95440b-3b95-49b2-9a5f-18712f038f49 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:34.792467 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d63787c4-37c0-4783-987f-043cebf95fd7 req-eb95440b-3b95-49b2-9a5f-18712f038f49 service nova] Creating event network-changed:d016431f-949c-48dd-b7b6-18c3d910610b for instance ef88ce10-b961-440c-b62d-0d55b1b6996c on n-h1-861333-10 Oct 19 07:00:34.812638 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d63787c4-37c0-4783-987f-043cebf95fd7 req-eb95440b-3b95-49b2-9a5f-18712f038f49 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079002 Oct 19 07:00:34.814833 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1424/2799] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:34.826663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:34.829301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:34.842973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.845756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.845756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:34.845756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:34.852796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:34.854398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:35.224849 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3f8dc63-a8cf-4eca-a09f-3ef1c36e2964 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9" status: 200 len: 1622 microversion: 2.1 time: 0.691212 Oct 19 07:00:35.244197 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1376/2800] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:34 2022] GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9 => generated 1622 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:35.290363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:35.290991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:35.304365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:35.304872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:35.305317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:35.306040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:35.306501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:35.307155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:35.308350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:35.327442 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4adb67c9-d43b-4b67-ba84-dbaf23f57410 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1318 microversion: 2.1 time: 0.507110 Oct 19 07:00:35.328230 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1425/2801] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:34 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:35.373607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:35.375792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:35.378291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:35.378291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lazy-loading 'fault' on Instance uuid aa97282c-7684-4a7d-adda-93824d280396 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:35.546407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-763ba18d-dee9-47fa-abed-350626713058 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fbe0d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:35.566883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:35.575448 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02c7bf56-8166-4f2f-9f2d-b24c68910dc1 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 200 len: 1308 microversion: 2.1 time: 0.343036 Oct 19 07:00:35.579018 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1377/2802] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:35 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:35.588393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-259475208", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "05fec950-716c-4339-8de8-f7aa8c1e8b59"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:35.656039 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-763ba18d-dee9-47fa-abed-350626713058 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.110656 Oct 19 07:00:35.658212 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1426/2803] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:35 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:00:35.697814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:00:35.753073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:35.753707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:35.762364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:35.774107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:35.774648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:35.775107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:35.781559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:35.784656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:35.787011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:36.209235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:36.219605 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8859e642-c0d9-4bb4-b181-c421349b53c3 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.472553 Oct 19 07:00:36.220916 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1427/2804] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:35 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:36.357996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:36.359421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:36.372873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:36.374181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:36.376851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:36.380895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:36.383322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:36.385145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:36.626192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:00:36.626737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:00:36.627233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:00:36.627704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:00:36.628159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:00:36.657028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:36.668383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:36.670588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:36.673952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:36.691027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:36.691497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:36.796711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:00:36.821927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:00:36.881312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:00:36.908958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:00:36.963369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:36.997555 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b999230-230a-4b54-951f-ca7a36e09abc tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1318 microversion: 2.1 time: 0.643053 Oct 19 07:00:36.998182 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1428/2805] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:36 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:37.016229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:37.020486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: aa97282c-7684-4a7d-adda-93824d280396] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:37.038384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:37.042530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:37.043213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:37.044159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:37.045342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:37.045979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:37.074459 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] HTTP exception thrown: Instance aa97282c-7684-4a7d-adda-93824d280396 could not be found. Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Request method failure captured: Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 HTTP/1.1 Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6BMFreqHVcU-DMpMAvTRWhnyx7p8C1tRRLNh_e3-ioSfnJj-dHo62iXFthvYZlEZ8rd27JdCDeCIJYJOVbB-6Ll-RV7rTAU4eM6smogxcOg5U9tZvimxMWFj7g6svGw8-i9n1sxg5fut_a_KO0_JnFRRrRqLXozg2g1gwPcWYvn3aQ Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4b63168bfe4941ac8e4fbf19ed21860e Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveMigrationNegativeTest-617667930 Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b63168bfe4941ac8e4fbf19ed21860e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b63168bfe4941ac8e4fbf19ed21860e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b63168bfe4941ac8e4fbf19ed21860e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b63168bfe4941ac8e4fbf19ed21860e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-LiveMigrationNegativeTest-617667930 Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4b63168bfe4941ac8e4fbf19ed21860e Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-617667930 Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-LiveMigrationNegativeTest-617667930-project Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 042331c92e794909925dcfde9e576afd Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-LiveMigrationNegativeTest-617667930-project Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance aa97282c-7684-4a7d-adda-93824d280396 could not be found. Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'aa97282c-7684-4a7d-adda-93824d280396'} Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa97282c-7684-4a7d-adda-93824d280396 could not be found. Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa97282c-7684-4a7d-adda-93824d280396 could not be found. Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:37.076517 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:37.081665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:37.081665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:37.081665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:37.081665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:37.081665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:37.081665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa97282c-7684-4a7d-adda-93824d280396 could not be found. Oct 19 07:00:37.081665 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:37.083425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Returning 404 to user: Instance aa97282c-7684-4a7d-adda-93824d280396 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:37.085134 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d4ed002-eb2f-4a88-a974-af1981ef163a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396" status: 404 len: 111 microversion: 2.1 time: 0.078729 Oct 19 07:00:37.086266 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1429/2806] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:37 2022] GET /compute/v2.1/servers/aa97282c-7684-4a7d-adda-93824d280396 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:37.094467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d5693e4-a6f9-45c4-8ba4-a1c2c0b974ba tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fbcf0d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:37.172761 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6acec8ad-988e-4186-81e5-ed617aede792 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.588970 Oct 19 07:00:37.174064 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1378/2807] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:00:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:00:37.197292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:37.197832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:37.234967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:37.240368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:37.240368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:37.240368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:37.240368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:37.240368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:37.256069 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d5693e4-a6f9-45c4-8ba4-a1c2c0b974ba tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.167047 Oct 19 07:00:37.262834 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1430/2808] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:37 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:37.274796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4385d90-a448-49ed-998a-8a2ab7a77232 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:37.281670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4385d90-a448-49ed-998a-8a2ab7a77232 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:37.291606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:00:37.505326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4385d90-a448-49ed-998a-8a2ab7a77232 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:37.518946 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4385d90-a448-49ed-998a-8a2ab7a77232 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1216 microversion: 2.1 time: 0.253611 Oct 19 07:00:37.532161 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1431/2809] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:37 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1216 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:37.533606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:37.534106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:37.549343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:37.552361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:37.553069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:37.555838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:37.557276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:37.558265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:37.752580 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ede6efd0-ad6c-42c6-a8cd-f568acf718ec tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 204 len: 0 microversion: 2.1 time: 0.571403 Oct 19 07:00:37.758462 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1379/2810] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:37 2022] DELETE /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:00:37.764330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:37.766394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:37.796628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:37.801228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:37.801863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:37.802975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:37.807388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:37.809264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:37.926981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:37.939984 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6604733-fb42-4fe1-8db0-1b119e6c63d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.418196 Oct 19 07:00:37.959987 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1432/2811] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:37 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:38.023353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:38.024467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:38.037258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:38.038913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:38.040638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:38.041560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:38.048623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:38.048623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:38.420375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:38.437743 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-373d0175-21d2-4721-b0b5-8ce3b9b01501 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1318 microversion: 2.1 time: 0.419883 Oct 19 07:00:38.457128 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1433/2812] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:38 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:38.464603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12cc40b6-4ba0-47b6-8be2-e3d859fc0df7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d640d68b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:38.521450 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12cc40b6-4ba0-47b6-8be2-e3d859fc0df7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.062992 Oct 19 07:00:38.522421 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1434/2813] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:38 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:38.549715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cebd6a49-63eb-4319-b729-a50905f71c5b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:38.550511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cebd6a49-63eb-4319-b729-a50905f71c5b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:38.570447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:38.717746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:38.728955 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8e17160-9988-4792-8393-fae62004138a tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1475 microversion: 2.1 time: 0.971115 Oct 19 07:00:38.734819 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1380/2814] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:37 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1475 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:38.788677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cebd6a49-63eb-4319-b729-a50905f71c5b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:38.802879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cebd6a49-63eb-4319-b729-a50905f71c5b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1216 microversion: 2.1 time: 0.259370 Oct 19 07:00:38.804440 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1435/2815] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:38 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1216 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:38.966430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:38.967057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:38.979707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:38.990074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:38.990074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:38.990074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:38.990557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:38.990992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:39.603502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3d16106-bb7d-40e5-91d0-293297d9ed80 tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] Action: 'create', calling method: .version_select at 0x7f6d640d6430>, body: {"security_group": {"name": "tempest-securitygroup-513387699", "description": "tempest-description-65140068"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:39.768477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:39.777704 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d4c6fdb-723a-4256-9a15-e7384ed60498 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.815117 Oct 19 07:00:39.782691 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1381/2816] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:38 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:39.807036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a1be789e-3fc3-4cd4-b806-664276d2cedd req-87da5faa-8c4a-44bb-b1aa-27969a7b29c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2956c30a-7b4a-477e-962c-9cea7dc3ce59", "tag": "32be3cfb-91f2-46f7-aec9-59f76cdf913a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:39.844164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a1be789e-3fc3-4cd4-b806-664276d2cedd req-87da5faa-8c4a-44bb-b1aa-27969a7b29c3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:39.851658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a1be789e-3fc3-4cd4-b806-664276d2cedd req-87da5faa-8c4a-44bb-b1aa-27969a7b29c3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:39.852353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a1be789e-3fc3-4cd4-b806-664276d2cedd req-87da5faa-8c4a-44bb-b1aa-27969a7b29c3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:39.875758 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a1be789e-3fc3-4cd4-b806-664276d2cedd req-87da5faa-8c4a-44bb-b1aa-27969a7b29c3 service nova] Creating event network-changed:32be3cfb-91f2-46f7-aec9-59f76cdf913a for instance 2956c30a-7b4a-477e-962c-9cea7dc3ce59 on n-h1-861333-10 Oct 19 07:00:39.891930 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a1be789e-3fc3-4cd4-b806-664276d2cedd req-87da5faa-8c4a-44bb-b1aa-27969a7b29c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107633 Oct 19 07:00:39.893074 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1382/2817] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:39.898761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:39.904506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:39.918583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:39.925844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:39.926474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:39.927448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:39.928131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:39.928781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:40.979569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:40.994869 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19f18493-aba3-4582-aff7-5e8825595c10 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1318 microversion: 2.1 time: 1.099491 Oct 19 07:00:40.997683 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1383/2818] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:39 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1318 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:41.011268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a8e8427-a9bf-491c-8acc-82cbddcc6a38 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d640ec4c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:41.160788 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a8e8427-a9bf-491c-8acc-82cbddcc6a38 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.159063 Oct 19 07:00:41.165542 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1384/2819] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:40 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:41.233684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:41.233684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:41.236095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:41.237005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:41.238943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:41.242687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:41.243336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:41.245330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:41.318249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:41.674856 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3d16106-bb7d-40e5-91d0-293297d9ed80 tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 2.542477 Oct 19 07:00:41.675482 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1436/2820] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:00:39 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:41.681301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:41.682192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:41.693232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:41.705860 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c6a63d4-a1c4-4aef-8181-fd540eebfe0e tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1475 microversion: 2.1 time: 0.533657 Oct 19 07:00:41.713051 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1385/2821] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:41 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1475 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:41.721906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:41.722417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:41.722859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:41.723583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:41.726234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:41.726857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:41.731496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:41.742334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:41.742616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:41.742616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:41.742808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:41.743366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:41.748828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:41.749530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:41.939714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:41.950004 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-30f7111e-131c-4167-8eb4-d56f0dc83bff tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1274 microversion: 2.1 time: 0.272201 Oct 19 07:00:41.950590 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1437/2822] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:41 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:42.001537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-293fb04a-317d-4065-8e1b-9a5a8cdbe0ec req-e0a96200-a68c-4a92-9b20-27e184a021b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fec70db-d4c5-486a-89cf-15d5a41e95d0", "name": "network-vif-plugged", "status": "completed", "tag": "2d001924-043a-4f1c-95a7-e43b5bfe4f93"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:42.024311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-293fb04a-317d-4065-8e1b-9a5a8cdbe0ec req-e0a96200-a68c-4a92-9b20-27e184a021b0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:42.024958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-293fb04a-317d-4065-8e1b-9a5a8cdbe0ec req-e0a96200-a68c-4a92-9b20-27e184a021b0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:42.025654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-293fb04a-317d-4065-8e1b-9a5a8cdbe0ec req-e0a96200-a68c-4a92-9b20-27e184a021b0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:42.050659 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-293fb04a-317d-4065-8e1b-9a5a8cdbe0ec req-e0a96200-a68c-4a92-9b20-27e184a021b0 service nova] Creating event network-vif-plugged:2d001924-043a-4f1c-95a7-e43b5bfe4f93 for instance 9fec70db-d4c5-486a-89cf-15d5a41e95d0 on n-h2-861333-10 Oct 19 07:00:42.057359 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-293fb04a-317d-4065-8e1b-9a5a8cdbe0ec req-e0a96200-a68c-4a92-9b20-27e184a021b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096728 Oct 19 07:00:42.058959 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1438/2823] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:42.066557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dcb07536-407f-4c3a-921e-769c257b6ed6 tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] Action: 'create', calling method: .version_select at 0x7f6d640d68b0>, body: {"security_group": {"name": "tempest-securitygroup-1818407605", "description": "tempest-description-529644560"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:43.123316 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dcb07536-407f-4c3a-921e-769c257b6ed6 tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.062378 Oct 19 07:00:43.124421 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1439/2824] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:00:42 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:43.138898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b19f4ddc-a73e-4003-8d49-ae692c053077 req-29143d6e-1738-4c21-b558-398f9d295eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21a145d-a541-49b2-bdab-c4c8a86b77a8", "name": "network-vif-deleted", "tag": "ac067cf3-fdf0-4f63-8595-c03c413defcb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:43.188283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b19f4ddc-a73e-4003-8d49-ae692c053077 req-29143d6e-1738-4c21-b558-398f9d295eaf service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:43.192335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b19f4ddc-a73e-4003-8d49-ae692c053077 req-29143d6e-1738-4c21-b558-398f9d295eaf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:43.192335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b19f4ddc-a73e-4003-8d49-ae692c053077 req-29143d6e-1738-4c21-b558-398f9d295eaf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:43.217606 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b19f4ddc-a73e-4003-8d49-ae692c053077 req-29143d6e-1738-4c21-b558-398f9d295eaf service nova] Creating event network-vif-deleted:ac067cf3-fdf0-4f63-8595-c03c413defcb for instance c21a145d-a541-49b2-bdab-c4c8a86b77a8 on n-h2-861333-10 Oct 19 07:00:43.226650 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b19f4ddc-a73e-4003-8d49-ae692c053077 req-29143d6e-1738-4c21-b558-398f9d295eaf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100328 Oct 19 07:00:43.228074 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1440/2825] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:43.248026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:43.253514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:43.269079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:43.269832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:43.270473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:43.272223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:43.273164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:43.273881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:43.297186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:43.306665 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-88193f37-5ea8-4a34-857d-b0bd81332e6b tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 1.590938 Oct 19 07:00:43.320720 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1386/2826] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:41 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:43.333994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b30d159c-a390-4695-8bb4-1b3ebd7d4ab5 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64cfcf70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:43.388519 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b30d159c-a390-4695-8bb4-1b3ebd7d4ab5 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.066421 Oct 19 07:00:43.390461 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1387/2827] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:43 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:43.404374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:43.405257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:43.413400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:43.413989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:43.414511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:43.415458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:43.415985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:43.416534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:43.477160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:43.477160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:43.477160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:43.477160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lazy-loading 'fault' on Instance uuid c21a145d-a541-49b2-bdab-c4c8a86b77a8 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:43.477690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:43.477690 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98aefc58-cc7a-46b0-8f62-2e3177549793 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1318 microversion: 2.1 time: 0.218700 Oct 19 07:00:43.477690 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1441/2828] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:43 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:43.477690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:43.477690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:43.479557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:43.480409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:43.481143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:43.482069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:43.482677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:43.483312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:43.494195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042331c92e794909925dcfde9e576afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b63168bfe4941ac8e4fbf19ed21860e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:43.503546 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92711c7a-a142-48c9-949e-30d4057a8a93 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 200 len: 1309 microversion: 2.1 time: 0.111787 Oct 19 07:00:43.507572 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1388/2829] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:43 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:43.554632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:43.561586 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4533394a-3a80-4a1c-9513-946a08a4d204 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1274 microversion: 2.1 time: 0.098787 Oct 19 07:00:43.562527 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1442/2830] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:43 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:43.585332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db204729-93db-4f72-92ab-80088a0c1c3d tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Action: 'create', calling method: .version_select at 0x7f6d64010550>, body: {"security_group": {"name": "tempest-securitygroup-637354735", "description": "tempest-description-1370913859"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:44.088481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d4af7819-0a88-471f-9b8e-cf36c8a30547 req-1f567b52-242d-4304-9ca7-3736ddab0b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88ce10-b961-440c-b62d-0d55b1b6996c", "name": "network-vif-plugged", "status": "completed", "tag": "d016431f-949c-48dd-b7b6-18c3d910610b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:44.124717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4af7819-0a88-471f-9b8e-cf36c8a30547 req-1f567b52-242d-4304-9ca7-3736ddab0b84 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:44.125605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4af7819-0a88-471f-9b8e-cf36c8a30547 req-1f567b52-242d-4304-9ca7-3736ddab0b84 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:44.131958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4af7819-0a88-471f-9b8e-cf36c8a30547 req-1f567b52-242d-4304-9ca7-3736ddab0b84 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:44.183557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:44.186962 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d4af7819-0a88-471f-9b8e-cf36c8a30547 req-1f567b52-242d-4304-9ca7-3736ddab0b84 service nova] Creating event network-vif-plugged:d016431f-949c-48dd-b7b6-18c3d910610b for instance ef88ce10-b961-440c-b62d-0d55b1b6996c on n-h1-861333-10 Oct 19 07:00:44.247451 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d4af7819-0a88-471f-9b8e-cf36c8a30547 req-1f567b52-242d-4304-9ca7-3736ddab0b84 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149701 Oct 19 07:00:44.248665 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1443/2831] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:44.334952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:44.336027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:44.356732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:44.357792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:44.358484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:44.359472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:44.360442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:44.361123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:45.042267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:45.054973 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb82443e-04e9-4010-94ca-8af9b4fcc086 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.721098 Oct 19 07:00:45.056996 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1444/2832] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:44 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:45.062992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c475320-4c2c-4953-8f61-8fae835f9f3f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fbe0c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:45.170142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c475320-4c2c-4953-8f61-8fae835f9f3f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.113775 Oct 19 07:00:45.180390 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1445/2833] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:45 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:45.180390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:45.180579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:45.197284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:45.197877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:45.198322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:45.199030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:45.199494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:45.199982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:45.537768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:45.547129 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5289c44-bc7f-407d-9a1e-4c6a25cc078c tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1505 microversion: 2.1 time: 0.375387 Oct 19 07:00:45.549641 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1446/2834] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:45 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:45.577556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:45.580922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] [instance: c21a145d-a541-49b2-bdab-c4c8a86b77a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:45.591388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:45.594285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:45.597081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:45.598004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:45.600711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:45.601336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:45.636861 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] HTTP exception thrown: Instance c21a145d-a541-49b2-bdab-c4c8a86b77a8 could not be found. Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Request method failure captured: Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 HTTP/1.1 Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6BMFreqHVcU-DMpMAvTRWhnyx7p8C1tRRLNh_e3-ioSfnJj-dHo62iXFthvYZlEZ8rd27JdCDeCIJYJOVbB-6Ll-RV7rTAU4eM6smogxcOg5U9tZvimxMWFj7g6svGw8-i9n1sxg5fut_a_KO0_JnFRRrRqLXozg2g1gwPcWYvn3aQ Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4b63168bfe4941ac8e4fbf19ed21860e Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveMigrationNegativeTest-617667930 Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b63168bfe4941ac8e4fbf19ed21860e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b63168bfe4941ac8e4fbf19ed21860e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b63168bfe4941ac8e4fbf19ed21860e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b63168bfe4941ac8e4fbf19ed21860e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-LiveMigrationNegativeTest-617667930 Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4b63168bfe4941ac8e4fbf19ed21860e Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-617667930 Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-LiveMigrationNegativeTest-617667930-project Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 042331c92e794909925dcfde9e576afd Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-LiveMigrationNegativeTest-617667930-project Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance c21a145d-a541-49b2-bdab-c4c8a86b77a8 could not be found. Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c21a145d-a541-49b2-bdab-c4c8a86b77a8'} Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21a145d-a541-49b2-bdab-c4c8a86b77a8 could not be found. Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21a145d-a541-49b2-bdab-c4c8a86b77a8 could not be found. Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:45.640999 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:45.644546 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:45.644546 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:45.644546 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:45.644546 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:45.644546 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:45.644546 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21a145d-a541-49b2-bdab-c4c8a86b77a8 could not be found. Oct 19 07:00:45.644546 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:45.646687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] Returning 404 to user: Instance c21a145d-a541-49b2-bdab-c4c8a86b77a8 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:45.655622 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea65d6d1-8920-4e15-adc2-f34544d86cd5 tempest-LiveMigrationNegativeTest-617667930 tempest-LiveMigrationNegativeTest-617667930-project] 10.222.0.39 "GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8" status: 404 len: 111 microversion: 2.1 time: 0.094069 Oct 19 07:00:45.656914 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1447/2835] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:45 2022] GET /compute/v2.1/servers/c21a145d-a541-49b2-bdab-c4c8a86b77a8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:45.668548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:45.670231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:45.672657 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db204729-93db-4f72-92ab-80088a0c1c3d tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.166052 Oct 19 07:00:45.682528 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1389/2836] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:00:43 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:45.685539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:45.687651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:45.688181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:45.688320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: ef88ce10-b961-440c-b62d-0d55b1b6996c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:45.689633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:45.690370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:45.692307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:45.694167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:45.694884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:45.709602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:45.710125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:45.710579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:45.711309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:45.711776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:45.718952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:45.982148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:45.992666 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3a4034e-5d9e-4026-b1ab-847f130a56b6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1316 microversion: 2.1 time: 0.330389 Oct 19 07:00:45.993537 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1448/2837] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:45 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:46.000900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02c74e32-737a-4b99-b40d-9fe1fbaa6f7d tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Action: 'create', calling method: .version_select at 0x7f6d648519d0>, body: {"security_group": {"name": "tempest-securitygroup-595915549", "description": "tempest-description-1509954878"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:46.189942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:46.205436 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b296e9e7-236a-4844-8dfa-32939b6718aa tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c" status: 200 len: 1318 microversion: 2.1 time: 0.520940 Oct 19 07:00:46.206357 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1390/2838] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:45 2022] GET /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:46.216511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:46.218036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:46.241573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:46.242098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:46.242571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:46.243304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:46.243778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:46.244240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:46.747262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:46.855863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:47.181489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:47.203990 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7817d12e-6873-4345-a7be-a77061659ff9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.994886 Oct 19 07:00:47.226266 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1391/2839] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:46 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:47.242074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6e185b9-47b4-4477-a6d5-b777897d1193 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5faaaee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:47.343437 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02c74e32-737a-4b99-b40d-9fe1fbaa6f7d tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.347995 Oct 19 07:00:47.344589 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1449/2840] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:00:45 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:47.361423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:47.363448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:47.384894 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6e185b9-47b4-4477-a6d5-b777897d1193 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.162203 Oct 19 07:00:47.386560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:47.387070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:47.387501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:47.388256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:47.388711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:47.390190 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1392/2841] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:47 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:47.399066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:47.399295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:47.399295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: ef88ce10-b961-440c-b62d-0d55b1b6996c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:47.415385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:47.415890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:47.417012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:47.423090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:47.423614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:47.424055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:47.755354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:47.770666 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f2553da-778c-4a9e-b95b-733e422a6cec tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c" status: 200 len: 1505 microversion: 2.1 time: 0.378933 Oct 19 07:00:47.773610 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1393/2842] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:47 2022] GET /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:47.785070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Calling method '.version_select at 0x7f6d640771f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:47.889468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:47.928380 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03fb4067-214c-40eb-b199-c9dfeac60cc1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1316 microversion: 2.1 time: 0.573779 Oct 19 07:00:47.939717 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1450/2843] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:47 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:47.947856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:47.955491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: ef88ce10-b961-440c-b62d-0d55b1b6996c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:47.978863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:47.982230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:47.985344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:47.987893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:47.989783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:47.990254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:48.085491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: ef88ce10-b961-440c-b62d-0d55b1b6996c] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:00:48.531563 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9aaba08f-4805-476b-82f2-855e261fde4d tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c" status: 204 len: 0 microversion: 2.1 time: 0.592772 Oct 19 07:00:48.531563 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1451/2844] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:47 2022] DELETE /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:00:48.537978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:48.540047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:48.557517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:48.558427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:48.559073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:48.560594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:48.562270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:48.563054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:48.802547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=31 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:49.414293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:49.424008 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06d56e2b-c276-45f1-b561-79a1d9caa835 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.897100 Oct 19 07:00:49.440643 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1452/2845] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:48 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:49.449505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88463fc8-13c5-4235-a419-68434955726e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fb51160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:49.552518 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88463fc8-13c5-4235-a419-68434955726e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.110636 Oct 19 07:00:49.553893 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1453/2846] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:49 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:49.568231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:49.568989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:49.585339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:49.586065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:49.586696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:49.587770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:49.588455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:49.589061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:49.630183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:00:50.052824 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4576b062-bb08-45ed-9bad-20f8c8ab16d0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 204 len: 0 microversion: 2.1 time: 0.494574 Oct 19 07:00:50.053418 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1454/2847] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:49 2022] DELETE /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:00:50.058831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a1f79182-af2d-4614-87b8-fc1d4113f195 req-8f4a1ba1-f3b8-4d31-810d-88576b6af315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2a5047-f4a1-493a-9114-8cd7e5de3f90", "tag": "18569f14-d6ef-426c-aa3d-b8c900ea7d8f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:50.069967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a1f79182-af2d-4614-87b8-fc1d4113f195 req-8f4a1ba1-f3b8-4d31-810d-88576b6af315 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:50.070457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a1f79182-af2d-4614-87b8-fc1d4113f195 req-8f4a1ba1-f3b8-4d31-810d-88576b6af315 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:50.076621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a1f79182-af2d-4614-87b8-fc1d4113f195 req-8f4a1ba1-f3b8-4d31-810d-88576b6af315 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:50.121180 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a1f79182-af2d-4614-87b8-fc1d4113f195 req-8f4a1ba1-f3b8-4d31-810d-88576b6af315 service nova] Creating event network-changed:18569f14-d6ef-426c-aa3d-b8c900ea7d8f for instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 on n-h2-861333-10 Oct 19 07:00:50.138830 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a1f79182-af2d-4614-87b8-fc1d4113f195 req-8f4a1ba1-f3b8-4d31-810d-88576b6af315 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082170 Oct 19 07:00:50.143400 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1455/2848] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:50.155909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:50.156951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:50.170519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:50.178866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:50.185108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:50.188501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:50.189258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:50.189895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:50.715209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:50.738124 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-323fc7da-973d-43a9-b65e-ec2f817eb84a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1316 microversion: 2.1 time: 0.586367 Oct 19 07:00:50.743402 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1456/2849] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:50 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:50.964338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 99361189-a923-4d9a-96d4-c73647fe396a does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:00:50.965159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Neutron security group 99361189-a923-4d9a-96d4-c73647fe396a not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:00:50.965965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.security_groups [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Security Group ID 99361189-a923-4d9a-96d4-c73647fe396a does not exist {{(pid=127568) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 19 07:00:51.016682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 99361189-a923-4d9a-96d4-c73647fe396a does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:00:51.017295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Neutron security group 99361189-a923-4d9a-96d4-c73647fe396a not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:00:51.017732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.security_groups [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Security Group ID 99361189-a923-4d9a-96d4-c73647fe396a does not exist {{(pid=127568) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 19 07:00:51.059203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a06be5c9-e384-4617-b898-fdc1dad2ccf4 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:00:51.059816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Neutron security group a06be5c9-e384-4617-b898-fdc1dad2ccf4 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:00:51.060310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.security_groups [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Security Group ID a06be5c9-e384-4617-b898-fdc1dad2ccf4 does not exist {{(pid=127568) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 19 07:00:51.098843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a06be5c9-e384-4617-b898-fdc1dad2ccf4 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:00:51.099671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Neutron security group a06be5c9-e384-4617-b898-fdc1dad2ccf4 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:00:51.100446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.security_groups [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Security Group ID a06be5c9-e384-4617-b898-fdc1dad2ccf4 does not exist {{(pid=127568) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 19 07:00:51.390557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-721c22f9-8640-4e6e-8273-3188ef24fc5e tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d640d60d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-467759231", "description": "tempest-description-503464250"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:51.996638 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e747676-8272-41b0-88ca-e9f9050c535f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] 10.222.0.39 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8713 microversion: 2.1 time: 4.219432 Oct 19 07:00:51.997246 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1394/2850] 10.222.0.39 () {58 vars in 1191 bytes} [Wed Oct 19 07:00:47 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8713 bytes in 4221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:52.002751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:52.003379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: ef88ce10-b961-440c-b62d-0d55b1b6996c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:52.019062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:52.019613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:52.020068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:52.020832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:52.021296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:52.021734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:52.077285 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-721c22f9-8640-4e6e-8273-3188ef24fc5e tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.331866 Oct 19 07:00:52.077941 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1457/2851] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:00:50 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:52.083532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:52.084191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:52.114977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:52.115503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:52.115960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:52.116756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:52.117231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:52.117691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:52.128965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:52.140407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:52.140941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:52.141507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lazy-loading 'fault' on Instance uuid ef88ce10-b961-440c-b62d-0d55b1b6996c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:52.295010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:52.297272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:52.317555 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c91c9c05-54f7-4d77-b0e7-34d715ea8f25 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c" status: 200 len: 1308 microversion: 2.1 time: 0.319061 Oct 19 07:00:52.318285 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1395/2852] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:51 2022] GET /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:52.338965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38197041-dde9-4a9a-953e-4f233da0e838 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64628280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:52.410896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:52.416951 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38197041-dde9-4a9a-953e-4f233da0e838 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.081945 Oct 19 07:00:52.417533 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1396/2853] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:52 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:52.423812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e50ab0f0-6bab-4cc1-b4f1-eb107b17c3b2 req-b0f860c1-62ae-4205-a1b6-5d8c8d3bbefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956c30a-7b4a-477e-962c-9cea7dc3ce59", "name": "network-vif-plugged", "status": "completed", "tag": "32be3cfb-91f2-46f7-aec9-59f76cdf913a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:52.427787 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15dffd5e-187f-4f1c-ba1d-e43edbba59f1 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.348581 Oct 19 07:00:52.428643 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1458/2854] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:52 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:52.436392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e50ab0f0-6bab-4cc1-b4f1-eb107b17c3b2 req-b0f860c1-62ae-4205-a1b6-5d8c8d3bbefd service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:52.436929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e50ab0f0-6bab-4cc1-b4f1-eb107b17c3b2 req-b0f860c1-62ae-4205-a1b6-5d8c8d3bbefd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:52.437415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e50ab0f0-6bab-4cc1-b4f1-eb107b17c3b2 req-b0f860c1-62ae-4205-a1b6-5d8c8d3bbefd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:52.451602 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e50ab0f0-6bab-4cc1-b4f1-eb107b17c3b2 req-b0f860c1-62ae-4205-a1b6-5d8c8d3bbefd service nova] Creating event network-vif-plugged:32be3cfb-91f2-46f7-aec9-59f76cdf913a for instance 2956c30a-7b4a-477e-962c-9cea7dc3ce59 on n-h1-861333-10 Oct 19 07:00:52.456039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-65d78aa6-3c77-4b60-9e94-fea493e6ecce req-20a9b9fa-3254-40aa-b150-5502f6624c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88ce10-b961-440c-b62d-0d55b1b6996c", "name": "network-vif-deleted", "tag": "d016431f-949c-48dd-b7b6-18c3d910610b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:52.458986 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e50ab0f0-6bab-4cc1-b4f1-eb107b17c3b2 req-b0f860c1-62ae-4205-a1b6-5d8c8d3bbefd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039879 Oct 19 07:00:52.460084 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1397/2855] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:52.469123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:52.469828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-65d78aa6-3c77-4b60-9e94-fea493e6ecce req-20a9b9fa-3254-40aa-b150-5502f6624c47 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:52.470692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-65d78aa6-3c77-4b60-9e94-fea493e6ecce req-20a9b9fa-3254-40aa-b150-5502f6624c47 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:52.470981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:52.471529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-65d78aa6-3c77-4b60-9e94-fea493e6ecce req-20a9b9fa-3254-40aa-b150-5502f6624c47 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:52.484847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:52.485380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:52.485861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:52.487427 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-65d78aa6-3c77-4b60-9e94-fea493e6ecce req-20a9b9fa-3254-40aa-b150-5502f6624c47 service nova] Creating event network-vif-deleted:d016431f-949c-48dd-b7b6-18c3d910610b for instance ef88ce10-b961-440c-b62d-0d55b1b6996c on n-h1-861333-10 Oct 19 07:00:52.487865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:52.489965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:52.490607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:52.493242 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-65d78aa6-3c77-4b60-9e94-fea493e6ecce req-20a9b9fa-3254-40aa-b150-5502f6624c47 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047473 Oct 19 07:00:52.494357 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1459/2856] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:52.503209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-486bed85-a3bf-4996-a782-9fba1e4c121a tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] Calling method '.version_select at 0x7f6d5fb06f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:52.843736 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-486bed85-a3bf-4996-a782-9fba1e4c121a tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.347944 Oct 19 07:00:52.844647 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1460/2857] 10.222.0.39 () {58 vars in 1191 bytes} [Wed Oct 19 07:00:52 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:52.850200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2bb75b94-6fc5-4161-b4a2-44f21402f7a0 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d5fbbc790>, body: {"security_group_rule": {"parent_group_id": "18988fe8-ad83-4c50-9eee-419835f325c7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:52.995261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:53.003455 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67fb6ce2-8936-495c-97b0-813557168965 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1316 microversion: 2.1 time: 0.542167 Oct 19 07:00:53.008644 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1398/2858] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:52 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:53.036813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd271224-c7d0-44a7-9db4-a3b0e008b27f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Calling method '.version_select at 0x7f6d651c8670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:53.404961 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2bb75b94-6fc5-4161-b4a2-44f21402f7a0 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.557927 Oct 19 07:00:53.406907 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1461/2859] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:00:52 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:53.412879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:53.413883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: ef88ce10-b961-440c-b62d-0d55b1b6996c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:53.444903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:53.448689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:53.450382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:53.451533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:53.461069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:53.461760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:53.488534 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] HTTP exception thrown: Instance ef88ce10-b961-440c-b62d-0d55b1b6996c could not be found. Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Request method failure captured: Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c HTTP/1.1 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6BkspZXrW8U1-zUdMRn8wjplA8bLBefdAhBhgWwWlcIWgC36BHhV08U4kBlzjgOZj5el5SnWguUuLyFUXiz1RxqZYX9WdhRNhsfhy113PrNP4_eHPNIyyny6ctqqDt0uQfUMUPunoKw3hLx4bcHplAjkQZx9AGC-levlNyFgg7eEM4 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 5635c3d71ece423f811956a3c5b549c4 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-MultipleCreateTestJSON-115993314 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5635c3d71ece423f811956a3c5b549c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5635c3d71ece423f811956a3c5b549c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5635c3d71ece423f811956a3c5b549c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5635c3d71ece423f811956a3c5b549c4", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-MultipleCreateTestJSON-115993314 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 5635c3d71ece423f811956a3c5b549c4 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MultipleCreateTestJSON-115993314 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-MultipleCreateTestJSON-115993314-project Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 1d64c821b95f4122b1941b7a5223f0a4 Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-MultipleCreateTestJSON-115993314-project Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance ef88ce10-b961-440c-b62d-0d55b1b6996c could not be found. Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'ef88ce10-b961-440c-b62d-0d55b1b6996c'} Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef88ce10-b961-440c-b62d-0d55b1b6996c could not be found. Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef88ce10-b961-440c-b62d-0d55b1b6996c could not be found. Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:53.490695 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.494446 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:53.494446 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:53.494446 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:53.494446 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:53.494446 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:53.494446 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef88ce10-b961-440c-b62d-0d55b1b6996c could not be found. Oct 19 07:00:53.494446 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.497019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Returning 404 to user: Instance ef88ce10-b961-440c-b62d-0d55b1b6996c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:53.498158 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97b88bd5-be80-4036-b763-7c3ec58588e0 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c" status: 404 len: 111 microversion: 2.1 time: 0.089519 Oct 19 07:00:53.502453 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1462/2860] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:53 2022] GET /compute/v2.1/servers/ef88ce10-b961-440c-b62d-0d55b1b6996c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:53.508441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-99f7b23e-73b5-4850-a5f5-74553bdadfee tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d5fbbc0d0>, body: {"security_group_rule": {"parent_group_id": "18988fe8-ad83-4c50-9eee-419835f325c7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:53.577215 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-99f7b23e-73b5-4850-a5f5-74553bdadfee tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] HTTP exception thrown: This rule already exists in group 18988fe8-ad83-4c50-9eee-419835f325c7 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-99f7b23e-73b5-4850-a5f5-74553bdadfee tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Request method failure captured: Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 138 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6ChHDAz7i9vn4tiIQszt0zY1YVwJ2W854tB84QgJ3cx0lHLP50OqDU1xuu1FKcPFC7nVVRLQ9sD_d7vn3ri7JXBcGvyC83ywzDDwNFehj-lpY9rRic0YkNbnejzpbbOU56JN2ve829Wp_IQRrtgAgSb09ClWxUkp9jndRWwnSx5-zQ Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6887ac2f752c4fbe88fb79a850176376", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 84d43248b2804148a341b996211be841 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: {"security_group_rule": {"parent_group_id": "18988fe8-ad83-4c50-9eee-419835f325c7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: exception: This rule already exists in group 18988fe8-ad83-4c50-9eee-419835f325c7 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'security_group_rule': {'parent_group_id': '18988fe8-ad83-4c50-9eee-419835f325c7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 18988fe8-ad83-4c50-9eee-419835f325c7 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 18988fe8-ad83-4c50-9eee-419835f325c7 Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:53.594460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:53.598733 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:53.598733 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:53.598733 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 18988fe8-ad83-4c50-9eee-419835f325c7 Oct 19 07:00:53.598733 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:53.600453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-99f7b23e-73b5-4850-a5f5-74553bdadfee tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Returning 400 to user: This rule already exists in group 18988fe8-ad83-4c50-9eee-419835f325c7 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:53.601516 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-99f7b23e-73b5-4850-a5f5-74553bdadfee tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.097821 Oct 19 07:00:53.602502 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1463/2861] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:00:53 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:00:53.607733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2bba4dd-2356-4bec-8840-a157f46978e5 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d641f69d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:53.670852 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2bba4dd-2356-4bec-8840-a157f46978e5 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1451 microversion: 2.1 time: 0.067104 Oct 19 07:00:53.672788 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1464/2862] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:53 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1451 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:53.691111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:53.691111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:53.705652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:53.706541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:53.707203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:53.708172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:53.709217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:53.709932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:53.937162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:53.955335 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-075dc4d0-621f-474c-8e9f-b5d0aa53a461 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1324 microversion: 2.1 time: 0.280645 Oct 19 07:00:53.998520 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1465/2863] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:53 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:53.998520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:53.998520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:53.998520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:53.998520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:53.998520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:53.998520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:53.998520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:53.998520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:54.143367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:54.152870 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc7370c6-4b10-4706-87bb-d9caf4e33800 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1511 microversion: 2.1 time: 0.195856 Oct 19 07:00:54.153450 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1466/2864] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:53 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1511 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:54.324986 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd271224-c7d0-44a7-9db4-a3b0e008b27f tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/a9f6f93c-3bb4-42a0-94c4-71e3e2eaa3c8" status: 202 len: 0 microversion: 2.1 time: 1.315008 Oct 19 07:00:54.327643 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1399/2865] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:00:53 2022] DELETE /compute/v2.1/os-security-groups/a9f6f93c-3bb4-42a0-94c4-71e3e2eaa3c8 => generated 0 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:00:54.333425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c30d539c-4757-45b8-bbd4-ed900b6efbe2 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Calling method '.version_select at 0x7f6d6479b4c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:54.349376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-549804e6-d1d5-4a62-9679-9157d8c97b8a tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:54.354370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549804e6-d1d5-4a62-9679-9157d8c97b8a tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:54.356965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549804e6-d1d5-4a62-9679-9157d8c97b8a tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:54.357437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549804e6-d1d5-4a62-9679-9157d8c97b8a tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:54.358244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549804e6-d1d5-4a62-9679-9157d8c97b8a tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:54.361949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549804e6-d1d5-4a62-9679-9157d8c97b8a tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:54.365827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549804e6-d1d5-4a62-9679-9157d8c97b8a tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:54.408398 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-549804e6-d1d5-4a62-9679-9157d8c97b8a tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.253467 Oct 19 07:00:54.417436 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1467/2866] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 07:00:54 2022] GET /compute/v2.1/os-services => generated 949 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:54.426760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:54.427789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:54.443486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:54.444294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:54.444922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:54.445828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:54.454166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:54.454166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:54.486664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:00:54.770706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:54.780044 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0a51974-7dc3-45ab-9679-e1d11a1c0170 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1316 microversion: 2.1 time: 0.361091 Oct 19 07:00:54.781404 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1468/2867] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:54 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:54.786743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-843c823f-f2ff-42e3-b429-3a28c9848d97 tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] Calling method '.version_select at 0x7f6d64f013a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:55.027480 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c30d539c-4757-45b8-bbd4-ed900b6efbe2 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/9c6cc1ea-686e-47bf-bb0f-00ab76f2295f" status: 202 len: 0 microversion: 2.1 time: 0.698477 Oct 19 07:00:55.033251 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1400/2868] 10.222.0.39 () {58 vars in 1287 bytes} [Wed Oct 19 07:00:54 2022] DELETE /compute/v2.1/os-security-group-rules/9c6cc1ea-686e-47bf-bb0f-00ab76f2295f => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:00:55.039225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71da4636-ae36-4b0c-9b9d-c1214cafd502 tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:55.043690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71da4636-ae36-4b0c-9b9d-c1214cafd502 tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.044224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71da4636-ae36-4b0c-9b9d-c1214cafd502 tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.056491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71da4636-ae36-4b0c-9b9d-c1214cafd502 tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.056778 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-843c823f-f2ff-42e3-b429-3a28c9848d97 tempest-SecurityGroupsTestAdminJSON-492653039 tempest-SecurityGroupsTestAdminJSON-492653039-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/46775ae8-fb96-4860-bd52-cff1b6969367" status: 202 len: 0 microversion: 2.1 time: 0.270602 Oct 19 07:00:55.056778 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1469/2869] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:00:54 2022] DELETE /compute/v2.1/os-security-groups/46775ae8-fb96-4860-bd52-cff1b6969367 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:00:55.060896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71da4636-ae36-4b0c-9b9d-c1214cafd502 tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.061627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71da4636-ae36-4b0c-9b9d-c1214cafd502 tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.064294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71da4636-ae36-4b0c-9b9d-c1214cafd502 tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.065676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f840e29e-6ca5-4a34-8fe7-5a3e50c94306 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64905550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:55.096961 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71da4636-ae36-4b0c-9b9d-c1214cafd502 tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=n-d-861333-10" status: 200 len: 581 microversion: 2.1 time: 0.062334 Oct 19 07:00:55.097568 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1401/2870] 10.222.0.39 () {58 vars in 1174 bytes} [Wed Oct 19 07:00:55 2022] GET /compute/v2.1/os-services?host=n-d-861333-10 => generated 581 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:55.102298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-db6ee9bf-6d61-41e9-bc96-20cb1744a110 req-24b2eacf-841d-4c68-b6b7-232575750b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fec70db-d4c5-486a-89cf-15d5a41e95d0", "name": "network-vif-deleted", "tag": "2d001924-043a-4f1c-95a7-e43b5bfe4f93"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:55.113018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db6ee9bf-6d61-41e9-bc96-20cb1744a110 req-24b2eacf-841d-4c68-b6b7-232575750b60 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.113780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db6ee9bf-6d61-41e9-bc96-20cb1744a110 req-24b2eacf-841d-4c68-b6b7-232575750b60 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.114374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db6ee9bf-6d61-41e9-bc96-20cb1744a110 req-24b2eacf-841d-4c68-b6b7-232575750b60 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.129373 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-db6ee9bf-6d61-41e9-bc96-20cb1744a110 req-24b2eacf-841d-4c68-b6b7-232575750b60 service nova] Creating event network-vif-deleted:2d001924-043a-4f1c-95a7-e43b5bfe4f93 for instance 9fec70db-d4c5-486a-89cf-15d5a41e95d0 on n-h2-861333-10 Oct 19 07:00:55.134997 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-db6ee9bf-6d61-41e9-bc96-20cb1744a110 req-24b2eacf-841d-4c68-b6b7-232575750b60 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035998 Oct 19 07:00:55.136217 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1402/2871] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:55.143741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:55.144669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:55.151366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.152132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.153616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.153616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.153789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.154150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.179142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f840e29e-6ca5-4a34-8fe7-5a3e50c94306 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1460 microversion: 2.1 time: 0.121904 Oct 19 07:00:55.194013 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1470/2872] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:55 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1460 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:55.201842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2ae5dad-9f69-4f16-8fb1-b4ca5109bbf8 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d640d61f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-801248749", "description": "tempest-description-1864370918"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:55.405079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:55.419533 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79517869-33bf-45ae-ac7d-b3529318f2e4 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1519 microversion: 2.1 time: 0.281793 Oct 19 07:00:55.433982 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1403/2873] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:55 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1519 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:55.452486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60295467-1003-4628-83a4-0fe3ecdd912b tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] Calling method '.version_select at 0x7f6d645d3e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:55.682071 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2ae5dad-9f69-4f16-8fb1-b4ca5109bbf8 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.485033 Oct 19 07:00:55.688158 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1471/2874] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:00:55 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:55.688158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8712e8f-d7ba-4fef-8835-989e12c5efdd tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:55.698460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8712e8f-d7ba-4fef-8835-989e12c5efdd tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.699080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8712e8f-d7ba-4fef-8835-989e12c5efdd tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.699643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8712e8f-d7ba-4fef-8835-989e12c5efdd tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.700751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8712e8f-d7ba-4fef-8835-989e12c5efdd tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.701321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8712e8f-d7ba-4fef-8835-989e12c5efdd tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.706925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8712e8f-d7ba-4fef-8835-989e12c5efdd tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.728743 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8712e8f-d7ba-4fef-8835-989e12c5efdd tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.044283 Oct 19 07:00:55.737185 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1472/2875] 10.222.0.39 () {58 vars in 1176 bytes} [Wed Oct 19 07:00:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:55.743525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:55.744386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:55.751230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.752445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.752893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.753761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.754254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.754685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.800010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.800878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.801326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.801779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lazy-loading 'fault' on Instance uuid 9fec70db-d4c5-486a-89cf-15d5a41e95d0 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:00:55.836596 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60295467-1003-4628-83a4-0fe3ecdd912b tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/cdd85aed-1fce-4f9f-8574-5a73779ce85a" status: 202 len: 0 microversion: 2.1 time: 0.400799 Oct 19 07:00:55.837132 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1404/2876] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:00:55 2022] DELETE /compute/v2.1/os-security-groups/cdd85aed-1fce-4f9f-8574-5a73779ce85a => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:00:55.849789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf33ede1-9fef-4447-a7d2-02647bfa2c5b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d6479b4c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:55.859596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d64c821b95f4122b1941b7a5223f0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5635c3d71ece423f811956a3c5b549c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:55.887249 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1041b99-11ed-4db9-bf95-b47f898f9968 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 200 len: 1308 microversion: 2.1 time: 0.140018 Oct 19 07:00:55.893093 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1473/2877] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:55 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:55.898303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8f9a2474-369b-435b-8dbf-db3066ba783d req-c6e9dc43-a813-457d-92a2-b8faf2165cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2a5047-f4a1-493a-9114-8cd7e5de3f90", "name": "network-vif-plugged", "status": "completed", "tag": "18569f14-d6ef-426c-aa3d-b8c900ea7d8f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:55.910148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8f9a2474-369b-435b-8dbf-db3066ba783d req-c6e9dc43-a813-457d-92a2-b8faf2165cee service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.910633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8f9a2474-369b-435b-8dbf-db3066ba783d req-c6e9dc43-a813-457d-92a2-b8faf2165cee service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.911070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8f9a2474-369b-435b-8dbf-db3066ba783d req-c6e9dc43-a813-457d-92a2-b8faf2165cee service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.926643 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8f9a2474-369b-435b-8dbf-db3066ba783d req-c6e9dc43-a813-457d-92a2-b8faf2165cee service nova] Creating event network-vif-plugged:18569f14-d6ef-426c-aa3d-b8c900ea7d8f for instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 on n-h2-861333-10 Oct 19 07:00:55.932226 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8f9a2474-369b-435b-8dbf-db3066ba783d req-c6e9dc43-a813-457d-92a2-b8faf2165cee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037555 Oct 19 07:00:55.932839 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1474/2878] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:55.936088 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf33ede1-9fef-4447-a7d2-02647bfa2c5b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 200 len: 1460 microversion: 2.1 time: 0.093196 Oct 19 07:00:55.936728 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1405/2879] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:55 2022] GET /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 1460 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:55.940259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-244d1bfd-008f-49c3-8a7a-758f2ebe7127 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1122264605", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-244d1bfd-008f-49c3-8a7a-758f2ebe7127 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Request method failure captured: Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 243 Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CFfFAuG2qPP5foWuggG7X30bMJfUoZYtx_7Jd30L3ya2A1GgBItiltAkH2lOgAIbmAGdhG2oyuY7V2Xjtht9Ry8BaONpVJdGvHYdz2nOMGPG6EiewsXyTOGXy6kecVLPOqG5UDVlRAQMj3xXlA0QmIm3JNYfoMEwjWOEGZg5RKAvY Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9816fcfed2354664a054e1b3e146019c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 185d0e907b2e4c75916459859c5c8c22 Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1122264605", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1122264605', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '818fb9ba-07b2-4d4a-b733-3d665dc25aa2'}]}}} Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:55.947287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-244d1bfd-008f-49c3-8a7a-758f2ebe7127 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:55.960830 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-244d1bfd-008f-49c3-8a7a-758f2ebe7127 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.014870 Oct 19 07:00:55.964561 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1475/2880] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:00:55 2022] POST /compute/v2.1/servers => generated 175 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:00:55.971793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f53501d-5f5c-41bc-a318-5da892e7cdfe tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:55.975163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-336bdef6-1ae4-48c9-a2c4-ab8259aafc2e tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d645d3430>, body: {"security_group_rule": {"parent_group_id": "383bade6-bd8f-4a83-80b5-d2c3fe54c8b6", "ip_protocol": "tcp", "from_port": 1378638283, "to_port": 22}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:55.990842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f53501d-5f5c-41bc-a318-5da892e7cdfe tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.990842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f53501d-5f5c-41bc-a318-5da892e7cdfe tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.990842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f53501d-5f5c-41bc-a318-5da892e7cdfe tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:55.990842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f53501d-5f5c-41bc-a318-5da892e7cdfe tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:55.990842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f53501d-5f5c-41bc-a318-5da892e7cdfe tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:55.990842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f53501d-5f5c-41bc-a318-5da892e7cdfe tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:56.013265 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f53501d-5f5c-41bc-a318-5da892e7cdfe tempest-ServicesAdminTestJSON-1665424303 tempest-ServicesAdminTestJSON-1665424303-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.046714 Oct 19 07:00:56.014598 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1476/2881] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 07:00:55 2022] GET /compute/v2.1/os-services => generated 949 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:56.027356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:56.028850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:56.042148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:56.047197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:56.047197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:56.047197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:56.047197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:56.047197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:56.209666 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-336bdef6-1ae4-48c9-a2c4-ab8259aafc2e tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] HTTP exception thrown: Invalid port range 1378638283:22. Former value cannot be greater than the later Oct 19 07:00:56.213867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-336bdef6-1ae4-48c9-a2c4-ab8259aafc2e tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Request method failure captured: Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 146 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6ChHDAz7i9vn4tiIQszt0zY1YVwJ2W854tB84QgJ3cx0lHLP50OqDU1xuu1FKcPFC7nVVRLQ9sD_d7vn3ri7JXBcGvyC83ywzDDwNFehj-lpY9rRic0YkNbnejzpbbOU56JN2ve829Wp_IQRrtgAgSb09ClWxUkp9jndRWwnSx5-zQ Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6887ac2f752c4fbe88fb79a850176376", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 84d43248b2804148a341b996211be841 Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: {"security_group_rule": {"parent_group_id": "383bade6-bd8f-4a83-80b5-d2c3fe54c8b6", "ip_protocol": "tcp", "from_port": 1378638283, "to_port": 22}} Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid port range 1378638283:22. Former value cannot be greater than the later Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'security_group_rule': {'parent_group_id': '383bade6-bd8f-4a83-80b5-d2c3fe54c8b6', 'ip_protocol': 'tcp', 'from_port': 1378638283, 'to_port': 22}}} Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1378638283:22. Former value cannot be greater than the later Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1378638283:22. Former value cannot be greater than the later Oct 19 07:00:56.216630 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.221321 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:56.221321 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.221321 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:56.221321 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:56.221321 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:56.221321 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:56.221321 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:56.221321 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1378638283:22. Former value cannot be greater than the later Oct 19 07:00:56.221321 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.224267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-336bdef6-1ae4-48c9-a2c4-ab8259aafc2e tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Returning 400 to user: Invalid port range 1378638283:22. Former value cannot be greater than the later {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:56.226141 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b80faf67-e45b-4577-8276-6ae837edc50f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1316 microversion: 2.1 time: 0.210242 Oct 19 07:00:56.227652 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-336bdef6-1ae4-48c9-a2c4-ab8259aafc2e tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.289892 Oct 19 07:00:56.237378 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1406/2882] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:00:55 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:00:56.240593 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1477/2883] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:56 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:56.248655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:56.249492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:56.253223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5c1c1f8-6cc1-4312-a641-aa1bc7baf301 tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] Calling method '.version_select at 0x7f6d6483c160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:56.256509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:56.257206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:56.257808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:56.258677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:56.259297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:56.259885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:56.430590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:56.438331 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a9b04c5-9d15-4fd4-88b8-9f7672ab8ce2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1468 microversion: 2.1 time: 0.196640 Oct 19 07:00:56.438930 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1478/2884] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:56 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:56.444004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-777624ec-d5f7-4c2f-a19f-90f4095843a6 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:56.444722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-777624ec-d5f7-4c2f-a19f-90f4095843a6 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 5ee6fa96-3d72-48c8-af51-ed9ef68a5817] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:56.450440 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-777624ec-d5f7-4c2f-a19f-90f4095843a6 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] HTTP exception thrown: Instance 5ee6fa96-3d72-48c8-af51-ed9ef68a5817 could not be found. Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-777624ec-d5f7-4c2f-a19f-90f4095843a6 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Request method failure captured: Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/5ee6fa96-3d72-48c8-af51-ed9ef68a5817/metadata HTTP/1.1 Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CFfFAuG2qPP5foWuggG7X30bMJfUoZYtx_7Jd30L3ya2A1GgBItiltAkH2lOgAIbmAGdhG2oyuY7V2Xjtht9Ry8BaONpVJdGvHYdz2nOMGPG6EiewsXyTOGXy6kecVLPOqG5UDVlRAQMj3xXlA0QmIm3JNYfoMEwjWOEGZg5RKAvY Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9816fcfed2354664a054e1b3e146019c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 185d0e907b2e4c75916459859c5c8c22 Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 5ee6fa96-3d72-48c8-af51-ed9ef68a5817 could not be found. Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': '5ee6fa96-3d72-48c8-af51-ed9ef68a5817'} Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee6fa96-3d72-48c8-af51-ed9ef68a5817 could not be found. Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee6fa96-3d72-48c8-af51-ed9ef68a5817 could not be found. Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:56.452841 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:56.457759 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:56.457759 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:56.457759 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee6fa96-3d72-48c8-af51-ed9ef68a5817 could not be found. Oct 19 07:00:56.457759 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.457759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-777624ec-d5f7-4c2f-a19f-90f4095843a6 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Returning 404 to user: Instance 5ee6fa96-3d72-48c8-af51-ed9ef68a5817 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:56.458544 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-777624ec-d5f7-4c2f-a19f-90f4095843a6 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee6fa96-3d72-48c8-af51-ed9ef68a5817/metadata" status: 404 len: 111 microversion: 2.1 time: 0.018436 Oct 19 07:00:56.459144 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1479/2885] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 07:00:56 2022] GET /compute/v2.1/servers/5ee6fa96-3d72-48c8-af51-ed9ef68a5817/metadata => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:56.464792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc3ecfa5-8d60-4cfd-b8ba-12fd30b05fcf tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d5fb51040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1618902324", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:56.468159 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-fc3ecfa5-8d60-4cfd-b8ba-12fd30b05fcf tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] HTTP exception thrown: Security group id should be uuid Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc3ecfa5-8d60-4cfd-b8ba-12fd30b05fcf tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Request method failure captured: Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 131 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6ChHDAz7i9vn4tiIQszt0zY1YVwJ2W854tB84QgJ3cx0lHLP50OqDU1xuu1FKcPFC7nVVRLQ9sD_d7vn3ri7JXBcGvyC83ywzDDwNFehj-lpY9rRic0YkNbnejzpbbOU56JN2ve829Wp_IQRrtgAgSb09ClWxUkp9jndRWwnSx5-zQ Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6887ac2f752c4fbe88fb79a850176376", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 84d43248b2804148a341b996211be841 Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1618902324", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: exception: Security group id should be uuid Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1618902324', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:56.468807 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:56.473251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 19 07:00:56.473251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:56.473251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc3ecfa5-8d60-4cfd-b8ba-12fd30b05fcf tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Returning 400 to user: Security group id should be uuid {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:56.473251 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc3ecfa5-8d60-4cfd-b8ba-12fd30b05fcf tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009304 Oct 19 07:00:56.473251 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1480/2886] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:00:56 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 07:00:56.478533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38a5b011-1c7f-486e-afb8-0b2bcc9a776c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1911893016"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:56.494414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38a5b011-1c7f-486e-afb8-0b2bcc9a776c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:56.507038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38a5b011-1c7f-486e-afb8-0b2bcc9a776c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:56.507537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38a5b011-1c7f-486e-afb8-0b2bcc9a776c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:56.507975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38a5b011-1c7f-486e-afb8-0b2bcc9a776c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:56.516802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38a5b011-1c7f-486e-afb8-0b2bcc9a776c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:56.517853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38a5b011-1c7f-486e-afb8-0b2bcc9a776c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:56.520264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38a5b011-1c7f-486e-afb8-0b2bcc9a776c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:57.034909 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38a5b011-1c7f-486e-afb8-0b2bcc9a776c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "POST /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f/action" status: 202 len: 0 microversion: 2.1 time: 0.562127 Oct 19 07:00:57.044997 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1481/2887] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:00:56 2022] POST /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 07:00:57.058391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6416a4a6-5f75-4d91-a6d5-43423fec4e4c tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d5fbbcc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1645939841", "description": "tempest-description-1502418401"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:57.150257 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5c1c1f8-6cc1-4312-a641-aa1bc7baf301 tempest-SecurityGroupsTestAdminJSON-1129759787 tempest-SecurityGroupsTestAdminJSON-1129759787-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/03ae5d73-7b6f-4456-a942-8e1e2498a3db" status: 202 len: 0 microversion: 2.1 time: 0.910094 Oct 19 07:00:57.152218 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1407/2888] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:00:56 2022] DELETE /compute/v2.1/os-security-groups/03ae5d73-7b6f-4456-a942-8e1e2498a3db => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:00:57.179393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c41384c-229e-4ca4-98c6-e7cc9e4ea882 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-108716150", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c41384c-229e-4ca4-98c6-e7cc9e4ea882 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Request method failure captured: Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 498 Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6CFfFAuG2qPP5foWuggG7X30bMJfUoZYtx_7Jd30L3ya2A1GgBItiltAkH2lOgAIbmAGdhG2oyuY7V2Xjtht9Ry8BaONpVJdGvHYdz2nOMGPG6EiewsXyTOGXy6kecVLPOqG5UDVlRAQMj3xXlA0QmIm3JNYfoMEwjWOEGZg5RKAvY Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9816fcfed2354664a054e1b3e146019c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 185d0e907b2e4c75916459859c5c8c22 Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-108716150", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-108716150', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '818fb9ba-07b2-4d4a-b733-3d665dc25aa2'}]}}} Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 07:00:57.200654 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.204027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.209665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c41384c-229e-4ca4-98c6-e7cc9e4ea882 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:57.209665 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c41384c-229e-4ca4-98c6-e7cc9e4ea882 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.052222 Oct 19 07:00:57.229524 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1408/2889] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:00:57 2022] POST /compute/v2.1/servers => generated 687 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:00:57.242414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:57.242414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] [instance: 9fec70db-d4c5-486a-89cf-15d5a41e95d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:57.258328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:57.260726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:57.261214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:57.261967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:57.265143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:57.265143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:57.305965 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] HTTP exception thrown: Instance 9fec70db-d4c5-486a-89cf-15d5a41e95d0 could not be found. Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Request method failure captured: Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 HTTP/1.1 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6BkspZXrW8U1-zUdMRn8wjplA8bLBefdAhBhgWwWlcIWgC36BHhV08U4kBlzjgOZj5el5SnWguUuLyFUXiz1RxqZYX9WdhRNhsfhy113PrNP4_eHPNIyyny6ctqqDt0uQfUMUPunoKw3hLx4bcHplAjkQZx9AGC-levlNyFgg7eEM4 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 5635c3d71ece423f811956a3c5b549c4 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-MultipleCreateTestJSON-115993314 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5635c3d71ece423f811956a3c5b549c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5635c3d71ece423f811956a3c5b549c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5635c3d71ece423f811956a3c5b549c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5635c3d71ece423f811956a3c5b549c4", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-MultipleCreateTestJSON-115993314 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 5635c3d71ece423f811956a3c5b549c4 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MultipleCreateTestJSON-115993314 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-MultipleCreateTestJSON-115993314-project Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1d64c821b95f4122b1941b7a5223f0a4 Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-MultipleCreateTestJSON-115993314-project Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 9fec70db-d4c5-486a-89cf-15d5a41e95d0 could not be found. Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9fec70db-d4c5-486a-89cf-15d5a41e95d0'} Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fec70db-d4c5-486a-89cf-15d5a41e95d0 could not be found. Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fec70db-d4c5-486a-89cf-15d5a41e95d0 could not be found. Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.313794 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.318857 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.318857 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.318857 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.318857 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:57.318857 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:57.318857 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fec70db-d4c5-486a-89cf-15d5a41e95d0 could not be found. Oct 19 07:00:57.318857 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.322929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] Returning 404 to user: Instance 9fec70db-d4c5-486a-89cf-15d5a41e95d0 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:57.326145 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ccb62df9-9677-4a3d-9a66-1179f7b78876 tempest-MultipleCreateTestJSON-115993314 tempest-MultipleCreateTestJSON-115993314-project] 10.222.0.39 "GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0" status: 404 len: 111 microversion: 2.1 time: 0.093781 Oct 19 07:00:57.326741 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1409/2890] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:57 2022] GET /compute/v2.1/servers/9fec70db-d4c5-486a-89cf-15d5a41e95d0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:57.347898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f101d35e-1f6a-4044-8f21-0c1b2031f56f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64cfc940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:57.443298 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f101d35e-1f6a-4044-8f21-0c1b2031f56f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.115427 Oct 19 07:00:57.446331 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1410/2891] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:57 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:57.451603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:57.452991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:57.461354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:57.462806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:57.463465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:57.464952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:57.465586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:57.466665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:57.676956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:57.685857 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2cbd0e02-938a-4357-8623-e080ced089d0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1316 microversion: 2.1 time: 0.238444 Oct 19 07:00:57.687228 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1411/2892] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:57 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:57.706902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e81ebd48-dddf-4b9a-975b-11262927ebc2 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2097199032", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e81ebd48-dddf-4b9a-975b-11262927ebc2 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Request method failure captured: Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 500 Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6CFfFAuG2qPP5foWuggG7X30bMJfUoZYtx_7Jd30L3ya2A1GgBItiltAkH2lOgAIbmAGdhG2oyuY7V2Xjtht9Ry8BaONpVJdGvHYdz2nOMGPG6EiewsXyTOGXy6kecVLPOqG5UDVlRAQMj3xXlA0QmIm3JNYfoMEwjWOEGZg5RKAvY Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9816fcfed2354664a054e1b3e146019c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 185d0e907b2e4c75916459859c5c8c22 Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2097199032", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2097199032', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '818fb9ba-07b2-4d4a-b733-3d665dc25aa2'}]}}} Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 07:00:57.714931 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e81ebd48-dddf-4b9a-975b-11262927ebc2 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e81ebd48-dddf-4b9a-975b-11262927ebc2 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.029652 Oct 19 07:00:57.733672 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1412/2893] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:00:57 2022] POST /compute/v2.1/servers => generated 689 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:00:57.799232 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6416a4a6-5f75-4d91-a6d5-43423fec4e4c tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.752133 Oct 19 07:00:57.802610 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1482/2894] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:00:57 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:57.814028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5065115-5ed2-4acf-a99c-798089578309 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d6483c550>, body: {"security_group_rule": {"parent_group_id": "47c1a49e-dcac-48b4-835f-3675f642e7bf", "ip_protocol": "tempest-999-1216301556", "from_port": 22, "to_port": 22}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:57.967801 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b5065115-5ed2-4acf-a99c-798089578309 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] HTTP exception thrown: Invalid IP protocol tempest-999-1216301556. Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5065115-5ed2-4acf-a99c-798089578309 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Request method failure captured: Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 157 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6ChHDAz7i9vn4tiIQszt0zY1YVwJ2W854tB84QgJ3cx0lHLP50OqDU1xuu1FKcPFC7nVVRLQ9sD_d7vn3ri7JXBcGvyC83ywzDDwNFehj-lpY9rRic0YkNbnejzpbbOU56JN2ve829Wp_IQRrtgAgSb09ClWxUkp9jndRWwnSx5-zQ Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6887ac2f752c4fbe88fb79a850176376", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 84d43248b2804148a341b996211be841 Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: {"security_group_rule": {"parent_group_id": "47c1a49e-dcac-48b4-835f-3675f642e7bf", "ip_protocol": "tempest-999-1216301556", "from_port": 22, "to_port": 22}} Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid IP protocol tempest-999-1216301556. Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'security_group_rule': {'parent_group_id': '47c1a49e-dcac-48b4-835f-3675f642e7bf', 'ip_protocol': 'tempest-999-1216301556', 'from_port': 22, 'to_port': 22}}} Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1216301556. Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1216301556. Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.969470 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1216301556. Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5065115-5ed2-4acf-a99c-798089578309 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Returning 400 to user: Invalid IP protocol tempest-999-1216301556. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5065115-5ed2-4acf-a99c-798089578309 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.162377 Oct 19 07:00:57.974418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1413/2895] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:00:57 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 07:00:57.984009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fefb7367-d44c-4880-beb0-a95fa6415c61 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d5fbfddc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-25865828", "description": "tempest-description-1212399737"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:57.986323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c337fe7a-46d5-41d5-a6a8-c1a0f4f0412d tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-658507282", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c337fe7a-46d5-41d5-a6a8-c1a0f4f0412d tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Request method failure captured: Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 753 Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6CFfFAuG2qPP5foWuggG7X30bMJfUoZYtx_7Jd30L3ya2A1GgBItiltAkH2lOgAIbmAGdhG2oyuY7V2Xjtht9Ry8BaONpVJdGvHYdz2nOMGPG6EiewsXyTOGXy6kecVLPOqG5UDVlRAQMj3xXlA0QmIm3JNYfoMEwjWOEGZg5RKAvY Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9816fcfed2354664a054e1b3e146019c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 185d0e907b2e4c75916459859c5c8c22 Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-658507282", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-658507282', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '818fb9ba-07b2-4d4a-b733-3d665dc25aa2'}]}}} Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:00:57.991456 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:00:57.994308 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:00:57.996933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:57.996933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:57.996933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c337fe7a-46d5-41d5-a6a8-c1a0f4f0412d tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:57.997174 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c337fe7a-46d5-41d5-a6a8-c1a0f4f0412d tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.014864 Oct 19 07:00:58.002229 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1414/2896] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:00:57 2022] POST /compute/v2.1/servers => generated 1197 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 19 07:00:58.307178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4c210da-9e20-4385-a73e-9f7fd125b956 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1001002310", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4c210da-9e20-4385-a73e-9f7fd125b956 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Request method failure captured: Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 1266 Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6CFfFAuG2qPP5foWuggG7X30bMJfUoZYtx_7Jd30L3ya2A1GgBItiltAkH2lOgAIbmAGdhG2oyuY7V2Xjtht9Ry8BaONpVJdGvHYdz2nOMGPG6EiewsXyTOGXy6kecVLPOqG5UDVlRAQMj3xXlA0QmIm3JNYfoMEwjWOEGZg5RKAvY Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9816fcfed2354664a054e1b3e146019c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 185d0e907b2e4c75916459859c5c8c22 Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1001002310", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "818fb9ba-07b2-4d4a-b733-3d665dc25aa2"}]}} Oct 19 07:00:58.311758 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1001002310', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '818fb9ba-07b2-4d4a-b733-3d665dc25aa2'}]}}} Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.314776 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:00:58.316051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:00:58.317833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 07:00:58.317833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.317833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4c210da-9e20-4385-a73e-9f7fd125b956 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:58.317833 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4c210da-9e20-4385-a73e-9f7fd125b956 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010329 Oct 19 07:00:58.317833 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1415/2897] 10.222.0.39 () {60 vars in 1148 bytes} [Wed Oct 19 07:00:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 19 07:00:58.328806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06807a96-b4dc-4929-ae30-f9f88de3dd6c tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:58.330656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06807a96-b4dc-4929-ae30-f9f88de3dd6c tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 9edf0dea-1acb-4198-943a-461536b8c37d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:58.339371 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-06807a96-b4dc-4929-ae30-f9f88de3dd6c tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] HTTP exception thrown: Instance 9edf0dea-1acb-4198-943a-461536b8c37d could not be found. Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06807a96-b4dc-4929-ae30-f9f88de3dd6c tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Request method failure captured: Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/9edf0dea-1acb-4198-943a-461536b8c37d/metadata/test2 HTTP/1.1 Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6CFfFAuG2qPP5foWuggG7X30bMJfUoZYtx_7Jd30L3ya2A1GgBItiltAkH2lOgAIbmAGdhG2oyuY7V2Xjtht9Ry8BaONpVJdGvHYdz2nOMGPG6EiewsXyTOGXy6kecVLPOqG5UDVlRAQMj3xXlA0QmIm3JNYfoMEwjWOEGZg5RKAvY Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9816fcfed2354664a054e1b3e146019c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 185d0e907b2e4c75916459859c5c8c22 Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 9edf0dea-1acb-4198-943a-461536b8c37d could not be found. Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'server_id': '9edf0dea-1acb-4198-943a-461536b8c37d', 'id': 'test2'} Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9edf0dea-1acb-4198-943a-461536b8c37d could not be found. Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9edf0dea-1acb-4198-943a-461536b8c37d could not be found. Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:58.341802 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:58.347335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:58.347335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:58.347335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9edf0dea-1acb-4198-943a-461536b8c37d could not be found. Oct 19 07:00:58.347335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.349082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06807a96-b4dc-4929-ae30-f9f88de3dd6c tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Returning 404 to user: Instance 9edf0dea-1acb-4198-943a-461536b8c37d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:58.350234 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06807a96-b4dc-4929-ae30-f9f88de3dd6c tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/9edf0dea-1acb-4198-943a-461536b8c37d/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.025373 Oct 19 07:00:58.360476 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1416/2898] 10.222.0.39 () {58 vars in 1281 bytes} [Wed Oct 19 07:00:58 2022] GET /compute/v2.1/servers/9edf0dea-1acb-4198-943a-461536b8c37d/metadata/test2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:00:58.369344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:58.370111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:58.379361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:58.380213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:58.380851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:58.381894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:58.382533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:58.382967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:58.416261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:00:58.587960 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fefb7367-d44c-4880-beb0-a95fa6415c61 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.609694 Oct 19 07:00:58.590297 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1483/2899] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:00:57 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:58.599448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-072cb91e-ed22-4bb6-846a-9b258f83b9ca tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64aa2c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:58.678661 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-072cb91e-ed22-4bb6-846a-9b258f83b9ca tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.086059 Oct 19 07:00:58.688650 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1484/2900] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:58 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:58.701967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d82d1e9-7594-4e16-acde-1a07d1294ddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d648969d0>, body: {"security_group_rule": {"parent_group_id": "39d07317-dfa1-475b-8311-4cf2741347fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:58.810260 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-524717e4-288b-4c72-9e8a-cde5fa5997bc tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 204 len: 0 microversion: 2.1 time: 0.444337 Oct 19 07:00:58.810921 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1417/2901] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:00:58 2022] DELETE /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:00:58.818399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:58.818399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:58.840076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:58.843644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:58.844222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:58.846188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:58.847847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:58.848342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:58.904421 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3d82d1e9-7594-4e16-acde-1a07d1294ddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d82d1e9-7594-4e16-acde-1a07d1294ddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Request method failure captured: Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 138 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6ChHDAz7i9vn4tiIQszt0zY1YVwJ2W854tB84QgJ3cx0lHLP50OqDU1xuu1FKcPFC7nVVRLQ9sD_d7vn3ri7JXBcGvyC83ywzDDwNFehj-lpY9rRic0YkNbnejzpbbOU56JN2ve829Wp_IQRrtgAgSb09ClWxUkp9jndRWwnSx5-zQ Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6887ac2f752c4fbe88fb79a850176376", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 84d43248b2804148a341b996211be841 Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: {"security_group_rule": {"parent_group_id": "39d07317-dfa1-475b-8311-4cf2741347fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'security_group_rule': {'parent_group_id': '39d07317-dfa1-475b-8311-4cf2741347fe', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 07:00:58.906275 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d82d1e9-7594-4e16-acde-1a07d1294ddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:00:58.910562 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d82d1e9-7594-4e16-acde-1a07d1294ddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.215856 Oct 19 07:00:58.913042 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1485/2902] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:00:58 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:00:58.921541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:58.924067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:58.935176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:58.935902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:58.936595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:58.937732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:58.938512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:58.939686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:59.266345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:59.275250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0280af6a-353b-4ee8-a870-707a61e37651 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1466 microversion: 2.1 time: 0.463111 Oct 19 07:00:59.281401 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1418/2903] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:58 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1466 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:59.296754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-789920a1-a022-4153-b826-bb32e56de403 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d647815e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-969308276", "description": "tempest-description-1667316289"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:59.405872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:00:59.418730 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c0a11bb-a785-46ad-8338-475ec3dc65be tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1525 microversion: 2.1 time: 0.503955 Oct 19 07:00:59.419817 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1486/2904] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:58 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1525 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:59.425735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ee0444f-f4f0-45ce-ac15-ea45d8808055 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:00:59.428835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ee0444f-f4f0-45ce-ac15-ea45d8808055 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:00:59.433688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ee0444f-f4f0-45ce-ac15-ea45d8808055 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:59.433688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ee0444f-f4f0-45ce-ac15-ea45d8808055 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:59.434126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ee0444f-f4f0-45ce-ac15-ea45d8808055 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:59.435450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ee0444f-f4f0-45ce-ac15-ea45d8808055 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:59.436259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ee0444f-f4f0-45ce-ac15-ea45d8808055 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:59.436786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ee0444f-f4f0-45ce-ac15-ea45d8808055 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:59.795188 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ee0444f-f4f0-45ce-ac15-ea45d8808055 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1619 microversion: 2.1 time: 0.373995 Oct 19 07:00:59.803299 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1487/2905] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:00:59 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1619 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:00:59.824457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0b9a5f83-0079-462f-b3a2-34c11f11fa82 req-b1ff5d70-f407-44aa-8a02-8d678c6c9a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c", "name": "network-vif-unplugged", "status": "completed", "tag": "e9ea764b-95e8-4aeb-ae74-818b2898ceb8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:00:59.860378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b9a5f83-0079-462f-b3a2-34c11f11fa82 req-b1ff5d70-f407-44aa-8a02-8d678c6c9a91 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:00:59.865266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b9a5f83-0079-462f-b3a2-34c11f11fa82 req-b1ff5d70-f407-44aa-8a02-8d678c6c9a91 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:00:59.866017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b9a5f83-0079-462f-b3a2-34c11f11fa82 req-b1ff5d70-f407-44aa-8a02-8d678c6c9a91 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:00:59.915125 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0b9a5f83-0079-462f-b3a2-34c11f11fa82 req-b1ff5d70-f407-44aa-8a02-8d678c6c9a91 service nova] Creating event network-vif-unplugged:e9ea764b-95e8-4aeb-ae74-818b2898ceb8 for instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c on n-h2-861333-10 Oct 19 07:00:59.930916 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0b9a5f83-0079-462f-b3a2-34c11f11fa82 req-b1ff5d70-f407-44aa-8a02-8d678c6c9a91 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124304 Oct 19 07:00:59.934991 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1488/2906] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:00:59.957628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67ce42a7-c28d-45c1-aa81-7a18e28c9a97 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d648a8430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:00.045337 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67ce42a7-c28d-45c1-aa81-7a18e28c9a97 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.108737 Oct 19 07:01:00.045902 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1489/2907] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:00:59 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:00.051380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-190080456", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["05fec950-716c-4339-8de8-f7aa8c1e8b59"]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:00.063479 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-789920a1-a022-4153-b826-bb32e56de403 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.780327 Oct 19 07:01:00.065986 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1419/2908] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:00:59 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:00.080628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43ef907a-10e4-4e75-a4b1-f9ae92bcfddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d645d30d0>, body: {"security_group_rule": {"parent_group_id": "674b6edb-35b9-47be-a068-e5bb35ae9d65", "ip_protocol": "tcp", "from_port": 22, "to_port": 2066042457}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:00.171018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:01:00.338884 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-43ef907a-10e4-4e75-a4b1-f9ae92bcfddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] HTTP exception thrown: Invalid port range 22:2066042457. Valid TCP ports should be between 1-65535 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43ef907a-10e4-4e75-a4b1-f9ae92bcfddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Request method failure captured: Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 146 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6ChHDAz7i9vn4tiIQszt0zY1YVwJ2W854tB84QgJ3cx0lHLP50OqDU1xuu1FKcPFC7nVVRLQ9sD_d7vn3ri7JXBcGvyC83ywzDDwNFehj-lpY9rRic0YkNbnejzpbbOU56JN2ve829Wp_IQRrtgAgSb09ClWxUkp9jndRWwnSx5-zQ Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6887ac2f752c4fbe88fb79a850176376", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 84d43248b2804148a341b996211be841 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: {"security_group_rule": {"parent_group_id": "674b6edb-35b9-47be-a068-e5bb35ae9d65", "ip_protocol": "tcp", "from_port": 22, "to_port": 2066042457}} Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid port range 22:2066042457. Valid TCP ports should be between 1-65535 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'security_group_rule': {'parent_group_id': '674b6edb-35b9-47be-a068-e5bb35ae9d65', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2066042457}}} Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2066042457. Valid TCP ports should be between 1-65535 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2066042457. Valid TCP ports should be between 1-65535 Oct 19 07:01:00.340848 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2066042457. Valid TCP ports should be between 1-65535 Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43ef907a-10e4-4e75-a4b1-f9ae92bcfddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Returning 400 to user: Invalid port range 22:2066042457. Valid TCP ports should be between 1-65535 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:00.344371 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43ef907a-10e4-4e75-a4b1-f9ae92bcfddb tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.267122 Oct 19 07:01:00.349763 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1420/2909] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:01:00 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:01:00.362292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a18013f3-4325-4544-9cdc-f8b6e05b3ba9 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Action: 'create', calling method: .version_select at 0x7f6d64c59d30>, body: {"security_group_rule": {"parent_group_id": "8aa9d456-7a97-430f-a14a-474223a7e45a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:00.404585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-a18013f3-4325-4544-9cdc-f8b6e05b3ba9 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8aa9d456-7a97-430f-a14a-474223a7e45a does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:01:00.405372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-a18013f3-4325-4544-9cdc-f8b6e05b3ba9 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Neutron security group 8aa9d456-7a97-430f-a14a-474223a7e45a not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:01:00.405977 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a18013f3-4325-4544-9cdc-f8b6e05b3ba9 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] HTTP exception thrown: Security group 8aa9d456-7a97-430f-a14a-474223a7e45a does not exist Oct 19 07:01:00.405977 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-1fc18656-a851-4a4c-9c36-0c693fcfabb5'] Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a18013f3-4325-4544-9cdc-f8b6e05b3ba9 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Request method failure captured: Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 138 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6ChHDAz7i9vn4tiIQszt0zY1YVwJ2W854tB84QgJ3cx0lHLP50OqDU1xuu1FKcPFC7nVVRLQ9sD_d7vn3ri7JXBcGvyC83ywzDDwNFehj-lpY9rRic0YkNbnejzpbbOU56JN2ve829Wp_IQRrtgAgSb09ClWxUkp9jndRWwnSx5-zQ Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6887ac2f752c4fbe88fb79a850176376", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 84d43248b2804148a341b996211be841 Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: {"security_group_rule": {"parent_group_id": "8aa9d456-7a97-430f-a14a-474223a7e45a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group 8aa9d456-7a97-430f-a14a-474223a7e45a does not exist Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-1fc18656-a851-4a4c-9c36-0c693fcfabb5'] Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8aa9d456-7a97-430f-a14a-474223a7e45a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:01:00.408873 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8aa9d456-7a97-430f-a14a-474223a7e45a does not exist Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc18656-a851-4a4c-9c36-0c693fcfabb5'] Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8aa9d456-7a97-430f-a14a-474223a7e45a does not exist Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc18656-a851-4a4c-9c36-0c693fcfabb5'] Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8aa9d456-7a97-430f-a14a-474223a7e45a does not exist Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc18656-a851-4a4c-9c36-0c693fcfabb5'] Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8aa9d456-7a97-430f-a14a-474223a7e45a does not exist Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc18656-a851-4a4c-9c36-0c693fcfabb5'] Oct 19 07:01:00.413265 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.424011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a18013f3-4325-4544-9cdc-f8b6e05b3ba9 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Returning 404 to user: Security group 8aa9d456-7a97-430f-a14a-474223a7e45a does not exist Oct 19 07:01:00.424011 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-1fc18656-a851-4a4c-9c36-0c693fcfabb5'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:00.424011 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a18013f3-4325-4544-9cdc-f8b6e05b3ba9 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.068019 Oct 19 07:01:00.427409 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1421/2910] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:01:00 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:01:00.435091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c76545bf-1d29-499b-a392-c1efeeedf8da tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Calling method '.version_select at 0x7f6d645d3c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:00.500714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-c76545bf-1d29-499b-a392-c1efeeedf8da tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 78db0b59-782f-47a2-b533-bade2bfd7a88 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:01:00.501868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-c76545bf-1d29-499b-a392-c1efeeedf8da tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Neutron security group rule 78db0b59-782f-47a2-b533-bade2bfd7a88 not found {{(pid=127568) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 19 07:01:00.502699 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c76545bf-1d29-499b-a392-c1efeeedf8da tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] HTTP exception thrown: Security group rule 78db0b59-782f-47a2-b533-bade2bfd7a88 does not exist Oct 19 07:01:00.502699 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-f3b719ca-f6c4-4694-9a5b-fe60673546e8'] Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c76545bf-1d29-499b-a392-c1efeeedf8da tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Request method failure captured: Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-group-rules/78db0b59-782f-47a2-b533-bade2bfd7a88 HTTP/1.1 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6ChHDAz7i9vn4tiIQszt0zY1YVwJ2W854tB84QgJ3cx0lHLP50OqDU1xuu1FKcPFC7nVVRLQ9sD_d7vn3ri7JXBcGvyC83ywzDDwNFehj-lpY9rRic0YkNbnejzpbbOU56JN2ve829Wp_IQRrtgAgSb09ClWxUkp9jndRWwnSx5-zQ Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6887ac2f752c4fbe88fb79a850176376"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6887ac2f752c4fbe88fb79a850176376", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 6887ac2f752c4fbe88fb79a850176376 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 84d43248b2804148a341b996211be841 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group rule 78db0b59-782f-47a2-b533-bade2bfd7a88 does not exist Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-f3b719ca-f6c4-4694-9a5b-fe60673546e8'] Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '78db0b59-782f-47a2-b533-bade2bfd7a88'} Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:01:00.505428 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 78db0b59-782f-47a2-b533-bade2bfd7a88 does not exist Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3b719ca-f6c4-4694-9a5b-fe60673546e8'] Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 78db0b59-782f-47a2-b533-bade2bfd7a88 does not exist Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3b719ca-f6c4-4694-9a5b-fe60673546e8'] Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 78db0b59-782f-47a2-b533-bade2bfd7a88 does not exist Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3b719ca-f6c4-4694-9a5b-fe60673546e8'] Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 78db0b59-782f-47a2-b533-bade2bfd7a88 does not exist Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3b719ca-f6c4-4694-9a5b-fe60673546e8'] Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c76545bf-1d29-499b-a392-c1efeeedf8da tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Returning 404 to user: Security group rule 78db0b59-782f-47a2-b533-bade2bfd7a88 does not exist Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-f3b719ca-f6c4-4694-9a5b-fe60673546e8'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c76545bf-1d29-499b-a392-c1efeeedf8da tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/78db0b59-782f-47a2-b533-bade2bfd7a88" status: 404 len: 199 microversion: 2.1 time: 0.082648 Oct 19 07:01:00.513280 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1422/2911] 10.222.0.39 () {58 vars in 1287 bytes} [Wed Oct 19 07:01:00 2022] DELETE /compute/v2.1/os-security-group-rules/78db0b59-782f-47a2-b533-bade2bfd7a88 => generated 199 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:01:00.544155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:00.547876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:00.566057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:00.566568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:00.567038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:00.573155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:00.574813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:00.575446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:00.934868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:00.935868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:01:00.936474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:01:00.937251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:01:00.937785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:01:00.938947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:01:00.943442 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58e64d2e-3ae4-4d53-b2e6-068b050a98d7 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1525 microversion: 2.1 time: 0.431226 Oct 19 07:01:00.960885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:00.961594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:00.962429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:00.965116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:00.966130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:00.967446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:00.969062 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1423/2912] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:00 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1525 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:00.991752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8276a1ce-e663-44bd-aae7-955194d26243 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Calling method '.version_select at 0x7f6d647815e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:01.058666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:01:01.078057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:01:01.088331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:01.145651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:01:01.161236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:01:01.366129 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aeaf97a9-2a7f-4036-bcf0-923fbef597bd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.317870 Oct 19 07:01:01.367530 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1490/2913] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:01:01.372647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46cb730e-0986-4f99-b208-d1877a08c047 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d641f6040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:01.463959 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46cb730e-0986-4f99-b208-d1877a08c047 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.095019 Oct 19 07:01:01.468637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1491/2914] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:01 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:01.491312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf06fcff-3afc-4379-8b01-617d9cabd03d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:01.494709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf06fcff-3afc-4379-8b01-617d9cabd03d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:01.727270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf06fcff-3afc-4379-8b01-617d9cabd03d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:01.741472 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf06fcff-3afc-4379-8b01-617d9cabd03d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1216 microversion: 2.1 time: 0.267683 Oct 19 07:01:01.747698 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1492/2915] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:01 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1216 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:01.972403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:01.973803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:01.992841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:01.992841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:01.992841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:01.992841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:01.992841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:02.003314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:02.243310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:02.258866 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a8858f9-f28b-4549-bc2c-e8c4c1d64dc9 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1525 microversion: 2.1 time: 0.290568 Oct 19 07:01:02.261829 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1493/2916] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:01 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1525 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:02.484660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ded7f199-3e1c-4ffe-a1cc-5a3ae43f021d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64914dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:02.571575 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ded7f199-3e1c-4ffe-a1cc-5a3ae43f021d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.091355 Oct 19 07:01:02.572334 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1494/2917] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:02 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:02.596770 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8276a1ce-e663-44bd-aae7-955194d26243 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/674b6edb-35b9-47be-a068-e5bb35ae9d65" status: 202 len: 0 microversion: 2.1 time: 1.618675 Oct 19 07:01:02.601206 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1424/2918] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:01:00 2022] DELETE /compute/v2.1/os-security-groups/674b6edb-35b9-47be-a068-e5bb35ae9d65 => generated 0 bytes in 1631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:01:02.606530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-186a10e8-f417-4117-be2b-950f261b066c tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Calling method '.version_select at 0x7f6d641f6160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:02.778187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57e72bb2-3766-49d1-9e74-74e811fef61d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:02.779656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57e72bb2-3766-49d1-9e74-74e811fef61d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:02.866274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57e72bb2-3766-49d1-9e74-74e811fef61d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:02.870281 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57e72bb2-3766-49d1-9e74-74e811fef61d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1216 microversion: 2.1 time: 0.099817 Oct 19 07:01:02.884975 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1425/2919] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:02 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1216 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:02.992224 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-186a10e8-f417-4117-be2b-950f261b066c tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/39d07317-dfa1-475b-8311-4cf2741347fe" status: 202 len: 0 microversion: 2.1 time: 0.389838 Oct 19 07:01:02.992752 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1495/2920] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:01:02 2022] DELETE /compute/v2.1/os-security-groups/39d07317-dfa1-475b-8311-4cf2741347fe => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:01:03.001258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6357809-7b88-4d9b-8042-7b1544527be7 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Calling method '.version_select at 0x7f6d645e3b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:03.363133 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a858c0e5-5915-4555-a0d7-5af59de5e9a4 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] 10.222.0.39 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.183135 Oct 19 07:01:03.364215 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1496/2921] 10.222.0.39 () {58 vars in 1128 bytes} [Wed Oct 19 07:01:03 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 19 07:01:03.371817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:03.372901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:03.392030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:03.392835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:03.393460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:03.394371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:03.395268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:03.395877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:03.586357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:03.596567 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f38676d-7c4a-4fad-93d0-981f56b3442e tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1525 microversion: 2.1 time: 0.231055 Oct 19 07:01:03.615773 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1497/2922] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:03 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1525 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:03.625370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4515ed27-812b-4ea0-a036-0710b4a94eb3 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Calling method '.version_select at 0x7f6d64914670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:03.652452 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-4515ed27-812b-4ea0-a036-0710b4a94eb3 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] HTTP exception thrown: Image not found. Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4515ed27-812b-4ea0-a036-0710b4a94eb3 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Request method failure captured: Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CvXqXkSzzPgQsg_6J6bT_PFePlVbxNf9KBx34eg194uK8g0qTI8Yw57ic9zXpfBc3P5dgkDcwDuEPKZNxzxt-yJcy-62MEO0qLKAGxfufFLM2ooNMLGuybJkvBmtoWAzZjgga5nh_YkRtdxjCul0vvxeiDA1hFQWNW39YBJpsiHb0 Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4826e6c6d75b49bab173686e109626fe", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 18362d8b7b8f4ac4945eda4ca3152c97 Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '-1'} Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.654890 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4515ed27-812b-4ea0-a036-0710b4a94eb3 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4515ed27-812b-4ea0-a036-0710b4a94eb3 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] 10.222.0.39 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.039724 Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1498/2923] 10.222.0.39 () {58 vars in 1134 bytes} [Wed Oct 19 07:01:03 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:01:03.668315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96993f4c-0168-4ad3-9fdf-73ec62dd9faa tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64a303a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:03.738237 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96993f4c-0168-4ad3-9fdf-73ec62dd9faa tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.074190 Oct 19 07:01:03.738237 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1499/2924] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:03 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:03.743305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6678f4bd-78f6-400e-9e83-ea43466e8347 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Calling method '.version_select at 0x7f6d6485e9d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:03.759551 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6357809-7b88-4d9b-8042-7b1544527be7 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/47c1a49e-dcac-48b4-835f-3675f642e7bf" status: 202 len: 0 microversion: 2.1 time: 0.761205 Oct 19 07:01:03.761123 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1426/2925] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:01:02 2022] DELETE /compute/v2.1/os-security-groups/47c1a49e-dcac-48b4-835f-3675f642e7bf => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:01:03.771000 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6678f4bd-78f6-400e-9e83-ea43466e8347 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] HTTP exception thrown: Image not found. Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6678f4bd-78f6-400e-9e83-ea43466e8347 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Request method failure captured: Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/43faeb1d-d16a-40d8-945c-a744a64c747j HTTP/1.1 Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CvXqXkSzzPgQsg_6J6bT_PFePlVbxNf9KBx34eg194uK8g0qTI8Yw57ic9zXpfBc3P5dgkDcwDuEPKZNxzxt-yJcy-62MEO0qLKAGxfufFLM2ooNMLGuybJkvBmtoWAzZjgga5nh_YkRtdxjCul0vvxeiDA1hFQWNW39YBJpsiHb0 Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4826e6c6d75b49bab173686e109626fe", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 18362d8b7b8f4ac4945eda4ca3152c97 Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '43faeb1d-d16a-40d8-945c-a744a64c747j'} Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 43faeb1d-d16a-40d8-945c-a744a64c747j to delete Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 43faeb1d-d16a-40d8-945c-a744a64c747j could not be found. Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:03.773075 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.777997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6678f4bd-78f6-400e-9e83-ea43466e8347 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:03.779638 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6678f4bd-78f6-400e-9e83-ea43466e8347 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] 10.222.0.39 "DELETE /compute/v2.1/images/43faeb1d-d16a-40d8-945c-a744a64c747j" status: 404 len: 62 microversion: 2.1 time: 0.038848 Oct 19 07:01:03.779638 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1500/2926] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:03 2022] DELETE /compute/v2.1/images/43faeb1d-d16a-40d8-945c-a744a64c747j => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:01:03.784603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95544f5d-a339-4616-b0f6-c495502e78c9 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Calling method '.version_select at 0x7f6d64781ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:03.789893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6718b7fb-42be-481a-8085-0e3c33b3ec49 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Calling method '.version_select at 0x7f6d64e5f160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:03.814247 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6718b7fb-42be-481a-8085-0e3c33b3ec49 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] HTTP exception thrown: Image not found. Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6718b7fb-42be-481a-8085-0e3c33b3ec49 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Request method failure captured: Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/74f3ec48-a007-4a73-b937-ba60be1f44df1 HTTP/1.1 Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CvXqXkSzzPgQsg_6J6bT_PFePlVbxNf9KBx34eg194uK8g0qTI8Yw57ic9zXpfBc3P5dgkDcwDuEPKZNxzxt-yJcy-62MEO0qLKAGxfufFLM2ooNMLGuybJkvBmtoWAzZjgga5nh_YkRtdxjCul0vvxeiDA1hFQWNW39YBJpsiHb0 Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4826e6c6d75b49bab173686e109626fe", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 18362d8b7b8f4ac4945eda4ca3152c97 Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '74f3ec48-a007-4a73-b937-ba60be1f44df1'} Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 74f3ec48-a007-4a73-b937-ba60be1f44df1 to delete Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 74f3ec48-a007-4a73-b937-ba60be1f44df1 could not be found. Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:03.818287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6718b7fb-42be-481a-8085-0e3c33b3ec49 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6718b7fb-42be-481a-8085-0e3c33b3ec49 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] 10.222.0.39 "DELETE /compute/v2.1/images/74f3ec48-a007-4a73-b937-ba60be1f44df1" status: 404 len: 62 microversion: 2.1 time: 0.033893 Oct 19 07:01:03.832272 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1501/2927] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:01:03 2022] DELETE /compute/v2.1/images/74f3ec48-a007-4a73-b937-ba60be1f44df1 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 07:01:04.015062 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f230d787-5384-4d43-9482-37a1ae2c2f70 tempest-TenantUsagesNegativeTestJSON-1597298278 tempest-TenantUsagesNegativeTestJSON-1597298278-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-18T07%3A01%3A03.800284&end=2022-10-20T07%3A01%3A03.800284" status: 404 len: 112 microversion: - time: 0.193153 Oct 19 07:01:04.025302 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1502/2928] 10.222.0.39 () {58 vars in 1316 bytes} [Wed Oct 19 07:01:03 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-18T07%3A01%3A03.800284&end=2022-10-20T07%3A01%3A03.800284 => generated 112 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 07:01:04.031846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-954b3afb-f9d5-49ff-975f-631fa2cbaf78 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Calling method '.version_select at 0x7f6d6485e550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:04.054479 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-954b3afb-f9d5-49ff-975f-631fa2cbaf78 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] HTTP exception thrown: Image not found. Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-954b3afb-f9d5-49ff-975f-631fa2cbaf78 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Request method failure captured: Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/tempest-invalid-629452001 HTTP/1.1 Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CvXqXkSzzPgQsg_6J6bT_PFePlVbxNf9KBx34eg194uK8g0qTI8Yw57ic9zXpfBc3P5dgkDcwDuEPKZNxzxt-yJcy-62MEO0qLKAGxfufFLM2ooNMLGuybJkvBmtoWAzZjgga5nh_YkRtdxjCul0vvxeiDA1hFQWNW39YBJpsiHb0 Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4826e6c6d75b49bab173686e109626fe", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 18362d8b7b8f4ac4945eda4ca3152c97 Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'tempest-invalid-629452001'} Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-629452001 to delete Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-629452001 could not be found. Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.056265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-954b3afb-f9d5-49ff-975f-631fa2cbaf78 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-954b3afb-f9d5-49ff-975f-631fa2cbaf78 tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] 10.222.0.39 "DELETE /compute/v2.1/images/tempest-invalid-629452001" status: 404 len: 62 microversion: 2.1 time: 0.031222 Oct 19 07:01:04.062159 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1503/2929] 10.222.0.39 () {58 vars in 1203 bytes} [Wed Oct 19 07:01:04 2022] DELETE /compute/v2.1/images/tempest-invalid-629452001 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:01:04.070214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:04.070872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:04.082094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:04.085739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:04.085739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:04.085739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:04.085739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:04.085739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:04.173370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:04.182202 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4309a015-7db3-4eb9-8887-cb3f8e55893f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1268 microversion: 2.1 time: 0.122932 Oct 19 07:01:04.192709 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1504/2930] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:04 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1268 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:04.208939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3eeeef2-f516-4f57-a048-a1d6db57ab20 tempest-TenantUsagesNegativeTestJSON-1597298278 tempest-TenantUsagesNegativeTestJSON-1597298278-project-admin] Calling method '.version_select at 0x7f6d64914550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:04.214579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f3eeeef2-f516-4f57-a048-a1d6db57ab20 tempest-TenantUsagesNegativeTestJSON-1597298278 tempest-TenantUsagesNegativeTestJSON-1597298278-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3eeeef2-f516-4f57-a048-a1d6db57ab20 tempest-TenantUsagesNegativeTestJSON-1597298278 tempest-TenantUsagesNegativeTestJSON-1597298278-project-admin] Request method failure captured: Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-simple-tenant-usage/90ebd86d9eba491abbf519b642851a67?start=2022-10-20T07%3A01%3A03.800284&end=2022-10-18T07%3A01%3A03.800284 HTTP/1.1 Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CvBxQB534IHcZJzo6u1ZhJ-eOWBLEPSSigMwlpWgQMgyQndQC9DW1HRwfHV5GBgZ2me1oISwGzIgSiEL-s3676SJujeFtUAbVyxVH2-uw7SW3uiifJ8lj8dfsMJoNgJq2oF-6c-iZDw68UQclTUAgJbT74TuFawcfatvV7BJvYUmU Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 032e43e3171f4cac94dac61680b1d66a Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1597298278 Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/032e43e3171f4cac94dac61680b1d66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/032e43e3171f4cac94dac61680b1d66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/032e43e3171f4cac94dac61680b1d66a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_032e43e3171f4cac94dac61680b1d66a", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1597298278 Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 032e43e3171f4cac94dac61680b1d66a Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1597298278 Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TenantUsagesNegativeTestJSON-1597298278-project-admin Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 75428cb257e8429887a7032a1728c295 Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1597298278-project-admin Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid start time. The start time cannot occur after the end time. Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '90ebd86d9eba491abbf519b642851a67'} Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 19 07:01:04.221144 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.227745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3eeeef2-f516-4f57-a048-a1d6db57ab20 tempest-TenantUsagesNegativeTestJSON-1597298278 tempest-TenantUsagesNegativeTestJSON-1597298278-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:04.227745 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3eeeef2-f516-4f57-a048-a1d6db57ab20 tempest-TenantUsagesNegativeTestJSON-1597298278 tempest-TenantUsagesNegativeTestJSON-1597298278-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/90ebd86d9eba491abbf519b642851a67?start=2022-10-20T07%3A01%3A03.800284&end=2022-10-18T07%3A01%3A03.800284" status: 400 len: 111 microversion: 2.1 time: 0.029208 Oct 19 07:01:04.227745 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1505/2931] 10.222.0.39 () {58 vars in 1412 bytes} [Wed Oct 19 07:01:04 2022] GET /compute/v2.1/os-simple-tenant-usage/90ebd86d9eba491abbf519b642851a67?start=2022-10-20T07%3A01%3A03.800284&end=2022-10-18T07%3A01%3A03.800284 => generated 111 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:01:04.235897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f46eeb1b-7b80-4ce3-ad37-c0d7a8d6caff tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Calling method '.version_select at 0x7f6d64896700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:04.258486 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f46eeb1b-7b80-4ce3-ad37-c0d7a8d6caff tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] HTTP exception thrown: Image not found. Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f46eeb1b-7b80-4ce3-ad37-c0d7a8d6caff tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Request method failure captured: Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/3fcd819b-16d6-4567-9c18-5a42bec76e80 HTTP/1.1 Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CvXqXkSzzPgQsg_6J6bT_PFePlVbxNf9KBx34eg194uK8g0qTI8Yw57ic9zXpfBc3P5dgkDcwDuEPKZNxzxt-yJcy-62MEO0qLKAGxfufFLM2ooNMLGuybJkvBmtoWAzZjgga5nh_YkRtdxjCul0vvxeiDA1hFQWNW39YBJpsiHb0 Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4826e6c6d75b49bab173686e109626fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4826e6c6d75b49bab173686e109626fe", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4826e6c6d75b49bab173686e109626fe Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839 Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 18362d8b7b8f4ac4945eda4ca3152c97 Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1062479839-project Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3fcd819b-16d6-4567-9c18-5a42bec76e80'} Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3fcd819b-16d6-4567-9c18-5a42bec76e80 to delete Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3fcd819b-16d6-4567-9c18-5a42bec76e80 could not be found. Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:04.260291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f46eeb1b-7b80-4ce3-ad37-c0d7a8d6caff tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f46eeb1b-7b80-4ce3-ad37-c0d7a8d6caff tempest-ImagesDeleteNegativeTestJSON-1062479839 tempest-ImagesDeleteNegativeTestJSON-1062479839-project] 10.222.0.39 "DELETE /compute/v2.1/images/3fcd819b-16d6-4567-9c18-5a42bec76e80" status: 404 len: 62 microversion: 2.1 time: 0.035668 Oct 19 07:01:04.265314 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1506/2932] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:04 2022] DELETE /compute/v2.1/images/3fcd819b-16d6-4567-9c18-5a42bec76e80 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:01:04.407867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f6634f1-85d2-48ac-a731-67f052bb4207 tempest-TenantUsagesNegativeTestJSON-1476585493 tempest-TenantUsagesNegativeTestJSON-1476585493-project] Calling method '.version_select at 0x7f6d5fb06ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:04.414241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f6634f1-85d2-48ac-a731-67f052bb4207 tempest-TenantUsagesNegativeTestJSON-1476585493 tempest-TenantUsagesNegativeTestJSON-1476585493-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '53ccd5e09d0d4a3d829aebf8a4219997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebd86d9eba491abbf519b642851a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f6634f1-85d2-48ac-a731-67f052bb4207 tempest-TenantUsagesNegativeTestJSON-1476585493 tempest-TenantUsagesNegativeTestJSON-1476585493-project] Request method failure captured: Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T07%3A01%3A03.800284&end=2022-10-20T07%3A01%3A03.800284&detailed=1 HTTP/1.1 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CuY-Fi7jsv3ZfeKFX6tG4x6CZaE75DbpchfOERBtfyKkIWUwbqdmeyKvA6d_2kk8N7HbjqJWg_heKsZQxBsLJgMHzcNZ0xcMencffzOozIYTdrPtRPg2-5mH92gIph34sqBi6UlAFlNJQyw2Nw3iMCvD9h9-1u1C_8JtepqzWh8OM Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 90ebd86d9eba491abbf519b642851a67 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1476585493 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/90ebd86d9eba491abbf519b642851a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90ebd86d9eba491abbf519b642851a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/90ebd86d9eba491abbf519b642851a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_90ebd86d9eba491abbf519b642851a67", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1476585493 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 90ebd86d9eba491abbf519b642851a67 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1476585493 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TenantUsagesNegativeTestJSON-1476585493-project Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 53ccd5e09d0d4a3d829aebf8a4219997 Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1476585493-project Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: action_args: {} Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 07:01:04.418039 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f6634f1-85d2-48ac-a731-67f052bb4207 tempest-TenantUsagesNegativeTestJSON-1476585493 tempest-TenantUsagesNegativeTestJSON-1476585493-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f6634f1-85d2-48ac-a731-67f052bb4207 tempest-TenantUsagesNegativeTestJSON-1476585493 tempest-TenantUsagesNegativeTestJSON-1476585493-project] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T07%3A01%3A03.800284&end=2022-10-20T07%3A01%3A03.800284&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.155859 Oct 19 07:01:04.430682 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1507/2933] 10.222.0.39 () {58 vars in 1335 bytes} [Wed Oct 19 07:01:04 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T07%3A01%3A03.800284&end=2022-10-20T07%3A01%3A03.800284&detailed=1 => generated 123 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:01:04.625290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:04.627090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:04.663380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:04.666981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:04.668782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:04.672955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:04.674313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:04.678008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:04.695307 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95544f5d-a339-4616-b0f6-c495502e78c9 tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/383bade6-bd8f-4a83-80b5-d2c3fe54c8b6" status: 202 len: 0 microversion: 2.1 time: 0.922660 Oct 19 07:01:04.696923 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1427/2934] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:01:03 2022] DELETE /compute/v2.1/os-security-groups/383bade6-bd8f-4a83-80b5-d2c3fe54c8b6 => generated 0 bytes in 925 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:01:04.713553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13d64b01-f0b9-4d51-b176-ee64248404cd tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] Calling method '.version_select at 0x7f6d645d35e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:05.079615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:05.211432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:05.229602 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1697639-c8bb-41a6-a04d-ee08196caebe tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1525 microversion: 2.1 time: 0.606940 Oct 19 07:01:05.231208 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1508/2935] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:04 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1525 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:05.248558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbe4bad1-4d6c-4311-b299-af9ae0e4cb60 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d6485e3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:05.330312 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbe4bad1-4d6c-4311-b299-af9ae0e4cb60 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.097254 Oct 19 07:01:05.331156 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1509/2936] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:05 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:05.344615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7d7a35f9-b383-4d47-acee-448d2f6a0c94 req-10f0353f-0f9b-42df-8a49-dd8cc0d90557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e163a6-ba79-4799-b148-8577e4e1f14f", "name": "network-vif-plugged", "status": "completed", "tag": "6e7b73ff-17d4-48fe-88e8-152bb9294036"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:05.370100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7d7a35f9-b383-4d47-acee-448d2f6a0c94 req-10f0353f-0f9b-42df-8a49-dd8cc0d90557 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:05.370596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7d7a35f9-b383-4d47-acee-448d2f6a0c94 req-10f0353f-0f9b-42df-8a49-dd8cc0d90557 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:05.371740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7d7a35f9-b383-4d47-acee-448d2f6a0c94 req-10f0353f-0f9b-42df-8a49-dd8cc0d90557 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:05.389584 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7d7a35f9-b383-4d47-acee-448d2f6a0c94 req-10f0353f-0f9b-42df-8a49-dd8cc0d90557 service nova] Creating event network-vif-plugged:6e7b73ff-17d4-48fe-88e8-152bb9294036 for instance c0e163a6-ba79-4799-b148-8577e4e1f14f on n-h1-861333-10 Oct 19 07:01:05.404690 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7d7a35f9-b383-4d47-acee-448d2f6a0c94 req-10f0353f-0f9b-42df-8a49-dd8cc0d90557 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071385 Oct 19 07:01:05.405303 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1510/2937] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:05.414376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:05.417791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:05.424127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:05.424891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:05.425443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:05.426661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:05.427240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:05.427777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:05.597825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:05.618765 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c664ec6-5e5e-467b-ab02-c2b1c8caf9b5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1286 microversion: 2.1 time: 0.211954 Oct 19 07:01:05.619376 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1511/2938] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:05 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:05.994973 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13d64b01-f0b9-4d51-b176-ee64248404cd tempest-SecurityGroupRulesNegativeTestJSON-1446938410 tempest-SecurityGroupRulesNegativeTestJSON-1446938410-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/18988fe8-ad83-4c50-9eee-419835f325c7" status: 202 len: 0 microversion: 2.1 time: 1.288926 Oct 19 07:01:05.996121 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1428/2939] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:01:04 2022] DELETE /compute/v2.1/os-security-groups/18988fe8-ad83-4c50-9eee-419835f325c7 => generated 0 bytes in 1291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:01:06.256826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:06.257485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:06.272797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:06.273224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:06.273651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:06.274376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:06.274849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:06.275602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:06.348404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9b415e6-f2a1-4efb-a83a-19cc8eaab24f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d6479ba60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:06.436136 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9b415e6-f2a1-4efb-a83a-19cc8eaab24f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.092006 Oct 19 07:01:06.436950 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1429/2940] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:06 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:06.647588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:06.648653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:06.655001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:06.655839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:06.656544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:06.657489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:06.658213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:06.658852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:06.793445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:06.806344 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2237b29-1525-41df-b770-5870cdea57fa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1274 microversion: 2.1 time: 0.160081 Oct 19 07:01:06.808040 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1430/2941] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:06 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:06.847121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:06.861665 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d17bd2bf-fc99-4ef0-9156-6488aaed4d81 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1525 microversion: 2.1 time: 0.609167 Oct 19 07:01:06.864131 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1512/2942] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:06 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1525 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:07.460649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a13ac8e6-d7bf-44b1-b1ea-c49317398b24 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d645d3550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:07.566372 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a13ac8e6-d7bf-44b1-b1ea-c49317398b24 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.115742 Oct 19 07:01:07.574567 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1431/2943] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:07 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:07.836666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:07.837888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:07.853194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:07.854040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:07.854688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:07.855577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:07.857088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:07.857689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:07.887451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:07.888337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:07.909970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:07.909970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:07.916677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:07.917834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:07.922295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:07.922939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:07.939915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:08.101824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:08.112375 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1025eac7-c89c-4bbc-96c0-a9d547811386 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1483 microversion: 2.1 time: 0.227260 Oct 19 07:01:08.113201 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1432/2944] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:07 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1483 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:08.125854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a10c1ea8-db65-4564-aa7a-6e79e1db2115 req-487f9a9a-42cd-4553-8c70-164dd049334f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956c30a-7b4a-477e-962c-9cea7dc3ce59", "name": "network-vif-deleted", "tag": "32be3cfb-91f2-46f7-aec9-59f76cdf913a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:08.147959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a10c1ea8-db65-4564-aa7a-6e79e1db2115 req-487f9a9a-42cd-4553-8c70-164dd049334f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:08.148497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a10c1ea8-db65-4564-aa7a-6e79e1db2115 req-487f9a9a-42cd-4553-8c70-164dd049334f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:08.149113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a10c1ea8-db65-4564-aa7a-6e79e1db2115 req-487f9a9a-42cd-4553-8c70-164dd049334f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:08.178912 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a10c1ea8-db65-4564-aa7a-6e79e1db2115 req-487f9a9a-42cd-4553-8c70-164dd049334f service nova] Creating event network-vif-deleted:32be3cfb-91f2-46f7-aec9-59f76cdf913a for instance 2956c30a-7b4a-477e-962c-9cea7dc3ce59 on n-h1-861333-10 Oct 19 07:01:08.186238 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a10c1ea8-db65-4564-aa7a-6e79e1db2115 req-487f9a9a-42cd-4553-8c70-164dd049334f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071015 Oct 19 07:01:08.190127 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1433/2945] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:08.544899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:08.572710 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-288de0df-c131-4446-ada9-e265e4ff87bc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 0.741307 Oct 19 07:01:08.581737 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1513/2946] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:07 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:08.583284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e88fb7b-81c9-46ac-8d00-c6deb84576fb tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d6479b940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:08.668259 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e88fb7b-81c9-46ac-8d00-c6deb84576fb tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.089687 Oct 19 07:01:08.668841 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1434/2947] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:08 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:09.145682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:09.147955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:09.166430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:09.166929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:09.167366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:09.168069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:09.168552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:09.168985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:09.238232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:09.238917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:09.239575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:09.240217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lazy-loading 'fault' on Instance uuid 2956c30a-7b4a-477e-962c-9cea7dc3ce59 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:01:09.348660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185d0e907b2e4c75916459859c5c8c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9816fcfed2354664a054e1b3e146019c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:09.356717 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-def212ef-98d5-4404-a7ac-828650da0950 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 200 len: 1314 microversion: 2.1 time: 0.219689 Oct 19 07:01:09.360850 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1435/2948] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:09 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:09.530405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-602259047", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:09.603073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:09.606889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:09.614343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:09.618196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:09.618929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:09.619854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:09.624950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:09.625938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:09.701292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:01:10.060287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:10.071496 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d31fd846-57cf-4db8-88a7-7c965693b279 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 0.472197 Oct 19 07:01:10.091316 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1436/2949] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:09 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:10.101088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58c12825-c055-498f-8a82-b4ad3d8cb3fb tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64300280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:10.198529 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58c12825-c055-498f-8a82-b4ad3d8cb3fb tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.104340 Oct 19 07:01:10.200369 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1437/2950] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:10 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:10.259666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:01:10.260267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:01:10.260761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:01:10.261188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:01:10.261618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:01:10.280412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:10.281296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:10.281911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:10.283908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:10.286295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:10.286954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:10.339299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Getting quotas for project 7dda7801787e4ea3988a90f30451f3fa. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:01:10.359135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Getting quotas for user cd1e25ce6cfb48159196d4466727a4d2 and project 7dda7801787e4ea3988a90f30451f3fa. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:01:10.386240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:10.387709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] [instance: 2956c30a-7b4a-477e-962c-9cea7dc3ce59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:10.398718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:10.400425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:10.401613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:10.401949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:01:10.402982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:10.403668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:10.404353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:10.410870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:01:10.419562 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] HTTP exception thrown: Instance 2956c30a-7b4a-477e-962c-9cea7dc3ce59 could not be found. Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Request method failure captured: Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 HTTP/1.1 Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6CFfFAuG2qPP5foWuggG7X30bMJfUoZYtx_7Jd30L3ya2A1GgBItiltAkH2lOgAIbmAGdhG2oyuY7V2Xjtht9Ry8BaONpVJdGvHYdz2nOMGPG6EiewsXyTOGXy6kecVLPOqG5UDVlRAQMj3xXlA0QmIm3JNYfoMEwjWOEGZg5RKAvY Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9816fcfed2354664a054e1b3e146019c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9816fcfed2354664a054e1b3e146019c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 9816fcfed2354664a054e1b3e146019c Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653844411 Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 185d0e907b2e4c75916459859c5c8c22 Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653844411-project Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 2956c30a-7b4a-477e-962c-9cea7dc3ce59 could not be found. Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '2956c30a-7b4a-477e-962c-9cea7dc3ce59'} Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2956c30a-7b4a-477e-962c-9cea7dc3ce59 could not be found. Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2956c30a-7b4a-477e-962c-9cea7dc3ce59 could not be found. Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:10.422917 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:10.427248 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:10.427248 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:10.427248 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:10.427248 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:10.427248 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:10.427248 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:10.427248 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2956c30a-7b4a-477e-962c-9cea7dc3ce59 could not be found. Oct 19 07:01:10.427248 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:10.427248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] Returning 404 to user: Instance 2956c30a-7b4a-477e-962c-9cea7dc3ce59 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:10.430520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fff02450-e124-4456-bccb-2e5daa56c212 tempest-ServerMetadataNegativeTestJSON-1653844411 tempest-ServerMetadataNegativeTestJSON-1653844411-project] 10.222.0.39 "GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59" status: 404 len: 111 microversion: 2.1 time: 0.040632 Oct 19 07:01:10.431725 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1438/2951] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:10 2022] GET /compute/v2.1/servers/2956c30a-7b4a-477e-962c-9cea7dc3ce59 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:01:10.602605 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-981c5cf2-abe0-4a78-9780-2227313659c1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470036 Oct 19 07:01:10.612351 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1514/2952] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:01:10.615548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10e45e36-9d02-48e3-b527-8ecd9559164e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:10.621645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10e45e36-9d02-48e3-b527-8ecd9559164e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:10.765632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-10e45e36-9d02-48e3-b527-8ecd9559164e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:10.777839 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10e45e36-9d02-48e3-b527-8ecd9559164e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1216 microversion: 2.1 time: 0.166878 Oct 19 07:01:10.779647 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1439/2953] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:10 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1216 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:11.106222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:11.107129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:11.122166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:11.124157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:11.124842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:11.127523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:11.131660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:11.133532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:11.224746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f549312a-b7c1-483b-b2cb-bb4980292f01 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64628310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:11.334947 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f549312a-b7c1-483b-b2cb-bb4980292f01 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.118753 Oct 19 07:01:11.346038 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1440/2954] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:11 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:11.433442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f1a55ac0-0cb6-44a5-ba38-5ed17c562c9b req-6d0d783c-f6fd-4f71-8044-ffd0db8eb20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd23cc7-b696-4b27-895c-2ba60aa6c7c2", "tag": "e00ea9b3-3256-480a-a04e-4d6743c7e2b8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:11.469946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f1a55ac0-0cb6-44a5-ba38-5ed17c562c9b req-6d0d783c-f6fd-4f71-8044-ffd0db8eb20a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:11.471943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f1a55ac0-0cb6-44a5-ba38-5ed17c562c9b req-6d0d783c-f6fd-4f71-8044-ffd0db8eb20a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:11.472646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f1a55ac0-0cb6-44a5-ba38-5ed17c562c9b req-6d0d783c-f6fd-4f71-8044-ffd0db8eb20a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:11.495956 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f1a55ac0-0cb6-44a5-ba38-5ed17c562c9b req-6d0d783c-f6fd-4f71-8044-ffd0db8eb20a service nova] Creating event network-changed:e00ea9b3-3256-480a-a04e-4d6743c7e2b8 for instance efd23cc7-b696-4b27-895c-2ba60aa6c7c2 on n-h2-861333-10 Oct 19 07:01:11.504329 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f1a55ac0-0cb6-44a5-ba38-5ed17c562c9b req-6d0d783c-f6fd-4f71-8044-ffd0db8eb20a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074818 Oct 19 07:01:11.505773 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1441/2955] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:11.805553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c24b204c-90fe-482d-a228-ea18499aa277 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:11.806428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c24b204c-90fe-482d-a228-ea18499aa277 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:12.362275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:12.377433 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1921a4c2-f7f1-4a68-88c7-0ebb6460108c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 1.281622 Oct 19 07:01:12.378117 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1515/2956] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:11 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:12.392951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c24b204c-90fe-482d-a228-ea18499aa277 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:12.396988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5b1167c-7b02-4e49-b44b-6cffc4605945 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64aa2af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:12.403710 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c24b204c-90fe-482d-a228-ea18499aa277 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1216 microversion: 2.1 time: 0.602471 Oct 19 07:01:12.432320 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1442/2957] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:11 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1216 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:12.572736 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5b1167c-7b02-4e49-b44b-6cffc4605945 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.193343 Oct 19 07:01:12.573435 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1516/2958] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:12 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:13.407452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:13.409354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:13.439871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:13.440749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:13.463990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:13.465395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:13.468933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:13.473351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:13.479639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:13.480376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:13.486553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:13.489142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:13.489886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:13.492795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:13.495219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:13.495966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:13.911634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:13.930421 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-178b4305-75df-4646-bb8f-cdced3e2985b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 0.526718 Oct 19 07:01:13.948747 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1443/2959] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:13 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:13.970463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9883b887-7523-405a-bd42-5b6f0b53146e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d640d8670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:14.109988 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9883b887-7523-405a-bd42-5b6f0b53146e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.159187 Oct 19 07:01:14.111338 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1444/2960] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:13 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:14.151677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:14.174142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cbde88d-615d-46c2-81f5-dcf288ead8b9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1268 microversion: 2.1 time: 0.724785 Oct 19 07:01:14.175858 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1517/2961] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:13 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1268 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:14.964518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:14.966194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:14.990288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:14.991570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:14.993499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:14.994505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:14.995142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:14.997140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:15.126129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e9abe6b-8fa5-41c5-a322-81b9446ef357 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64aa2c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:15.248030 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e9abe6b-8fa5-41c5-a322-81b9446ef357 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.125989 Oct 19 07:01:15.257866 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1518/2962] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:15 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:15.272651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:15.273292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:15.305196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:15.305196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:15.305196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:15.305196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:15.305196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:15.305196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:15.560346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:15.579058 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51f66507-b357-4ffc-87af-ab570adfcbce tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 0.620998 Oct 19 07:01:15.599848 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1445/2963] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:14 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:15.785901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:15.807119 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6df827a8-22a9-49e6-8925-3ba985f423a0 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1274 microversion: 2.1 time: 0.556829 Oct 19 07:01:15.833116 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1519/2964] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:15 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1274 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:16.107021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1629576037", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "1cd63371-7e73-482d-890a-97bb9362cb66"}, {"uuid": "b36a6ebf-5b09-4740-b0d2-de8c4f9fcf96"}, {"uuid": "1cd63371-7e73-482d-890a-97bb9362cb66"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:16.250312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] validate_networks() for [('1cd63371-7e73-482d-890a-97bb9362cb66', None, None, None, None, None), ('b36a6ebf-5b09-4740-b0d2-de8c4f9fcf96', None, None, None, None, None), ('1cd63371-7e73-482d-890a-97bb9362cb66', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:01:16.272499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1704fbb-f0f9-46cc-a118-d255cc28911d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64896550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:16.362342 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1704fbb-f0f9-46cc-a118-d255cc28911d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.099803 Oct 19 07:01:16.368525 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1520/2965] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:16 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:16.608787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:16.609776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:16.636785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:16.639825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:16.641329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:16.652487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:16.653360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:16.654588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:17.246676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:17.260922 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66b6f25c-ddfa-415f-bde6-ec7958df9866 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 0.657306 Oct 19 07:01:17.262829 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1521/2966] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:16 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:17.276029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:17.279407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:17.296050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:17.296566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:17.301962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:17.303392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:17.304028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:17.304823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:17.510022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:17.520131 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-310824dc-55e0-4d93-b201-fc2d06f21844 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1274 microversion: 2.1 time: 0.255474 Oct 19 07:01:17.534580 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1522/2967] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:17 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:17.551119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43caa656-745f-49cf-af0b-7caccae4c4a1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fb0c790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:17.615305 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43caa656-745f-49cf-af0b-7caccae4c4a1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.079540 Oct 19 07:01:17.616232 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1523/2968] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:17 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:18.290585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:18.291293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:18.308602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:18.309110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:18.309560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:18.310284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:18.310748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:18.311181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:19.082375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:19.110368 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c99ae383-cdb2-45eb-81ec-689dcd63df82 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 0.824176 Oct 19 07:01:19.123962 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1524/2969] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:18 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:19.131239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:19.131612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:19.140447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:19.141201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:19.141797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:19.143814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:19.144496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:19.145246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:19.249983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:19.260231 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47952133-7acc-4f6c-976b-28a66d78371a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1274 microversion: 2.1 time: 0.135837 Oct 19 07:01:19.261404 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1525/2970] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:19 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1274 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:19.268809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bedde960-2071-4d1b-bd37-ce53bf604985 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64987430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:19.332865 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bedde960-2071-4d1b-bd37-ce53bf604985 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.070031 Oct 19 07:01:19.334827 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1526/2971] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:19 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:19.486694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:01:19.489446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:01:19.491666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:01:19.492091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:01:19.492538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:01:19.494768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:19.504650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:19.505116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:19.505550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:19.506266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:19.506719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:19.507140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:19.514028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:19.525765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Getting quotas for project 4b64d433fbb74f5b89ab02e4572ddc45. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:01:19.531357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Getting quotas for user 41810b44169748bd97b407696a681dc7 and project 4b64d433fbb74f5b89ab02e4572ddc45. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:01:19.557094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:01:19.557094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:01:19.866557 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c06a1428-1b26-404b-ac74-1af2c2fc4b50 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.764266 Oct 19 07:01:19.879678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6d5204e-72ca-4fcb-a86f-0bd25c3219de tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:19.880340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6d5204e-72ca-4fcb-a86f-0bd25c3219de tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:19.889996 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1446/2972] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:01:20.097851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6d5204e-72ca-4fcb-a86f-0bd25c3219de tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:20.107325 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6d5204e-72ca-4fcb-a86f-0bd25c3219de tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1213 microversion: 2.1 time: 0.232462 Oct 19 07:01:20.129710 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1527/2973] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:19 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1213 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:20.139293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:20.140201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:20.155046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:20.155963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:20.156649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:20.158160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:20.160867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:20.161533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:20.286094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:20.287029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:20.302410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:20.313761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:20.325919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:20.325919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:20.326320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:20.327032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:20.330513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:20.602977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:20.611045 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b0fe077-8f67-47b5-a71e-8d0ea2101704 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 0.477947 Oct 19 07:01:20.611627 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1447/2974] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:20 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:20.633416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94c41262-1448-4266-beda-f95de6582872 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64d21e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:20.711165 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94c41262-1448-4266-beda-f95de6582872 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.095625 Oct 19 07:01:20.714285 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1448/2975] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:20 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:20.730870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b477d5c0-013b-477b-ba70-62688aee5cc0 req-371e2c93-b2d9-44f7-984d-a20647099ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd23cc7-b696-4b27-895c-2ba60aa6c7c2", "name": "network-vif-plugged", "status": "completed", "tag": "e00ea9b3-3256-480a-a04e-4d6743c7e2b8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:20.750013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b477d5c0-013b-477b-ba70-62688aee5cc0 req-371e2c93-b2d9-44f7-984d-a20647099ed8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:20.750765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b477d5c0-013b-477b-ba70-62688aee5cc0 req-371e2c93-b2d9-44f7-984d-a20647099ed8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:20.752502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b477d5c0-013b-477b-ba70-62688aee5cc0 req-371e2c93-b2d9-44f7-984d-a20647099ed8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:20.768176 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b477d5c0-013b-477b-ba70-62688aee5cc0 req-371e2c93-b2d9-44f7-984d-a20647099ed8 service nova] Creating event network-vif-plugged:e00ea9b3-3256-480a-a04e-4d6743c7e2b8 for instance efd23cc7-b696-4b27-895c-2ba60aa6c7c2 on n-h2-861333-10 Oct 19 07:01:20.794531 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b477d5c0-013b-477b-ba70-62688aee5cc0 req-371e2c93-b2d9-44f7-984d-a20647099ed8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077751 Oct 19 07:01:20.796692 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1449/2976] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:21.136830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93a11a5a-75a6-41ee-a801-dd1f8e96bf8e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:21.138035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93a11a5a-75a6-41ee-a801-dd1f8e96bf8e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:21.438570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:21.451115 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f34dec98-5581-4869-bcf0-8b5a13194826 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1316 microversion: 2.1 time: 1.172120 Oct 19 07:01:21.456990 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1528/2977] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:20 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1316 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:21.634585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:21.635580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:21.647682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:21.648389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:21.649159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:21.650078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:21.655602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:21.658190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:21.916402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93a11a5a-75a6-41ee-a801-dd1f8e96bf8e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:21.931246 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93a11a5a-75a6-41ee-a801-dd1f8e96bf8e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1213 microversion: 2.1 time: 0.796006 Oct 19 07:01:21.933579 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1450/2978] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:21 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1213 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:21.961365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95b902b7-9dd9-4f01-ab59-ebc106b05c81 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d651d8550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:22.066476 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95b902b7-9dd9-4f01-ab59-ebc106b05c81 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.111814 Oct 19 07:01:22.067058 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1451/2979] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:21 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:22.287956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:22.301384 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7291647d-87f7-4144-bf75-36661747b3f6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 0.666813 Oct 19 07:01:22.303919 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1529/2980] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:21 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:22.480774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:22.481567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:22.495150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:22.495854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:22.500457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:22.502295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:22.502936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:22.503550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:22.962208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:22.962208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:23.002206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:23.002796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:23.021586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:23.022317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:23.022806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:23.023247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:23.203105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:23.215102 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d76b203-b173-4396-9672-889545953b4c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1265 microversion: 2.1 time: 0.263616 Oct 19 07:01:23.230228 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1530/2981] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:22 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:23.254950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e295704-080f-4e2c-afec-55f56138092c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64a30700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:23.359816 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e295704-080f-4e2c-afec-55f56138092c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.128172 Oct 19 07:01:23.360521 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1531/2982] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:23 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:23.376067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:23.377430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:23.383689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:23.384227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:23.384681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:23.385746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:23.386856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:23.396750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:23.511706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:23.528199 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f78ff01f-05ae-41a5-a5dd-6df0b5ff786e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1316 microversion: 2.1 time: 1.045128 Oct 19 07:01:23.536494 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1452/2983] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:22 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1316 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:24.491865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:24.506824 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dde03e12-5ab8-4ed5-ac42-e83936803946 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1316 microversion: 2.1 time: 1.144917 Oct 19 07:01:24.509885 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1532/2984] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:23 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1316 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:24.537768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:24.538765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:24.566916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:24.570127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:24.571044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:24.573464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:24.574962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:24.576671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:24.732888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d7e20bbd-6b93-4f61-9694-6a14d2862448 req-1e12c4eb-bafa-4236-872f-415773c91315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "524a6e73-ef2b-4af5-884d-331924e8ad09", "tag": "1249d2c6-bb1b-43b7-9034-10146ff5c868"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:24.760087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d7e20bbd-6b93-4f61-9694-6a14d2862448 req-1e12c4eb-bafa-4236-872f-415773c91315 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:24.765353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d7e20bbd-6b93-4f61-9694-6a14d2862448 req-1e12c4eb-bafa-4236-872f-415773c91315 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:24.765822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d7e20bbd-6b93-4f61-9694-6a14d2862448 req-1e12c4eb-bafa-4236-872f-415773c91315 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:24.806905 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d7e20bbd-6b93-4f61-9694-6a14d2862448 req-1e12c4eb-bafa-4236-872f-415773c91315 service nova] Creating event network-changed:1249d2c6-bb1b-43b7-9034-10146ff5c868 for instance 524a6e73-ef2b-4af5-884d-331924e8ad09 on n-h1-861333-10 Oct 19 07:01:24.823729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d7e20bbd-6b93-4f61-9694-6a14d2862448 req-1e12c4eb-bafa-4236-872f-415773c91315 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.701454 Oct 19 07:01:24.824309 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1453/2985] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:24.829433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-532c9325-e658-494d-a96d-d0a1d76f8dfe tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d651d8550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:24.866923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:24.874791 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0588841-e384-4340-a0ee-193579de08c8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1271 microversion: 2.1 time: 0.349462 Oct 19 07:01:24.875381 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1533/2986] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:24 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1271 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:24.898518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:24.903246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:24.932174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:24.932783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:24.933118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:24.933846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:24.934315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:24.934749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:24.952560 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-532c9325-e658-494d-a96d-d0a1d76f8dfe tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.126849 Oct 19 07:01:24.953473 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1454/2987] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:24 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:25.090186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8ac8777-2492-48cd-918d-f06774f1c565 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1559528108", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:25.093630 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b8ac8777-2492-48cd-918d-f06774f1c565 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] HTTP exception thrown: min_count must be <= max_count Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8ac8777-2492-48cd-918d-f06774f1c565 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Request method failure captured: Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 184 Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DEzKUrPWZmc5Nw1wj6dr_ElaX1f5HDdp7U1BHg0VThxwHJSDnNk9AqrrgFnKeEmlJP8XUeziUR34lziBpXadXjUXff6ygb30b8o1O49AzYzAGmyo7X0RoDhUgAcrDi3FB6dfwt193gaoVOPzuo-oOsMoUnxY-ILltVfOhjcdzEe4I Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0858b76290a146b5bff27727343d3081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0858b76290a146b5bff27727343d3081", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f97d9bac4ff2406cbdfaf1a198c1983d Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1559528108", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: exception: min_count must be <= max_count Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1559528108', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 19 07:01:25.095247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.102432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8ac8777-2492-48cd-918d-f06774f1c565 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Returning 400 to user: min_count must be <= max_count {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:25.103431 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8ac8777-2492-48cd-918d-f06774f1c565 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.149024 Oct 19 07:01:25.115535 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1455/2988] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:24 2022] POST /compute/v2.1/servers => generated 74 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 07:01:25.205582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abdf8cbf-1d6e-4b0b-bd16-bf1bd88d4a6a tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1043260245", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "max_count": 0}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abdf8cbf-1d6e-4b0b-bd16-bf1bd88d4a6a tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Request method failure captured: Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 168 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DEzKUrPWZmc5Nw1wj6dr_ElaX1f5HDdp7U1BHg0VThxwHJSDnNk9AqrrgFnKeEmlJP8XUeziUR34lziBpXadXjUXff6ygb30b8o1O49AzYzAGmyo7X0RoDhUgAcrDi3FB6dfwt193gaoVOPzuo-oOsMoUnxY-ILltVfOhjcdzEe4I Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0858b76290a146b5bff27727343d3081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0858b76290a146b5bff27727343d3081", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f97d9bac4ff2406cbdfaf1a198c1983d Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1043260245", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "max_count": 0}} Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1043260245', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'max_count': 0}}} Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 0 Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:01:25.214397 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 19 07:01:25.219016 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.221335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abdf8cbf-1d6e-4b0b-bd16-bf1bd88d4a6a tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:25.222410 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abdf8cbf-1d6e-4b0b-bd16-bf1bd88d4a6a tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022679 Oct 19 07:01:25.228274 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1456/2989] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:25 2022] POST /compute/v2.1/servers => generated 130 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:01:25.340134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de157f37-d1c7-48a0-b346-55d3e88d1cd5 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-561692423", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "max_count": 2.5}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de157f37-d1c7-48a0-b346-55d3e88d1cd5 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Request method failure captured: Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 169 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DEzKUrPWZmc5Nw1wj6dr_ElaX1f5HDdp7U1BHg0VThxwHJSDnNk9AqrrgFnKeEmlJP8XUeziUR34lziBpXadXjUXff6ygb30b8o1O49AzYzAGmyo7X0RoDhUgAcrDi3FB6dfwt193gaoVOPzuo-oOsMoUnxY-ILltVfOhjcdzEe4I Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0858b76290a146b5bff27727343d3081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0858b76290a146b5bff27727343d3081", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f97d9bac4ff2406cbdfaf1a198c1983d Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-561692423", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "max_count": 2.5}} Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-561692423', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'max_count': 2.5}}} Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 2.5 Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:01:25.344457 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de157f37-d1c7-48a0-b346-55d3e88d1cd5 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de157f37-d1c7-48a0-b346-55d3e88d1cd5 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017783 Oct 19 07:01:25.362928 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1457/2990] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:25 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:01:25.457784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be71690c-88ae-4863-a20a-d56028daa22c tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-607550169", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 0}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be71690c-88ae-4863-a20a-d56028daa22c tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Request method failure captured: Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 167 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DEzKUrPWZmc5Nw1wj6dr_ElaX1f5HDdp7U1BHg0VThxwHJSDnNk9AqrrgFnKeEmlJP8XUeziUR34lziBpXadXjUXff6ygb30b8o1O49AzYzAGmyo7X0RoDhUgAcrDi3FB6dfwt193gaoVOPzuo-oOsMoUnxY-ILltVfOhjcdzEe4I Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0858b76290a146b5bff27727343d3081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0858b76290a146b5bff27727343d3081", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f97d9bac4ff2406cbdfaf1a198c1983d Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-607550169", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 0}} Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-607550169', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'min_count': 0}}} Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 0 Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:01:25.462953 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 19 07:01:25.467608 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:25.477044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be71690c-88ae-4863-a20a-d56028daa22c tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:25.481303 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be71690c-88ae-4863-a20a-d56028daa22c tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025140 Oct 19 07:01:25.481303 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1458/2991] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:25 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:01:25.533205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:25.533937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:25.554279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:25.558072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:25.558072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:25.558072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:25.558072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:25.558072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:26.147373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:26.165348 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e964fcc1-8a5c-4897-acea-ecb6d87cbafe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1316 microversion: 2.1 time: 1.282637 Oct 19 07:01:26.166773 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1534/2992] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:24 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1316 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:26.178082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b846d1af-2e01-4cd4-a03c-41d4981cbdb7 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1329752566", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 2.5}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b846d1af-2e01-4cd4-a03c-41d4981cbdb7 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Request method failure captured: Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 170 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6DEzKUrPWZmc5Nw1wj6dr_ElaX1f5HDdp7U1BHg0VThxwHJSDnNk9AqrrgFnKeEmlJP8XUeziUR34lziBpXadXjUXff6ygb30b8o1O49AzYzAGmyo7X0RoDhUgAcrDi3FB6dfwt193gaoVOPzuo-oOsMoUnxY-ILltVfOhjcdzEe4I Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0858b76290a146b5bff27727343d3081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0858b76290a146b5bff27727343d3081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0858b76290a146b5bff27727343d3081", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0858b76290a146b5bff27727343d3081 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1671496931 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f97d9bac4ff2406cbdfaf1a198c1983d Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1671496931-project Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1329752566", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 2.5}} Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1329752566', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'min_count': 2.5}}} Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 2.5 Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:01:26.202043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:01:26.214567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b846d1af-2e01-4cd4-a03c-41d4981cbdb7 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:26.223431 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b846d1af-2e01-4cd4-a03c-41d4981cbdb7 tempest-MultipleCreateNegativeTestJSON-1671496931 tempest-MultipleCreateNegativeTestJSON-1671496931-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037338 Oct 19 07:01:26.225624 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1535/2993] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:26 2022] POST /compute/v2.1/servers => generated 139 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:01:26.233568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:26.234541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:26.250040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:26.250800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:26.252125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:26.253280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:26.253959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:26.255232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:26.474076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:26.484133 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5877bf72-3fb3-47d2-8284-cb0af86b1ba8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1466 microversion: 2.1 time: 0.955257 Oct 19 07:01:26.504728 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1459/2994] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:25 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1466 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:26.506535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:26.523502 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb21c19a-ad95-4f95-b805-e1861e063b3a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1271 microversion: 2.1 time: 0.288503 Oct 19 07:01:26.524332 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1536/2995] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:26 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1271 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:26.525530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bdefc1ed-b797-4dce-96bf-42d6475f1fee tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64c38f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:26.544794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca67c5f0-c93c-491f-8048-ae9d17407635 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:26.545414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca67c5f0-c93c-491f-8048-ae9d17407635 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:26.573954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca67c5f0-c93c-491f-8048-ae9d17407635 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:26.574449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca67c5f0-c93c-491f-8048-ae9d17407635 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:26.574892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca67c5f0-c93c-491f-8048-ae9d17407635 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:26.605348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca67c5f0-c93c-491f-8048-ae9d17407635 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:26.607340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca67c5f0-c93c-491f-8048-ae9d17407635 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:26.611089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca67c5f0-c93c-491f-8048-ae9d17407635 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:26.623965 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bdefc1ed-b797-4dce-96bf-42d6475f1fee tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.117869 Oct 19 07:01:26.624698 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1460/2996] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:26 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:27.197174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:27.198522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:27.215936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:27.219031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:27.219851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:27.221853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:27.224749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:27.227100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:27.429462 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca67c5f0-c93c-491f-8048-ae9d17407635 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1619 microversion: 2.1 time: 0.902419 Oct 19 07:01:27.429462 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1537/2997] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:26 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1619 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:27.549650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:27.550272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:27.560493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:27.560998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:27.561668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:27.562168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:27.562627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:27.563069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:28.553165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:28.557166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:28.562220 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e63b00f8-9aca-4b32-a8f3-22c47a77c913 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1313 microversion: 2.1 time: 1.016957 Oct 19 07:01:28.566670 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1538/2998] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:27 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1313 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:28.574342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef6c28c1-a195-452c-9ed6-2aa2b02cd66f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fb06040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:28.676712 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef6c28c1-a195-452c-9ed6-2aa2b02cd66f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.106045 Oct 19 07:01:28.688521 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1539/2999] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:28 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:28.700838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-482617698", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "05fec950-716c-4339-8de8-f7aa8c1e8b59"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:28.820788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:01:29.073355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:29.100239 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-909a8862-e6cf-49bd-b5de-7ef3eef1087d tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1316 microversion: 2.1 time: 1.898034 Oct 19 07:01:29.100239 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1461/3000] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:27 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1316 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:29.586958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:29.587571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:29.604453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:29.605747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:29.606243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:29.606800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:29.607458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:29.607913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:29.609270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:30.026165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:01:30.026649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:01:30.027068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:01:30.031030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:01:30.032620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:01:30.057764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=17 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:30.071164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:30.071923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:30.074734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:30.076090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:30.081903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:30.082559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:30.113796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:30.130339 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a2a383f-e75c-48e8-a5f9-78cd9fd80bba tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1313 microversion: 2.1 time: 0.547287 Oct 19 07:01:30.135762 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1462/3001] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:29 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:30.135953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:01:30.163235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Getting quotas for user 6d399daf565e4ceabd2883ad43ef7f8b and project a6f0b288d116428981f07801b48d1cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:01:30.169477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3abda25e-ced9-43bd-baf7-5df25e82fdb4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d649c7d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:30.246876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:01:30.259532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:01:30.340943 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3abda25e-ced9-43bd-baf7-5df25e82fdb4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.202574 Oct 19 07:01:30.342200 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1463/3002] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:30 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:30.357410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:30.358547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:30.375382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:30.377912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:30.378525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:30.379411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:30.380011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:30.380686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:30.574196 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eff1fcbe-545f-40bd-9703-ce55bdbd07c3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.883888 Oct 19 07:01:30.576042 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1540/3003] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:01:30.586551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4db8aa63-c494-41f7-b728-8e374f4cb5a3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:30.587481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4db8aa63-c494-41f7-b728-8e374f4cb5a3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:30.759389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4db8aa63-c494-41f7-b728-8e374f4cb5a3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:30.765588 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4db8aa63-c494-41f7-b728-8e374f4cb5a3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1216 microversion: 2.1 time: 0.183076 Oct 19 07:01:30.766954 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1541/3004] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:30 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1216 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:30.943531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:30.956307 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c318072-9d18-4d06-9b62-16bb74a7db20 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1316 microversion: 2.1 time: 0.610802 Oct 19 07:01:30.959447 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1464/3005] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:30 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1316 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:31.152622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:31.153875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:31.156430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:31.174467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:31.174995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:31.175437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:31.176205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:31.176765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:31.177186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:31.357085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb4bbd2f-97e0-4547-a9d9-b5e1c3cace6c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d645e3b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:31.469830 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb4bbd2f-97e0-4547-a9d9-b5e1c3cace6c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.116916 Oct 19 07:01:31.470923 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1465/3006] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:31 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:31.793370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2be51e23-8a94-4927-91af-d99b5b62aeb5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:31.802175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2be51e23-8a94-4927-91af-d99b5b62aeb5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:31.924481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:32.091195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2be51e23-8a94-4927-91af-d99b5b62aeb5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:32.103506 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2be51e23-8a94-4927-91af-d99b5b62aeb5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1216 microversion: 2.1 time: 0.311562 Oct 19 07:01:32.104625 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1466/3007] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:31 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1216 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:32.116411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:32.120185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:32.133950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:32.135149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:32.135760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:32.137688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:32.138406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:32.139058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:32.344315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:32.391385 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a65cf60f-cfe1-455a-a2e1-2f7df821d4c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1334 microversion: 2.1 time: 1.216938 Oct 19 07:01:32.391385 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1542/3008] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:31 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1334 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:32.488417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19f968ea-4b91-46e2-98dd-df5a8223932c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64eee700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:32.567591 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19f968ea-4b91-46e2-98dd-df5a8223932c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.083000 Oct 19 07:01:32.568209 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1543/3009] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:32 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:32.601014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:32.611098 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64b64dcf-e951-418c-bc97-6748b6bf3e48 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1316 microversion: 2.1 time: 0.503259 Oct 19 07:01:32.617508 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1467/3010] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:32 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:33.134089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:33.141764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:33.162406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:33.163357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:33.164871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:33.168693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:33.173055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:33.175013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:33.419967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-938267740", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:33.521434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] validate_networks() for [('29335e90-a1bf-4955-b677-1be0dcbe05b7', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:01:33.713821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:33.723455 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-086bc257-0c01-4550-b2d5-3a91d2fd09a4 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1268 microversion: 2.1 time: 0.593820 Oct 19 07:01:33.743389 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1468/3011] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:33 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1268 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:33.753369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:33.759676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:33.780197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:33.780565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:33.781011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:33.781795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:33.782255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:33.783195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:34.770828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:34.817559 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-339d9813-eebf-4dd0-a65a-e3dc182304b9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 1.072556 Oct 19 07:01:34.821175 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1469/3012] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:33 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:34.861299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-016a3739-177c-40a6-bfb7-37e1be03a96e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d66166a60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:34.971859 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-016a3739-177c-40a6-bfb7-37e1be03a96e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.128470 Oct 19 07:01:34.975241 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1470/3013] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:34 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:35.003434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:35.004129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:35.044200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:35.047593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:35.048066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:35.060452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:35.060970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:35.065260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:35.369411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:35.380153 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43798719-e0b2-490e-b000-257e22212507 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1316 microversion: 2.1 time: 0.401545 Oct 19 07:01:35.380809 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1471/3014] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:34 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:35.400338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:35.402441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:35.413847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:35.418760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:35.418760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:35.418760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:35.418760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:35.418760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:35.624443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:35.633834 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-358a34bb-ffab-45af-ae1f-eb15d85f8e90 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1274 microversion: 2.1 time: 0.239967 Oct 19 07:01:35.644404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:01:35.645118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:01:35.645622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:01:35.646174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:01:35.646704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:01:35.648908 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1472/3015] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:35 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:35.660012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-547f4a99-7e7b-476f-b672-d7a74e4032a7 req-c4dc942a-e97b-4c3b-98dd-01acaca78ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524a6e73-ef2b-4af5-884d-331924e8ad09", "name": "network-vif-plugged", "status": "completed", "tag": "1249d2c6-bb1b-43b7-9034-10146ff5c868"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:35.674074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:35.675499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:35.676216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:35.677190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:35.677887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:35.678567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:35.692085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-547f4a99-7e7b-476f-b672-d7a74e4032a7 req-c4dc942a-e97b-4c3b-98dd-01acaca78ce2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:35.692661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-547f4a99-7e7b-476f-b672-d7a74e4032a7 req-c4dc942a-e97b-4c3b-98dd-01acaca78ce2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:35.695606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-547f4a99-7e7b-476f-b672-d7a74e4032a7 req-c4dc942a-e97b-4c3b-98dd-01acaca78ce2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:35.717448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Getting quotas for project b3dbcf548a5843b3987aba2aac6028b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:01:35.727476 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-547f4a99-7e7b-476f-b672-d7a74e4032a7 req-c4dc942a-e97b-4c3b-98dd-01acaca78ce2 service nova] Creating event network-vif-plugged:1249d2c6-bb1b-43b7-9034-10146ff5c868 for instance 524a6e73-ef2b-4af5-884d-331924e8ad09 on n-h1-861333-10 Oct 19 07:01:35.731441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Getting quotas for user 260c88b50daf4cdd8048282cea957f93 and project b3dbcf548a5843b3987aba2aac6028b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:01:35.748735 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-547f4a99-7e7b-476f-b672-d7a74e4032a7 req-c4dc942a-e97b-4c3b-98dd-01acaca78ce2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095354 Oct 19 07:01:35.752930 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1473/3016] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:35.763631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:01:35.769862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:01:35.854317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:35.856920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:35.878521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:35.879033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:35.879478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:35.880256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:35.880712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:35.881141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:35.981434 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7290bb56-737f-43b9-b415-b301e38a49fe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.897319 Oct 19 07:01:35.983870 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1544/3017] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:01:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:01:35.994793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a87f6e1a-df7f-47b8-a2c0-e99be97c6d95 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64eeeb80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:36.096508 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a87f6e1a-df7f-47b8-a2c0-e99be97c6d95 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.110193 Oct 19 07:01:36.098079 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1545/3018] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:35 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:36.107816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83d60018-05ca-469d-8ba6-778130580e0b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:36.113392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83d60018-05ca-469d-8ba6-778130580e0b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:36.469990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:36.479556 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-031dfb0c-f3b5-429f-87bf-3c3b842abc4d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 0.630933 Oct 19 07:01:36.503750 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1474/3019] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:35 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:36.521554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:36.522633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:36.543218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:36.553248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:36.553960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:36.554930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:36.555607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:36.556295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:36.883470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83d60018-05ca-469d-8ba6-778130580e0b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:36.892921 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83d60018-05ca-469d-8ba6-778130580e0b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1213 microversion: 2.1 time: 0.792884 Oct 19 07:01:36.908747 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1546/3020] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:36 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1213 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:36.922094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:36.923282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:36.963367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:36.969636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:36.972845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:36.973303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:36.974056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:36.974518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:36.974956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:36.997864 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b85da228-b043-4c65-9cbb-719463537b3a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1316 microversion: 2.1 time: 0.492796 Oct 19 07:01:37.012984 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1475/3021] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:36 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:37.026411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a7f26992-6d82-4b97-8805-d183a87b2f26 req-2d3c7a22-4f9d-423b-b499-744187799b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "tag": "6d2bd259-7782-49a5-8138-b9ebd0e10fb5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:37.051232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a7f26992-6d82-4b97-8805-d183a87b2f26 req-2d3c7a22-4f9d-423b-b499-744187799b1e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:37.052045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a7f26992-6d82-4b97-8805-d183a87b2f26 req-2d3c7a22-4f9d-423b-b499-744187799b1e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:37.052761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a7f26992-6d82-4b97-8805-d183a87b2f26 req-2d3c7a22-4f9d-423b-b499-744187799b1e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:37.105887 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a7f26992-6d82-4b97-8805-d183a87b2f26 req-2d3c7a22-4f9d-423b-b499-744187799b1e service nova] Creating event network-changed:6d2bd259-7782-49a5-8138-b9ebd0e10fb5 for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:01:37.115369 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a7f26992-6d82-4b97-8805-d183a87b2f26 req-2d3c7a22-4f9d-423b-b499-744187799b1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100799 Oct 19 07:01:37.116656 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1476/3022] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:37.126014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d4bca02-4f96-44a5-a4b1-7f3654ad665b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d647d5160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:37.197445 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d4bca02-4f96-44a5-a4b1-7f3654ad665b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.077226 Oct 19 07:01:37.206518 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1477/3023] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:37 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:37.519370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:37.519370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:37.528807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:37.529579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:37.530126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:37.530973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:37.535135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:37.535685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:38.396084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:38.419958 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-752ed8d9-ec15-469e-a4c3-272f9f371295 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 1.509986 Oct 19 07:01:38.424942 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1547/3024] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:36 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:38.436395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:38.437367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:38.457527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:38.459526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:38.460234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:38.462367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:38.463456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:38.471140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:38.471796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:38.504071 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-50a5be6a-8a7d-4d2a-83ea-fb2366c89cc3 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 0.997910 Oct 19 07:01:38.506027 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1478/3025] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:37 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:38.534510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:38.541072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:38.569071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:38.571966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:38.572661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:38.577094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:38.578663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:38.586999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:38.786423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:38.795219 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-011b73e7-95a1-4a3c-8400-5a6772184c46 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1209 microversion: 2.1 time: 0.368923 Oct 19 07:01:38.798687 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1548/3026] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:38 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1209 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:38.820285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3fb3f44c-1784-4a65-8c1a-e66d93ba4ecd tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64eeeee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:38.909201 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3fb3f44c-1784-4a65-8c1a-e66d93ba4ecd tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.109152 Oct 19 07:01:38.909922 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1549/3027] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:38 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:39.039471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:39.052920 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a74731d8-c712-4e3a-9b9e-b7f2f84a2b60 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1466 microversion: 2.1 time: 0.544311 Oct 19 07:01:39.052920 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1479/3028] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:38 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1466 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:39.080024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-359707346", "metadata": {"image_type": "test"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:39.084456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:39.095988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:39.101288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:39.102017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:39.103420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:39.104166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:39.104947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:39.199552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Getting quotas for project 7dda7801787e4ea3988a90f30451f3fa. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:01:39.214012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Getting quotas for user cd1e25ce6cfb48159196d4466727a4d2 and project 7dda7801787e4ea3988a90f30451f3fa. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:01:39.656602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20ef3e9f-5dbb-4a78-9122-98565e32be67 tempest-FloatingIPDetailsNegativeTestJSON-1307307068 tempest-FloatingIPDetailsNegativeTestJSON-1307307068-project] Calling method '.version_select at 0x7f6d6483c790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:40.245658 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8ab06e8-a2a1-4cf9-9a77-f44b82c475c4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "POST /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09/action" status: 202 len: 0 microversion: 2.1 time: 1.153066 Oct 19 07:01:40.249348 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1550/3029] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:01:39 2022] POST /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09/action => generated 0 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 07:01:40.264362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:40.269282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:40.284621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:40.286034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:40.287010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:40.288156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:40.288818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:40.289467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:40.394511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-20ef3e9f-5dbb-4a78-9122-98565e32be67 tempest-FloatingIPDetailsNegativeTestJSON-1307307068 tempest-FloatingIPDetailsNegativeTestJSON-1307307068-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 04578159-8525-4e42-a442-30184d95eee5 could not be found", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:01:40.395527 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-20ef3e9f-5dbb-4a78-9122-98565e32be67 tempest-FloatingIPDetailsNegativeTestJSON-1307307068 tempest-FloatingIPDetailsNegativeTestJSON-1307307068-project] HTTP exception thrown: Floating IP not found for ID 04578159-8525-4e42-a442-30184d95eee5 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20ef3e9f-5dbb-4a78-9122-98565e32be67 tempest-FloatingIPDetailsNegativeTestJSON-1307307068 tempest-FloatingIPDetailsNegativeTestJSON-1307307068-project] Request method failure captured: Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-floating-ips/04578159-8525-4e42-a442-30184d95eee5 HTTP/1.1 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DTcslYC3QlHF-hUovvC8pjsidtir0GoXQ4KQkgUX4rjMAI5ZAFkCVGaECE4fxFa3Ntj_ESNSmoVa8KhMGTd9ea67ABMus5NoxgdI-MmWtyxjhDhZ33bMsAvrG9XotezVN4C74KGB_AX_gE29rMAgp7j8XP6G4UqKcHoyVts8sXh60 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: aadf4eba65f94729b36aa7af4e464f43 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1307307068 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aadf4eba65f94729b36aa7af4e464f43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aadf4eba65f94729b36aa7af4e464f43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aadf4eba65f94729b36aa7af4e464f43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aadf4eba65f94729b36aa7af4e464f43", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1307307068 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: aadf4eba65f94729b36aa7af4e464f43 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1307307068 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1307307068-project Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 11d07716f4bd4cd7be9af9d7af0d155c Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1307307068-project Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: exception: Floating IP not found for ID 04578159-8525-4e42-a442-30184d95eee5 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '04578159-8525-4e42-a442-30184d95eee5'} Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:01:40.397933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 04578159-8525-4e42-a442-30184d95eee5 could not be found Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad749709-e725-4076-ac39-f72abd6e0676'] Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 04578159-8525-4e42-a442-30184d95eee5. Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 04578159-8525-4e42-a442-30184d95eee5 Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 04578159-8525-4e42-a442-30184d95eee5 Oct 19 07:01:40.403239 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:01:40.408227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20ef3e9f-5dbb-4a78-9122-98565e32be67 tempest-FloatingIPDetailsNegativeTestJSON-1307307068 tempest-FloatingIPDetailsNegativeTestJSON-1307307068-project] Returning 404 to user: Floating IP not found for ID 04578159-8525-4e42-a442-30184d95eee5 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:01:40.408941 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20ef3e9f-5dbb-4a78-9122-98565e32be67 tempest-FloatingIPDetailsNegativeTestJSON-1307307068 tempest-FloatingIPDetailsNegativeTestJSON-1307307068-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/04578159-8525-4e42-a442-30184d95eee5" status: 404 len: 111 microversion: 2.1 time: 1.006238 Oct 19 07:01:40.410030 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1480/3030] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 07:01:39 2022] GET /compute/v2.1/os-floating-ips/04578159-8525-4e42-a442-30184d95eee5 => generated 111 bytes in 1008 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:01:40.429281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:40.429281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:40.473819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:40.481017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:40.482390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:40.484380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:40.487309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:40.488173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:40.511342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:41.076029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:41.102832 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5146d635-af5a-47e3-90c3-28c9ae560935 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.849200 Oct 19 07:01:41.106098 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1551/3031] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:40 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:41.131100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:41.132011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:41.155707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:41.159102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:41.159937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:41.162034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:41.162711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:41.165509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:41.395222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:41.412427 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fedc7b35-00e9-4ffa-90d6-a767cbaffd10 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 1.001165 Oct 19 07:01:41.423428 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1481/3032] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:40 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:41.424826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:41.437766 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-239bb55b-b92f-45a5-82f0-ffde5239b538 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1271 microversion: 2.1 time: 0.327115 Oct 19 07:01:41.453850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7abcbe47-6b23-46cd-b8ec-b9e298f5a786 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d640d8dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:41.455345 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1552/3033] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:41 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1271 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:41.472089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef4ed7b8-aba6-407d-9f8f-7b91225ad51a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d5fb0cc10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:41.663147 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7abcbe47-6b23-46cd-b8ec-b9e298f5a786 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1451 microversion: 2.1 time: 0.237262 Oct 19 07:01:41.673887 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1482/3034] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:41 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1451 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:41.698857 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef4ed7b8-aba6-407d-9f8f-7b91225ad51a tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 200 len: 1421 microversion: 2.1 time: 0.240943 Oct 19 07:01:41.700432 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1553/3035] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:41 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 1421 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:42.138168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:42.139274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:42.159572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:42.159973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:42.161875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:42.162773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:42.163207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8ad2cb56-4d69-4fbb-88b5-8f01d677fa4a req-d407e69b-eb01-45c7-8d65-bba4b21f65f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "tag": "1d2dd742-7bd1-44d6-965d-652ce6110efc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:42.166165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:42.166814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:42.187697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8ad2cb56-4d69-4fbb-88b5-8f01d677fa4a req-d407e69b-eb01-45c7-8d65-bba4b21f65f1 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:42.188305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8ad2cb56-4d69-4fbb-88b5-8f01d677fa4a req-d407e69b-eb01-45c7-8d65-bba4b21f65f1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:42.190353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8ad2cb56-4d69-4fbb-88b5-8f01d677fa4a req-d407e69b-eb01-45c7-8d65-bba4b21f65f1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:42.218655 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8ad2cb56-4d69-4fbb-88b5-8f01d677fa4a req-d407e69b-eb01-45c7-8d65-bba4b21f65f1 service nova] Creating event network-changed:1d2dd742-7bd1-44d6-965d-652ce6110efc for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:01:42.250696 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8ad2cb56-4d69-4fbb-88b5-8f01d677fa4a req-d407e69b-eb01-45c7-8d65-bba4b21f65f1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089670 Oct 19 07:01:42.253407 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1554/3036] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:42.444281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:42.445770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:42.452671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:42.453267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:42.453724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:42.454445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:42.454948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:42.455405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:43.130829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:43.146932 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ce49b3e-cb50-43dc-a10d-4ff5635b3160 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 1.015295 Oct 19 07:01:43.150428 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1483/3037] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:42 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:43.197192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:43.198875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:43.206468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:43.221769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:43.227361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:43.228887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:43.230251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:43.233010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:43.234997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:43.439722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:43.454310 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0c19fd9-0655-438c-8b3c-dba7a62c2e9f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 1.015898 Oct 19 07:01:43.460611 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1555/3038] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:42 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:43.471474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90bb1ab6-8c16-42ed-ac33-0f1e35bceb71 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64add040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:43.514014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:43.544500 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbc763b8-14fd-462b-bad0-6bf918dfc9ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1271 microversion: 2.1 time: 0.392584 Oct 19 07:01:43.545612 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1484/3039] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:43 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1271 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:43.568657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c119a2ac-da56-4e78-ba4e-12c3bf63d3e9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64bfcf70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:43.670282 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90bb1ab6-8c16-42ed-ac33-0f1e35bceb71 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1460 microversion: 2.1 time: 0.206944 Oct 19 07:01:43.676426 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1556/3040] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:43 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1460 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:43.696418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0a661594-5e72-4503-8a57-e41d543abdf9 req-0f6212ed-83f9-475d-ac78-d63168e47c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6b49d7-9798-47ae-8879-d89895160ca3", "tag": "96d5eb61-1eb1-4fe5-a4d4-98b8a536c92a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:43.703006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a661594-5e72-4503-8a57-e41d543abdf9 req-0f6212ed-83f9-475d-ac78-d63168e47c2a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:43.703559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a661594-5e72-4503-8a57-e41d543abdf9 req-0f6212ed-83f9-475d-ac78-d63168e47c2a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:43.703986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a661594-5e72-4503-8a57-e41d543abdf9 req-0f6212ed-83f9-475d-ac78-d63168e47c2a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:43.707306 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c119a2ac-da56-4e78-ba4e-12c3bf63d3e9 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 200 len: 1421 microversion: 2.1 time: 0.160312 Oct 19 07:01:43.708621 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1485/3041] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:43 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 1421 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:43.743106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e7c96bc-004b-465c-8523-50f8f3cf7247 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d650880d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:43.748223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0a661594-5e72-4503-8a57-e41d543abdf9 req-0f6212ed-83f9-475d-ac78-d63168e47c2a service nova] Creating event network-changed:96d5eb61-1eb1-4fe5-a4d4-98b8a536c92a for instance db6b49d7-9798-47ae-8879-d89895160ca3 on n-h1-861333-10 Oct 19 07:01:43.764636 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0a661594-5e72-4503-8a57-e41d543abdf9 req-0f6212ed-83f9-475d-ac78-d63168e47c2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086621 Oct 19 07:01:43.766775 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1557/3042] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:43.844866 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e7c96bc-004b-465c-8523-50f8f3cf7247 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 200 len: 1460 microversion: 2.1 time: 0.135048 Oct 19 07:01:43.854809 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1486/3043] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:43 2022] GET /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 1460 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:43.861712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:43.862498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:43.881699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:43.882519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:43.893984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:43.893984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:43.893984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:43.893984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:44.177607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:44.182204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:44.192638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:44.199390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:44.199959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:44.202771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:44.203392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:44.203946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:45.004344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:45.014885 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aef2ee48-c5c3-4dcf-b25c-fd253fee8546 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.842073 Oct 19 07:01:45.018050 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1487/3044] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:44 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:45.027394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:45.028014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:45.047707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:45.055540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:45.056418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:45.057460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:45.058587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:45.059359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:45.060041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:45.074567 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b7e4614-5db8-4885-ac55-7c6eb4c591b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1468 microversion: 2.1 time: 1.217005 Oct 19 07:01:45.085530 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1558/3045] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:43 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1468 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:45.103793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:45.104776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:45.113148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:45.113904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:45.114589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:45.115502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:45.116157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:45.116807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:45.676036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:45.689716 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cee37468-ddc9-410a-8647-8d2a56b4f1eb tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 0.667191 Oct 19 07:01:45.697762 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1488/3046] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:45 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:45.701515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:45.729743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61036279-c3b3-4859-9577-67e1fdde9920 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d6460a1f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:45.773870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:45.791382 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f77f2b5-d6eb-4851-ad27-c8ee755f25da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1313 microversion: 2.1 time: 0.701839 Oct 19 07:01:45.791880 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1559/3047] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:45 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1313 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:45.804170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38ac7763-ec5b-47b0-a79d-d26e695ff7b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1224288292"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:45.815964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38ac7763-ec5b-47b0-a79d-d26e695ff7b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:45.839765 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61036279-c3b3-4859-9577-67e1fdde9920 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 200 len: 1421 microversion: 2.1 time: 0.123432 Oct 19 07:01:45.844571 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1489/3048] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:45 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 1421 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:45.861127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac7763-ec5b-47b0-a79d-d26e695ff7b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:45.863659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac7763-ec5b-47b0-a79d-d26e695ff7b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:45.866106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac7763-ec5b-47b0-a79d-d26e695ff7b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:45.872774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac7763-ec5b-47b0-a79d-d26e695ff7b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:45.873602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac7763-ec5b-47b0-a79d-d26e695ff7b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:45.874067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac7763-ec5b-47b0-a79d-d26e695ff7b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:46.040823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:46.041451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:46.054752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:46.055309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:46.055719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:46.056478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:46.056948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:46.057387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:46.509160 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38ac7763-ec5b-47b0-a79d-d26e695ff7b4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "POST /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c/action" status: 202 len: 0 microversion: 2.1 time: 0.715482 Oct 19 07:01:46.515160 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1560/3049] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:01:45 2022] POST /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 07:01:46.526652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:46.535002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ccf9dd3-bbeb-4c48-9bef-7bf47eea721e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64adda60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:46.537173 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-215f0c61-8837-449a-aa4e-e28f89847956 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.500958 Oct 19 07:01:46.545255 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1490/3050] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:46 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:46.686297 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ccf9dd3-bbeb-4c48-9bef-7bf47eea721e tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d" status: 200 len: 1451 microversion: 2.1 time: 0.163938 Oct 19 07:01:46.702664 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1561/3051] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:46 2022] GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:46.720638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:46.722498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:46.731051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:46.744631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:46.745482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:46.750342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:46.751130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:46.751856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:46.812590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:46.813657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:46.832867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:46.833402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:46.835504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:46.836503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:46.836983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:46.847870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:46.889614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=15 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:47.400460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:47.409275 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a90d0422-95be-4cc0-8fc3-3507bb916df5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 0.692511 Oct 19 07:01:47.415134 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1491/3052] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:46 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:47.438220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7c996dc-5047-4973-9e04-9cc58acd32c7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d66166790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:47.524200 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7c996dc-5047-4973-9e04-9cc58acd32c7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 200 len: 1421 microversion: 2.1 time: 0.094186 Oct 19 07:01:47.525213 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1492/3053] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:47 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 1421 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:47.530736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9e94696a-9205-45ce-b193-ed7849365a1e req-1af48d86-c45c-445f-b4b9-11b47523baf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e163a6-ba79-4799-b148-8577e4e1f14f", "name": "network-vif-unplugged", "status": "completed", "tag": "6e7b73ff-17d4-48fe-88e8-152bb9294036"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:47.559711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9e94696a-9205-45ce-b193-ed7849365a1e req-1af48d86-c45c-445f-b4b9-11b47523baf6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:47.563572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9e94696a-9205-45ce-b193-ed7849365a1e req-1af48d86-c45c-445f-b4b9-11b47523baf6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:47.564441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9e94696a-9205-45ce-b193-ed7849365a1e req-1af48d86-c45c-445f-b4b9-11b47523baf6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:47.578495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:47.584042 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c93118f-6b19-4abc-aff6-2b8d4a03a803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1313 microversion: 2.1 time: 0.776172 Oct 19 07:01:47.587103 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9e94696a-9205-45ce-b193-ed7849365a1e req-1af48d86-c45c-445f-b4b9-11b47523baf6 service nova] Creating event network-vif-unplugged:6e7b73ff-17d4-48fe-88e8-152bb9294036 for instance c0e163a6-ba79-4799-b148-8577e4e1f14f on n-h1-861333-10 Oct 19 07:01:47.590129 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1562/3054] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:46 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:47.600706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:47.607317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:47.617894 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9e94696a-9205-45ce-b193-ed7849365a1e req-1af48d86-c45c-445f-b4b9-11b47523baf6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090588 Oct 19 07:01:47.618745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:47.619139 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1493/3055] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:47.621224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:47.621880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:47.630271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:47.630271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:47.630271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:47.709241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e00dac81-28aa-4dd0-a03c-dfed82ba8b63 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d647d5af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:47.805424 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e00dac81-28aa-4dd0-a03c-dfed82ba8b63 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d" status: 200 len: 1451 microversion: 2.1 time: 0.099040 Oct 19 07:01:47.806879 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1494/3056] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:47 2022] GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d => generated 1451 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:47.886112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-fc6ce84c-2cf8-44cb-aafe-b64b67bf6c26 req-fd0fdbcd-bfd0-494e-94ea-b989813c0def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "tag": "9fb85dca-4a0b-4244-8f9a-9e4ba09304f3"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:47.906052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fc6ce84c-2cf8-44cb-aafe-b64b67bf6c26 req-fd0fdbcd-bfd0-494e-94ea-b989813c0def service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:47.908168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fc6ce84c-2cf8-44cb-aafe-b64b67bf6c26 req-fd0fdbcd-bfd0-494e-94ea-b989813c0def service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:47.908849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fc6ce84c-2cf8-44cb-aafe-b64b67bf6c26 req-fd0fdbcd-bfd0-494e-94ea-b989813c0def service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:47.934533 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-fc6ce84c-2cf8-44cb-aafe-b64b67bf6c26 req-fd0fdbcd-bfd0-494e-94ea-b989813c0def service nova] Creating event network-changed:9fb85dca-4a0b-4244-8f9a-9e4ba09304f3 for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:01:47.945079 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-fc6ce84c-2cf8-44cb-aafe-b64b67bf6c26 req-fd0fdbcd-bfd0-494e-94ea-b989813c0def service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062924 Oct 19 07:01:47.946075 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1495/3057] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:48.264454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:48.269462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:01:48.277572 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e00b398-0837-4e1f-ac9d-f3bf2b1e8a0b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.686137 Oct 19 07:01:48.284701 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1563/3058] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:47 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:48.443349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:48.444517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:48.461335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:48.462194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:48.462823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:48.465998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:48.465998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:48.465998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:48.540788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93c60121-6b7c-4a1d-9b56-2dfea5638009 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64eee4c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:48.619362 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93c60121-6b7c-4a1d-9b56-2dfea5638009 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 200 len: 1421 microversion: 2.1 time: 0.083037 Oct 19 07:01:48.629529 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1564/3059] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:48 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 1421 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:48.642597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:48.643720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:48.656676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:48.658256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:48.662627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:48.663893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:48.664617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:48.665398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:49.599433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:49.616920 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-917c616f-498f-49ff-b890-aa4ed026ad76 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 1.178715 Oct 19 07:01:49.617576 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1496/3060] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:48 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:49.645842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df5f7eb1-f221-47c2-be77-99d159d615a2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64fe9f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:49.760087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:49.769838 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df5f7eb1-f221-47c2-be77-99d159d615a2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d" status: 200 len: 1451 microversion: 2.1 time: 0.138269 Oct 19 07:01:49.771157 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1497/3061] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:49 2022] GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d => generated 1451 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:49.784247 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-952702c8-1013-4656-bd21-319aca4c81fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1313 microversion: 2.1 time: 1.153186 Oct 19 07:01:49.784494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:49.785908 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1565/3062] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:48 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1313 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:49.795496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-daa37d96-ed5e-47f9-a0ba-e81fdced5989 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64aae5e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:49.796997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:49.815401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:49.816198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:49.819365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:49.825526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:49.825526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:49.825526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:49.865714 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-daa37d96-ed5e-47f9-a0ba-e81fdced5989 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 200 len: 1421 microversion: 2.1 time: 0.077957 Oct 19 07:01:49.868002 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1566/3063] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:49 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:49.881161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a759040b-4128-48e5-986f-aba4aeba2987 req-285fbf01-49ff-4f99-973b-48323eb100ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524a6e73-ef2b-4af5-884d-331924e8ad09", "name": "network-vif-plugged", "status": "completed", "tag": "1249d2c6-bb1b-43b7-9034-10146ff5c868"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:49.925759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a759040b-4128-48e5-986f-aba4aeba2987 req-285fbf01-49ff-4f99-973b-48323eb100ba service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:49.928322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a759040b-4128-48e5-986f-aba4aeba2987 req-285fbf01-49ff-4f99-973b-48323eb100ba service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:49.934430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a759040b-4128-48e5-986f-aba4aeba2987 req-285fbf01-49ff-4f99-973b-48323eb100ba service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:49.962514 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a759040b-4128-48e5-986f-aba4aeba2987 req-285fbf01-49ff-4f99-973b-48323eb100ba service nova] Creating event network-vif-plugged:1249d2c6-bb1b-43b7-9034-10146ff5c868 for instance 524a6e73-ef2b-4af5-884d-331924e8ad09 on n-h1-861333-10 Oct 19 07:01:49.975441 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a759040b-4128-48e5-986f-aba4aeba2987 req-285fbf01-49ff-4f99-973b-48323eb100ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105899 Oct 19 07:01:49.976388 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1567/3064] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:01:49.996628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-20d02ec8-24ae-465a-bf29-6982b783d6a3 req-b1789eae-003d-43ee-828a-4c100399c15d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f796c13-81fd-477b-9bc4-cd4abd638858", "tag": "cbebb461-c975-4224-b923-3bf36717886f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:01:50.017393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20d02ec8-24ae-465a-bf29-6982b783d6a3 req-b1789eae-003d-43ee-828a-4c100399c15d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:50.023785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20d02ec8-24ae-465a-bf29-6982b783d6a3 req-b1789eae-003d-43ee-828a-4c100399c15d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:50.024309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20d02ec8-24ae-465a-bf29-6982b783d6a3 req-b1789eae-003d-43ee-828a-4c100399c15d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:50.062786 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-20d02ec8-24ae-465a-bf29-6982b783d6a3 req-b1789eae-003d-43ee-828a-4c100399c15d service nova] Creating event network-changed:cbebb461-c975-4224-b923-3bf36717886f for instance 4f796c13-81fd-477b-9bc4-cd4abd638858 on n-h2-861333-10 Oct 19 07:01:50.082088 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-20d02ec8-24ae-465a-bf29-6982b783d6a3 req-b1789eae-003d-43ee-828a-4c100399c15d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090729 Oct 19 07:01:50.085139 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1568/3065] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:01:50.495257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:50.514056 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3e27a6b-30b3-4d63-aff3-c4d7e9eaf576 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.741495 Oct 19 07:01:50.530481 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1498/3066] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:49 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:50.645678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:50.646826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:50.662885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:50.663392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:50.663886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:50.664627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:50.665113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:50.665560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:50.786729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9752fbea-268b-4da5-97c1-fb01b3bbfa23 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64828670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:50.865928 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9752fbea-268b-4da5-97c1-fb01b3bbfa23 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d" status: 200 len: 1451 microversion: 2.1 time: 0.083315 Oct 19 07:01:50.866522 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1499/3067] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:50 2022] GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d => generated 1451 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:01:50.877444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:50.891236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:50.909729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:50.910517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:50.911157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:50.913147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:50.924909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:50.925617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:51.644633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:51.669912 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12189dc3-e260-4b31-b46f-d861413837c5 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 1.030491 Oct 19 07:01:51.678180 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1569/3068] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:50 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:51.703303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0590684a-c454-4a12-ad9d-b7467372f9c5 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64a30550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:52.250105 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0590684a-c454-4a12-ad9d-b7467372f9c5 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 200 len: 1421 microversion: 2.1 time: 0.566608 Oct 19 07:01:52.251109 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1570/3069] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:51 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 1421 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:52.266723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:52.294037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:52.299355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:52.308439 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f56e51cd-94ae-4b9d-aea4-123a33f7af32 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1313 microversion: 2.1 time: 1.431603 Oct 19 07:01:52.313878 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1500/3070] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:50 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1313 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:52.332487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:52.334125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d435ff4-4cff-48b0-9a0a-bd18b47b64d9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d647c4940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:52.335170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:52.341275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:52.347236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:52.351538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:52.352264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:53.026086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:53.039869 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43975689-9350-4f97-9ed3-c91aba6e9a9f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.784470 Oct 19 07:01:53.041025 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1571/3071] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:52 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:53.055385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:01:53.059190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:01:53.084412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:53.090639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:53.092806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:53.093793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:01:53.094462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:01:53.101881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:01:55.267050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:01:55.276334 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9ac7a4a-8401-4fe3-9d07-3898990ccd38 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 2.230194 Oct 19 07:01:55.280468 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1572/3072] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:01:53 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:01:55.308634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e999c4fa-739c-48c5-b473-3bf4f21f6f56 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64916430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:00.910596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:02.275136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=63 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:03.070600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:05.260729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=28 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:11.311297 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d435ff4-4cff-48b0-9a0a-bd18b47b64d9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d" status: 200 len: 1451 microversion: 2.1 time: 18.995358 Oct 19 07:02:11.312731 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1501/3073] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:52 2022] GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d => generated 1451 bytes in 18997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:11.329687 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e999c4fa-739c-48c5-b473-3bf4f21f6f56 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 200 len: 1430 microversion: 2.1 time: 16.046474 Oct 19 07:02:11.331267 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1573/3074] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:01:55 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 1430 bytes in 16050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:11.344010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:11.345183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:11.350833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:11.352461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:11.378994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:11.378994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:11.378994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:11.379301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:11.379922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:11.380911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:11.381345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:11.382517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:11.383178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:11.385806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:11.386482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:11.386959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:11.631059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:11.648244 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43017aff-400c-4ca7-a03b-30c781436f70 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.314302 Oct 19 07:02:11.650065 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1574/3075] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:11 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:11.663468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5a19a7ce-6206-458a-81f6-d82ea7b10832 req-98ec66f0-2436-4154-b93a-e190cf247772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c", "name": "network-vif-plugged", "status": "completed", "tag": "e9ea764b-95e8-4aeb-ae74-818b2898ceb8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:11.684408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5a19a7ce-6206-458a-81f6-d82ea7b10832 req-98ec66f0-2436-4154-b93a-e190cf247772 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:11.684573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5a19a7ce-6206-458a-81f6-d82ea7b10832 req-98ec66f0-2436-4154-b93a-e190cf247772 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:11.685346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5a19a7ce-6206-458a-81f6-d82ea7b10832 req-98ec66f0-2436-4154-b93a-e190cf247772 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:11.706758 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5a19a7ce-6206-458a-81f6-d82ea7b10832 req-98ec66f0-2436-4154-b93a-e190cf247772 service nova] Creating event network-vif-plugged:e9ea764b-95e8-4aeb-ae74-818b2898ceb8 for instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c on n-h2-861333-10 Oct 19 07:02:11.712229 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5a19a7ce-6206-458a-81f6-d82ea7b10832 req-98ec66f0-2436-4154-b93a-e190cf247772 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060386 Oct 19 07:02:11.713704 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1575/3076] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:11.722563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:11.722563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:11.728260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:11.728762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:11.729403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:11.730124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:11.730760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:11.731230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:11.738900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:11.747133 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f93ef5be-da6b-44c2-b4dd-b8a3bb86ab4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1313 microversion: 2.1 time: 0.433163 Oct 19 07:02:11.748426 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1502/3077] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:11 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:11.964301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:11.975098 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6cafa6b-de8f-4e0b-bca4-b0e4b100a819 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 0.259974 Oct 19 07:02:11.976817 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1576/3078] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:11 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:12.046146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be83cbd8-5f95-4274-a3e6-e8428142a24f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'create', calling method: .version_select at 0x7f6d64e17040>, body: {"keypair": {"name": "tempest-keypair-901693878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItaCYMFqRNIhr9/Mu/tzbHhCWVtvJ/2FiPxIKdlMoJ91xpTAuTetK7MA8kGGfWGIUX20pteCuC1Qr5F+iEZ/ZU7o2P4ocxRGgKD4jqQD7SV9LJT4v4GJlsbyD2a5AnQ7Q=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:12.066644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be83cbd8-5f95-4274-a3e6-e8428142a24f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for project 05016de78e0b4491a53cfa3885193ca8. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:12.073169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be83cbd8-5f95-4274-a3e6-e8428142a24f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for user 2543970e80c84e109961fc84bfaaedd1 and project 05016de78e0b4491a53cfa3885193ca8. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:12.077243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a318dcee-3159-4035-aea4-cedc81329e1c tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Action: 'create', calling method: .version_select at 0x7f6d64797e50>, body: {"keypair": {"name": "tempest-keypair-1551532450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvrlmLbltTvAtkGrdm/5nWC+j8Xfo2ZhxPtI7PzNWCLb8w6yN2K6Eags5iXa929srzh7g3jz+Ck7RMdyUf8R9cFJH2Ww5mHGGifEPMNAhEWKCFE9J7oIUhRa9RUCoyrNA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:12.112082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a318dcee-3159-4035-aea4-cedc81329e1c tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:12.130635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a318dcee-3159-4035-aea4-cedc81329e1c tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for user 3b3f4869a1b64b1a8029a9c60bd31f8f and project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:12.266311 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be83cbd8-5f95-4274-a3e6-e8428142a24f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.516539 Oct 19 07:02:12.266967 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1503/3079] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:02:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:12.296599 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a318dcee-3159-4035-aea4-cedc81329e1c tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.318359 Oct 19 07:02:12.306825 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1577/3080] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:02:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:12.311803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a782a746-fee4-4bc5-9837-94258e85d0ef tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64d634c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:12.352295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-2051820138", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "9b8df54b-6fbd-478f-8f23-4667d90e03dd"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:12.364357 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a782a746-fee4-4bc5-9837-94258e85d0ef tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 200 len: 1430 microversion: 2.1 time: 0.056286 Oct 19 07:02:12.373343 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1578/3081] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:12 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 1430 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:12.379031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e29480a-98ef-42e0-935c-247efd76b144 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Calling method '.version_select at 0x7f6d649654c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:12.389053 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e29480a-98ef-42e0-935c-247efd76b144 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-1551532450" status: 200 len: 498 microversion: 2.1 time: 0.014299 Oct 19 07:02:12.389838 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1579/3082] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 07:02:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1551532450 => generated 498 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:12.395102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-079a10bf-82dc-4156-a640-676655fcbaa8 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d647973a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:12.434137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] validate_networks() for [('9b8df54b-6fbd-478f-8f23-4667d90e03dd', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:02:12.442608 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-079a10bf-82dc-4156-a640-676655fcbaa8 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d" status: 200 len: 1451 microversion: 2.1 time: 0.051864 Oct 19 07:02:12.443203 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1580/3083] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:12 2022] GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d => generated 1451 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:12.448226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:12.448662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:12.455781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:12.456170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:12.456624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:12.457510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:12.457980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:12.458422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:12.632941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:12.641296 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c1d557c-bce3-42da-bdf8-1f99f8ced062 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1466 microversion: 2.1 time: 0.196850 Oct 19 07:02:12.641992 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1581/3084] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:12 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1466 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:12.648117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-56fdc7e2-6eb8-4ae1-9b73-48143114e703 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Calling method '.version_select at 0x7f6d647979d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:12.739398 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-56fdc7e2-6eb8-4ae1-9b73-48143114e703 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551532450" status: 202 len: 0 microversion: 2.1 time: 0.095309 Oct 19 07:02:12.739996 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1582/3085] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:02:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551532450 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:02:12.744909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04a61fff-6407-439e-95b6-6360f245d75e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64ebd3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:12.793160 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04a61fff-6407-439e-95b6-6360f245d75e tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/bf91402f-43c2-455b-ba41-1073b9eae084" status: 200 len: 784 microversion: 2.1 time: 0.051982 Oct 19 07:02:12.794198 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1583/3086] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:12 2022] GET /compute/v2.1/images/bf91402f-43c2-455b-ba41-1073b9eae084 => generated 784 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:12.800085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:12.800767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:12.807156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:12.807938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:12.808642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:12.809530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:12.810029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:12.810474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:12.877457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:02:12.877885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:02:12.878617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:02:12.879030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:02:12.879446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:02:12.893409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:12.893895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:12.894527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:12.895401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:12.896247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:12.896826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:12.916826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Getting quotas for project 433ad16e975a4768b2a26b3c6771b89c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:12.922260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Getting quotas for user 04f412dc05164ab9b33aaa8bb244f348 and project 433ad16e975a4768b2a26b3c6771b89c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:12.941477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:02:12.941477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:02:13.000812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:13.010340 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8cf4a8ed-038a-4821-827a-445f51f406bf tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.215286 Oct 19 07:02:13.010933 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1584/3087] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:12 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:13.015543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba7f430d-2103-4d1f-8638-f36a92370425 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Action: 'create', calling method: .version_select at 0x7f6d64e5fd30>, body: {"keypair": {"name": "tempest-keypair-2032078163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpE2Y3fr6h551nIR+XCa3MxyqRL+dP4OMHph1JQC3eFzUr4Ce/jcT00M56reUv2WrQ0FzO4NWPAMvGkAHblLRZluyow4a2B3zY0r+743iDhDAU17OEShykiH8A32SD9zw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:13.036839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ba7f430d-2103-4d1f-8638-f36a92370425 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:13.043067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ba7f430d-2103-4d1f-8638-f36a92370425 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for user 3b3f4869a1b64b1a8029a9c60bd31f8f and project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:13.059322 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9efd4e95-dab6-4882-b1a3-f7bc0c9dd00c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790617 Oct 19 07:02:13.059983 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1504/3088] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:02:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:02:13.066377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.067114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:13.074743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:13.075268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:13.075877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:13.079630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:13.079630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:13.079630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:13.151578 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba7f430d-2103-4d1f-8638-f36a92370425 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139580 Oct 19 07:02:13.152219 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1585/3089] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:02:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:13.160065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8269fe0-289a-4a21-ae87-ce1cae4f3c52 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.175165 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8269fe0-289a-4a21-ae87-ce1cae4f3c52 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021867 Oct 19 07:02:13.175758 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1586/3090] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 07:02:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:13.190648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.191292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:13.199553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:13.200064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:13.200576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:13.201303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:13.201770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:13.202205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:13.256884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:13.270923 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59e0c98a-4395-48fe-bb03-52081c633614 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1313 microversion: 2.1 time: 0.205237 Oct 19 07:02:13.270923 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1505/3091] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:13 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:13.272041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e4830bd-d15a-4871-a776-ddb77c928e26 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.272887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e4830bd-d15a-4871-a776-ddb77c928e26 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:13.353992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e4830bd-d15a-4871-a776-ddb77c928e26 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:13.365658 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e4830bd-d15a-4871-a776-ddb77c928e26 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1228 microversion: 2.1 time: 0.097376 Oct 19 07:02:13.366714 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1506/3092] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:13 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1228 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:13.371443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9752d79f-9aac-476a-a71b-e2e6fb9362be tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Calling method '.version_select at 0x7f6d64e3f9d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.407217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:13.416343 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d2f6301-f2ea-4d57-a0fc-5ce475129637 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 0.231321 Oct 19 07:02:13.416889 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1587/3093] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:13 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:13.421944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afa506a0-2fb2-40b2-9a81-493e3f9ab651 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64e41160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.456678 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9752d79f-9aac-476a-a71b-e2e6fb9362be tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032078163" status: 202 len: 0 microversion: 2.1 time: 0.088605 Oct 19 07:02:13.465131 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1507/3094] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032078163 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:02:13.472918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f06ac24-e149-4063-8552-4c66e185fcdd tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64e2e550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.540481 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f06ac24-e149-4063-8552-4c66e185fcdd tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d" status: 200 len: 1460 microversion: 2.1 time: 0.076885 Oct 19 07:02:13.541353 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1508/3095] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:13 2022] GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d => generated 1460 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:13.551100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6500ce2-7aba-40f2-b2a7-99706894be36 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Action: 'create', calling method: .version_select at 0x7f6d649e3700>, body: {"keypair": {"name": "tempest-keypair-2124421376", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:13.567503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f6500ce2-7aba-40f2-b2a7-99706894be36 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:13.575625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f6500ce2-7aba-40f2-b2a7-99706894be36 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for user 3b3f4869a1b64b1a8029a9c60bd31f8f and project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:13.674351 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6500ce2-7aba-40f2-b2a7-99706894be36 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.122749 Oct 19 07:02:13.674748 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1509/3096] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:02:13 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:13.679894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-987f62d0-c1a8-4b8b-90db-11f25277eab1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64c59820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.732628 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-987f62d0-c1a8-4b8b-90db-11f25277eab1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d" status: 200 len: 1460 microversion: 2.1 time: 0.056574 Oct 19 07:02:13.733701 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1510/3097] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:13 2022] GET /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d => generated 1460 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:13.738594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2011383e-ed57-4934-8e18-a7198eff68e1 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Calling method '.version_select at 0x7f6d651d8550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.853848 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2011383e-ed57-4934-8e18-a7198eff68e1 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124421376" status: 202 len: 0 microversion: 2.1 time: 0.119308 Oct 19 07:02:13.854439 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1511/3098] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124421376 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:02:13.861229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6b49d7-9798-47ae-8879-d89895160ca3", "name": "network-vif-plugged", "status": "completed", "tag": "96d5eb61-1eb1-4fe5-a4d4-98b8a536c92a"}, {"server_uuid": "4f796c13-81fd-477b-9bc4-cd4abd638858", "name": "network-vif-plugged", "status": "completed", "tag": "cbebb461-c975-4224-b923-3bf36717886f"}, {"server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "name": "network-vif-plugged", "status": "completed", "tag": "9fb85dca-4a0b-4244-8f9a-9e4ba09304f3"}, {"server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "name": "network-vif-plugged", "status": "completed", "tag": "6d2bd259-7782-49a5-8138-b9ebd0e10fb5"}, {"server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "name": "network-vif-plugged", "status": "completed", "tag": "1d2dd742-7bd1-44d6-965d-652ce6110efc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:13.873489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:13.873974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:13.874514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:13.896974 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] Creating event network-vif-plugged:96d5eb61-1eb1-4fe5-a4d4-98b8a536c92a for instance db6b49d7-9798-47ae-8879-d89895160ca3 on n-h1-861333-10 Oct 19 07:02:13.902729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] Creating event network-vif-plugged:cbebb461-c975-4224-b923-3bf36717886f for instance 4f796c13-81fd-477b-9bc4-cd4abd638858 on n-h2-861333-10 Oct 19 07:02:13.902729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] Creating event network-vif-plugged:9fb85dca-4a0b-4244-8f9a-9e4ba09304f3 for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:02:13.902729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] Creating event network-vif-plugged:6d2bd259-7782-49a5-8138-b9ebd0e10fb5 for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:02:13.902729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] Creating event network-vif-plugged:1d2dd742-7bd1-44d6-965d-652ce6110efc for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:02:13.910484 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-33606d89-eee9-415a-b1a6-8fc53155aaaf req-bac75f6b-5198-4c4c-98ab-838fe2a6d86e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.053967 Oct 19 07:02:13.911206 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1512/3099] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:13.917000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:13.917776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:13.931072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:13.931072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:13.931072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:13.931072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:13.931072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:13.931072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:14.290606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:14.299312 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e105406-7a05-4731-ab9f-8605f148a0a9 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1468 microversion: 2.1 time: 0.386177 Oct 19 07:02:14.300387 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1513/3100] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:13 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:14.308630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4f083f6-0a75-4720-9c07-043c81fc1720 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Action: 'create', calling method: .version_select at 0x7f6d647d5af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1089393260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExn8Sv1Me+Es7ER1mUHXhFH9hNDeC2d/rqQTh0vu0fI+YNweeIZkPvyTgR5iw95OLuri6Z9mAywXanoylVTEaCegUQbH8CLbU8Y2GK5UKNTVhsQ8cOurlIZ8mR44zvdpQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:14.346687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e4f083f6-0a75-4720-9c07-043c81fc1720 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:14.352195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e4f083f6-0a75-4720-9c07-043c81fc1720 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for user 3b3f4869a1b64b1a8029a9c60bd31f8f and project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:14.466624 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4f083f6-0a75-4720-9c07-043c81fc1720 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.164173 Oct 19 07:02:14.467573 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1514/3101] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:02:14 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:14.472433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:14.473040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:14.484723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:14.485438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:14.486577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:14.487479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:14.488098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:14.488717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:14.643453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:14.652427 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b06e35cd-1221-4056-9d95-921329648be5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.183761 Oct 19 07:02:14.671823 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1515/3102] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:14 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:14.677051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:14.677676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:14.683850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:14.686045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:14.686045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:14.686045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:14.686045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:14.686425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:14.748999 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afa506a0-2fb2-40b2-9a81-493e3f9ab651 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "DELETE /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 204 len: 0 microversion: 2.1 time: 1.331041 Oct 19 07:02:14.750614 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1588/3103] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:13 2022] DELETE /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 0 bytes in 1333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:14.757274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87041656-9978-4667-a655-75b8c38c4216 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64de2dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:14.864784 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87041656-9978-4667-a655-75b8c38c4216 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images?changes-since=2022-10-19T06%3A59%3A49Z" status: 200 len: 1904 microversion: 2.1 time: 0.111772 Oct 19 07:02:14.865678 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1589/3104] 10.222.0.39 () {58 vars in 1199 bytes} [Wed Oct 19 07:02:14 2022] GET /compute/v2.1/images?changes-since=2022-10-19T06%3A59%3A49Z => generated 1904 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:14.880635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:14.881368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:14.888699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:14.888860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:14.889224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:14.889677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:14.890390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:14.890852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:14.891287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:14.898631 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-601120a4-1966-42a5-a1cd-d9accd67de3b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1313 microversion: 2.1 time: 0.225461 Oct 19 07:02:14.899904 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1516/3105] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:14 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:14.905442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:14.910100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:14.917110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:14.917685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:14.918260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:14.919113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:14.919682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:14.920216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:14.973248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:14.984678 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1a61c29-74d6-4af2-8085-0ce12ed76667 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1224 microversion: 2.1 time: 0.108367 Oct 19 07:02:14.986008 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1590/3106] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:14 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:14.991848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cbfad21-58c0-47bd-92b3-21f17a2415a6 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Action: 'create', calling method: .version_select at 0x7f6d64916f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-520360811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKxbQTaB2jiFSFq/sqpVYnwEDnWc9Nh0rUaVBTCZb2y+V15tmuGS1Pu4O1PaVqFFvis03rHONOsyzGqKhHXYyTz4MSLZ/aLhfkFmcoaPZq4OikSkpSLqbKNaQLjgm8Naw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:15.014021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2cbfad21-58c0-47bd-92b3-21f17a2415a6 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:15.020277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2cbfad21-58c0-47bd-92b3-21f17a2415a6 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for user 3b3f4869a1b64b1a8029a9c60bd31f8f and project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:15.105734 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cbfad21-58c0-47bd-92b3-21f17a2415a6 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.118230 Oct 19 07:02:15.106420 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1591/3107] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:02:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:15.111676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a38f39a-b9fc-4f99-9661-184eba1aa552 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64797ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:15.134552 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7a38f39a-b9fc-4f99-9661-184eba1aa552 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] HTTP exception thrown: Image not found. Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a38f39a-b9fc-4f99-9661-184eba1aa552 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Request method failure captured: Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 HTTP/1.1 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6C0X03ify_t_iYiKZynP2s-M38935CJCdulCm8qvYymTU1TF_mo7gFL8LIFDWqJBJdQUumLj8R7cWVjxM12ynZ_N6cmromHXnlMdr6QeNInDHI5EAQvhmIh2_uu9nriV7_MyNnJoONl11cGrFpSrR7Y-5qrm5FiS7pFw_Wo0ZxePC0 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 7dda7801787e4ea3988a90f30451f3fa Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerTestJSON-432133937 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7dda7801787e4ea3988a90f30451f3fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7dda7801787e4ea3988a90f30451f3fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7dda7801787e4ea3988a90f30451f3fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7dda7801787e4ea3988a90f30451f3fa", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerTestJSON-432133937 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 7dda7801787e4ea3988a90f30451f3fa Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-432133937 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerTestJSON-432133937-project Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: cd1e25ce6cfb48159196d4466727a4d2 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerTestJSON-432133937-project Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'ec6c1ab2-d266-46f1-9469-531b095f08a5'} Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ec6c1ab2-d266-46f1-9469-531b095f08a5 Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 07:02:15.136815 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ec6c1ab2-d266-46f1-9469-531b095f08a5 could not be found. Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a38f39a-b9fc-4f99-9661-184eba1aa552 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a38f39a-b9fc-4f99-9661-184eba1aa552 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 404 len: 62 microversion: 2.1 time: 0.030807 Oct 19 07:02:15.142161 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1592/3108] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:15 2022] GET /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:02:15.149660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9234e38-0285-4526-9f3f-9d267216b774 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d5fba91f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:15.183055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:15.191850 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf964476-3c44-48d6-a361-c2f3596c8c70 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1355 microversion: 2.1 time: 0.290142 Oct 19 07:02:15.192560 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1517/3109] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:14 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1355 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:15.201763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-561681aa-4f5e-4fbf-a288-6c7d037d447c tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Action: 'create', calling method: .version_select at 0x7f6d64e2ed30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-780232385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIJ/+bcJx+K3OqGs9SUk44vL7ClhCrDYKfWIPMTC2Cy5+VR3ZVpd/kT53J8vYJoVi1Luv1IlqnF2tclPxoqYBWKPIrwc0hDxd0kzulvMZS3+xQf5ltF5pkTh20nr9UOXQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:15.220780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-561681aa-4f5e-4fbf-a288-6c7d037d447c tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:15.235399 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9234e38-0285-4526-9f3f-9d267216b774 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1421104447" status: 200 len: 485 microversion: 2.1 time: 0.095456 Oct 19 07:02:15.238191 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1593/3110] 10.222.0.39 () {58 vars in 1231 bytes} [Wed Oct 19 07:02:15 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1421104447 => generated 485 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:15.242623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-561681aa-4f5e-4fbf-a288-6c7d037d447c tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Getting quotas for user 3b3f4869a1b64b1a8029a9c60bd31f8f and project e1245ce46fc543bb93cf35cbceeee541. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:15.249998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2aa173c8-b070-4b94-ad81-f16928ad8d75 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-623172414"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:15.253545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2aa173c8-b070-4b94-ad81-f16928ad8d75 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:15.263746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa173c8-b070-4b94-ad81-f16928ad8d75 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:15.264399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa173c8-b070-4b94-ad81-f16928ad8d75 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:15.264714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa173c8-b070-4b94-ad81-f16928ad8d75 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:15.265589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa173c8-b070-4b94-ad81-f16928ad8d75 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:15.266229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa173c8-b070-4b94-ad81-f16928ad8d75 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:15.266988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa173c8-b070-4b94-ad81-f16928ad8d75 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:15.384260 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-561681aa-4f5e-4fbf-a288-6c7d037d447c tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.189843 Oct 19 07:02:15.390198 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1518/3111] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:02:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:15.402299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52d489e0-7261-4d55-b6f6-9cdb9dc5dbec tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64e3f9d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:15.499469 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52d489e0-7261-4d55-b6f6-9cdb9dc5dbec tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images?server=3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 958 microversion: 2.1 time: 0.107544 Oct 19 07:02:15.500952 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1519/3112] 10.222.0.39 () {58 vars in 1209 bytes} [Wed Oct 19 07:02:15 2022] GET /compute/v2.1/images?server=3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 958 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:15.506659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6cc1bea-0938-42c5-b196-c2342c4f8730 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Calling method '.version_select at 0x7f6d651a3b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:15.522475 n-d-861333-10 devstack@n-api.service[127568]: WARNING oslo_db.sqlalchemy.utils [None req-f6cc1bea-0938-42c5-b196-c2342c4f8730 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 07:02:15.537030 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6cc1bea-0938-42c5-b196-c2342c4f8730 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.034624 Oct 19 07:02:15.538167 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1520/3113] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 07:02:15 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:15.543073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d52d87cc-327e-4f72-8bae-2f42aa1a907d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64e2e430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:15.611590 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d52d87cc-327e-4f72-8bae-2f42aa1a907d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2Fc0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 485 microversion: 2.1 time: 0.071672 Oct 19 07:02:15.612443 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1521/3114] 10.222.0.39 () {58 vars in 1317 bytes} [Wed Oct 19 07:02:15 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2Fc0e163a6-ba79-4799-b148-8577e4e1f14f => generated 485 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:15.616888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69eb7391-bcfc-4a4b-a00e-876d1b78cbb5 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Calling method '.version_select at 0x7f6d645d3c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:15.728217 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69eb7391-bcfc-4a4b-a00e-876d1b78cbb5 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-780232385" status: 202 len: 0 microversion: 2.1 time: 0.114907 Oct 19 07:02:15.728966 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2aa173c8-b070-4b94-ad81-f16928ad8d75 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "POST /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09/action" status: 202 len: 0 microversion: 2.1 time: 0.482742 Oct 19 07:02:15.729873 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1594/3115] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:02:15 2022] POST /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 07:02:15.733274 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1522/3116] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:02:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-780232385 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:02:15.738528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bd7ddc4-9244-439d-8723-ee18434da598 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64d33d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:15.740814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1068866997", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6982a92b-3116-4178-8c1d-06fbcd358c52"}], "security_groups": [{"name": "tempest-securitygroup--562552710"}], "key_name": "tempest-keypair-901693878", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:15.835108 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bd7ddc4-9244-439d-8723-ee18434da598 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2Fc0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 485 microversion: 2.1 time: 0.100945 Oct 19 07:02:15.836010 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1523/3117] 10.222.0.39 () {58 vars in 1303 bytes} [Wed Oct 19 07:02:15 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2Fc0e163a6-ba79-4799-b148-8577e4e1f14f => generated 485 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:15.844046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:15.844695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:15.863501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:15.867935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:15.868424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:15.869165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:15.869621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:15.874047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:15.897871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] validate_networks() for [('6982a92b-3116-4178-8c1d-06fbcd358c52', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:02:16.103008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:16.127196 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71161959-5753-4017-b8db-1629449a3ea2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1316 microversion: 2.1 time: 0.289981 Oct 19 07:02:16.131314 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1524/3118] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:15 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:16.160312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a95e7b14-6f07-414a-a24d-0a21a6eb06af tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Calling method '.version_select at 0x7f6d64e17e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:16.179998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:16.270307 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a95e7b14-6f07-414a-a24d-0a21a6eb06af tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-520360811" status: 202 len: 0 microversion: 2.1 time: 0.123794 Oct 19 07:02:16.271287 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1525/3119] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:02:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-520360811 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:02:16.276864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73970afe-dbdd-4f37-b1e0-f6a1769690b5 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d645d3550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:16.330590 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73970afe-dbdd-4f37-b1e0-f6a1769690b5 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.057250 Oct 19 07:02:16.331946 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1526/3120] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:16 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:16.342259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2b3c185-bf1c-44c2-a051-8087335091e0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64bfc040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:16.409086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:02:16.409513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:02:16.410190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:02:16.410660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:02:16.411239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:02:16.420910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:16.421866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:16.422322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:16.423460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:16.424165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:16.425005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:16.460729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2b3c185-bf1c-44c2-a051-8087335091e0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3283 microversion: 2.1 time: 0.122922 Oct 19 07:02:16.461596 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1527/3121] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 07:02:16 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3283 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:16.466084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:16.466295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:16.467091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:16.473809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:16.474529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:16.475162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:16.475315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for user 2543970e80c84e109961fc84bfaaedd1 and project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:16.475883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:16.476368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:16.476956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:16.491288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:02:16.494652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:02:16.664308 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6cb93f91-5bf5-44ce-8bb6-9b780db363db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.933028 Oct 19 07:02:16.665216 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1595/3122] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:02:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:02:16.683713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7136d494-3df0-4bc6-874e-3149b2e64786 req-46670b92-b59f-4dd2-a3d5-04b94be652d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524a6e73-ef2b-4af5-884d-331924e8ad09", "name": "network-vif-unplugged", "status": "completed", "tag": "1249d2c6-bb1b-43b7-9034-10146ff5c868"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:16.705174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7136d494-3df0-4bc6-874e-3149b2e64786 req-46670b92-b59f-4dd2-a3d5-04b94be652d7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:16.705872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7136d494-3df0-4bc6-874e-3149b2e64786 req-46670b92-b59f-4dd2-a3d5-04b94be652d7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:16.706495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7136d494-3df0-4bc6-874e-3149b2e64786 req-46670b92-b59f-4dd2-a3d5-04b94be652d7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:16.720552 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7136d494-3df0-4bc6-874e-3149b2e64786 req-46670b92-b59f-4dd2-a3d5-04b94be652d7 service nova] Creating event network-vif-unplugged:1249d2c6-bb1b-43b7-9034-10146ff5c868 for instance 524a6e73-ef2b-4af5-884d-331924e8ad09 on n-h1-861333-10 Oct 19 07:02:16.721518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:16.732308 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7136d494-3df0-4bc6-874e-3149b2e64786 req-46670b92-b59f-4dd2-a3d5-04b94be652d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062450 Oct 19 07:02:16.733217 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1596/3123] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:16.734497 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12cc4f21-39d2-42fe-a00d-15342b53c067 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1500 microversion: 2.1 time: 0.271711 Oct 19 07:02:16.741077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:16.741950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:16.748485 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1528/3124] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:16 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1500 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:16.749359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:16.749960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:16.750506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:16.751320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:16.752565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:16.753350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:16.760094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:16.760742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:16.776087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:16.780038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:16.783010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:16.783939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:16.784597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:16.788449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:16.856022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:16.873395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac6f2844-0748-4393-961c-c4e59a8fdb82 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1288 microversion: 2.1 time: 0.137661 Oct 19 07:02:16.878389 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1597/3125] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:16 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1288 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:16.897841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f8a7951-ef4b-4ffe-941e-d0d984cf6880 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] Calling method '.version_select at 0x7f6d64addd30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:17.008360 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f8a7951-ef4b-4ffe-941e-d0d984cf6880 tempest-KeyPairsV2TestJSON-1679863392 tempest-KeyPairsV2TestJSON-1679863392-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1089393260" status: 202 len: 0 microversion: 2.1 time: 0.116249 Oct 19 07:02:17.009355 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1598/3126] 10.222.0.39 () {58 vars in 1278 bytes} [Wed Oct 19 07:02:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1089393260 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:02:17.017435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb38f864-8331-4e89-a23a-ef81c3fb2d87 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64916160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:17.043769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:17.052199 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8242f313-a309-4e0e-81ec-aeddeb52238a tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1800 microversion: 2.1 time: 0.302598 Oct 19 07:02:17.052782 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1529/3127] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:16 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1800 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:17.063716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e7bfd70-668d-4be4-9339-c8a031c8b185 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:17.064174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e7bfd70-668d-4be4-9339-c8a031c8b185 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:17.121890 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb38f864-8331-4e89-a23a-ef81c3fb2d87 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.111432 Oct 19 07:02:17.122688 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1599/3128] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 07:02:17 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:17.127424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:17.130813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:17.137133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:17.137630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:17.138099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:17.138832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:17.139263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:17.139771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:17.162876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e7bfd70-668d-4be4-9339-c8a031c8b185 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:17.164279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lazy-loading 'flavor' on Instance uuid 4f796c13-81fd-477b-9bc4-cd4abd638858 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:17.175057 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e7bfd70-668d-4be4-9339-c8a031c8b185 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1238 microversion: 2.1 time: 0.119942 Oct 19 07:02:17.175662 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1530/3129] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:17 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1238 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:17.183505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2acbf64b-712b-4c5b-bc54-9305685ddb3e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:17.184006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2acbf64b-712b-4c5b-bc54-9305685ddb3e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:17.201019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acbf64b-712b-4c5b-bc54-9305685ddb3e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:17.201507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acbf64b-712b-4c5b-bc54-9305685ddb3e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:17.201957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acbf64b-712b-4c5b-bc54-9305685ddb3e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:17.202786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acbf64b-712b-4c5b-bc54-9305685ddb3e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:17.203333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acbf64b-712b-4c5b-bc54-9305685ddb3e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:17.203763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acbf64b-712b-4c5b-bc54-9305685ddb3e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:17.239923 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2acbf64b-712b-4c5b-bc54-9305685ddb3e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e/ips" status: 200 len: 213 microversion: 2.1 time: 0.062964 Oct 19 07:02:17.241227 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1531/3130] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:02:17 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e/ips => generated 213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:17.275102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2995abbc-105f-4b1e-9c0c-b6bca1d21049 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64bfc280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:17.375906 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2995abbc-105f-4b1e-9c0c-b6bca1d21049 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.116568 Oct 19 07:02:17.393655 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1532/3131] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 07:02:17 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:17.396863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:17.397876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:17.405229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:17.406553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:17.407163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:17.409265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:17.410075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:17.411378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:17.602163 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9d704eb-2732-4f0b-a740-54ec98938994 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "POST /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858/action" status: 200 len: 32 microversion: 2.1 time: 0.477758 Oct 19 07:02:17.603311 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1600/3132] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:02:17 2022] POST /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858/action => generated 32 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:02:17.616783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:17.619072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:17.628006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:17.629022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:17.629717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:17.630680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:17.631146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:17.632315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:17.672593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:17.694826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:17.707352 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4cfc6cc1-bdf1-4e92-8089-67e88c4f07c5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1466 microversion: 2.1 time: 0.318876 Oct 19 07:02:17.710224 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1533/3133] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:17 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1466 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:17.721903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-007883d1-8297-4e11-8021-f993ab0a08b7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d645d3f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:17.802653 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-007883d1-8297-4e11-8021-f993ab0a08b7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.090834 Oct 19 07:02:17.803365 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1534/3134] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:17 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:17.825267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07be969b-e26e-488e-8872-04f5ecf8efb6 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d647740d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:17.972591 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07be969b-e26e-488e-8872-04f5ecf8efb6 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/detail?changes-since=2022-10-19T06%3A59%3A44Z" status: 200 len: 6324 microversion: 2.1 time: 0.166891 Oct 19 07:02:17.985656 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1535/3135] 10.222.0.39 () {58 vars in 1220 bytes} [Wed Oct 19 07:02:17 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-19T06%3A59%3A44Z => generated 6324 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:18.000572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:18.001525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:18.018559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.019706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.020673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.021773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.022706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.023647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.165602 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54c99772-ed79-499f-9da0-08659d8efcf1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 204 len: 0 microversion: 2.1 time: 0.559870 Oct 19 07:02:18.166596 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1601/3136] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:17 2022] DELETE /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:18.174183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4270792b-c5c2-471b-a726-df5e8ff09f93 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:18.175219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4270792b-c5c2-471b-a726-df5e8ff09f93 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:18.186507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4270792b-c5c2-471b-a726-df5e8ff09f93 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.187312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4270792b-c5c2-471b-a726-df5e8ff09f93 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.191449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4270792b-c5c2-471b-a726-df5e8ff09f93 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.191449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4270792b-c5c2-471b-a726-df5e8ff09f93 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.191449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4270792b-c5c2-471b-a726-df5e8ff09f93 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.191449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4270792b-c5c2-471b-a726-df5e8ff09f93 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.248519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:18.483213 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4270792b-c5c2-471b-a726-df5e8ff09f93 tempest-ServersOnMultiNodesTest-525623276 tempest-ServersOnMultiNodesTest-525623276-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1619 microversion: 2.1 time: 0.314619 Oct 19 07:02:18.485457 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1602/3137] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:18 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1619 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:18.491384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:18.492304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:18.496015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:18.500731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.501500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.502361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.503544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.508044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.508985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.692247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:18.702712 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04a5327b-76df-4255-a90b-93e1d8732d9c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1328 microversion: 2.1 time: 0.215272 Oct 19 07:02:18.703981 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1603/3138] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:18 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1328 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:18.708913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd2c94f4-989d-46b8-a79a-186b4b259a32 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64965940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:18.796801 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd2c94f4-989d-46b8-a79a-186b4b259a32 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1421104447" status: 200 len: 665 microversion: 2.1 time: 0.087091 Oct 19 07:02:18.796801 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1604/3139] 10.222.0.39 () {58 vars in 1252 bytes} [Wed Oct 19 07:02:18 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1421104447 => generated 665 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:18.797077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:18.799428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:18.800218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:18.807234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.808057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.808738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.809457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.809916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.810534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.821254 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4cf91eb0-4544-42d6-bae1-91da0d423040 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.826350 Oct 19 07:02:18.822613 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1536/3140] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:17 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:18.828519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:18.831205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:18.838586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.839748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.841589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.843309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:18.844010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:18.847327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:18.992900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:19.004391 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97a527ca-acd7-4520-8e1e-f3065c75bc0b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1242 microversion: 2.1 time: 0.180452 Oct 19 07:02:19.005349 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1537/3141] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:18 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:19.011153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.012023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:19.020468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:19.021243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:19.021978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:19.022888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:19.024014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:19.024720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:19.059493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:19.068459 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f5d22ce-5ded-4b8f-b167-7d1ae4ea618c tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1806 microversion: 2.1 time: 0.273789 Oct 19 07:02:19.072061 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1605/3142] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:18 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1806 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:19.081300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c088a188-9b5c-49b7-bec5-360f2734e3f2 req-cd02a15f-a0fe-4d5d-abab-62d1d86d9316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c", "name": "network-vif-unplugged", "status": "completed", "tag": "e9ea764b-95e8-4aeb-ae74-818b2898ceb8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:19.099064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:19.110716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c088a188-9b5c-49b7-bec5-360f2734e3f2 req-cd02a15f-a0fe-4d5d-abab-62d1d86d9316 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:19.111549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c088a188-9b5c-49b7-bec5-360f2734e3f2 req-cd02a15f-a0fe-4d5d-abab-62d1d86d9316 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:19.112003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c088a188-9b5c-49b7-bec5-360f2734e3f2 req-cd02a15f-a0fe-4d5d-abab-62d1d86d9316 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:19.126354 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c088a188-9b5c-49b7-bec5-360f2734e3f2 req-cd02a15f-a0fe-4d5d-abab-62d1d86d9316 service nova] Creating event network-vif-unplugged:e9ea764b-95e8-4aeb-ae74-818b2898ceb8 for instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c on n-h2-861333-10 Oct 19 07:02:19.132625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c088a188-9b5c-49b7-bec5-360f2734e3f2 req-cd02a15f-a0fe-4d5d-abab-62d1d86d9316 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058509 Oct 19 07:02:19.133242 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1606/3143] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:19.140398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f83b71c-7ff8-48b3-a555-144ed813633f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64896280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.215206 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f83b71c-7ff8-48b3-a555-144ed813633f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2Fc0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1463 microversion: 2.1 time: 0.080707 Oct 19 07:02:19.217128 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1607/3144] 10.222.0.39 () {58 vars in 1338 bytes} [Wed Oct 19 07:02:19 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2Fc0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1463 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:19.226462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf1b1c46-cbdc-401a-b6c1-be46d076caa1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d5fb068b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.282284 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf1b1c46-cbdc-401a-b6c1-be46d076caa1 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.060881 Oct 19 07:02:19.282889 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1608/3145] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:19 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:19.288451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8fdf6119-e076-4c57-8190-3f4039aa681f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64b3c3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.362471 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8fdf6119-e076-4c57-8190-3f4039aa681f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2Fc0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1463 microversion: 2.1 time: 0.078326 Oct 19 07:02:19.363209 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1609/3146] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Oct 19 07:02:19 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2Fc0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1463 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:19.379494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83c44b54-35fe-4694-b23a-dadb4357fae3 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64916ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.442142 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44898187-6744-4cbe-835a-ab884afc715d tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 204 len: 0 microversion: 2.1 time: 0.435205 Oct 19 07:02:19.442733 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1538/3147] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:19 2022] DELETE /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:19.452664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.452664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:19.466468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:19.467697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:19.469241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:19.469975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:19.470468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:19.470896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:19.477633 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83c44b54-35fe-4694-b23a-dadb4357fae3 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7099 microversion: 2.1 time: 0.102713 Oct 19 07:02:19.478232 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1610/3148] 10.222.0.39 () {58 vars in 1170 bytes} [Wed Oct 19 07:02:19 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7099 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:19.494093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:19.504257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1929dd3c-6cf5-4e3a-8eb5-11e98c1a9ffb tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d647aa040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.580062 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1929dd3c-6cf5-4e3a-8eb5-11e98c1a9ffb tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4365 microversion: 2.1 time: 0.082059 Oct 19 07:02:19.588544 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1611/3149] 10.222.0.39 () {58 vars in 1170 bytes} [Wed Oct 19 07:02:19 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:19.598403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46ace109-4c6e-4607-8c7a-4f608ab75618 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d648969d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.651755 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46ace109-4c6e-4607-8c7a-4f608ab75618 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/bf91402f-43c2-455b-ba41-1073b9eae084" status: 200 len: 784 microversion: 2.1 time: 0.057989 Oct 19 07:02:19.652377 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1612/3150] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:19 2022] GET /compute/v2.1/images/bf91402f-43c2-455b-ba41-1073b9eae084 => generated 784 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:02:19.695271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5226cb82-94ec-41c1-9e4a-533079401452 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64e419d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.724295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:19.731862 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7837620-3788-4f28-a784-0eb43882622b tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1472 microversion: 2.1 time: 0.284821 Oct 19 07:02:19.741607 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1539/3151] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:19 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:19.755948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.756850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:19.759072 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5226cb82-94ec-41c1-9e4a-533079401452 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1607 microversion: 2.1 time: 0.082974 Oct 19 07:02:19.773957 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1613/3152] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 07:02:19 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1607 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:19.777014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:19.777754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:19.778579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:19.778937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d945c07-ed98-4f6e-ab96-ebeed5ac3a3c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64d63c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:19.780292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:19.780975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:19.781619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.011761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:20.022490 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d87ca834-6855-42e6-8af3-3c60b028633c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1328 microversion: 2.1 time: 0.279742 Oct 19 07:02:20.026397 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1540/3153] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:19 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1328 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:20.045275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:20.046107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:20.052889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.055419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.055419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.055419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.055419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.056199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.272381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:20.278831 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bac65ed-2227-45f4-907c-6b3decfaf3f9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.237322 Oct 19 07:02:20.279539 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1541/3154] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:20 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:20.285003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:20.285756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:20.294100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.294726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.295324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.296144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.296611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.300884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.398109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:20.407519 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fde55530-642d-4ec8-9918-bf9b211c9ac9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1234 microversion: 2.1 time: 0.126835 Oct 19 07:02:20.408765 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1542/3155] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:20 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1234 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:20.413879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:20.414495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:20.422521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.422521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.422521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.422521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.422987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.423396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.645579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:20.653524 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ea5e635-ee24-428f-94dc-fbc4cf31cd57 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1806 microversion: 2.1 time: 0.243503 Oct 19 07:02:20.654105 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1543/3156] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:20 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1806 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:20.660060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0f9ee723-aba6-42b9-aca3-c283ab3bb4d6 req-7a7237e2-b668-4aa4-afc0-a3c05ee8ee55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e9049b-317b-4e0f-b462-5595803b63e5", "tag": "cef45970-e531-404c-8a40-4a529a362e4f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:20.672848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0f9ee723-aba6-42b9-aca3-c283ab3bb4d6 req-7a7237e2-b668-4aa4-afc0-a3c05ee8ee55 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.673335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0f9ee723-aba6-42b9-aca3-c283ab3bb4d6 req-7a7237e2-b668-4aa4-afc0-a3c05ee8ee55 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.673774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0f9ee723-aba6-42b9-aca3-c283ab3bb4d6 req-7a7237e2-b668-4aa4-afc0-a3c05ee8ee55 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.685775 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0f9ee723-aba6-42b9-aca3-c283ab3bb4d6 req-7a7237e2-b668-4aa4-afc0-a3c05ee8ee55 service nova] Creating event network-changed:cef45970-e531-404c-8a40-4a529a362e4f for instance f7e9049b-317b-4e0f-b462-5595803b63e5 on n-h2-861333-10 Oct 19 07:02:20.691035 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0f9ee723-aba6-42b9-aca3-c283ab3bb4d6 req-7a7237e2-b668-4aa4-afc0-a3c05ee8ee55 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035838 Oct 19 07:02:20.691656 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1544/3157] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:20.815109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d097ba37-9d32-43f0-8ee3-b50bc4c0cf74 tempest-AbsoluteLimitsTestJSON-1648465877 tempest-AbsoluteLimitsTestJSON-1648465877-project] Calling method '.version_select at 0x7f6d64c5a430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:20.827127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d097ba37-9d32-43f0-8ee3-b50bc4c0cf74 tempest-AbsoluteLimitsTestJSON-1648465877 tempest-AbsoluteLimitsTestJSON-1648465877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.827496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d097ba37-9d32-43f0-8ee3-b50bc4c0cf74 tempest-AbsoluteLimitsTestJSON-1648465877 tempest-AbsoluteLimitsTestJSON-1648465877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.827980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d097ba37-9d32-43f0-8ee3-b50bc4c0cf74 tempest-AbsoluteLimitsTestJSON-1648465877 tempest-AbsoluteLimitsTestJSON-1648465877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.828700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d097ba37-9d32-43f0-8ee3-b50bc4c0cf74 tempest-AbsoluteLimitsTestJSON-1648465877 tempest-AbsoluteLimitsTestJSON-1648465877-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.829168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d097ba37-9d32-43f0-8ee3-b50bc4c0cf74 tempest-AbsoluteLimitsTestJSON-1648465877 tempest-AbsoluteLimitsTestJSON-1648465877-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.839013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d097ba37-9d32-43f0-8ee3-b50bc4c0cf74 tempest-AbsoluteLimitsTestJSON-1648465877 tempest-AbsoluteLimitsTestJSON-1648465877-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.862244 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d097ba37-9d32-43f0-8ee3-b50bc4c0cf74 tempest-AbsoluteLimitsTestJSON-1648465877 tempest-AbsoluteLimitsTestJSON-1648465877-project] 10.222.0.39 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.169348 Oct 19 07:02:20.864258 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1545/3158] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Oct 19 07:02:20 2022] GET /compute/v2.1/limits => generated 511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:20.867843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9874dfd-a5f1-4744-8742-5e83dd4c9f76 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64d334c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:20.925759 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9874dfd-a5f1-4744-8742-5e83dd4c9f76 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.061751 Oct 19 07:02:20.926779 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1546/3159] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:20 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:20.940812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:20.941782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:20.955600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.955600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.955600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:20.955600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:20.955600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:20.956173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:21.101096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:21.108840 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5fa471f-454b-45ab-8f68-f9f437c460e1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1472 microversion: 2.1 time: 0.175287 Oct 19 07:02:21.109416 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1547/3160] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:20 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:21.114417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:21.115025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:21.120793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:21.121276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:21.121710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:21.122399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:21.122855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:21.123284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:21.297608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:21.308931 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60afeb9c-1574-40a1-9c1a-521710b8742a tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1328 microversion: 2.1 time: 0.198414 Oct 19 07:02:21.325295 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1548/3161] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:21 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1328 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:21.325295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-60e1a9e2-a36d-4845-aa86-603b35bcc842 req-9991d18f-06cf-4733-8b73-065e3d5340a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524a6e73-ef2b-4af5-884d-331924e8ad09", "name": "network-vif-plugged", "status": "completed", "tag": "1249d2c6-bb1b-43b7-9034-10146ff5c868"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:21.326713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-60e1a9e2-a36d-4845-aa86-603b35bcc842 req-9991d18f-06cf-4733-8b73-065e3d5340a0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:21.333205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-60e1a9e2-a36d-4845-aa86-603b35bcc842 req-9991d18f-06cf-4733-8b73-065e3d5340a0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:21.333205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-60e1a9e2-a36d-4845-aa86-603b35bcc842 req-9991d18f-06cf-4733-8b73-065e3d5340a0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:21.336077 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d945c07-ed98-4f6e-ab96-ebeed5ac3a3c tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "DELETE /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d" status: 204 len: 0 microversion: 2.1 time: 1.560993 Oct 19 07:02:21.340410 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1614/3162] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:19 2022] DELETE /compute/v2.1/images/42b544bd-212f-42a8-bc9a-9a8996789c1d => generated 0 bytes in 1563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:21.342243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:21.343446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:21.357868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:21.358553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:21.360908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:21.360908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:21.360908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:21.361778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:21.371579 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-60e1a9e2-a36d-4845-aa86-603b35bcc842 req-9991d18f-06cf-4733-8b73-065e3d5340a0 service nova] Creating event network-vif-plugged:1249d2c6-bb1b-43b7-9034-10146ff5c868 for instance 524a6e73-ef2b-4af5-884d-331924e8ad09 on n-h1-861333-10 Oct 19 07:02:21.378552 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-60e1a9e2-a36d-4845-aa86-603b35bcc842 req-9991d18f-06cf-4733-8b73-065e3d5340a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067209 Oct 19 07:02:21.379512 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1549/3163] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:21.389287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-212d6163-4ae0-4c4a-b2be-523fa1ae42a4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d649c7ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:21.612609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:21.631579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a471a4a2-fc7d-4238-9f59-e627c3604c8e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.293015 Oct 19 07:02:21.632202 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1615/3164] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:21 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:21.637073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:21.637848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:21.656002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:21.657236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:21.659692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:21.661389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:21.661886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:21.662417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:21.790187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:21.798140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dde22097-5f78-422b-98d6-b5f6d769bb99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1290 microversion: 2.1 time: 0.164745 Oct 19 07:02:21.805057 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1616/3165] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:21 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1290 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:21.814930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:21.818302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:21.837104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:21.837950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:21.838412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:21.839573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:21.840051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:21.840653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:22.097630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:22.111140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9cdec601-5e72-4b2e-86c2-7dcf605902d1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1785 microversion: 2.1 time: 0.304714 Oct 19 07:02:22.111746 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1617/3166] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:21 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1785 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:22.124757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07c52468-ac45-4d93-a2ce-9584a052e9af tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d5fba91f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:23.490717 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-212d6163-4ae0-4c4a-b2be-523fa1ae42a4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "DELETE /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c" status: 204 len: 0 microversion: 2.1 time: 2.102562 Oct 19 07:02:23.491963 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1550/3167] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:21 2022] DELETE /compute/v2.1/images/a98fb023-58ad-4627-b116-82f7870a281c => generated 0 bytes in 2108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:23.497157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:23.498909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:23.510359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:23.511102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:23.512861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:23.518984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:23.518984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:23.518984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:23.561041 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07c52468-ac45-4d93-a2ce-9584a052e9af tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 1.446454 Oct 19 07:02:23.561903 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1618/3168] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:22 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:23.581036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:23.582989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:23.584245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:23.584364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:23.585144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lazy-loading 'fault' on Instance uuid db6b49d7-9798-47ae-8879-d89895160ca3 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:23.588949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:23.605607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:23.606107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:23.606544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:23.607314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:23.612891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:23.612891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:23.800937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:23.816883 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8776beff-2b81-459f-963b-35b4baaa156f tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 200 len: 1306 microversion: 2.1 time: 0.323509 Oct 19 07:02:23.819564 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1551/3169] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:23 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 1306 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:23.835630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ab75d6b3-d156-48dd-a0eb-82b658027f88 req-2397ddfc-4102-4f06-9df2-1bb2af2f53fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6b49d7-9798-47ae-8879-d89895160ca3", "name": "network-vif-deleted", "tag": "96d5eb61-1eb1-4fe5-a4d4-98b8a536c92a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:23.859379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab75d6b3-d156-48dd-a0eb-82b658027f88 req-2397ddfc-4102-4f06-9df2-1bb2af2f53fe service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:23.861099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab75d6b3-d156-48dd-a0eb-82b658027f88 req-2397ddfc-4102-4f06-9df2-1bb2af2f53fe service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:23.863677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab75d6b3-d156-48dd-a0eb-82b658027f88 req-2397ddfc-4102-4f06-9df2-1bb2af2f53fe service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:23.884049 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ab75d6b3-d156-48dd-a0eb-82b658027f88 req-2397ddfc-4102-4f06-9df2-1bb2af2f53fe service nova] Creating event network-vif-deleted:96d5eb61-1eb1-4fe5-a4d4-98b8a536c92a for instance db6b49d7-9798-47ae-8879-d89895160ca3 on n-h1-861333-10 Oct 19 07:02:23.892097 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ab75d6b3-d156-48dd-a0eb-82b658027f88 req-2397ddfc-4102-4f06-9df2-1bb2af2f53fe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066631 Oct 19 07:02:23.892097 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1552/3170] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:23.897999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:23.899242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:23.907881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:23.909325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:23.910015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:23.911003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:23.911777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:23.912489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:24.061755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:24.077507 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9cfb606c-e3e7-4b21-865e-36f2fa79d2e6 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1328 microversion: 2.1 time: 0.514307 Oct 19 07:02:24.085004 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1619/3171] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:23 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1328 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:24.098179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-197e77b7-f0c9-4f4a-91da-2f4434050e61 req-c70c66b4-fa92-426d-90a8-10da462c13a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "name": "network-vif-deleted", "tag": "1d2dd742-7bd1-44d6-965d-652ce6110efc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:24.135418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-197e77b7-f0c9-4f4a-91da-2f4434050e61 req-c70c66b4-fa92-426d-90a8-10da462c13a8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:24.135418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-197e77b7-f0c9-4f4a-91da-2f4434050e61 req-c70c66b4-fa92-426d-90a8-10da462c13a8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:24.135418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-197e77b7-f0c9-4f4a-91da-2f4434050e61 req-c70c66b4-fa92-426d-90a8-10da462c13a8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:24.153731 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-197e77b7-f0c9-4f4a-91da-2f4434050e61 req-c70c66b4-fa92-426d-90a8-10da462c13a8 service nova] Creating event network-vif-deleted:1d2dd742-7bd1-44d6-965d-652ce6110efc for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:02:24.162605 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-197e77b7-f0c9-4f4a-91da-2f4434050e61 req-c70c66b4-fa92-426d-90a8-10da462c13a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074774 Oct 19 07:02:24.163738 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1620/3172] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:24.170314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:24.172214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:24.183746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:24.184781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:24.185553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:24.186629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:24.187965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:24.188633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:24.374622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:24.387843 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6655e75e-6c29-46c8-857a-6fbdb1088132 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1296 microversion: 2.1 time: 0.221818 Oct 19 07:02:24.388060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:24.389249 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1621/3173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:24 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1296 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:24.399422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:24.399554 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fba8e8e0-700a-4b13-8682-a29c6aac3531 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.507266 Oct 19 07:02:24.401064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:24.409609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:24.410466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:24.411049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:24.412183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:24.412657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:24.412792 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1553/3174] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:23 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:24.413091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:24.422904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5749ff86-fe09-47e0-a709-0052e676d8e3 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64fca310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:24.743587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:24.757756 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc742342-739b-441b-8901-f836022a0763 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 200 len: 1608 microversion: 2.1 time: 0.366416 Oct 19 07:02:24.758352 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1622/3175] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:24 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 1608 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:24.769250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-045c7d46-b00c-4471-9d74-e8c4be8b14a0 req-fb42f5a0-599b-44a0-ae5a-c2ef996cb477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "name": "network-vif-unplugged", "status": "completed", "tag": "6d2bd259-7782-49a5-8138-b9ebd0e10fb5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:24.792698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-045c7d46-b00c-4471-9d74-e8c4be8b14a0 req-fb42f5a0-599b-44a0-ae5a-c2ef996cb477 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:24.798255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-045c7d46-b00c-4471-9d74-e8c4be8b14a0 req-fb42f5a0-599b-44a0-ae5a-c2ef996cb477 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:24.799632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-045c7d46-b00c-4471-9d74-e8c4be8b14a0 req-fb42f5a0-599b-44a0-ae5a-c2ef996cb477 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:24.842161 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-045c7d46-b00c-4471-9d74-e8c4be8b14a0 req-fb42f5a0-599b-44a0-ae5a-c2ef996cb477 service nova] Creating event network-vif-unplugged:6d2bd259-7782-49a5-8138-b9ebd0e10fb5 for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:02:24.862813 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-045c7d46-b00c-4471-9d74-e8c4be8b14a0 req-fb42f5a0-599b-44a0-ae5a-c2ef996cb477 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096664 Oct 19 07:02:24.863784 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1623/3176] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:24.893488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08e6558a-30de-49b9-8c34-43d4c99f0279 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64a4cca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:26.552266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:26.552266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:26.833630 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5749ff86-fe09-47e0-a709-0052e676d8e3 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "DELETE /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603" status: 204 len: 0 microversion: 2.1 time: 2.419256 Oct 19 07:02:26.838495 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1554/3177] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:24 2022] DELETE /compute/v2.1/images/d8c85f1d-555c-4cae-aeea-1f8a863da603 => generated 0 bytes in 2422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:26.853723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:26.863820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: db6b49d7-9798-47ae-8879-d89895160ca3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:26.883326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:26.888326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:26.888326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:26.888326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:26.892510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:26.893658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] HTTP exception thrown: Instance db6b49d7-9798-47ae-8879-d89895160ca3 could not be found. Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Request method failure captured: Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 HTTP/1.1 Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6AxJep7BOnVFHWS5MxsB-tji5pQWc3llPlG_eQg6utr_o8t5Kd1nuvvscxTdfejU1hcBEwwTdxsmOfUUNHbb3ldOyZkT6xMJGjtVJOqsxLleTPhG2Kj5iSpwWxD86pL7izc64fKnCHANy71dZXEvcJwwMW4nVJm6UxV4_WF7V2UqFM Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6f0b288d116428981f07801b48d1cc8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 6d399daf565e4ceabd2883ad43ef7f8b Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance db6b49d7-9798-47ae-8879-d89895160ca3 could not be found. Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'db6b49d7-9798-47ae-8879-d89895160ca3'} Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6b49d7-9798-47ae-8879-d89895160ca3 could not be found. Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:26.934183 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6b49d7-9798-47ae-8879-d89895160ca3 could not be found. Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6b49d7-9798-47ae-8879-d89895160ca3 could not be found. Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Returning 404 to user: Instance db6b49d7-9798-47ae-8879-d89895160ca3 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:26.938119 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d25c9c55-21cd-42d2-acb1-926587b62010 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3" status: 404 len: 111 microversion: 2.1 time: 0.094086 Oct 19 07:02:26.940751 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1555/3178] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:26 2022] GET /compute/v2.1/servers/db6b49d7-9798-47ae-8879-d89895160ca3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:26.949295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:26.952220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:26.954430 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08e6558a-30de-49b9-8c34-43d4c99f0279 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 2.088677 Oct 19 07:02:26.958054 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1624/3179] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:24 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:26.960425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:26.961320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:26.962052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:26.962992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:26.963660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:26.964417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:26.980380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:26.985171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:27.012306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.021493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.022322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.023312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.024057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.024690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.196052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:27.218701 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dddc533d-f550-4096-8329-ab62006509d7 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1328 microversion: 2.1 time: 0.266032 Oct 19 07:02:27.218701 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1556/3180] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:26 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1328 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:27.228502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:27.229261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:27.248241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.258882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.259349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.260756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.261237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.262352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.355800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:27.369824 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afb1aa47-cc05-42d3-81c0-03d605703705 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1363 microversion: 2.1 time: 0.410609 Oct 19 07:02:27.373720 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1625/3181] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:26 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:27.384795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:27.385684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:27.401653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.408042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.408042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.408042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.408042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.408042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.438868 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] HTTP exception thrown: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Request method failure captured: Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e HTTP/1.1 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CxpbzAHxQOKvQTsILB4qFNu4l2IRiGnmtaI6tz74B_ARxhYa4crz4w0-8Vln3USBV83YQjr1HB1FKq58iJLlQ2sinh3rOGu4g9_ZW8NoS5OHhdlHyftEU2OAXiKeZNeDGc6wP7_1ODDOpLiTs9E0-9e6ywXhfZ3IXrclqe-9CSHKc Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b64d433fbb74f5b89ab02e4572ddc45", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestMultiNic-209800037 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestMultiNic-209800037-project Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 41810b44169748bd97b407696a681dc7 Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestMultiNic-209800037-project Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '1155b0c5-6521-4c4e-8197-41e0672c618e'} Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:27.441302 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:27.445272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:27.445272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:27.445272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:27.445272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:27.445272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:27.445272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:02:27.445272 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:27.445272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Returning 404 to user: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:27.445272 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97666ddc-5808-467d-a5fe-8df27008c912 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 404 len: 111 microversion: 2.1 time: 0.069880 Oct 19 07:02:27.457142 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1626/3182] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:27 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:27.462697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0fc4116f-8124-480b-a224-afeef58f1ae7 req-8f90462b-ddbf-4380-ad5f-07ddff28b6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "name": "network-vif-deleted", "tag": "9fb85dca-4a0b-4244-8f9a-9e4ba09304f3"}, {"server_uuid": "1155b0c5-6521-4c4e-8197-41e0672c618e", "name": "network-vif-deleted", "tag": "6d2bd259-7782-49a5-8138-b9ebd0e10fb5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:27.484286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0fc4116f-8124-480b-a224-afeef58f1ae7 req-8f90462b-ddbf-4380-ad5f-07ddff28b6a9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.485521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0fc4116f-8124-480b-a224-afeef58f1ae7 req-8f90462b-ddbf-4380-ad5f-07ddff28b6a9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.485883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0fc4116f-8124-480b-a224-afeef58f1ae7 req-8f90462b-ddbf-4380-ad5f-07ddff28b6a9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.511362 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0fc4116f-8124-480b-a224-afeef58f1ae7 req-8f90462b-ddbf-4380-ad5f-07ddff28b6a9 service nova] Creating event network-vif-deleted:9fb85dca-4a0b-4244-8f9a-9e4ba09304f3 for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:02:27.511995 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0fc4116f-8124-480b-a224-afeef58f1ae7 req-8f90462b-ddbf-4380-ad5f-07ddff28b6a9 service nova] Creating event network-vif-deleted:6d2bd259-7782-49a5-8138-b9ebd0e10fb5 for instance 1155b0c5-6521-4c4e-8197-41e0672c618e on n-h1-861333-10 Oct 19 07:02:27.519725 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0fc4116f-8124-480b-a224-afeef58f1ae7 req-8f90462b-ddbf-4380-ad5f-07ddff28b6a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061225 Oct 19 07:02:27.520801 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1627/3183] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:27.528076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-680dc7f2-215e-4623-b553-2f1fa4e03b75 req-d3ef1354-6644-42e5-92e4-fdddbdff0955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:27.540375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-680dc7f2-215e-4623-b553-2f1fa4e03b75 req-d3ef1354-6644-42e5-92e4-fdddbdff0955 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.541435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-680dc7f2-215e-4623-b553-2f1fa4e03b75 req-d3ef1354-6644-42e5-92e4-fdddbdff0955 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.542118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-680dc7f2-215e-4623-b553-2f1fa4e03b75 req-d3ef1354-6644-42e5-92e4-fdddbdff0955 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.555727 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-680dc7f2-215e-4623-b553-2f1fa4e03b75 req-d3ef1354-6644-42e5-92e4-fdddbdff0955 service nova] Creating event network-changed:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:02:27.561843 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-680dc7f2-215e-4623-b553-2f1fa4e03b75 req-d3ef1354-6644-42e5-92e4-fdddbdff0955 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038080 Oct 19 07:02:27.562915 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1628/3184] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:27.570005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:27.570641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:27.571353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:27.581411 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa885a76-b4cd-4bee-a81e-93b600e2c1e4 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.366289 Oct 19 07:02:27.581999 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1557/3185] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:27 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:27.582497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.583084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.583612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.584459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.585180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.585823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.594811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:27.596742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:27.608480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.610285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.613380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.615938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:27.616719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:27.620379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:27.633428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:27.682717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:28.060514 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8ffe675-4e46-4cf2-b54e-999aaa71c19e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 204 len: 0 microversion: 2.1 time: 0.473795 Oct 19 07:02:28.062026 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1558/3186] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:27 2022] DELETE /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:28.062196 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6da4f5d-144d-43b5-9c4c-841ee7df7310 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 204 len: 0 microversion: 2.1 time: 0.496697 Oct 19 07:02:28.064197 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1629/3187] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:27 2022] DELETE /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:28.083742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a92e4e8-78d4-4d22-9105-44ead84e4863 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d6479ba60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:28.083926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:28.083926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:28.098284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:28.098799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:28.099252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:28.099984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:28.111119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:28.112359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:28.165060 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a92e4e8-78d4-4d22-9105-44ead84e4863 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.101454 Oct 19 07:02:28.166079 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1559/3188] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:28 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:28.188735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:28.196059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:28.241171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:28.244642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:28.246736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:28.248781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:28.255887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:28.258803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:28.605298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:28.618144 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb186169-727e-4d1e-b18b-6f2c0ccadcb2 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1474 microversion: 2.1 time: 0.547468 Oct 19 07:02:28.632692 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1630/3189] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:28 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1474 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:28.648653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:28.650619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:28.667196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:28.669231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:28.674898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:28.674898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:28.682389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:28.683205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:28.920092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:28.932927 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-761475a8-ec9a-453b-a1de-ea65ae352ef5 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1472 microversion: 2.1 time: 0.759250 Oct 19 07:02:28.933956 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1560/3190] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:28 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1472 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:28.959259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-195e5fbb-d108-4e6a-9d26-95bcad996775 req-233b877f-8af6-4d5e-bb40-2df40d469aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e9049b-317b-4e0f-b462-5595803b63e5", "name": "network-vif-plugged", "status": "completed", "tag": "cef45970-e531-404c-8a40-4a529a362e4f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:28.984419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-195e5fbb-d108-4e6a-9d26-95bcad996775 req-233b877f-8af6-4d5e-bb40-2df40d469aa9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:28.984996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-195e5fbb-d108-4e6a-9d26-95bcad996775 req-233b877f-8af6-4d5e-bb40-2df40d469aa9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:28.985440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-195e5fbb-d108-4e6a-9d26-95bcad996775 req-233b877f-8af6-4d5e-bb40-2df40d469aa9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:29.009652 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-195e5fbb-d108-4e6a-9d26-95bcad996775 req-233b877f-8af6-4d5e-bb40-2df40d469aa9 service nova] Creating event network-vif-plugged:cef45970-e531-404c-8a40-4a529a362e4f for instance f7e9049b-317b-4e0f-b462-5595803b63e5 on n-h2-861333-10 Oct 19 07:02:29.022861 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-195e5fbb-d108-4e6a-9d26-95bcad996775 req-233b877f-8af6-4d5e-bb40-2df40d469aa9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084230 Oct 19 07:02:29.023942 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1561/3191] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:29.036216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:29.037145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:29.046557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:29.047151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:29.047585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:29.048221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:29.049379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:29.049880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:29.061902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:29.446865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:29.460075 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bef0311f-817b-4e01-aeeb-10f7be7066b2 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1328 microversion: 2.1 time: 0.825955 Oct 19 07:02:29.463867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1631/3192] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:28 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1328 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:29.473293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:29.478450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:29.486905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:29.487761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:29.488466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:29.489447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:29.490355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:29.490997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:29.515767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:29.661379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:29.678440 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-853f343d-c0e0-4245-97d9-282419d1c6ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1363 microversion: 2.1 time: 0.644628 Oct 19 07:02:29.678440 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1562/3193] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:29 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1363 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:29.678440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-622d88ec-9557-4481-b821-a27c898bf170 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d649c7700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:29.715615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:29.731745 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72c32036-4905-4fa6-986c-de6c95aff78e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.265333 Oct 19 07:02:29.731745 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1632/3194] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:29 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:29.741983 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-622d88ec-9557-4481-b821-a27c898bf170 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.070019 Oct 19 07:02:29.743158 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1563/3195] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:29 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:29.763894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:29.765933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:29.778287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:29.780405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:29.782621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:29.783610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:29.786720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:29.787432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:29.968774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:29.970306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:29.989536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:29.993829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:29.993829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:29.993829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:29.993829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:29.994823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:30.032175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:30.044658 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b09a82d-3275-4a88-b9aa-ac1e3e57f63f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1474 microversion: 2.1 time: 0.289052 Oct 19 07:02:30.062414 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1633/3196] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:29 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:30.485374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:30.490547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:30.505176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:30.506140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:30.507808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:30.509905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:30.511186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:30.513135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:30.661209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:30.682084 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66e4f2b2-cb7b-4006-9d46-41272523b5d1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1472 microversion: 2.1 time: 0.720754 Oct 19 07:02:30.684707 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1564/3197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:29 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1472 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:30.702980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:30.703914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:30.718533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:30.719351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:30.722328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:30.722328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:30.722328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:30.722328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:30.825766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=28 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:30.849690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:30.931181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:30.947510 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2788f056-aa0f-4c2e-8106-0e3035f9ae4e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1363 microversion: 2.1 time: 0.253622 Oct 19 07:02:30.949974 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1565/3198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:30 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:30.956656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1c25622c-0dc2-4442-834b-d491ac07578e req-546cb1ad-a7bb-473c-bda6-3a5717e3f965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd23cc7-b696-4b27-895c-2ba60aa6c7c2", "name": "network-vif-deleted", "tag": "e00ea9b3-3256-480a-a04e-4d6743c7e2b8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:30.990367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1c25622c-0dc2-4442-834b-d491ac07578e req-546cb1ad-a7bb-473c-bda6-3a5717e3f965 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:30.993486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1c25622c-0dc2-4442-834b-d491ac07578e req-546cb1ad-a7bb-473c-bda6-3a5717e3f965 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:30.994173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1c25622c-0dc2-4442-834b-d491ac07578e req-546cb1ad-a7bb-473c-bda6-3a5717e3f965 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:31.027827 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1c25622c-0dc2-4442-834b-d491ac07578e req-546cb1ad-a7bb-473c-bda6-3a5717e3f965 service nova] Creating event network-vif-deleted:e00ea9b3-3256-480a-a04e-4d6743c7e2b8 for instance efd23cc7-b696-4b27-895c-2ba60aa6c7c2 on n-h2-861333-10 Oct 19 07:02:31.044294 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1c25622c-0dc2-4442-834b-d491ac07578e req-546cb1ad-a7bb-473c-bda6-3a5717e3f965 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092638 Oct 19 07:02:31.046064 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1566/3199] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:31.051882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-291d095c-9460-40d6-a8ba-dcb296786125 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64f48820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:31.141460 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-291d095c-9460-40d6-a8ba-dcb296786125 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.093797 Oct 19 07:02:31.167733 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1567/3200] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:31 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:31.179219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:31.181390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:31.197437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:31.206429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:31.206960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:31.209211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:31.211416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:31.212085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:31.341961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:31.357253 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fefc4309-0a72-43b1-b8c6-5f97dbabdcc1 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1328 microversion: 2.1 time: 0.876411 Oct 19 07:02:31.360538 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1634/3201] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:30 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1328 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:31.381722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:31.382549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:31.403085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:31.412358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:31.412358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:31.412358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:31.412358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:31.412358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:31.787825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:31.797806 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-415e0ee0-5aed-49ee-92b5-2c367542d840 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1474 microversion: 2.1 time: 0.432394 Oct 19 07:02:31.799737 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1635/3202] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:31 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1474 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:31.830774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:31.831396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:31.846266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:31.847032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:31.847649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:31.848656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:31.849285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:31.849884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:31.914653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:31.924514 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8c145bb-d326-45b2-b08f-44e166a80e02 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.754757 Oct 19 07:02:31.938996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:31.940440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:31.943546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:31.944420 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1568/3203] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:31 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:31.945604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lazy-loading 'fault' on Instance uuid efd23cc7-b696-4b27-895c-2ba60aa6c7c2 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:31.983631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:31.987720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:32.006050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:32.007464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:32.007464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:32.009979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:32.011182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:32.012724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:32.134434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:32.147498 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7375848-aa67-4773-83b6-18b0f20d222a tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 200 len: 1306 microversion: 2.1 time: 0.319295 Oct 19 07:02:32.149197 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1636/3204] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:31 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 1306 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:32.176273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68e451a9-6327-49d3-bb87-e48b2d5b44bc tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d5fbfd310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:32.251948 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68e451a9-6327-49d3-bb87-e48b2d5b44bc tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.085761 Oct 19 07:02:32.257469 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1637/3205] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:32 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:32.388286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:32.389799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:32.410167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:32.417153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:32.417153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:32.420643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:32.424344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:32.427232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:32.577179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:32.590410 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30d01938-5df9-4112-a0b8-e1585dcb610a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1363 microversion: 2.1 time: 0.612854 Oct 19 07:02:32.592472 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1569/3206] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:31 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1363 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:32.824329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:32.824951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:32.845528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:32.846100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:32.848741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:32.849509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:32.850670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:32.853424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:32.884249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:32.898305 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9c311dd-7728-4f07-8698-df7aad5e02f0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1527 microversion: 2.1 time: 0.514557 Oct 19 07:02:32.909893 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1638/3207] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:32 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1527 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:32.937903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:32.938653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:32.975934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:32.989908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:32.990480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:32.993873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:32.994406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:32.994869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.133309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:33.145142 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e190a1aa-9e34-44f8-8434-a0b452f0ec1f tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 200 len: 1303 microversion: 2.1 time: 0.326177 Oct 19 07:02:33.162286 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1570/3208] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:32 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 1303 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:33.171261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:33.172925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:33.183665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:33.184407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:33.185044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.185931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:33.186545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:33.187273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.349380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:33.372357 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-867d7e11-38f1-4ced-8711-78d785d7934c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1527 microversion: 2.1 time: 0.445238 Oct 19 07:02:33.392633 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1639/3209] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:32 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1527 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:33.407366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c48d484e-fea5-4129-a85a-b7c1602075ec req-e3bbc822-6952-4f69-b24f-9cf0b93b2505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e163a6-ba79-4799-b148-8577e4e1f14f", "name": "network-vif-deleted", "tag": "6e7b73ff-17d4-48fe-88e8-152bb9294036"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:33.469444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c48d484e-fea5-4129-a85a-b7c1602075ec req-e3bbc822-6952-4f69-b24f-9cf0b93b2505 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:33.472540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c48d484e-fea5-4129-a85a-b7c1602075ec req-e3bbc822-6952-4f69-b24f-9cf0b93b2505 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:33.473172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c48d484e-fea5-4129-a85a-b7c1602075ec req-e3bbc822-6952-4f69-b24f-9cf0b93b2505 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.520672 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c48d484e-fea5-4129-a85a-b7c1602075ec req-e3bbc822-6952-4f69-b24f-9cf0b93b2505 service nova] Creating event network-vif-deleted:6e7b73ff-17d4-48fe-88e8-152bb9294036 for instance c0e163a6-ba79-4799-b148-8577e4e1f14f on n-h1-861333-10 Oct 19 07:02:33.528657 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c48d484e-fea5-4129-a85a-b7c1602075ec req-e3bbc822-6952-4f69-b24f-9cf0b93b2505 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129684 Oct 19 07:02:33.534406 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1640/3210] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:33.550924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:33.556324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: efd23cc7-b696-4b27-895c-2ba60aa6c7c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:33.562108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:33.563118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:33.564013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.565183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:33.566129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:33.567454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.582487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:33.588289 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] HTTP exception thrown: Instance efd23cc7-b696-4b27-895c-2ba60aa6c7c2 could not be found. Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Request method failure captured: Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 HTTP/1.1 Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AxJep7BOnVFHWS5MxsB-tji5pQWc3llPlG_eQg6utr_o8t5Kd1nuvvscxTdfejU1hcBEwwTdxsmOfUUNHbb3ldOyZkT6xMJGjtVJOqsxLleTPhG2Kj5iSpwWxD86pL7izc64fKnCHANy71dZXEvcJwwMW4nVJm6UxV4_WF7V2UqFM Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6f0b288d116428981f07801b48d1cc8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 6d399daf565e4ceabd2883ad43ef7f8b Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance efd23cc7-b696-4b27-895c-2ba60aa6c7c2 could not be found. Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'efd23cc7-b696-4b27-895c-2ba60aa6c7c2'} Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd23cc7-b696-4b27-895c-2ba60aa6c7c2 could not be found. Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd23cc7-b696-4b27-895c-2ba60aa6c7c2 could not be found. Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:33.590439 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.602133 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:33.602133 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:33.602133 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:33.602133 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:33.602133 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:33.602133 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd23cc7-b696-4b27-895c-2ba60aa6c7c2 could not be found. Oct 19 07:02:33.602133 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.602568 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9968b79c-04ae-45c7-a980-75f7cbd7c509 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.429368 Oct 19 07:02:33.605288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Returning 404 to user: Instance efd23cc7-b696-4b27-895c-2ba60aa6c7c2 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:33.606480 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca179b4a-2a6c-4627-935d-b65747a06cd2 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2" status: 404 len: 111 microversion: 2.1 time: 0.070309 Oct 19 07:02:33.607336 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1641/3211] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:33 2022] GET /compute/v2.1/servers/efd23cc7-b696-4b27-895c-2ba60aa6c7c2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:33.609881 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1571/3212] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:33 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:33.614662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f392a039-ca04-488b-902c-adfca158f174 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d68bd4430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:33.681073 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f392a039-ca04-488b-902c-adfca158f174 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.072255 Oct 19 07:02:33.687738 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1642/3213] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:33 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:33.705168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:33.705168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:33.724563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:33.725073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:33.725526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.726248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:33.726714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:33.727150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.806169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:33.896374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:33.896880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:33.906293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:33.907140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:33.907743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.917496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:33.918721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:33.919564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:33.956579 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] HTTP exception thrown: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Request method failure captured: Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 HTTP/1.1 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DyHr1rvAgbnjkH_Q3u1-NcdMLCwNPMrKfwRuJ4m_9fvAHVuDXfNODny1yPD47KLG208Xpv5RzLJto9hcKyHhbiYp9ysczVIDuomJnaEgTHpxRoZly-0-g_GXebNV5moez_ZrZBeDj4fwbelYqaOnwBqOjdZjbg6426pXERS2NY78U Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 3d320b6f63904f85b08974cd22907659 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1522296325 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3d320b6f63904f85b08974cd22907659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3d320b6f63904f85b08974cd22907659"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3d320b6f63904f85b08974cd22907659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3d320b6f63904f85b08974cd22907659", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1522296325 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 3d320b6f63904f85b08974cd22907659 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1522296325 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1522296325-project Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: ebe77d9e1530498896e0130d7de91563 Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1522296325-project Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'f7e9049b-317b-4e0f-b462-5595803b63e5'} Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:33.959345 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:33.965481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:33.968262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Returning 404 to user: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:33.969488 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6b95f25-0fad-463f-ae3f-4ca3e74e12f1 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 404 len: 111 microversion: 2.1 time: 0.358499 Oct 19 07:02:33.975303 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1572/3214] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:33 2022] DELETE /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 111 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:34.001231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:34.002292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:34.010269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.011209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.021883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.021883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.021883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.021883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.218551 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5846e8a4-7565-4596-a311-caf21822baad tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 204 len: 0 microversion: 2.1 time: 0.527686 Oct 19 07:02:34.219161 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1643/3215] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:33 2022] DELETE /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:34.224673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:34.225384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:34.244726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.253068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.254067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.255027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.259045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.259763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.277388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:34.287061 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5070d7eb-f538-4347-b2cf-965931a61fa6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1363 microversion: 2.1 time: 0.294177 Oct 19 07:02:34.303518 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1573/3216] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:33 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:34.312287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:34.313353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: c0e163a6-ba79-4799-b148-8577e4e1f14f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:34.320411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.321128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.321748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.322509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.323139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.323735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.342368 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] HTTP exception thrown: Instance c0e163a6-ba79-4799-b148-8577e4e1f14f could not be found. Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Request method failure captured: Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f HTTP/1.1 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6BfvNHdv4fbd6t1SrCA40SQ6ybTcc9AWJz1-aEbOyliT3y2XPpUJoZyBY6JUyFpPZSVKBqw2POB2Fs240qfpRdVffWASrkuqFmX_qLzCodvFbynMNOqHfoFgm4unPNsaIwpHRlU3fK8jbTbyMQmjyg88_aJyXn5jMlh2USzNQVd73w Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 4c12e540806a4482a3b3c2f2e4c96d75 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ListImageFiltersTestJSON-81999076 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4c12e540806a4482a3b3c2f2e4c96d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4c12e540806a4482a3b3c2f2e4c96d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4c12e540806a4482a3b3c2f2e4c96d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4c12e540806a4482a3b3c2f2e4c96d75", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ListImageFiltersTestJSON-81999076 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 4c12e540806a4482a3b3c2f2e4c96d75 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-81999076 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ListImageFiltersTestJSON-81999076-project Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 8d0c669a9c954108a75045073e26e6f5 Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ListImageFiltersTestJSON-81999076-project Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance c0e163a6-ba79-4799-b148-8577e4e1f14f could not be found. Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'c0e163a6-ba79-4799-b148-8577e4e1f14f'} Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e163a6-ba79-4799-b148-8577e4e1f14f could not be found. Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e163a6-ba79-4799-b148-8577e4e1f14f could not be found. Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:34.344230 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:34.348431 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:34.348431 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:34.348431 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:34.348431 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:34.348431 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:34.348431 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e163a6-ba79-4799-b148-8577e4e1f14f could not be found. Oct 19 07:02:34.348431 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:34.349649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Returning 404 to user: Instance c0e163a6-ba79-4799-b148-8577e4e1f14f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:34.352676 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dfc6924e-1328-4940-a49c-86ea036f8cb7 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f" status: 404 len: 111 microversion: 2.1 time: 0.044317 Oct 19 07:02:34.356292 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1574/3217] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:34 2022] GET /compute/v2.1/servers/c0e163a6-ba79-4799-b148-8577e4e1f14f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:34.361246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:34.361880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:34.371997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:34.373896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.374428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.374948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.375680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.376271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.377138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.582299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:34.592598 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-277f091c-1d4f-4c79-a7e9-52f1743a1f43 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1472 microversion: 2.1 time: 0.236857 Oct 19 07:02:34.593691 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1575/3218] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:34 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:34.599037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:34.599541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:34.608410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.611739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.611739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.611739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.611739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.612681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.664824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:34.718023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:34.728903 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f57d7710-8b6e-41b1-a97a-26021c494861 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1527 microversion: 2.1 time: 0.508517 Oct 19 07:02:34.731543 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1644/3219] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:34 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1527 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:34.739616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:34.740449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:34.747105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.747857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.748519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:34.749383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:34.750277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:34.750865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.016364 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c7ca1c8-6758-4be6-bf9a-177ddd913cc1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 204 len: 0 microversion: 2.1 time: 0.421142 Oct 19 07:02:35.016985 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1576/3220] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:34 2022] DELETE /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:35.024370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6379acbb-711a-41f0-9083-6eaf06371b4b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64c5fc10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:35.073956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:35.089916 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6379acbb-711a-41f0-9083-6eaf06371b4b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.071563 Oct 19 07:02:35.092764 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1577/3221] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:35 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:35.099791 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad03fc90-e3b9-4cac-9acd-542c437c3fca tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.364317 Oct 19 07:02:35.100705 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1645/3222] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:34 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:35.105758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0d1408ca-a883-43fb-9086-dea4e20ebc3a req-22a3f93b-f4cf-4184-acd7-b6df6b4ace57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "name": "network-vif-plugged", "status": "completed", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:35.124134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Action: 'update', calling method: >, body: {"server": {"name": "f7e9049b-317b-4e0f-b462-5595803b63e5_new"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:35.129149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:35.150891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.155593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.156554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.159969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.160768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.161441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.163896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d1408ca-a883-43fb-9086-dea4e20ebc3a req-22a3f93b-f4cf-4184-acd7-b6df6b4ace57 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.164619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d1408ca-a883-43fb-9086-dea4e20ebc3a req-22a3f93b-f4cf-4184-acd7-b6df6b4ace57 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.166475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d1408ca-a883-43fb-9086-dea4e20ebc3a req-22a3f93b-f4cf-4184-acd7-b6df6b4ace57 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.182957 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0d1408ca-a883-43fb-9086-dea4e20ebc3a req-22a3f93b-f4cf-4184-acd7-b6df6b4ace57 service nova] Creating event network-vif-plugged:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:02:35.195534 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] HTTP exception thrown: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:35.196664 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0d1408ca-a883-43fb-9086-dea4e20ebc3a req-22a3f93b-f4cf-4184-acd7-b6df6b4ace57 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094456 Oct 19 07:02:35.197832 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1646/3223] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Request method failure captured: Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 HTTP/1.1 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 64 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DyHr1rvAgbnjkH_Q3u1-NcdMLCwNPMrKfwRuJ4m_9fvAHVuDXfNODny1yPD47KLG208Xpv5RzLJto9hcKyHhbiYp9ysczVIDuomJnaEgTHpxRoZly-0-g_GXebNV5moez_ZrZBeDj4fwbelYqaOnwBqOjdZjbg6426pXERS2NY78U Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 3d320b6f63904f85b08974cd22907659 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1522296325 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3d320b6f63904f85b08974cd22907659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3d320b6f63904f85b08974cd22907659"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3d320b6f63904f85b08974cd22907659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3d320b6f63904f85b08974cd22907659", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1522296325 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 3d320b6f63904f85b08974cd22907659 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1522296325 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1522296325-project Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: ebe77d9e1530498896e0130d7de91563 Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1522296325-project Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "f7e9049b-317b-4e0f-b462-5595803b63e5_new"}} Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'f7e9049b-317b-4e0f-b462-5595803b63e5', 'body': {'server': {'name': 'f7e9049b-317b-4e0f-b462-5595803b63e5_new'}}} Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:02:35.198366 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:35.202160 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:35.203173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:35.203633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:35.205289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] Returning 404 to user: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:35.206817 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0148c596-830f-4eca-852e-d723f65c1060 tempest-ServersNegativeTestMultiTenantJSON-1522296325 tempest-ServersNegativeTestMultiTenantJSON-1522296325-project] 10.222.0.39 "PUT /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 404 len: 111 microversion: 2.1 time: 0.112953 Oct 19 07:02:35.211192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.212073 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1578/3224] 10.222.0.39 () {60 vars in 1256 bytes} [Wed Oct 19 07:02:35 2022] PUT /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:35.212604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.213219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.214128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.214892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.215492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.218959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:35.219597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:35.229204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.230128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.231705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.233008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.233925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.237372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.277594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:35.494318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:35.503409 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f3f047b-ad99-4590-8621-a16268615aa4 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1474 microversion: 2.1 time: 0.304373 Oct 19 07:02:35.512681 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1647/3225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:35 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1474 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:35.512681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:35.512681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:35.515450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.515949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.516797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.517836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.518311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.518975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.824169 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b4dc2a4-4864-4f8c-a478-4d0c35089708 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 204 len: 0 microversion: 2.1 time: 0.610493 Oct 19 07:02:35.825088 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1579/3226] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:35 2022] DELETE /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:35.833035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:35.834185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:35.850570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.854872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.854872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.854872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:35.854872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:35.854872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:35.944591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:35.953140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f2463f2-496c-4fa0-aa2a-867a35a3da5f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1363 microversion: 2.1 time: 0.447828 Oct 19 07:02:35.958537 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1648/3227] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:35 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:35.974380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:35.979537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:35.999837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:36.005053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:36.006642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:36.008775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:36.011647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:36.014001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:36.280825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:36.291250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f32c3315-b9b7-4d63-a59f-54e57ca48e92 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1472 microversion: 2.1 time: 0.465123 Oct 19 07:02:36.299159 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1580/3228] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:35 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1472 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:36.320572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f00c521-bb8f-4c28-8a69-a10089cfc6c6 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d647c4f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:36.400566 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f00c521-bb8f-4c28-8a69-a10089cfc6c6 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.099989 Oct 19 07:02:36.402316 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1581/3229] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:36 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:36.407260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:36.416755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:36.448408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:36.448408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:36.448408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:36.448408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:36.448408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:36.448408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:36.460795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:36.472591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:36.508980 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bbd879e7-3a91-4c77-b681-5fe6b284c67c tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1533 microversion: 2.1 time: 0.546279 Oct 19 07:02:36.525582 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1649/3230] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:35 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1533 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:36.535752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:36.535752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:36.558460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:36.558963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:36.559407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:36.560168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:36.560611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:36.561046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:36.810006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:36.822241 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd6b1bdb-4499-43ba-bbb7-613b98355169 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1474 microversion: 2.1 time: 0.295510 Oct 19 07:02:36.824258 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1650/3231] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:36 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1474 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:36.985873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:36.987415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:37.006305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.010935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.010935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:37.010935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.011864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.012372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:37.091335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:37.095701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:37.112773 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4e8e24e-00b5-491d-9e50-57f4516587e7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.709049 Oct 19 07:02:37.114335 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1582/3232] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:36 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:37.327505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:37.328203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:37.342068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.342575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.343020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:37.343734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.348848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.349495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:37.460873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:37.469992 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0327c3c3-a2c6-44c6-83bd-6ba5f4257cc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1551 microversion: 2.1 time: 0.488158 Oct 19 07:02:37.471691 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1651/3233] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:36 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1551 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:37.484889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ac026f1-ebec-4453-9834-d9184cc285fe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d5fb06c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:37.558813 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ac026f1-ebec-4453-9834-d9184cc285fe tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.085750 Oct 19 07:02:37.561354 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1652/3234] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:37 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:37.580480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-088c25eb-e80f-4c5d-96fe-094be0a56097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:37.580480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-088c25eb-e80f-4c5d-96fe-094be0a56097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:37.590984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c25eb-e80f-4c5d-96fe-094be0a56097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.591779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c25eb-e80f-4c5d-96fe-094be0a56097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.593588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c25eb-e80f-4c5d-96fe-094be0a56097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:37.594555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c25eb-e80f-4c5d-96fe-094be0a56097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.596664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c25eb-e80f-4c5d-96fe-094be0a56097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.599632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c25eb-e80f-4c5d-96fe-094be0a56097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:37.661815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:37.678551 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a1888e9-8e56-4a5b-9bcf-ee3568c510b9 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1472 microversion: 2.1 time: 0.357158 Oct 19 07:02:37.692414 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1583/3235] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:37 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:37.697551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:37.698182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:37.722108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.723676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.724146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:37.726265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.726783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.728361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:37.930327 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-088c25eb-e80f-4c5d-96fe-094be0a56097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.367623 Oct 19 07:02:37.941770 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1653/3236] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:02:37 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/os-interface => generated 285 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:37.953998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:37.957926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:37.969235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.972479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.974802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:37.974802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:37.982123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:37.982917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:38.187064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:38.210618 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea394ca5-3aa9-41b2-a0f1-520592b61a78 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1533 microversion: 2.1 time: 0.524601 Oct 19 07:02:38.213186 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1584/3237] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:37 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1533 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:38.227131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:38.232058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:38.258132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:38.260709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:38.261354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:38.266492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:38.266492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:38.266492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:38.414140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:38.431409 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d3da224-af2e-423d-8742-f9e1698a091d tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1474 microversion: 2.1 time: 0.481630 Oct 19 07:02:38.436530 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1654/3238] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:37 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1474 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:38.580600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e28a556-729c-407e-81f0-33489e49878c tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64ebddc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:38.671144 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e28a556-729c-407e-81f0-33489e49878c tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.098634 Oct 19 07:02:38.671725 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1655/3239] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:38 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:38.710178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:38.713862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:38.729307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:38.732214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:38.733860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:38.736832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:38.738522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:38.739009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:38.749179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:38.779571 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45b21a76-4ed3-49e4-9ca1-38bd5d47caad tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.560570 Oct 19 07:02:38.786525 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1585/3240] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:38 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:39.240546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:39.241692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:39.293362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:39.296495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:39.301377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:39.302640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:39.309378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:39.312795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:39.450925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:39.450925 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5ff412c-5d07-4873-aa2e-e5a221bf8df8 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1472 microversion: 2.1 time: 0.726346 Oct 19 07:02:39.452340 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1656/3241] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:38 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1472 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:39.472451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:39.486036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:39.503060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:39.503060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:39.503060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:39.507116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:39.516088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:39.516692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:40.335745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:40.345349 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-148c808b-3fdd-4635-87f8-1fd7bcae57e1 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1474 microversion: 2.1 time: 0.887650 Oct 19 07:02:40.347547 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1657/3242] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:39 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1474 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:40.453208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-781341a2-7438-4b7a-b952-2929c4b1974f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: .version_select at 0x7f6d64896820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1495145409", "description": "tempest-description-1172066755"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:40.833141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f412dc05164ab9b33aaa8bb244f348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433ad16e975a4768b2a26b3c6771b89c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:40.843154 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-faa5602f-0834-4bc7-b5c4-dc507aa01fa5 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 200 len: 1533 microversion: 2.1 time: 1.612065 Oct 19 07:02:40.857165 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1586/3243] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:39 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 1533 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:40.866768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5be8c634-6721-478a-977e-d53fcd1062b4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64c38a60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:40.980907 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5be8c634-6721-478a-977e-d53fcd1062b4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.121558 Oct 19 07:02:40.981703 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1587/3244] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:40 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:41.007832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-295e32c9-769d-4fbd-bd77-8922b1ebd59c req-9cda7364-890d-4781-8c9f-323b83b9b0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2a5047-f4a1-493a-9114-8cd7e5de3f90", "name": "network-vif-unplugged", "status": "completed", "tag": "18569f14-d6ef-426c-aa3d-b8c900ea7d8f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:41.033901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-295e32c9-769d-4fbd-bd77-8922b1ebd59c req-9cda7364-890d-4781-8c9f-323b83b9b0e4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:41.041177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-295e32c9-769d-4fbd-bd77-8922b1ebd59c req-9cda7364-890d-4781-8c9f-323b83b9b0e4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:41.045158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-295e32c9-769d-4fbd-bd77-8922b1ebd59c req-9cda7364-890d-4781-8c9f-323b83b9b0e4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:41.097221 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-295e32c9-769d-4fbd-bd77-8922b1ebd59c req-9cda7364-890d-4781-8c9f-323b83b9b0e4 service nova] Creating event network-vif-unplugged:18569f14-d6ef-426c-aa3d-b8c900ea7d8f for instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 on n-h2-861333-10 Oct 19 07:02:41.111241 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-295e32c9-769d-4fbd-bd77-8922b1ebd59c req-9cda7364-890d-4781-8c9f-323b83b9b0e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127753 Oct 19 07:02:41.124567 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1588/3245] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:41.133922 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-781341a2-7438-4b7a-b952-2929c4b1974f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.784877 Oct 19 07:02:41.138880 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1658/3246] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:02:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:41.149243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:41.152208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:41.167672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:41.173789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:41.177204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:41.177939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:41.178344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:41.180880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:41.181389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:41.181829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:41.272920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:41.273449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:41.273909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:41.287276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:41.291729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:41.295631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:41.611745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:41.622564 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e33872f0-6150-400e-a345-1bbd7ca6307c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1472 microversion: 2.1 time: 0.480622 Oct 19 07:02:41.641424 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1659/3247] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:41 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1472 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:41.647489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-88bbd23b-0395-416c-a6fc-00e685938772 req-f82b1977-71c8-4c21-9267-83c19eab584f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e9049b-317b-4e0f-b462-5595803b63e5", "name": "network-vif-deleted", "tag": "cef45970-e531-404c-8a40-4a529a362e4f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:41.677443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88bbd23b-0395-416c-a6fc-00e685938772 req-f82b1977-71c8-4c21-9267-83c19eab584f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:41.678133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88bbd23b-0395-416c-a6fc-00e685938772 req-f82b1977-71c8-4c21-9267-83c19eab584f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:41.680161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88bbd23b-0395-416c-a6fc-00e685938772 req-f82b1977-71c8-4c21-9267-83c19eab584f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:41.696273 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-88bbd23b-0395-416c-a6fc-00e685938772 req-f82b1977-71c8-4c21-9267-83c19eab584f service nova] Creating event network-vif-deleted:cef45970-e531-404c-8a40-4a529a362e4f for instance f7e9049b-317b-4e0f-b462-5595803b63e5 on n-h2-861333-10 Oct 19 07:02:41.726510 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-88bbd23b-0395-416c-a6fc-00e685938772 req-f82b1977-71c8-4c21-9267-83c19eab584f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069557 Oct 19 07:02:41.727223 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1660/3248] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:41.745592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b89d6db1-e595-42ee-91dd-e6c240bedb7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: .version_select at 0x7f6d68ae5820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1269006230", "description": "tempest-description-2035648679"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:42.275209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:42.298778 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38965f7e-48ab-4dd1-99aa-cf81055ce847 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 1.172464 Oct 19 07:02:42.303245 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1589/3249] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:41 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:42.324437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:42.326919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:42.327697 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b89d6db1-e595-42ee-91dd-e6c240bedb7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.589058 Oct 19 07:02:42.330982 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1661/3250] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:02:41 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:42.337577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-677020463", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "131668e2-a776-49e6-9834-3c973dd39d70"}, {"uuid": "53b68294-0dbb-4f62-b330-636c4642c07a"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:42.364798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:42.366575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:42.369560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:42.372487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:42.373329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:42.374828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:42.489579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] validate_networks() for [('131668e2-a776-49e6-9834-3c973dd39d70', None, None, None, None, None), ('53b68294-0dbb-4f62-b330-636c4642c07a', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:02:43.920551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:43.940073 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd78f779-6758-4989-94ad-2a6e61a63575 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1474 microversion: 2.1 time: 1.629701 Oct 19 07:02:43.942218 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1590/3251] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:42 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1474 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:43.959265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:43.959921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] [instance: f7e9049b-317b-4e0f-b462-5595803b63e5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:43.985221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:43.987838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:43.989181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:43.989951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:43.990423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:43.993003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:44.059802 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] HTTP exception thrown: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Request method failure captured: Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 HTTP/1.1 Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6Dm5c9b-NJrOhsDVOlktm88iQt3G3BlVqMPa8V640BiktHzRul0r5dXMOb5BJoI2JRJlS9g6lwjn5LTc0i4rUpSsdbKRzGdLJsQg7O98vtNW1rsbwoARinUf5EVnOB_2mAepTDaU0OdQ9_uUTxEScdpsApCrrI5YNZL5Xn_eHBGGJs Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 433ad16e975a4768b2a26b3c6771b89c Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-987449466 Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/433ad16e975a4768b2a26b3c6771b89c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/433ad16e975a4768b2a26b3c6771b89c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/433ad16e975a4768b2a26b3c6771b89c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_433ad16e975a4768b2a26b3c6771b89c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-987449466 Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 433ad16e975a4768b2a26b3c6771b89c Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-987449466 Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestMultiTenantJSON-987449466-project Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 04f412dc05164ab9b33aaa8bb244f348 Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-987449466-project Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'f7e9049b-317b-4e0f-b462-5595803b63e5'} Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:44.067889 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:44.072437 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:44.072437 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:44.072437 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:44.072437 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:44.072437 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:44.072437 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:44.072437 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:44.072437 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. Oct 19 07:02:44.072437 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:44.077544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] Returning 404 to user: Instance f7e9049b-317b-4e0f-b462-5595803b63e5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:44.078016 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-78ab6091-717f-4c1f-91a1-4c9003f821d0 tempest-ServersNegativeTestMultiTenantJSON-987449466 tempest-ServersNegativeTestMultiTenantJSON-987449466-project] 10.222.0.39 "GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5" status: 404 len: 111 microversion: 2.1 time: 0.132304 Oct 19 07:02:44.082425 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1591/3252] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:43 2022] GET /compute/v2.1/servers/f7e9049b-317b-4e0f-b462-5595803b63e5 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:44.101217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-976778af-381e-48b0-9afc-7eef6fd00754 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d68b3ee50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:44.242980 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-976778af-381e-48b0-9afc-7eef6fd00754 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.158685 Oct 19 07:02:44.245294 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1592/3253] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:44 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:44.264178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1002193095", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "3540d671-9bee-4fde-bb25-277092fca2cb"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:44.395141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] validate_networks() for [('3540d671-9bee-4fde-bb25-277092fca2cb', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:02:45.073309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:02:45.074468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:02:45.075140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:02:45.075747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:02:45.076420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:02:45.079939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:45.095392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.098115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.100301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:45.102940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.104416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.106121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:45.154215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Getting quotas for project 4b64d433fbb74f5b89ab02e4572ddc45. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:45.175522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Getting quotas for user 41810b44169748bd97b407696a681dc7 and project 4b64d433fbb74f5b89ab02e4572ddc45. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:45.198122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:02:45.225869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:02:45.440452 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd602ad7-0837-400a-85c2-d72a4ccebcf2 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.108173 Oct 19 07:02:45.453766 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1662/3254] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:02:45.455879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:45.460913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:45.478439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.478950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.479408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:45.480171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.480649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.481092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:45.558651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.559160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.559614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:45.560081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lazy-loading 'fault' on Instance uuid 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:45.633753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:45.641614 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2d95405-c219-4083-a05e-0446884b5daa tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1306 microversion: 2.1 time: 0.189895 Oct 19 07:02:45.644261 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1663/3255] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:45 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:45.650663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:45.652136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:45.672037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.673251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.675138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:45.676079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.676772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.677536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:45.894035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:45.905250 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32ee8485-bf02-44e9-a640-a23624bef85a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.259641 Oct 19 07:02:45.905868 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1664/3256] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:45 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:45.913951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3474ad13-91f0-4ab7-80e0-9470d2900687 req-fad31191-87db-4de5-92ab-a13279ddb6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2a5047-f4a1-493a-9114-8cd7e5de3f90", "name": "network-vif-deleted", "tag": "18569f14-d6ef-426c-aa3d-b8c900ea7d8f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:45.924631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3474ad13-91f0-4ab7-80e0-9470d2900687 req-fad31191-87db-4de5-92ab-a13279ddb6ee service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.925113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3474ad13-91f0-4ab7-80e0-9470d2900687 req-fad31191-87db-4de5-92ab-a13279ddb6ee service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.925547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3474ad13-91f0-4ab7-80e0-9470d2900687 req-fad31191-87db-4de5-92ab-a13279ddb6ee service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:45.937598 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3474ad13-91f0-4ab7-80e0-9470d2900687 req-fad31191-87db-4de5-92ab-a13279ddb6ee service nova] Creating event network-vif-deleted:18569f14-d6ef-426c-aa3d-b8c900ea7d8f for instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 on n-h2-861333-10 Oct 19 07:02:45.943223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3474ad13-91f0-4ab7-80e0-9470d2900687 req-fad31191-87db-4de5-92ab-a13279ddb6ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035800 Oct 19 07:02:45.943838 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1665/3257] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:45.949095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:45.949787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:45.959426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.959426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.959426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:45.959426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:45.960255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:45.960420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:46.011720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:46.012458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:46.013060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:46.013680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lazy-loading 'fault' on Instance uuid 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:46.130068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:46.146214 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-707f73ad-5cf8-41c7-aab0-f35b9b98474b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1308 microversion: 2.1 time: 0.200937 Oct 19 07:02:46.175202 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1666/3258] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:45 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:46.181172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70d337c7-980e-4adc-824f-b051bbfdbf1b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d65227820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:46.268231 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70d337c7-980e-4adc-824f-b051bbfdbf1b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1426 microversion: 2.1 time: 0.090844 Oct 19 07:02:46.269980 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1667/3259] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:46 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1426 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:46.298811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52e4c58a-2911-4e46-bacd-f326e38e1463 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:46.304963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52e4c58a-2911-4e46-bacd-f326e38e1463 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:46.422335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52e4c58a-2911-4e46-bacd-f326e38e1463 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:46.432353 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52e4c58a-2911-4e46-bacd-f326e38e1463 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1212 microversion: 2.1 time: 0.160966 Oct 19 07:02:46.440343 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1668/3260] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:46 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1212 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:46.669061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:46.669886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:46.677121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:46.677699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:46.678140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:46.678850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:46.679306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:46.679734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:46.699091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:02:46.700476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:02:46.702432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:02:46.706813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:02:46.706813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:02:46.722457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:46.722941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:46.723554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:46.724214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lazy-loading 'fault' on Instance uuid 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:46.739455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:46.739952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:46.746702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:46.752853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:46.752853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:46.752853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:46.786123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Getting quotas for project 230afab7d7eb4d98950bece49d03ded6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:46.795484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Getting quotas for user 54f1ed18a0014aefa8d9a01259b83730 and project 230afab7d7eb4d98950bece49d03ded6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:46.825662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:02:46.828189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:02:46.852735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:46.860582 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-381d8dc3-3d32-4889-9ca4-91bad76b4b32 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 200 len: 1306 microversion: 2.1 time: 0.195846 Oct 19 07:02:46.865025 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1669/3261] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:46 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 1306 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:46.929283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:46.929941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:46.943982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:46.949558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:46.949558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:46.949558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:46.949558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:46.950545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:46.954001 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99455cbe-4617-4e66-9e1c-71f3ef5f6f62 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.702442 Oct 19 07:02:46.954871 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1593/3262] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:02:46.966349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa8fefb1-41a7-4a6c-9d09-586fc39159d8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:46.966970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa8fefb1-41a7-4a6c-9d09-586fc39159d8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:47.183736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:47.196168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa8fefb1-41a7-4a6c-9d09-586fc39159d8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:47.197650 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a12dbbb-d0cb-40bb-bd4c-2a582fe54014 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1506 microversion: 2.1 time: 0.271412 Oct 19 07:02:47.199526 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1670/3263] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:46 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:47.205178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:47.206071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:47.221986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:47.222494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:47.223447 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa8fefb1-41a7-4a6c-9d09-586fc39159d8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1216 microversion: 2.1 time: 0.257391 Oct 19 07:02:47.226223 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1594/3264] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:46 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1216 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:47.231215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:47.232008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:47.232525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:47.232970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:47.286730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-adad7501-7293-435e-91d6-0db23c59018b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64729e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:47.332083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:47.337520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:47.338523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:47.340263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lazy-loading 'fault' on Instance uuid 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:47.401517 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-adad7501-7293-435e-91d6-0db23c59018b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1435 microversion: 2.1 time: 0.119959 Oct 19 07:02:47.406088 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1595/3265] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:47 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1435 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:02:47.435465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af58b986-e53a-4ae6-a4d8-1a3732c76e7f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d6460f820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:47.452561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0c669a9c954108a75045073e26e6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c12e540806a4482a3b3c2f2e4c96d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:47.467533 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f88067af-80a1-4f0f-9bf4-1e27ae6ed1b0 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 200 len: 1308 microversion: 2.1 time: 0.266633 Oct 19 07:02:47.468792 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1671/3266] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:47 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:47.474448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:47.475496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:47.483254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:47.483254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:47.483805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:47.484771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:47.485705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:47.486395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:47.573794 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af58b986-e53a-4ae6-a4d8-1a3732c76e7f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 200 len: 1435 microversion: 2.1 time: 0.157970 Oct 19 07:02:47.575236 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1596/3267] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:02:47 2022] GET /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 1435 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:47.594741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:47.596463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:47.605994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:47.606807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:47.607528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:47.608641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:47.609433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:47.610130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:47.685265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:47.698616 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90394c05-16c9-45ae-9fc8-bfd507afa72f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1216 microversion: 2.1 time: 0.227427 Oct 19 07:02:47.700172 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1672/3268] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:47 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1216 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:47.866101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:47.899064 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fc2b676-f02d-4369-ad01-8636dac3cd06 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1466 microversion: 2.1 time: 0.309175 Oct 19 07:02:47.902478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:47.903105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 1a2a5047-f4a1-493a-9114-8cd7e5de3f90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:47.915461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:47.915976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:47.916442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:47.917150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:47.917607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:47.918037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:47.924697 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1597/3269] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:47 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1466 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:47.931376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d524c069-a8e7-45b8-8f4c-536a706dfa57 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64596c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:47.997911 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] HTTP exception thrown: Instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 could not be found. Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Request method failure captured: Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 HTTP/1.1 Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AxJep7BOnVFHWS5MxsB-tji5pQWc3llPlG_eQg6utr_o8t5Kd1nuvvscxTdfejU1hcBEwwTdxsmOfUUNHbb3ldOyZkT6xMJGjtVJOqsxLleTPhG2Kj5iSpwWxD86pL7izc64fKnCHANy71dZXEvcJwwMW4nVJm6UxV4_WF7V2UqFM Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6f0b288d116428981f07801b48d1cc8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 6d399daf565e4ceabd2883ad43ef7f8b Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 could not be found. Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '1a2a5047-f4a1-493a-9114-8cd7e5de3f90'} Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 could not be found. Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 could not be found. Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:47.999781 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:48.005426 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:48.005426 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:48.005426 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:48.005426 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:48.005426 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:48.005426 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 could not be found. Oct 19 07:02:48.005426 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:48.005426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Returning 404 to user: Instance 1a2a5047-f4a1-493a-9114-8cd7e5de3f90 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:48.005426 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-308598ad-6afa-4bdd-b45a-5b4c6e8a5bed tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90" status: 404 len: 111 microversion: 2.1 time: 0.117251 Oct 19 07:02:48.018282 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1673/3270] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:47 2022] GET /compute/v2.1/servers/1a2a5047-f4a1-493a-9114-8cd7e5de3f90 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:48.031375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-96a2f25e-aa1f-4429-ad9a-2e47c79e0f36 req-4f3386d2-950e-49f2-acb3-7993ea1c3c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c", "name": "network-vif-deleted", "tag": "e9ea764b-95e8-4aeb-ae74-818b2898ceb8"}, {"name": "network-changed", "server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:48.088855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-96a2f25e-aa1f-4429-ad9a-2e47c79e0f36 req-4f3386d2-950e-49f2-acb3-7993ea1c3c92 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:48.089787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-96a2f25e-aa1f-4429-ad9a-2e47c79e0f36 req-4f3386d2-950e-49f2-acb3-7993ea1c3c92 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:48.090942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-96a2f25e-aa1f-4429-ad9a-2e47c79e0f36 req-4f3386d2-950e-49f2-acb3-7993ea1c3c92 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:48.135566 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-96a2f25e-aa1f-4429-ad9a-2e47c79e0f36 req-4f3386d2-950e-49f2-acb3-7993ea1c3c92 service nova] Creating event network-vif-deleted:e9ea764b-95e8-4aeb-ae74-818b2898ceb8 for instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c on n-h2-861333-10 Oct 19 07:02:48.136540 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-96a2f25e-aa1f-4429-ad9a-2e47c79e0f36 req-4f3386d2-950e-49f2-acb3-7993ea1c3c92 service nova] Creating event network-changed:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:02:48.147247 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-96a2f25e-aa1f-4429-ad9a-2e47c79e0f36 req-4f3386d2-950e-49f2-acb3-7993ea1c3c92 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.127447 Oct 19 07:02:48.149342 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1674/3271] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:48.172652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:48.174174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 97939c70-1ac7-4626-8d23-50bfa0d115d9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:48.185010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:48.191429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:48.191429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:48.193759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:48.198402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:48.199243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:48.256668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 97939c70-1ac7-4626-8d23-50bfa0d115d9] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:48.272416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:48.624228 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4e31d22-92eb-4f31-b6b1-3cb33fbd2a17 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9" status: 204 len: 0 microversion: 2.1 time: 0.455966 Oct 19 07:02:48.624931 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1675/3272] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:48 2022] DELETE /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:48.630848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:48.631812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:48.639537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:48.640285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:48.640957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:48.642230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:48.643048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:48.643911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:48.817020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:48.828356 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5052d5a5-6ff3-476f-ad43-7a4ebd3b526d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1486 microversion: 2.1 time: 0.201384 Oct 19 07:02:48.830843 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1676/3273] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:48 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1486 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:48.855203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:48.861144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:48.867162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:48.867943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:48.868472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:48.870003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:48.870642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:48.871495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:48.987181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:49.009664 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-169f3349-b760-4fdd-8c44-3f65301a8f2c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1220 microversion: 2.1 time: 0.174594 Oct 19 07:02:49.009664 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1677/3274] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:48 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1220 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:49.022853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:49.024138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] [instance: 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:49.038401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:49.039046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:49.039757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:49.040767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:49.041415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:49.041860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:49.058973 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] HTTP exception thrown: Instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c could not be found. Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Request method failure captured: Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c HTTP/1.1 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6BfvNHdv4fbd6t1SrCA40SQ6ybTcc9AWJz1-aEbOyliT3y2XPpUJoZyBY6JUyFpPZSVKBqw2POB2Fs240qfpRdVffWASrkuqFmX_qLzCodvFbynMNOqHfoFgm4unPNsaIwpHRlU3fK8jbTbyMQmjyg88_aJyXn5jMlh2USzNQVd73w Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4c12e540806a4482a3b3c2f2e4c96d75 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ListImageFiltersTestJSON-81999076 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4c12e540806a4482a3b3c2f2e4c96d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4c12e540806a4482a3b3c2f2e4c96d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4c12e540806a4482a3b3c2f2e4c96d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4c12e540806a4482a3b3c2f2e4c96d75", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ListImageFiltersTestJSON-81999076 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4c12e540806a4482a3b3c2f2e4c96d75 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-81999076 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ListImageFiltersTestJSON-81999076-project Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 8d0c669a9c954108a75045073e26e6f5 Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ListImageFiltersTestJSON-81999076-project Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c could not be found. Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c'} Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c could not be found. Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c could not be found. Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:49.060714 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:49.065559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:49.065559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:49.065559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:49.065559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:49.065559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:49.065559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c could not be found. Oct 19 07:02:49.065559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:49.065559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Returning 404 to user: Instance 3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:49.072274 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce20eade-864b-4cce-8d3b-749b9c2dfaef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c" status: 404 len: 111 microversion: 2.1 time: 0.061915 Oct 19 07:02:49.073911 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1678/3275] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:49 2022] GET /compute/v2.1/servers/3c8a7ed4-910b-4281-a5a3-0f2a5c69c08c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:49.080987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:49.081458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:49.102899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:49.103736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:49.109265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:49.110029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:49.110519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:49.110977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:49.156087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:49.599185 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45e75103-02a6-4110-9f18-00031dd3baa6 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 204 len: 0 microversion: 2.1 time: 0.524787 Oct 19 07:02:49.599854 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1679/3276] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:49 2022] DELETE /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:49.610460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:49.612356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:49.621450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:49.623394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:49.624422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:49.625488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:49.627520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:49.628243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:49.731101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:49.738457 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d524c069-a8e7-45b8-8f4c-536a706dfa57 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "DELETE /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102" status: 204 len: 0 microversion: 2.1 time: 1.812549 Oct 19 07:02:49.739118 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1598/3277] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:47 2022] DELETE /compute/v2.1/images/1ec863f7-e9b7-4d70-9573-814de5c83102 => generated 0 bytes in 1814 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:49.745364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1820993734", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:49.746141 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29a97aa1-2c84-40c2-9f22-3682a948cdae tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1264 microversion: 2.1 time: 0.144305 Oct 19 07:02:49.748075 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1680/3278] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:49 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:49.755287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a27ace4-6cf7-4e9c-928b-e4d36d7165ef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d68b8cd30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:49.873745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] validate_networks() for [('29335e90-a1bf-4955-b677-1be0dcbe05b7', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:02:50.505849 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a27ace4-6cf7-4e9c-928b-e4d36d7165ef tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "DELETE /compute/v2.1/images/1c8db80b-b205-4f66-8a6c-a07d1c7d1cd5" status: 204 len: 0 microversion: 2.1 time: 0.756244 Oct 19 07:02:50.506538 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1681/3279] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:49 2022] DELETE /compute/v2.1/images/1c8db80b-b205-4f66-8a6c-a07d1c7d1cd5 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:50.526039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:50.526686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 97939c70-1ac7-4626-8d23-50bfa0d115d9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:50.546986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:50.547627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:50.548450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:50.549371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:50.550003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:50.550626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:50.766114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:50.780285 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8085c80-5427-4967-842c-5edc118a5223 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9" status: 200 len: 1475 microversion: 2.1 time: 0.256604 Oct 19 07:02:50.781611 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1682/3280] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:50 2022] GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9 => generated 1475 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:50.786931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ef9789f-a516-4a57-a1b6-84be8da0afb2 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '.version_select at 0x7f6d64e5fa60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:50.842028 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-4ef9789f-a516-4a57-a1b6-84be8da0afb2 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] HTTP exception thrown: Image not found. Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ef9789f-a516-4a57-a1b6-84be8da0afb2 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Request method failure captured: Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 HTTP/1.1 Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6C0X03ify_t_iYiKZynP2s-M38935CJCdulCm8qvYymTU1TF_mo7gFL8LIFDWqJBJdQUumLj8R7cWVjxM12ynZ_N6cmromHXnlMdr6QeNInDHI5EAQvhmIh2_uu9nriV7_MyNnJoONl11cGrFpSrR7Y-5qrm5FiS7pFw_Wo0ZxePC0 Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 7dda7801787e4ea3988a90f30451f3fa Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerTestJSON-432133937 Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7dda7801787e4ea3988a90f30451f3fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7dda7801787e4ea3988a90f30451f3fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7dda7801787e4ea3988a90f30451f3fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7dda7801787e4ea3988a90f30451f3fa", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerTestJSON-432133937 Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 7dda7801787e4ea3988a90f30451f3fa Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-432133937 Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerTestJSON-432133937-project Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: cd1e25ce6cfb48159196d4466727a4d2 Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerTestJSON-432133937-project Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'ec6c1ab2-d266-46f1-9469-531b095f08a5'} Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ec6c1ab2-d266-46f1-9469-531b095f08a5 to delete Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ec6c1ab2-d266-46f1-9469-531b095f08a5 could not be found. Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:50.846188 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ef9789f-a516-4a57-a1b6-84be8da0afb2 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ef9789f-a516-4a57-a1b6-84be8da0afb2 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "DELETE /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5" status: 404 len: 62 microversion: 2.1 time: 0.064834 Oct 19 07:02:50.850962 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1683/3281] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:50 2022] DELETE /compute/v2.1/images/ec6c1ab2-d266-46f1-9469-531b095f08a5 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:02:50.864696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:50.865671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:50.875784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:50.877648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:50.881396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:50.882336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:50.885026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:50.886985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:50.985865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:51.000296 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f01a038-9615-42d0-9dac-e1fce28365d1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1212 microversion: 2.1 time: 0.149324 Oct 19 07:02:51.004723 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1684/3282] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:50 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1212 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:51.018488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f6ad09dd-f7a6-4470-a938-7f9405bc3fa1 req-896c7d6f-04cd-472b-965b-143ef2e537c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524a6e73-ef2b-4af5-884d-331924e8ad09", "name": "network-vif-unplugged", "status": "completed", "tag": "1249d2c6-bb1b-43b7-9034-10146ff5c868"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:51.029708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f6ad09dd-f7a6-4470-a938-7f9405bc3fa1 req-896c7d6f-04cd-472b-965b-143ef2e537c5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:51.030194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f6ad09dd-f7a6-4470-a938-7f9405bc3fa1 req-896c7d6f-04cd-472b-965b-143ef2e537c5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:51.030635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f6ad09dd-f7a6-4470-a938-7f9405bc3fa1 req-896c7d6f-04cd-472b-965b-143ef2e537c5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:51.045006 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f6ad09dd-f7a6-4470-a938-7f9405bc3fa1 req-896c7d6f-04cd-472b-965b-143ef2e537c5 service nova] Creating event network-vif-unplugged:1249d2c6-bb1b-43b7-9034-10146ff5c868 for instance 524a6e73-ef2b-4af5-884d-331924e8ad09 on n-h1-861333-10 Oct 19 07:02:51.051411 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f6ad09dd-f7a6-4470-a938-7f9405bc3fa1 req-896c7d6f-04cd-472b-965b-143ef2e537c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045302 Oct 19 07:02:51.052122 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1685/3283] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:51.058323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32e9c7c9-488a-4bc5-a2ec-d9e326cf9c13 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d68baef70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:51.066332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:02:51.066933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:02:51.067514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:02:51.068375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:02:51.068897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:02:51.080249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:51.080749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:51.081190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:51.082097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:51.082748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:51.083343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:51.102422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Getting quotas for project b3dbcf548a5843b3987aba2aac6028b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:02:51.108074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Getting quotas for user 260c88b50daf4cdd8048282cea957f93 and project b3dbcf548a5843b3987aba2aac6028b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:02:51.121218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:02:51.123433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:02:51.302987 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f3e21b3-5a89-4113-bfff-f4486b06f178 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.561786 Oct 19 07:02:51.303455 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1599/3284] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:02:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:02:51.308902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:51.309869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:51.318233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:51.319056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:51.319737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:51.320746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:51.321422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:51.322085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:51.559409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:51.564151 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c63fb34-c2e2-4973-b940-0645895cb57d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1264 microversion: 2.1 time: 0.258700 Oct 19 07:02:51.565538 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1600/3285] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:51 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1264 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:51.571013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:51.571917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:51.582852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:51.582852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:51.583300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:51.584655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:51.585372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:51.585806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:51.718860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:51.950451 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32e9c7c9-488a-4bc5-a2ec-d9e326cf9c13 tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "DELETE /compute/v2.1/images/256703dd-7d85-4d61-85a4-082349e076de" status: 204 len: 0 microversion: 2.1 time: 0.896402 Oct 19 07:02:51.950849 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1686/3286] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:51 2022] DELETE /compute/v2.1/images/256703dd-7d85-4d61-85a4-082349e076de => generated 0 bytes in 898 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:51.961755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d9d8616-51b6-4ef4-89a3-30ae30ced4da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:51.961928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d9d8616-51b6-4ef4-89a3-30ae30ced4da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:52.096665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d9d8616-51b6-4ef4-89a3-30ae30ced4da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:52.108553 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d9d8616-51b6-4ef4-89a3-30ae30ced4da tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1214 microversion: 2.1 time: 0.153663 Oct 19 07:02:52.116031 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1687/3287] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:51 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:52.123165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ee8f2a01-a86b-488f-97b4-c3939d5ca70a req-491e8e0b-e6c1-4bdc-8eaa-dbe20341b877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97939c70-1ac7-4626-8d23-50bfa0d115d9", "name": "network-vif-deleted", "tag": "7e3fe6c4-e18b-454b-a9e4-35869a7da8ab"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:52.141854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee8f2a01-a86b-488f-97b4-c3939d5ca70a req-491e8e0b-e6c1-4bdc-8eaa-dbe20341b877 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.143601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee8f2a01-a86b-488f-97b4-c3939d5ca70a req-491e8e0b-e6c1-4bdc-8eaa-dbe20341b877 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.144500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee8f2a01-a86b-488f-97b4-c3939d5ca70a req-491e8e0b-e6c1-4bdc-8eaa-dbe20341b877 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.179759 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ee8f2a01-a86b-488f-97b4-c3939d5ca70a req-491e8e0b-e6c1-4bdc-8eaa-dbe20341b877 service nova] Creating event network-vif-deleted:7e3fe6c4-e18b-454b-a9e4-35869a7da8ab for instance 97939c70-1ac7-4626-8d23-50bfa0d115d9 on n-h2-861333-10 Oct 19 07:02:52.194826 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ee8f2a01-a86b-488f-97b4-c3939d5ca70a req-491e8e0b-e6c1-4bdc-8eaa-dbe20341b877 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082349 Oct 19 07:02:52.195901 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1688/3288] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:52.204781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:52.207168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 97939c70-1ac7-4626-8d23-50bfa0d115d9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:52.219677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.219677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.220130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.221125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.221825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.222589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.282871 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e98bea0d-5a7e-4c8b-b11a-a69f20dceb9f tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "DELETE /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 204 len: 0 microversion: 2.1 time: 0.706419 Oct 19 07:02:52.282871 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1601/3289] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:51 2022] DELETE /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:52.293184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63ded35e-8b01-4c11-8ee1-a4ed53afd03b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] Calling method '.version_select at 0x7f6d64bfc9d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:52.307085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.307592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.308034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.308526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lazy-loading 'fault' on Instance uuid 97939c70-1ac7-4626-8d23-50bfa0d115d9 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:52.403230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:52.415687 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84fcbc85-c489-4c92-bf4f-f79d85936d08 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9" status: 200 len: 1309 microversion: 2.1 time: 0.216273 Oct 19 07:02:52.417854 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1689/3290] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:52 2022] GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9 => generated 1309 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:52.431212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:52.433215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:52.447158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.450085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.458698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.458698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.458698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.458698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.581186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:52.590579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fbb5081-1022-4f53-87ce-a2594a506f7b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1268 microversion: 2.1 time: 0.170182 Oct 19 07:02:52.591273 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1690/3291] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:52 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:52.604613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:52.605313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:52.611988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.612739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.613263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.614096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.614585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.619079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.859107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:52.872604 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9290d7c5-f631-4da9-a9b7-650de63dc1f4 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1472 microversion: 2.1 time: 0.279923 Oct 19 07:02:52.893031 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1691/3292] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:52 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:52.901138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:52.901764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:52.914037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.914550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.915009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.915731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:52.916222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:52.916687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:52.992010 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63ded35e-8b01-4c11-8ee1-a4ed53afd03b tempest-ListImageFiltersTestJSON-81999076 tempest-ListImageFiltersTestJSON-81999076-project] 10.222.0.39 "DELETE /compute/v2.1/images/58abfda2-469c-4e56-b3c9-3bd87ed4ad6b" status: 204 len: 0 microversion: 2.1 time: 0.713207 Oct 19 07:02:52.995933 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1602/3293] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:52 2022] DELETE /compute/v2.1/images/58abfda2-469c-4e56-b3c9-3bd87ed4ad6b => generated 0 bytes in 716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:53.061999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:53.082708 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4be1699c-981b-43de-bd74-b5f3d47c0cec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1270 microversion: 2.1 time: 0.188839 Oct 19 07:02:53.096151 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1692/3294] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:52 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:53.134142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:53.135215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:53.152170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.152170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.152170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:53.153519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.154092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.155468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:53.298151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:53.307516 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a3c9a46-be26-43a3-93dc-f35733e941e8 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1218 microversion: 2.1 time: 0.179121 Oct 19 07:02:53.308119 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1603/3295] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:53 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:53.442339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:53.442962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 97939c70-1ac7-4626-8d23-50bfa0d115d9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:53.453323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.453323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.453323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:53.453849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.454355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.455502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:53.472096 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] HTTP exception thrown: Instance 97939c70-1ac7-4626-8d23-50bfa0d115d9 could not be found. Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Request method failure captured: Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9 HTTP/1.1 Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AxJep7BOnVFHWS5MxsB-tji5pQWc3llPlG_eQg6utr_o8t5Kd1nuvvscxTdfejU1hcBEwwTdxsmOfUUNHbb3ldOyZkT6xMJGjtVJOqsxLleTPhG2Kj5iSpwWxD86pL7izc64fKnCHANy71dZXEvcJwwMW4nVJm6UxV4_WF7V2UqFM Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6f0b288d116428981f07801b48d1cc8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 6d399daf565e4ceabd2883ad43ef7f8b Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 97939c70-1ac7-4626-8d23-50bfa0d115d9 could not be found. Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '97939c70-1ac7-4626-8d23-50bfa0d115d9'} Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97939c70-1ac7-4626-8d23-50bfa0d115d9 could not be found. Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97939c70-1ac7-4626-8d23-50bfa0d115d9 could not be found. Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:53.479182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97939c70-1ac7-4626-8d23-50bfa0d115d9 could not be found. Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Returning 404 to user: Instance 97939c70-1ac7-4626-8d23-50bfa0d115d9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c163ed87-240f-4eb7-a6b0-289656d75092 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9" status: 404 len: 111 microversion: 2.1 time: 0.036938 Oct 19 07:02:53.484245 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1693/3296] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:53 2022] GET /compute/v2.1/servers/97939c70-1ac7-4626-8d23-50bfa0d115d9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:53.485002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:53.485002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:53.492041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.492849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.493285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:53.494470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.494928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.495635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:53.582033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:53.590757 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63c53e09-2042-4b3d-ba8c-dec8a19e3ef7 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1432 microversion: 2.1 time: 0.110168 Oct 19 07:02:53.591919 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1604/3297] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:53 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1432 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:53.618933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:53.619861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:53.627463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.628306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.629027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:53.630705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.631403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.632065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:53.728026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:53.741549 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-30eacdcb-5a29-4382-aaec-8e6d93a58d77 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1268 microversion: 2.1 time: 0.128859 Oct 19 07:02:53.758304 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1694/3298] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:53 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:53.899884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:53.900531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:53.907499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.908355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.909173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:53.910100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:53.910776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:53.911475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.088660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:54.096572 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07190b81-aba7-48c9-9eb0-319629835738 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1472 microversion: 2.1 time: 0.200891 Oct 19 07:02:54.097139 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1605/3299] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:53 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:54.111915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:54.112749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:54.118773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.119474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.119943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.120712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.121166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.125429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.268764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2a825ace-3260-4551-ade6-cdb872ec3b73 req-c1d77ec9-c3b5-44b4-bf61-80d3c089e57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3ea51c-9562-44a5-b313-a11890f07cf1", "name": "network-vif-deleted", "tag": "80a29399-b219-4238-8163-034c06e4ed8c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:54.277131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2a825ace-3260-4551-ade6-cdb872ec3b73 req-c1d77ec9-c3b5-44b4-bf61-80d3c089e57e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.277616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2a825ace-3260-4551-ade6-cdb872ec3b73 req-c1d77ec9-c3b5-44b4-bf61-80d3c089e57e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.278053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2a825ace-3260-4551-ade6-cdb872ec3b73 req-c1d77ec9-c3b5-44b4-bf61-80d3c089e57e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.289943 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2a825ace-3260-4551-ade6-cdb872ec3b73 req-c1d77ec9-c3b5-44b4-bf61-80d3c089e57e service nova] Creating event network-vif-deleted:80a29399-b219-4238-8163-034c06e4ed8c for instance 0f3ea51c-9562-44a5-b313-a11890f07cf1 on n-h1-861333-10 Oct 19 07:02:54.294934 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2a825ace-3260-4551-ade6-cdb872ec3b73 req-c1d77ec9-c3b5-44b4-bf61-80d3c089e57e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031543 Oct 19 07:02:54.297275 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1606/3300] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:02:54.333689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:54.334445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:54.343396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.344141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.345195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.346704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.347426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.348285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.375430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:54.413230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:54.422293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:54.444546 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5828639-b18b-42f8-9b4c-1b7bacc9b824 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1312 microversion: 2.1 time: 0.337172 Oct 19 07:02:54.463079 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1695/3301] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:54 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:54.480774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:54.492957 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4c4a55d-57d1-4185-a84a-103cf62be124 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1266 microversion: 2.1 time: 0.165471 Oct 19 07:02:54.494890 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1607/3302] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:54 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:54.626479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:54.629014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:54.639200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.640155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.640790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.664692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.665593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.666253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.753323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:54.757945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.760937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.761595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.762222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lazy-loading 'fault' on Instance uuid 0f3ea51c-9562-44a5-b313-a11890f07cf1 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:54.769666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:54.771126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:54.789492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.790092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.790552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.791199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:54.809298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:54.810250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:54.913213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:54.921693 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-25520952-6f02-4abb-aefa-d0d9d5103d78 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 200 len: 1309 microversion: 2.1 time: 0.301235 Oct 19 07:02:54.922297 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1696/3303] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:54 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 1309 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:54.989448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:55.000068 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1da137f2-dae0-490c-961e-bfe28fd310f3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1276 microversion: 2.1 time: 0.234805 Oct 19 07:02:55.001150 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1608/3304] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:54 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:55.120062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:55.121370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:55.139447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:55.142047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:55.145643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:55.146473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:55.147409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:55.148747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:55.151440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:55.486774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:55.492452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:55.511943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:02:55.523997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:55.526752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:55.527682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:55.528646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:55.529464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:55.530680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.005071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:56.015550 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d98d244-ceaa-444c-81cb-faa7caad35a7 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1472 microversion: 2.1 time: 0.899288 Oct 19 07:02:56.017239 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1697/3305] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:55 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1472 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:56.023541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:56.024668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:56.036930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:56.037823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:56.038505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.039594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:56.040394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:56.041086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.096503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:56.110805 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97ec07c4-4786-4277-8361-f7ba46919e95 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1312 microversion: 2.1 time: 0.643920 Oct 19 07:02:56.115126 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1609/3306] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:55 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1312 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:56.144964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:56.147563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 0f3ea51c-9562-44a5-b313-a11890f07cf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:56.150255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:56.163550 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f3f8f14-5620-4e2c-ae81-1043922a22d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1272 microversion: 2.1 time: 0.142026 Oct 19 07:02:56.164945 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1698/3307] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:56 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:56.176211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:56.182070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:56.184332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:56.185005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:56.185629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.187385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:56.188314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:56.188901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.190609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:56.191117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:56.191566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.192341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:56.203247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:56.203818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.208718 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] HTTP exception thrown: Instance 0f3ea51c-9562-44a5-b313-a11890f07cf1 could not be found. Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Request method failure captured: Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 HTTP/1.1 Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6AxJep7BOnVFHWS5MxsB-tji5pQWc3llPlG_eQg6utr_o8t5Kd1nuvvscxTdfejU1hcBEwwTdxsmOfUUNHbb3ldOyZkT6xMJGjtVJOqsxLleTPhG2Kj5iSpwWxD86pL7izc64fKnCHANy71dZXEvcJwwMW4nVJm6UxV4_WF7V2UqFM Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6f0b288d116428981f07801b48d1cc8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 6d399daf565e4ceabd2883ad43ef7f8b Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 0f3ea51c-9562-44a5-b313-a11890f07cf1 could not be found. Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '0f3ea51c-9562-44a5-b313-a11890f07cf1'} Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3ea51c-9562-44a5-b313-a11890f07cf1 could not be found. Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3ea51c-9562-44a5-b313-a11890f07cf1 could not be found. Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:56.216566 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3ea51c-9562-44a5-b313-a11890f07cf1 could not be found. Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Returning 404 to user: Instance 0f3ea51c-9562-44a5-b313-a11890f07cf1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-816d68c2-2169-4731-9eae-08affb8f6ec1 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1" status: 404 len: 111 microversion: 2.1 time: 0.096244 Oct 19 07:02:56.220993 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1610/3308] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:56 2022] GET /compute/v2.1/servers/0f3ea51c-9562-44a5-b313-a11890f07cf1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:56.227643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d3c74e80-5fd4-4047-9259-5bcbbc257fdc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:56.345233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:56.372410 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2edd7f47-b93e-476f-9b01-a3b173903526 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1274 microversion: 2.1 time: 0.194655 Oct 19 07:02:56.373450 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1699/3309] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:56 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:56.380121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-50cccc9e-0350-464c-b04a-aa8864aa716c req-0ab6102f-5687-4a2a-ab52-d27361e9a4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524a6e73-ef2b-4af5-884d-331924e8ad09", "name": "network-vif-deleted", "tag": "1249d2c6-bb1b-43b7-9034-10146ff5c868"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:56.387849 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d3c74e80-5fd4-4047-9259-5bcbbc257fdc tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/cbc3012e-aa9e-4a3a-ac7e-dac5cf061c7e" status: 204 len: 0 microversion: 2.1 time: 0.164074 Oct 19 07:02:56.398386 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1611/3310] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:02:56 2022] DELETE /compute/v2.1/os-server-groups/cbc3012e-aa9e-4a3a-ac7e-dac5cf061c7e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:56.415139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-50cccc9e-0350-464c-b04a-aa8864aa716c req-0ab6102f-5687-4a2a-ab52-d27361e9a4f8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:56.415944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-50cccc9e-0350-464c-b04a-aa8864aa716c req-0ab6102f-5687-4a2a-ab52-d27361e9a4f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:56.417062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:56.420125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:56.420279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-50cccc9e-0350-464c-b04a-aa8864aa716c req-0ab6102f-5687-4a2a-ab52-d27361e9a4f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.453763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:56.455454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:56.456432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.458205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:56.458999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:56.459733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:56.460177 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-50cccc9e-0350-464c-b04a-aa8864aa716c req-0ab6102f-5687-4a2a-ab52-d27361e9a4f8 service nova] Creating event network-vif-deleted:1249d2c6-bb1b-43b7-9034-10146ff5c868 for instance 524a6e73-ef2b-4af5-884d-331924e8ad09 on n-h1-861333-10 Oct 19 07:02:56.466483 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-50cccc9e-0350-464c-b04a-aa8864aa716c req-0ab6102f-5687-4a2a-ab52-d27361e9a4f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091508 Oct 19 07:02:56.467123 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1700/3311] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:56.519759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:57.009008 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b56752b-fd61-4753-9ad3-53d586a48127 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932" status: 204 len: 0 microversion: 2.1 time: 0.602427 Oct 19 07:02:57.012454 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1612/3312] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:56 2022] DELETE /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:02:57.024475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:57.025296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:57.043754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.048540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.048540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.048540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.048540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.048540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.049558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:57.049558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:57.073923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.083935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.085616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.087984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.088730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.089504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.111892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:02:57.188440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.189308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.190432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.191072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lazy-loading 'fault' on Instance uuid 524a6e73-ef2b-4af5-884d-331924e8ad09 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:02:57.438484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd1e25ce6cfb48159196d4466727a4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dda7801787e4ea3988a90f30451f3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:57.449894 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb3e43af-2bbc-4e30-8e9f-e26f0111924b tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 200 len: 1306 microversion: 2.1 time: 0.407900 Oct 19 07:02:57.457509 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1613/3313] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:57 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 1306 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:57.475281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:57.475861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:57.491894 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1242b8df-0b3c-423e-9845-4a2c3883b9e3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 204 len: 0 microversion: 2.1 time: 0.474246 Oct 19 07:02:57.492535 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1701/3314] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:02:57 2022] DELETE /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:02:57.498630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:57.499632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:57.505301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.505661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.506100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.518101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.519238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.519692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.521134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.529907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.529907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.529907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.529907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.529907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.840829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:57.855182 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c54c4fff-69b8-4593-98e5-8e63b8c4a86f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.360410 Oct 19 07:02:57.857128 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1702/3315] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:57 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:57.900585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:57.902026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:57.910691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.911541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.912319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.913327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:57.914165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:57.923291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:57.975126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:57.987829 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7609ffe-8354-4ee2-86b2-6d886054d30b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.528756 Oct 19 07:02:58.003699 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1614/3316] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:57 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:58.003699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:58.003699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:58.020387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:58.021008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:58.021525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:58.022494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:58.023072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:58.023627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:58.087280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:58.112428 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a443aa3-5041-40a9-af28-9277fe614641 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1274 microversion: 2.1 time: 0.216353 Oct 19 07:02:58.117318 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1703/3317] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:57 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1274 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:58.423636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:58.469597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-59f086ce-8952-49e5-bb9d-21bf9b17632f req-e4ccea4b-8756-442f-b251-edd083a46744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "745f6b1c-f983-46eb-9948-dc986b45ba87", "tag": "93c2eeb3-715c-4937-b03a-3ec37abca581"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:02:58.489625 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35fe53d0-dcfd-420e-bab6-4d16e99bc5c0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932" status: 200 len: 1473 microversion: 2.1 time: 0.487425 Oct 19 07:02:58.491540 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1615/3318] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:57 2022] GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932 => generated 1473 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:58.508089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59f086ce-8952-49e5-bb9d-21bf9b17632f req-e4ccea4b-8756-442f-b251-edd083a46744 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:58.508089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59f086ce-8952-49e5-bb9d-21bf9b17632f req-e4ccea4b-8756-442f-b251-edd083a46744 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:58.508089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59f086ce-8952-49e5-bb9d-21bf9b17632f req-e4ccea4b-8756-442f-b251-edd083a46744 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:58.514235 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-59f086ce-8952-49e5-bb9d-21bf9b17632f req-e4ccea4b-8756-442f-b251-edd083a46744 service nova] Creating event network-changed:93c2eeb3-715c-4937-b03a-3ec37abca581 for instance 745f6b1c-f983-46eb-9948-dc986b45ba87 on n-h1-861333-10 Oct 19 07:02:58.522778 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-59f086ce-8952-49e5-bb9d-21bf9b17632f req-e4ccea4b-8756-442f-b251-edd083a46744 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056715 Oct 19 07:02:58.527155 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1704/3319] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:02:58.529384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:58.533820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] [instance: 524a6e73-ef2b-4af5-884d-331924e8ad09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:58.552916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:58.555934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:58.556421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:58.559946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:58.561333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:58.561790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:58.597499 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] HTTP exception thrown: Instance 524a6e73-ef2b-4af5-884d-331924e8ad09 could not be found. Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Request method failure captured: Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 HTTP/1.1 Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6C0X03ify_t_iYiKZynP2s-M38935CJCdulCm8qvYymTU1TF_mo7gFL8LIFDWqJBJdQUumLj8R7cWVjxM12ynZ_N6cmromHXnlMdr6QeNInDHI5EAQvhmIh2_uu9nriV7_MyNnJoONl11cGrFpSrR7Y-5qrm5FiS7pFw_Wo0ZxePC0 Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 7dda7801787e4ea3988a90f30451f3fa Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerTestJSON-432133937 Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7dda7801787e4ea3988a90f30451f3fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7dda7801787e4ea3988a90f30451f3fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7dda7801787e4ea3988a90f30451f3fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7dda7801787e4ea3988a90f30451f3fa", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerTestJSON-432133937 Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 7dda7801787e4ea3988a90f30451f3fa Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-432133937 Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerTestJSON-432133937-project Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: cd1e25ce6cfb48159196d4466727a4d2 Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerTestJSON-432133937-project Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 524a6e73-ef2b-4af5-884d-331924e8ad09 could not be found. Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '524a6e73-ef2b-4af5-884d-331924e8ad09'} Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 524a6e73-ef2b-4af5-884d-331924e8ad09 could not be found. Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 524a6e73-ef2b-4af5-884d-331924e8ad09 could not be found. Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:02:58.600395 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:58.605838 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:02:58.605838 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:02:58.605838 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:02:58.605838 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:02:58.605838 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:02:58.605838 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 524a6e73-ef2b-4af5-884d-331924e8ad09 could not be found. Oct 19 07:02:58.605838 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:02:58.607172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] Returning 404 to user: Instance 524a6e73-ef2b-4af5-884d-331924e8ad09 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:02:58.608914 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d728cbf-f6d9-4fdb-985f-57df6e1af978 tempest-ImagesOneServerTestJSON-432133937 tempest-ImagesOneServerTestJSON-432133937-project] 10.222.0.39 "GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09" status: 404 len: 111 microversion: 2.1 time: 0.095491 Oct 19 07:02:58.615361 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1616/3320] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:58 2022] GET /compute/v2.1/servers/524a6e73-ef2b-4af5-884d-331924e8ad09 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:02:58.889917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:58.891396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:58.905427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:58.906454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:58.927616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:58.930227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:58.933803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:58.935150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:59.012775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:59.014134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:59.024672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:59.025414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:59.026037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:59.027436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:59.028062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:59.028805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:59.452492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:59.466252 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7eb0680c-182e-40d2-a3db-4097bd35ba38 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.583011 Oct 19 07:02:59.466252 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1705/3321] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:58 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:59.494655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:59.494655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:59.507353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:59.509851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:59.510431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:59.511253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:02:59.514674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:02:59.515214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:02:59.928166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:02:59.957262 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c3932ad-18dd-4c5e-abc4-2be6e5ffdfc4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.474372 Oct 19 07:02:59.979512 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1706/3322] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:59 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:02:59.985499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:02:59.987031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:02:59.998108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:00.000061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:00.000790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:00.002124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:00.002861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:00.003703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:00.024397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:00.043255 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5abcdda1-fbb4-4887-821c-766bc3ecf5a8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 1.032658 Oct 19 07:03:00.047780 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1617/3323] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:59 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:00.342236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:00.359361 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61861296-c68d-4d32-b798-e32a73367cf0 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932" status: 200 len: 1473 microversion: 2.1 time: 0.378182 Oct 19 07:03:00.379939 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1707/3324] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:02:59 2022] GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932 => generated 1473 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:00.492825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:00.493763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:00.523970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:00.530251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:00.530251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:00.530251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:00.530251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:00.530251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:00.803953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b38b2915-4d15-4806-8330-f6b57469d58b req-e4decfce-0278-4182-be66-6362a6f8fb25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "745f6b1c-f983-46eb-9948-dc986b45ba87", "tag": "88d566a1-4fe0-4e50-8b39-9e3786d9bbfc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:00.829369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b38b2915-4d15-4806-8330-f6b57469d58b req-e4decfce-0278-4182-be66-6362a6f8fb25 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:00.830239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b38b2915-4d15-4806-8330-f6b57469d58b req-e4decfce-0278-4182-be66-6362a6f8fb25 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:00.831119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b38b2915-4d15-4806-8330-f6b57469d58b req-e4decfce-0278-4182-be66-6362a6f8fb25 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:00.850773 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b38b2915-4d15-4806-8330-f6b57469d58b req-e4decfce-0278-4182-be66-6362a6f8fb25 service nova] Creating event network-changed:88d566a1-4fe0-4e50-8b39-9e3786d9bbfc for instance 745f6b1c-f983-46eb-9948-dc986b45ba87 on n-h1-861333-10 Oct 19 07:03:00.857747 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b38b2915-4d15-4806-8330-f6b57469d58b req-e4decfce-0278-4182-be66-6362a6f8fb25 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062911 Oct 19 07:03:00.859081 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1708/3325] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:00.986939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:00.987743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:01.000427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:01.000947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:01.001403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:01.005993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:01.007245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:01.010255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:01.092389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:01.118821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:01.265882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:01.278602 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3a89815-a13b-46cd-a2bf-280625dbc80a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.791355 Oct 19 07:03:01.279831 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1618/3326] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:00 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:01.285597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:01.291968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:01.299921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:01.308294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:01.310869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:01.311889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:01.314268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:01.314268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:01.924663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:01.935925 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2db72da4-6e37-4c53-beab-e00bcee93871 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.654683 Oct 19 07:03:01.940422 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1619/3327] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:01 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:01.947735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:01.948389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:01.956537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:01.957689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:01.958498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:01.959570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:01.960044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:01.960502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:01.964853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:01.973371 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1996c1e3-900f-47da-9ee6-494688406444 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.992460 Oct 19 07:03:01.988648 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1709/3328] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:00 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:02.104978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:02.166654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:02.178149 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a722d97f-fe44-41c9-81ce-88cfe4166c8e tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932" status: 200 len: 1431 microversion: 2.1 time: 0.236357 Oct 19 07:03:02.199366 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1620/3329] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:01 2022] GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932 => generated 1431 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:02.207452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-998c0b0d-9fe2-4944-b413-31b871a7174b req-31c7ce85-014e-4480-af62-87607cd45df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45331ac2-d336-45d0-9dc8-7aa7e655b089", "tag": "403707ee-a10d-4498-97d0-2d584dd43cf6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:02.261809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-998c0b0d-9fe2-4944-b413-31b871a7174b req-31c7ce85-014e-4480-af62-87607cd45df6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:02.262583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-998c0b0d-9fe2-4944-b413-31b871a7174b req-31c7ce85-014e-4480-af62-87607cd45df6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:02.263268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-998c0b0d-9fe2-4944-b413-31b871a7174b req-31c7ce85-014e-4480-af62-87607cd45df6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:02.272237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb1b9db2-1fca-4897-8b26-48a64a72050d tempest-ListImageFiltersNegativeTestJSON-1935885713 tempest-ListImageFiltersNegativeTestJSON-1935885713-project] Calling method '.version_select at 0x7f6d64916160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:02.286699 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-998c0b0d-9fe2-4944-b413-31b871a7174b req-31c7ce85-014e-4480-af62-87607cd45df6 service nova] Creating event network-changed:403707ee-a10d-4498-97d0-2d584dd43cf6 for instance 45331ac2-d336-45d0-9dc8-7aa7e655b089 on n-h2-861333-10 Oct 19 07:03:02.302989 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bb1b9db2-1fca-4897-8b26-48a64a72050d tempest-ListImageFiltersNegativeTestJSON-1935885713 tempest-ListImageFiltersNegativeTestJSON-1935885713-project] HTTP exception thrown: Image not found. Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb1b9db2-1fca-4897-8b26-48a64a72050d tempest-ListImageFiltersNegativeTestJSON-1935885713 tempest-ListImageFiltersNegativeTestJSON-1935885713-project] Request method failure captured: Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/images/bcd4856a-f5cb-4b5e-b6d6-c09e67d03bb1 HTTP/1.1 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6ElzTZALE5FI4kfF_KpxixG-xUzKTQQaGtbzWiiKzm5dAlmkkeiU9wYY3v01dGVbYmK_oDzxPXa-FoLzfAkgB_sI_sTDlI6BfF0ovQRMRdy94oz5XIejN9e5NpfylIMTyaW6cK3n3oO-gATbCeDCdSMqdVy0ADg3tn_95vaGgsp6XU Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 996d472eab794477ae0e1746dfe27e62 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1935885713 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/996d472eab794477ae0e1746dfe27e62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/996d472eab794477ae0e1746dfe27e62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/996d472eab794477ae0e1746dfe27e62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_996d472eab794477ae0e1746dfe27e62", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1935885713 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 996d472eab794477ae0e1746dfe27e62 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1935885713 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ListImageFiltersNegativeTestJSON-1935885713-project Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 8ded466d36ab4365af16e3cc96116dc4 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1935885713-project Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'bcd4856a-f5cb-4b5e-b6d6-c09e67d03bb1'} Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bcd4856a-f5cb-4b5e-b6d6-c09e67d03bb1 Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 07:03:02.305823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bcd4856a-f5cb-4b5e-b6d6-c09e67d03bb1 could not be found. Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:03:02.309797 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:02.316529 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-998c0b0d-9fe2-4944-b413-31b871a7174b req-31c7ce85-014e-4480-af62-87607cd45df6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106515 Oct 19 07:03:02.316529 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1621/3330] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:02.319399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:02.319540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb1b9db2-1fca-4897-8b26-48a64a72050d tempest-ListImageFiltersNegativeTestJSON-1935885713 tempest-ListImageFiltersNegativeTestJSON-1935885713-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:02.319640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:02.319734 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb1b9db2-1fca-4897-8b26-48a64a72050d tempest-ListImageFiltersNegativeTestJSON-1935885713 tempest-ListImageFiltersNegativeTestJSON-1935885713-project] 10.222.0.39 "GET /compute/v2.1/images/bcd4856a-f5cb-4b5e-b6d6-c09e67d03bb1" status: 404 len: 62 microversion: 2.1 time: 0.329093 Oct 19 07:03:02.319734 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1710/3331] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:03:01 2022] GET /compute/v2.1/images/bcd4856a-f5cb-4b5e-b6d6-c09e67d03bb1 => generated 62 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:03:02.345147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:02.350040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:02.350513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:02.351867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:02.352422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:02.352869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:02.963333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:02.964273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:02.965731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:02.981180 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0435a5c3-37b2-42f2-b762-bb39379c75fa tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.669733 Oct 19 07:03:02.997334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:02.997928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:03.000205 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1622/3332] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:02 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:03.005298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:03.008414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:03.010380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:03.011637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:03.016186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:03.021922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:03.040756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:03.041427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:03.042041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:03.055283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:03.056049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:03.056919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:03.654193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:03.664441 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ee331a8-d617-489f-8ac1-96cc7b695bc2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.661950 Oct 19 07:03:03.668086 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1623/3333] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:03 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:03.682089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:03.682726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:03.721240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:03.721756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:03.722210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:03.727356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:03.728213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:03.730215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:03.808146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:03.808711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:03.809173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:03.809646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lazy-loading 'fault' on Instance uuid d5cdaae7-d4cb-4347-a879-9b98c1747932 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:03:03.819833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:03.832811 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-893f8026-3360-41b6-a17e-811fcb9c96f1 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.874610 Oct 19 07:03:03.833478 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1711/3334] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:02 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:03.892747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:03.897646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:03.902492 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1068c5f3-2092-4d0b-8323-c93ffff0ab45 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932" status: 200 len: 1308 microversion: 2.1 time: 0.233261 Oct 19 07:03:03.903398 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1624/3335] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:03 2022] GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932 => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:04.012289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:04.013043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:04.020648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:04.021390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:04.022082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:04.022889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:04.023455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:04.024088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:04.257996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:04.266386 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58b93a76-685c-4e30-a8b3-dcb529242e39 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.257906 Oct 19 07:03:04.266895 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1712/3336] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:04 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:04.397300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-93b28401-ff98-4a80-92e9-76a18a4df1f2 req-72ed2830-2fa2-4e7b-94fc-dadc5b1a5228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cdaae7-d4cb-4347-a879-9b98c1747932", "name": "network-vif-deleted", "tag": "8a955975-1b4c-4908-abd4-81ab7291df58"}, {"server_uuid": "3643b581-f3e9-4281-9fc0-80424ba41658", "name": "network-vif-deleted", "tag": "72d920f7-ef25-4437-b1f6-2b3ca1c0fffb"}, {"name": "network-changed", "server_uuid": "5ee29286-42c5-4ccb-81b5-fa88405ad098", "tag": "9f4f26bc-df31-4e43-841b-ead84f8e6346"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:04.412751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93b28401-ff98-4a80-92e9-76a18a4df1f2 req-72ed2830-2fa2-4e7b-94fc-dadc5b1a5228 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:04.413590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93b28401-ff98-4a80-92e9-76a18a4df1f2 req-72ed2830-2fa2-4e7b-94fc-dadc5b1a5228 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:04.414031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93b28401-ff98-4a80-92e9-76a18a4df1f2 req-72ed2830-2fa2-4e7b-94fc-dadc5b1a5228 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:04.434650 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-93b28401-ff98-4a80-92e9-76a18a4df1f2 req-72ed2830-2fa2-4e7b-94fc-dadc5b1a5228 service nova] Creating event network-vif-deleted:8a955975-1b4c-4908-abd4-81ab7291df58 for instance d5cdaae7-d4cb-4347-a879-9b98c1747932 on n-h2-861333-10 Oct 19 07:03:04.434650 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-93b28401-ff98-4a80-92e9-76a18a4df1f2 req-72ed2830-2fa2-4e7b-94fc-dadc5b1a5228 service nova] Creating event network-vif-deleted:72d920f7-ef25-4437-b1f6-2b3ca1c0fffb for instance 3643b581-f3e9-4281-9fc0-80424ba41658 on n-h2-861333-10 Oct 19 07:03:04.434650 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-93b28401-ff98-4a80-92e9-76a18a4df1f2 req-72ed2830-2fa2-4e7b-94fc-dadc5b1a5228 service nova] Creating event network-changed:9f4f26bc-df31-4e43-841b-ead84f8e6346 for instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 on n-h1-861333-10 Oct 19 07:03:04.441226 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-93b28401-ff98-4a80-92e9-76a18a4df1f2 req-72ed2830-2fa2-4e7b-94fc-dadc5b1a5228 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.049739 Oct 19 07:03:04.441839 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1625/3337] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:04.691724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:04.692367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:04.699011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:04.699518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:04.699961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:04.700705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:04.701171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:04.701607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:04.722508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:04.856720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:04.857428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:04.865944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:04.866438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:04.867032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:04.867548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:04.868578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:04.869038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:04.870046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:04.873879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-544c85a8-cabc-4b4d-a648-0c87eecabad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.186182 Oct 19 07:03:04.874837 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1713/3338] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:04 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:04.942447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:04.943165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: d5cdaae7-d4cb-4347-a879-9b98c1747932] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:04.968366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:04.969421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:04.969879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:04.970664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:04.971256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:04.971598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:04.999960 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] HTTP exception thrown: Instance d5cdaae7-d4cb-4347-a879-9b98c1747932 could not be found. Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Request method failure captured: Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932 HTTP/1.1 Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AxJep7BOnVFHWS5MxsB-tji5pQWc3llPlG_eQg6utr_o8t5Kd1nuvvscxTdfejU1hcBEwwTdxsmOfUUNHbb3ldOyZkT6xMJGjtVJOqsxLleTPhG2Kj5iSpwWxD86pL7izc64fKnCHANy71dZXEvcJwwMW4nVJm6UxV4_WF7V2UqFM Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6f0b288d116428981f07801b48d1cc8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 6d399daf565e4ceabd2883ad43ef7f8b Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance d5cdaae7-d4cb-4347-a879-9b98c1747932 could not be found. Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'd5cdaae7-d4cb-4347-a879-9b98c1747932'} Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5cdaae7-d4cb-4347-a879-9b98c1747932 could not be found. Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5cdaae7-d4cb-4347-a879-9b98c1747932 could not be found. Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:05.001030 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:05.006117 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:05.006117 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:05.006117 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:05.006117 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:05.006117 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:05.006117 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5cdaae7-d4cb-4347-a879-9b98c1747932 could not be found. Oct 19 07:03:05.006117 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:05.010063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Returning 404 to user: Instance d5cdaae7-d4cb-4347-a879-9b98c1747932 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:05.011322 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00fb46fd-a8a5-498e-96d3-02555c2e4958 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932" status: 404 len: 111 microversion: 2.1 time: 0.081065 Oct 19 07:03:05.028391 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1714/3339] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:04 2022] GET /compute/v2.1/servers/d5cdaae7-d4cb-4347-a879-9b98c1747932 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:05.038471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:05.039102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:05.054243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:05.054989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:05.055672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:05.056591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:05.057321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:05.057922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:05.108358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:05.109086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:05.109848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:05.110478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lazy-loading 'fault' on Instance uuid 3643b581-f3e9-4281-9fc0-80424ba41658 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:03:05.309772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:05.324174 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-178bd103-94ca-43b6-914e-e26859906979 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 200 len: 1308 microversion: 2.1 time: 0.289998 Oct 19 07:03:05.325164 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1715/3340] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:05 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:05.337964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:05.339090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:05.363007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:05.363730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:05.364212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:05.364940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:05.365555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:05.365998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:05.396575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:05.409226 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b674bb96-097f-4768-ad73-c9435626371b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.556205 Oct 19 07:03:05.418839 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1626/3341] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:04 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:05.732575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:05.744879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-277594fc-beb6-456f-a390-096be5f8318f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.417363 Oct 19 07:03:05.745485 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1716/3342] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:05 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:05.900786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:05.902122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:05.913740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:05.914859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:05.915314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:05.916077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:05.916562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:05.916997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:06.153968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:06.162518 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22262864-2009-42b3-a45f-ef704c286753 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.267080 Oct 19 07:03:06.163108 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1627/3343] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:05 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:06.367475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:06.373197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 3643b581-f3e9-4281-9fc0-80424ba41658] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:06.382426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:06.383136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:06.383847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:06.384766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:06.385385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:06.385987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:06.403733 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] HTTP exception thrown: Instance 3643b581-f3e9-4281-9fc0-80424ba41658 could not be found. Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Request method failure captured: Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 HTTP/1.1 Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6AxJep7BOnVFHWS5MxsB-tji5pQWc3llPlG_eQg6utr_o8t5Kd1nuvvscxTdfejU1hcBEwwTdxsmOfUUNHbb3ldOyZkT6xMJGjtVJOqsxLleTPhG2Kj5iSpwWxD86pL7izc64fKnCHANy71dZXEvcJwwMW4nVJm6UxV4_WF7V2UqFM Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6f0b288d116428981f07801b48d1cc8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 6d399daf565e4ceabd2883ad43ef7f8b Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 3643b581-f3e9-4281-9fc0-80424ba41658 could not be found. Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '3643b581-f3e9-4281-9fc0-80424ba41658'} Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3643b581-f3e9-4281-9fc0-80424ba41658 could not be found. Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3643b581-f3e9-4281-9fc0-80424ba41658 could not be found. Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:06.411263 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:06.415977 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:06.415977 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:06.415977 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:06.415977 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:06.415977 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:06.415977 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3643b581-f3e9-4281-9fc0-80424ba41658 could not be found. Oct 19 07:03:06.415977 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:06.415977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Returning 404 to user: Instance 3643b581-f3e9-4281-9fc0-80424ba41658 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:06.415977 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a47622ff-298f-49a7-afda-0ed5d2e3c9dd tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658" status: 404 len: 111 microversion: 2.1 time: 0.043496 Oct 19 07:03:06.417840 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1628/3344] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:06 2022] GET /compute/v2.1/servers/3643b581-f3e9-4281-9fc0-80424ba41658 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:06.422733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df46930f-e7b8-432c-a051-8a26aa297fe3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:06.530779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-031ab20f-2463-48b1-a8a2-a10b7cf3a90a tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] Calling method '.version_select at 0x7f6d641f6670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:06.557631 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df46930f-e7b8-432c-a051-8a26aa297fe3 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/3f1302cc-65fa-4253-b491-ad55b0ce99a4" status: 204 len: 0 microversion: 2.1 time: 0.138640 Oct 19 07:03:06.558214 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1629/3345] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:03:06 2022] DELETE /compute/v2.1/os-server-groups/3f1302cc-65fa-4253-b491-ad55b0ce99a4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:03:06.562947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:06.565010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:06.571338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:06.571835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:06.572310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:06.573021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:06.573480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:06.573915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:06.605199 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-031ab20f-2463-48b1-a8a2-a10b7cf3a90a tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55/defaults" status: 200 len: 371 microversion: 2.1 time: 0.246138 Oct 19 07:03:06.605786 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1717/3346] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:03:06 2022] GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55/defaults => generated 371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:06.618332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:06.619105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:06.626425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:06.627478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:06.627927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:06.628845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:06.629485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:06.630339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:06.662482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:03:07.020157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:07.032483 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cff841a5-4988-43fa-a51a-ded4fb67118e tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.473143 Oct 19 07:03:07.048497 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1630/3347] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:06 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:07.048497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8006e289-5cdd-4cea-a81a-c947d7e35c3f tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] Calling method '.version_select at 0x7f6d648000d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:07.094789 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6621b9e-5108-4796-9806-11ae998cf113 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "DELETE /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 204 len: 0 microversion: 2.1 time: 0.473573 Oct 19 07:03:07.094789 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1718/3348] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:03:06 2022] DELETE /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:03:07.101166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:07.103926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:07.114478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:07.115362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:07.116202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:07.117211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:07.118897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:07.119605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:07.164791 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8006e289-5cdd-4cea-a81a-c947d7e35c3f tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55" status: 200 len: 371 microversion: 2.1 time: 0.128398 Oct 19 07:03:07.166102 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1631/3349] 10.222.0.39 () {58 vars in 1242 bytes} [Wed Oct 19 07:03:07 2022] GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55 => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:07.171895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:07.175216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:07.182271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:07.183093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:07.183715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:07.184622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:07.185232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:07.185816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:07.434173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:07.454249 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e6d9189-802e-48dc-942a-5ca18d961332 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1472 microversion: 2.1 time: 0.286811 Oct 19 07:03:07.455499 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1632/3350] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:07 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:07.460942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48596cde-e159-4930-8b79-bb7cf3d28e2e tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] Calling method '.version_select at 0x7f6d646d4ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:07.490225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:07.498268 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a3dda40-49d2-4cb9-ac59-12e5a0684bfe tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.402540 Oct 19 07:03:07.498864 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1719/3351] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:07 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:07.509905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:07.513670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:07.522278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:07.522790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:07.523238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:07.523954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:07.524456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:07.525069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:07.568156 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48596cde-e159-4930-8b79-bb7cf3d28e2e tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55/defaults" status: 200 len: 371 microversion: 2.1 time: 0.108534 Oct 19 07:03:07.568156 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1633/3352] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:03:07 2022] GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55/defaults => generated 371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:07.583491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-012c89d0-05e3-4240-bdb0-2e45a3171b3d tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] Calling method '.version_select at 0x7f6d645bc670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:07.661268 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-012c89d0-05e3-4240-bdb0-2e45a3171b3d tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55" status: 200 len: 371 microversion: 2.1 time: 0.084899 Oct 19 07:03:07.662299 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1634/3353] 10.222.0.39 () {58 vars in 1242 bytes} [Wed Oct 19 07:03:07 2022] GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55 => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:07.685363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e75af48-41e8-4567-af1c-a909511ab944 tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] Calling method '.version_select at 0x7f6d647b91f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:07.775265 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e75af48-41e8-4567-af1c-a909511ab944 tempest-QuotasTestJSON-956852169 tempest-QuotasTestJSON-956852169-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55?user_id=0198cb5c08b04231b3654615d3141570" status: 200 len: 371 microversion: 2.1 time: 0.093817 Oct 19 07:03:07.788679 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1635/3354] 10.222.0.39 () {58 vars in 1323 bytes} [Wed Oct 19 07:03:07 2022] GET /compute/v2.1/os-quota-sets/71e8394a4301491a8681159ab53a3b55?user_id=0198cb5c08b04231b3654615d3141570 => generated 371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:07.969606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:07.981786 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-048aea26-929d-4d45-9f09-5c1e10f321b1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.477244 Oct 19 07:03:07.996147 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1720/3355] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:07 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:08.060852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:08.072358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:08.072358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:08.072358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:08.072358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:08.073416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:08.074055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:08.074644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:08.487044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:08.488747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:08.509305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:08.519563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:08.527584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:08.531553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:08.531553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:08.531553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:08.810383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:08.819291 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0551729-3e9d-4f69-b512-ee58bd10bc48 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.762354 Oct 19 07:03:08.825333 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1636/3356] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:08 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:08.839135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:08.840756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:08.862761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:08.863181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:08.863634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:08.864422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:08.864894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:08.865325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:09.014068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:09.023192 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-661a8a7f-f4c9-4270-8c15-76c6f46da360 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1472 microversion: 2.1 time: 0.549073 Oct 19 07:03:09.037388 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1721/3357] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:08 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1472 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:09.047466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:09.048368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:09.056230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:09.056888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:09.058469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:09.060667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:09.061646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:09.063670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:09.308218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:09.320722 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f01b2db9-b80f-43b6-aef7-a676c38bdaf5 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.490660 Oct 19 07:03:09.321315 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1637/3358] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:08 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:09.483148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:09.508592 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4aa3c37b-21b8-40f7-9565-2d358e8e068f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.469373 Oct 19 07:03:09.520914 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1722/3359] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:09 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:09.677721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8eeb4f72-ee2e-4004-984a-d7464798e95d req-807aef8e-92c4-428d-a5c0-226e27b774d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05fec950-716c-4339-8de8-f7aa8c1e8b59", "name": "network-vif-deleted", "tag": "d7b77af1-f570-4be6-80a4-f59540977e4e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:09.691852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8eeb4f72-ee2e-4004-984a-d7464798e95d req-807aef8e-92c4-428d-a5c0-226e27b774d0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:09.692394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8eeb4f72-ee2e-4004-984a-d7464798e95d req-807aef8e-92c4-428d-a5c0-226e27b774d0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:09.693050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8eeb4f72-ee2e-4004-984a-d7464798e95d req-807aef8e-92c4-428d-a5c0-226e27b774d0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:09.734245 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8eeb4f72-ee2e-4004-984a-d7464798e95d req-807aef8e-92c4-428d-a5c0-226e27b774d0 service nova] Creating event network-vif-deleted:d7b77af1-f570-4be6-80a4-f59540977e4e for instance 05fec950-716c-4339-8de8-f7aa8c1e8b59 on n-h1-861333-10 Oct 19 07:03:09.739922 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8eeb4f72-ee2e-4004-984a-d7464798e95d req-807aef8e-92c4-428d-a5c0-226e27b774d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066540 Oct 19 07:03:09.740737 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1638/3360] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:09.842308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:09.842927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:09.862683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:09.862683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:09.862683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:09.862683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:09.862683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:09.862683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:10.213255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:10.225701 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4ae018a-dc9f-405f-8701-6c0153c0871b tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.387052 Oct 19 07:03:10.226865 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1723/3361] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:09 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:10.233147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:10.234156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:10.243671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:10.257422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:10.258236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:10.261907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:10.262443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:10.264407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:10.357714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:10.358223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:10.358675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:10.362404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lazy-loading 'fault' on Instance uuid 05fec950-716c-4339-8de8-f7aa8c1e8b59 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:03:10.428400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d399daf565e4ceabd2883ad43ef7f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f0b288d116428981f07801b48d1cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:10.438503 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63e1aac1-e045-40a7-a1d1-d6b2ebb6ce2c tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 200 len: 1306 microversion: 2.1 time: 0.210135 Oct 19 07:03:10.442035 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1724/3362] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:10 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 1306 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:10.452769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:10.454217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:10.463727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:10.464277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:10.467035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:10.468028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:10.468781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:10.469440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:10.572785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55135c82-7744-4545-b8ba-61cda06b6d2f tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d645d3e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1740716918", "description": "tempest-description-1314413264"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:10.730439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:10.747208 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46ee8098-63f8-446c-b60a-885f1adb65af tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.303545 Oct 19 07:03:10.753556 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1725/3363] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:10 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:10.778262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:10.779268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:10.793921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:10.794930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:10.796710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:10.797937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:10.799550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:10.800540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:11.109304 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55135c82-7744-4545-b8ba-61cda06b6d2f tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.102913 Oct 19 07:03:11.118746 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1639/3364] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:03:11.125605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b3f28a10-77f5-4784-b068-75f96d4c905f req-c2f4efeb-09bf-4865-8e10-061c8518fd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45331ac2-d336-45d0-9dc8-7aa7e655b089", "name": "network-vif-plugged", "status": "completed", "tag": "403707ee-a10d-4498-97d0-2d584dd43cf6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:11.146156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3f28a10-77f5-4784-b068-75f96d4c905f req-c2f4efeb-09bf-4865-8e10-061c8518fd9c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:11.146156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3f28a10-77f5-4784-b068-75f96d4c905f req-c2f4efeb-09bf-4865-8e10-061c8518fd9c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:11.146156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3f28a10-77f5-4784-b068-75f96d4c905f req-c2f4efeb-09bf-4865-8e10-061c8518fd9c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:11.157403 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b3f28a10-77f5-4784-b068-75f96d4c905f req-c2f4efeb-09bf-4865-8e10-061c8518fd9c service nova] Creating event network-vif-plugged:403707ee-a10d-4498-97d0-2d584dd43cf6 for instance 45331ac2-d336-45d0-9dc8-7aa7e655b089 on n-h2-861333-10 Oct 19 07:03:11.163782 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b3f28a10-77f5-4784-b068-75f96d4c905f req-c2f4efeb-09bf-4865-8e10-061c8518fd9c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043162 Oct 19 07:03:11.166178 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1640/3365] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:11.174162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76015143-36c4-4bb4-a6e2-7df0289bfab0 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d645d3e50>, body: {"security_group_rule": {"parent_group_id": "9f2ea34e-d87c-460c-98c6-4c651db9631d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:11.199705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:11.218461 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e749d8fc-9f67-4be7-aedd-7f2d78f0ce16 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.463533 Oct 19 07:03:11.224873 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1726/3366] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:10 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:11.254020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:11.254950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:11.272309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:11.273070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:11.274993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:11.275942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:11.278011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:11.278776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:11.558841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:11.572645 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4beb01c1-71df-4c18-a64b-91d7657ff521 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.324452 Oct 19 07:03:11.590646 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1727/3367] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:11 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:11.600011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:11.600747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] [instance: 05fec950-716c-4339-8de8-f7aa8c1e8b59] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:11.607314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:11.607820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:11.608348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:11.609574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:11.610397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:11.610848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:11.639572 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] HTTP exception thrown: Instance 05fec950-716c-4339-8de8-f7aa8c1e8b59 could not be found. Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Request method failure captured: Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 HTTP/1.1 Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6AxJep7BOnVFHWS5MxsB-tji5pQWc3llPlG_eQg6utr_o8t5Kd1nuvvscxTdfejU1hcBEwwTdxsmOfUUNHbb3ldOyZkT6xMJGjtVJOqsxLleTPhG2Kj5iSpwWxD86pL7izc64fKnCHANy71dZXEvcJwwMW4nVJm6UxV4_WF7V2UqFM Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6f0b288d116428981f07801b48d1cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6f0b288d116428981f07801b48d1cc8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a6f0b288d116428981f07801b48d1cc8 Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-305615538 Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 6d399daf565e4ceabd2883ad43ef7f8b Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersOnMultiNodesTest-305615538-project Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 05fec950-716c-4339-8de8-f7aa8c1e8b59 could not be found. Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '05fec950-716c-4339-8de8-f7aa8c1e8b59'} Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05fec950-716c-4339-8de8-f7aa8c1e8b59 could not be found. Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05fec950-716c-4339-8de8-f7aa8c1e8b59 could not be found. Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:11.643495 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05fec950-716c-4339-8de8-f7aa8c1e8b59 could not be found. Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] Returning 404 to user: Instance 05fec950-716c-4339-8de8-f7aa8c1e8b59 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3bd3080-ed23-4559-873d-3166cb5f4b33 tempest-ServersOnMultiNodesTest-305615538 tempest-ServersOnMultiNodesTest-305615538-project] 10.222.0.39 "GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59" status: 404 len: 111 microversion: 2.1 time: 0.054070 Oct 19 07:03:11.647872 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1728/3368] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:11 2022] GET /compute/v2.1/servers/05fec950-716c-4339-8de8-f7aa8c1e8b59 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:11.778045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:11.778045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:11.785489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:11.786285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:11.786955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:11.788048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:11.788779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:11.789700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:11.862361 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76015143-36c4-4bb4-a6e2-7df0289bfab0 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.693976 Oct 19 07:03:11.862912 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1641/3369] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:03:11 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:11.882795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c2facaa-d003-4cab-b5bb-2fa920ea9df6 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d645a0430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1958397480", "description": "tempest-description-855368990"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:12.206604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:12.214995 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3afe5d69-d839-49b9-b6d6-3c06e22cf1df tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1314 microversion: 2.1 time: 0.441456 Oct 19 07:03:12.236932 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1729/3370] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:11 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:12.247142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:12.247973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:12.286522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:12.287255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:12.287790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:12.288726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:12.289280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:12.289779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:12.321467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:12.445275 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c2facaa-d003-4cab-b5bb-2fa920ea9df6 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.569196 Oct 19 07:03:12.446439 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1642/3371] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:11 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:12.466032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-baf7849c-d08d-46c5-bcf4-43717a2c04e5 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d640258b0>, body: {"security_group_rule": {"parent_group_id": "81932174-2c64-4b81-8db5-9953cc86e0b1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:12.869573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:12.877996 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7aa007f-89f5-4617-8b49-97ec77d4c41b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.635019 Oct 19 07:03:12.886936 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1730/3372] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:12 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:12.892155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:12.893304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:12.913785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:12.914288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:12.914928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:12.916013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:12.917251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:12.917872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:13.139429 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-baf7849c-d08d-46c5-bcf4-43717a2c04e5 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.680674 Oct 19 07:03:13.144179 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1643/3373] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:03:12 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:13.159527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-094892f7-bdf6-4be1-b06e-b8aec2ca822b tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d645d33a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1028601274", "description": "tempest-description-1510756704"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:13.801729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:13.812406 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-642dc2f7-5d12-44ba-be81-cb1a1d82a576 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.924080 Oct 19 07:03:13.813310 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1731/3374] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:12 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:13.837157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8e0112bd-ea1b-4b54-b20f-4c93978ef054 req-ab9f0ba9-54ea-4ca1-a153-2916e843a27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745f6b1c-f983-46eb-9948-dc986b45ba87", "name": "network-vif-plugged", "status": "completed", "tag": "88d566a1-4fe0-4e50-8b39-9e3786d9bbfc"}, {"server_uuid": "745f6b1c-f983-46eb-9948-dc986b45ba87", "name": "network-vif-plugged", "status": "completed", "tag": "93c2eeb3-715c-4937-b03a-3ec37abca581"}, {"server_uuid": "5ee29286-42c5-4ccb-81b5-fa88405ad098", "name": "network-vif-plugged", "status": "completed", "tag": "9f4f26bc-df31-4e43-841b-ead84f8e6346"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:13.852966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8e0112bd-ea1b-4b54-b20f-4c93978ef054 req-ab9f0ba9-54ea-4ca1-a153-2916e843a27c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:13.853475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8e0112bd-ea1b-4b54-b20f-4c93978ef054 req-ab9f0ba9-54ea-4ca1-a153-2916e843a27c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:13.853920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8e0112bd-ea1b-4b54-b20f-4c93978ef054 req-ab9f0ba9-54ea-4ca1-a153-2916e843a27c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:13.870101 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8e0112bd-ea1b-4b54-b20f-4c93978ef054 req-ab9f0ba9-54ea-4ca1-a153-2916e843a27c service nova] Creating event network-vif-plugged:88d566a1-4fe0-4e50-8b39-9e3786d9bbfc for instance 745f6b1c-f983-46eb-9948-dc986b45ba87 on n-h1-861333-10 Oct 19 07:03:13.870684 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8e0112bd-ea1b-4b54-b20f-4c93978ef054 req-ab9f0ba9-54ea-4ca1-a153-2916e843a27c service nova] Creating event network-vif-plugged:93c2eeb3-715c-4937-b03a-3ec37abca581 for instance 745f6b1c-f983-46eb-9948-dc986b45ba87 on n-h1-861333-10 Oct 19 07:03:13.871198 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8e0112bd-ea1b-4b54-b20f-4c93978ef054 req-ab9f0ba9-54ea-4ca1-a153-2916e843a27c service nova] Creating event network-vif-plugged:9f4f26bc-df31-4e43-841b-ead84f8e6346 for instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 on n-h1-861333-10 Oct 19 07:03:13.884262 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-094892f7-bdf6-4be1-b06e-b8aec2ca822b tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.729763 Oct 19 07:03:13.884262 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1644/3375] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:13.884262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:13.884262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:13.893991 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8e0112bd-ea1b-4b54-b20f-4c93978ef054 req-ab9f0ba9-54ea-4ca1-a153-2916e843a27c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.061408 Oct 19 07:03:13.896364 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1732/3376] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:13.899427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:13.900216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:13.900407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:13.901187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:13.901658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:13.902085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:13.910791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b2619be-56e0-4d81-8b99-7f974478fa41 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d68ba0b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1616436391", "description": "tempest-description-1680291620"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:14.292485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:14.302784 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-806b1dfd-a05d-4099-975b-72c7876c84cf tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1500 microversion: 2.1 time: 0.425484 Oct 19 07:03:14.303549 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1645/3377] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:13 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1500 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:14.308239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:14.313834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:14.327547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:14.329225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:14.330231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:14.331210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:14.331897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:14.332635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:14.677480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:14.687775 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0580fb6f-3790-4d92-a2dc-e6a0d3786f47 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.382994 Oct 19 07:03:14.696720 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1646/3378] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:14 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:14.702688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:14.705230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:14.712456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:14.713012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:14.713468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:14.714266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:14.714734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:14.715207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:14.751842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lazy-loading 'flavor' on Instance uuid 45331ac2-d336-45d0-9dc8-7aa7e655b089 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:03:14.759367 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b2619be-56e0-4d81-8b99-7f974478fa41 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.861734 Oct 19 07:03:14.760393 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1733/3379] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:14.779529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84290196-dd81-45b2-b847-fb13c12daaf0 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d68a94e50>, body: {"security_group_rule": {"parent_group_id": "4b8510f9-d1bf-464f-b584-23d7917f9c0a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8a24fa16-c508-4836-b68b-c1f777e62847"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:15.131522 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1e68a92-c21e-48b6-8d73-0d9908ea2287 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "POST /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089/action" status: 200 len: 32 microversion: 2.1 time: 0.430417 Oct 19 07:03:15.132978 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1647/3380] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:03:14 2022] POST /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089/action => generated 32 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:15.161125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:15.164799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:15.184559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:15.184559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:15.184559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:15.184559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:15.184559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:15.184559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:15.617375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:15.625929 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5bd773f-0151-4e16-bc0e-ee8144a63153 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1333 microversion: 2.1 time: 0.489846 Oct 19 07:03:15.633018 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1648/3381] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:15 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1333 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:15.633363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:15.634171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:15.640767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:15.643591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:15.644826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:15.645281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:15.646012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:15.646481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:15.646916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:15.695411 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84290196-dd81-45b2-b847-fb13c12daaf0 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.921886 Oct 19 07:03:15.697321 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1734/3382] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:03:14 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:15.718950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:15.719718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:15.744000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:15.745337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:15.746766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:15.747832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:15.748346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:15.748797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:16.039582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:16.066611 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-194c44eb-c162-4e83-9227-ecb969c71b48 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1316 microversion: 2.1 time: 0.355867 Oct 19 07:03:16.074768 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1735/3383] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:15 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:16.088758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8fe667d5-0361-419d-af33-4e17688c388b tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d68a59d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1330511730", "description": "tempest-description-2055870626"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:16.124894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:16.136274 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc908d19-a44d-4e30-9634-399c2c7d752c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.507690 Oct 19 07:03:16.148857 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1649/3384] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:15 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:16.590123 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8fe667d5-0361-419d-af33-4e17688c388b tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.518575 Oct 19 07:03:16.592431 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1736/3385] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:16 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:16.606633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a844bc5b-a95a-49f5-b7cf-d967cc794d7d tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d645a0430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-886447848", "description": "tempest-description-498167016"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:16.649801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:16.651136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:16.659064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:16.659823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:16.660473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:16.661361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:16.661983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:16.662428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:16.881687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:16.894529 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cddf2026-54d3-4ccb-9c43-a3a955ec9bf9 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1669 microversion: 2.1 time: 0.248762 Oct 19 07:03:16.913855 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1737/3386] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:16 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1669 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:16.921116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1508506-c644-40bd-98ee-628dcbbc84ea tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:16.921717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1508506-c644-40bd-98ee-628dcbbc84ea tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:16.944450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1508506-c644-40bd-98ee-628dcbbc84ea tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:16.959220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1508506-c644-40bd-98ee-628dcbbc84ea tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:16.959220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1508506-c644-40bd-98ee-628dcbbc84ea tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:16.963486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1508506-c644-40bd-98ee-628dcbbc84ea tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:16.965419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1508506-c644-40bd-98ee-628dcbbc84ea tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:16.966114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1508506-c644-40bd-98ee-628dcbbc84ea tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.016682 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1508506-c644-40bd-98ee-628dcbbc84ea tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87/ips" status: 200 len: 180 microversion: 2.1 time: 0.101348 Oct 19 07:03:17.018261 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1738/3387] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:03:16 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87/ips => generated 180 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:03:17.032690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:17.033379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:17.041078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.043685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.043685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.043685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.043685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.043685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.202514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:17.216930 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4694cdc-2fe3-4171-ba58-5e4235baa84e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.197203 Oct 19 07:03:17.218118 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1739/3388] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:17 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:17.223473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:17.224550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:17.232128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.232859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.234131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.235793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.236656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.237549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.278265 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a844bc5b-a95a-49f5-b7cf-d967cc794d7d tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.676315 Oct 19 07:03:17.279913 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1650/3389] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:17.280227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:03:17.284964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:17.285766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:17.300421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.302820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.308537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.310341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.312509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.313657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.625724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:17.635694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:17.650659 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64b2c738-869f-4aa3-8c71-1246a740b462 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1504 microversion: 2.1 time: 0.369430 Oct 19 07:03:17.664897 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1651/3390] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:17 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:17.683221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:17.683837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:17.690723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.691226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.691672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.692446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.692920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.693363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.735018 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ab981d5-d79f-4745-a8e3-ab48c0f65cb0 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "DELETE /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 204 len: 0 microversion: 2.1 time: 0.510675 Oct 19 07:03:17.741860 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1740/3391] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:03:17 2022] DELETE /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:03:17.751023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:17.751750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:17.766942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:17.793726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.795030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.797283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.801939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:17.802500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:17.802953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:17.964740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:17.975983 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe0f89d7-175b-4d9c-a31e-9628084d37d7 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.309855 Oct 19 07:03:17.985607 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1652/3392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:17 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:17.992625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a17df5c-a860-4b49-882f-794763f28c57 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d645d33a0>, body: {"security_group_rule": {"parent_group_id": "f3b87867-ba2d-4390-a609-f5c7906866c7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b091fd4f-69c2-4425-81cc-5fd8769ee310"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:18.194546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:18.204620 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-651ec408-30b2-4d6a-8de2-02d38e72ba5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.457601 Oct 19 07:03:18.210165 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1741/3393] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:17 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:18.227449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:18.233576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:18.244495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:18.245252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:18.245860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:18.246744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:18.247372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:18.247983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:18.545753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:18.555136 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b47575f-5af9-4343-9e25-2eb329d8ecec tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1675 microversion: 2.1 time: 0.345946 Oct 19 07:03:18.563645 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1742/3394] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:18 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1675 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:18.572471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1495145409"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:18.573225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:18.579430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:18.580612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:18.589427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:18.589427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:18.589427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:18.589427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:18.787173 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.network.security_group_api [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Adding security group 338fe563-9bc0-41ab-86ba-a177ca90a447 to port 9f4f26bc-df31-4e43-841b-ead84f8e6346 Oct 19 07:03:18.887693 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a17df5c-a860-4b49-882f-794763f28c57 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.905102 Oct 19 07:03:18.889119 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1653/3395] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:03:17 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:18.894286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:18.897492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:18.904276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:18.905056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:18.905717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:18.906477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:18.907278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:18.907762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:18.913045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:19.055120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:19.063052 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48a418bb-b60e-4b13-b863-4fef0e181d76 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.172692 Oct 19 07:03:19.063780 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1654/3396] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:18 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:19.365449 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a62a6cc-5385-4540-ba9a-19c27fc8bf93 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098/action" status: 202 len: 0 microversion: 2.1 time: 0.802057 Oct 19 07:03:19.366211 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1743/3397] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:03:18 2022] POST /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098/action => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:19.371080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c5adcd9-9191-4556-9a96-ba66eb58fb4e tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d68bae430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:19.428209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1886310753", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "42aff9d2-68d2-4568-ab15-e40ff916a47b"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:19.534222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] validate_networks() for [('42aff9d2-68d2-4568-ab15-e40ff916a47b', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:03:19.995195 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c5adcd9-9191-4556-9a96-ba66eb58fb4e tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/b091fd4f-69c2-4425-81cc-5fd8769ee310" status: 202 len: 0 microversion: 2.1 time: 0.627559 Oct 19 07:03:19.997213 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1744/3398] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:19 2022] DELETE /compute/v2.1/os-security-groups/b091fd4f-69c2-4425-81cc-5fd8769ee310 => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:20.008772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:20.013074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:20.035623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:20.037910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:20.040846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:20.042302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:20.045833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:20.046876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:20.226665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:03:20.227154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:03:20.229257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:03:20.229690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:03:20.230134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:03:20.255854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:20.257138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:20.264343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:20.267253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:20.268732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:20.269191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:20.324812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Getting quotas for project 8582aa8284734a249ce3cc6d6a765be2. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:20.338284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Getting quotas for user bc6883b78d9d4260a6e90dfcbb3dca4e and project 8582aa8284734a249ce3cc6d6a765be2. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:20.363123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:03:20.366115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:03:20.553708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:20.564930 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c667a397-c725-4204-ba74-1492e885a3d0 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.565671 Oct 19 07:03:20.565457 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1745/3399] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:19 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:20.573954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e373170c-041c-4855-93ff-83b448c6f248 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1963992929"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:20.587288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e373170c-041c-4855-93ff-83b448c6f248 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:20.605562 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23e26dfe-1c51-4d7f-9863-c5d81f59c312 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.536931 Oct 19 07:03:20.607455 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1655/3400] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:03:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:03:20.620475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e373170c-041c-4855-93ff-83b448c6f248 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:20.622674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e373170c-041c-4855-93ff-83b448c6f248 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:20.623152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e373170c-041c-4855-93ff-83b448c6f248 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:20.623901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e373170c-041c-4855-93ff-83b448c6f248 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:20.624249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1269006230"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:20.628697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e373170c-041c-4855-93ff-83b448c6f248 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:20.628697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e373170c-041c-4855-93ff-83b448c6f248 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:20.629805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:20.674158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:20.676897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:20.678648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:20.681662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:20.682483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:20.683278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:21.032909 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.network.security_group_api [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Adding security group c80082a6-a10f-49bd-b622-8b9b37e65041 to port 9f4f26bc-df31-4e43-841b-ead84f8e6346 Oct 19 07:03:21.371406 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e373170c-041c-4855-93ff-83b448c6f248 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.801751 Oct 19 07:03:21.372774 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1746/3401] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:03:20 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 19 07:03:21.401790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9c0a5066-2940-4291-8f14-6ba10168f6f7 req-6608de58-6f87-43f7-83eb-31c675d10e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee29286-42c5-4ccb-81b5-fa88405ad098", "tag": "9f4f26bc-df31-4e43-841b-ead84f8e6346"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:21.430434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9c0a5066-2940-4291-8f14-6ba10168f6f7 req-6608de58-6f87-43f7-83eb-31c675d10e71 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:21.432816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9c0a5066-2940-4291-8f14-6ba10168f6f7 req-6608de58-6f87-43f7-83eb-31c675d10e71 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:21.432816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9c0a5066-2940-4291-8f14-6ba10168f6f7 req-6608de58-6f87-43f7-83eb-31c675d10e71 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:21.456611 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9c0a5066-2940-4291-8f14-6ba10168f6f7 req-6608de58-6f87-43f7-83eb-31c675d10e71 service nova] Creating event network-changed:9f4f26bc-df31-4e43-841b-ead84f8e6346 for instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 on n-h1-861333-10 Oct 19 07:03:21.465372 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9c0a5066-2940-4291-8f14-6ba10168f6f7 req-6608de58-6f87-43f7-83eb-31c675d10e71 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089019 Oct 19 07:03:21.469435 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1747/3402] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:21.482871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:21.484606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:21.513724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:21.514225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:21.514671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:21.515389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:21.515845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:21.519196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:21.643230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:21.687563 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7c8bb83-affe-4a35-8217-7c7a674d563f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1612 microversion: 2.1 time: 0.214551 Oct 19 07:03:21.691067 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1748/3403] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:21 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1612 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:21.702549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8784cc64-e0f1-46e7-9628-d2777a641224 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d68b8ca60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:21.831854 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8784cc64-e0f1-46e7-9628-d2777a641224 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/f3b87867-ba2d-4390-a609-f5c7906866c7" status: 200 len: 248 microversion: 2.1 time: 0.139443 Oct 19 07:03:21.832582 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1749/3404] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:03:21 2022] GET /compute/v2.1/os-security-groups/f3b87867-ba2d-4390-a609-f5c7906866c7 => generated 248 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:21.847538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-73849098-85a8-4caa-8e82-12301572a5fc req-8f68b886-b256-4680-83c4-356c0d75183e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745f6b1c-f983-46eb-9948-dc986b45ba87", "name": "network-vif-deleted", "tag": "88d566a1-4fe0-4e50-8b39-9e3786d9bbfc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:21.883648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-73849098-85a8-4caa-8e82-12301572a5fc req-8f68b886-b256-4680-83c4-356c0d75183e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:21.884149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-73849098-85a8-4caa-8e82-12301572a5fc req-8f68b886-b256-4680-83c4-356c0d75183e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:21.891072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-73849098-85a8-4caa-8e82-12301572a5fc req-8f68b886-b256-4680-83c4-356c0d75183e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:21.930064 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-73849098-85a8-4caa-8e82-12301572a5fc req-8f68b886-b256-4680-83c4-356c0d75183e service nova] Creating event network-vif-deleted:88d566a1-4fe0-4e50-8b39-9e3786d9bbfc for instance 745f6b1c-f983-46eb-9948-dc986b45ba87 on n-h1-861333-10 Oct 19 07:03:21.947724 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-73849098-85a8-4caa-8e82-12301572a5fc req-8f68b886-b256-4680-83c4-356c0d75183e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101093 Oct 19 07:03:21.947724 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1750/3405] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:21.959212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cae489d4-85a7-4c98-9289-f0ccc13a7b87 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:21.961503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cae489d4-85a7-4c98-9289-f0ccc13a7b87 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:22.117786 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-272d0c9b-96d5-4080-8718-9b2935efa99f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098/action" status: 202 len: 0 microversion: 2.1 time: 1.496832 Oct 19 07:03:22.117786 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1656/3406] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:03:20 2022] POST /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098/action => generated 0 bytes in 1500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:22.119411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:22.120232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:22.140745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:22.141436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:22.146340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:22.146340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:22.146340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:22.146340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:22.181829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cae489d4-85a7-4c98-9289-f0ccc13a7b87 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:22.189103 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cae489d4-85a7-4c98-9289-f0ccc13a7b87 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1216 microversion: 2.1 time: 0.242249 Oct 19 07:03:22.190251 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1751/3407] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:21 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1216 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:22.209555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8920f9cf-ea4e-4e6f-8501-2d3f7b3352f8 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d68adc5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1473346554", "description": "tempest-description-1900581126"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:22.688871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:22.698782 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be74e96f-b3ac-4691-9993-46bf40dfa210 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.585374 Oct 19 07:03:22.699372 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1657/3408] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:22 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:22.709716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7eae8d2b-617b-427a-adff-6042abce34d3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:22.714429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7eae8d2b-617b-427a-adff-6042abce34d3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:22.737726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eae8d2b-617b-427a-adff-6042abce34d3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:22.738233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eae8d2b-617b-427a-adff-6042abce34d3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:22.743489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eae8d2b-617b-427a-adff-6042abce34d3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:22.745390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eae8d2b-617b-427a-adff-6042abce34d3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:22.748723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eae8d2b-617b-427a-adff-6042abce34d3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:22.748723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eae8d2b-617b-427a-adff-6042abce34d3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:23.136290 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8920f9cf-ea4e-4e6f-8501-2d3f7b3352f8 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.932230 Oct 19 07:03:23.157998 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1752/3409] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:22 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:23.165428 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7eae8d2b-617b-427a-adff-6042abce34d3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.464897 Oct 19 07:03:23.166763 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1658/3410] 10.222.0.39 () {58 vars in 1293 bytes} [Wed Oct 19 07:03:22 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098/os-security-groups => generated 1159 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:23.174672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7aae06e-ba00-4161-bd39-07dc6930fe35 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d68bb4af0>, body: {"security_group_rule": {"parent_group_id": "ed9b1233-b323-4321-99c8-e2e8ebb03fbf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:23.187757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:23.189998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:23.218517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:23.226728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:23.226728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:23.226728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:23.238227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:23.240374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:23.313280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:23.339830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:23.340717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:23.341451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:23.342161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lazy-loading 'fault' on Instance uuid 745f6b1c-f983-46eb-9948-dc986b45ba87 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:03:23.493988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41810b44169748bd97b407696a681dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64d433fbb74f5b89ab02e4572ddc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:23.519256 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05cd3d7c-dc34-4379-93e8-29afef273391 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 200 len: 1459 microversion: 2.1 time: 0.354940 Oct 19 07:03:23.519942 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1753/3411] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:23 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 1459 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:23.537582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4fa84d8b-998d-4a71-9736-7c936aa89763 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: .version_select at 0x7f6d64db35e0>, body: {"security_group": {"name": " tempest-securitygroup -1077657076 ", "description": "tempest-description-2102708411"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:23.982241 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c7aae06e-ba00-4161-bd39-07dc6930fe35 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.814095 Oct 19 07:03:23.982842 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1659/3412] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:03:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:23.988149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:23.988846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:24.008525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:24.008525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:24.008525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:24.009193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:24.009650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:24.010085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:24.119431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:24.132403 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-566b09b3-1ee7-4856-b8b0-cbb0adc01175 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1268 microversion: 2.1 time: 0.148083 Oct 19 07:03:24.134304 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1660/3413] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:23 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:24.148070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:24.149218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:24.163074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:24.163789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:24.164444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:24.165369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:24.166008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:24.167113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:24.372606 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4fa84d8b-998d-4a71-9736-7c936aa89763 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.851405 Oct 19 07:03:24.381960 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1754/3414] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:23 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:24.381960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b3b70337-1840-4b73-8c0b-e8fe49be2ba1 req-2629b110-50e1-4396-b5a1-66a33280fc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745f6b1c-f983-46eb-9948-dc986b45ba87", "name": "network-vif-deleted", "tag": "93c2eeb3-715c-4937-b03a-3ec37abca581"}, {"name": "network-changed", "server_uuid": "5ee29286-42c5-4ccb-81b5-fa88405ad098", "tag": "9f4f26bc-df31-4e43-841b-ead84f8e6346"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:24.407737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b3b70337-1840-4b73-8c0b-e8fe49be2ba1 req-2629b110-50e1-4396-b5a1-66a33280fc0e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:24.408855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b3b70337-1840-4b73-8c0b-e8fe49be2ba1 req-2629b110-50e1-4396-b5a1-66a33280fc0e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:24.409261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b3b70337-1840-4b73-8c0b-e8fe49be2ba1 req-2629b110-50e1-4396-b5a1-66a33280fc0e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:24.442874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b3b70337-1840-4b73-8c0b-e8fe49be2ba1 req-2629b110-50e1-4396-b5a1-66a33280fc0e service nova] Creating event network-vif-deleted:93c2eeb3-715c-4937-b03a-3ec37abca581 for instance 745f6b1c-f983-46eb-9948-dc986b45ba87 on n-h1-861333-10 Oct 19 07:03:24.443423 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b3b70337-1840-4b73-8c0b-e8fe49be2ba1 req-2629b110-50e1-4396-b5a1-66a33280fc0e service nova] Creating event network-changed:9f4f26bc-df31-4e43-841b-ead84f8e6346 for instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 on n-h1-861333-10 Oct 19 07:03:24.456504 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b3b70337-1840-4b73-8c0b-e8fe49be2ba1 req-2629b110-50e1-4396-b5a1-66a33280fc0e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081587 Oct 19 07:03:24.461610 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1755/3415] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:24.463378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1e60a27-5a5c-4cfc-a2cb-4e5c32a23d2b tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Action: 'create', calling method: .version_select at 0x7f6d68be1040>, body: {"security_group_rule": {"parent_group_id": "ed9b1233-b323-4321-99c8-e2e8ebb03fbf", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:24.645734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:24.658520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03190905-f8d8-44f8-8703-7f7ee52c3585 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.522867 Oct 19 07:03:24.663603 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1661/3416] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:24 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:24.674469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60ad3114-e7f5-4fb8-875d-fcc3cdd73ad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa16a60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:24.887746 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60ad3114-e7f5-4fb8-875d-fcc3cdd73ad8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7" status: 200 len: 224 microversion: 2.1 time: 0.222202 Oct 19 07:03:24.888990 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1662/3417] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:03:24 2022] GET /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 => generated 224 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:24.895464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:24.897002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:24.925120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:24.926573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:24.928142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:24.929095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:24.931018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:24.932622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:24.990998 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] HTTP exception thrown: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Request method failure captured: Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 HTTP/1.1 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6CxpbzAHxQOKvQTsILB4qFNu4l2IRiGnmtaI6tz74B_ARxhYa4crz4w0-8Vln3USBV83YQjr1HB1FKq58iJLlQ2sinh3rOGu4g9_ZW8NoS5OHhdlHyftEU2OAXiKeZNeDGc6wP7_1ODDOpLiTs9E0-9e6ywXhfZ3IXrclqe-9CSHKc Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b64d433fbb74f5b89ab02e4572ddc45", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 41810b44169748bd97b407696a681dc7 Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '745f6b1c-f983-46eb-9948-dc986b45ba87'} Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:24.997332 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:25.005212 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:25.005212 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:25.005212 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:25.005212 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:25.005212 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:25.005212 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:25.005212 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:25.005212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Returning 404 to user: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:25.005212 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a440d88c-b74d-4c58-b121-318dac4b7453 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 404 len: 111 microversion: 2.1 time: 0.108443 Oct 19 07:03:25.007970 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1663/3418] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:24 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:25.019562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-011c6b1d-1c9e-4ba2-84df-4a81e3447731 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa16160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:25.356434 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1e60a27-5a5c-4cfc-a2cb-4e5c32a23d2b tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.897420 Oct 19 07:03:25.370166 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1756/3419] 10.222.0.39 () {60 vars in 1195 bytes} [Wed Oct 19 07:03:24 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:25.375599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:25.376529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:25.383457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:25.384236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:25.385153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:25.386857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:25.387831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:25.388625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:25.541975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:25.566886 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51bd6a11-52f9-4119-b4d6-053f98206671 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1274 microversion: 2.1 time: 0.192656 Oct 19 07:03:25.581719 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1757/3420] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:25 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:25.603133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cedf70cf-d1bc-46c6-99fd-916a5dd70ab2 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d68a46ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:26.111654 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cedf70cf-d1bc-46c6-99fd-916a5dd70ab2 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/ed9b1233-b323-4321-99c8-e2e8ebb03fbf" status: 200 len: 665 microversion: 2.1 time: 0.528434 Oct 19 07:03:26.112645 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1758/3421] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:03:25 2022] GET /compute/v2.1/os-security-groups/ed9b1233-b323-4321-99c8-e2e8ebb03fbf => generated 665 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:26.125448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:26.126382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:26.144267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:26.145063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:26.145694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:26.146425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:26.146892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:26.147328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:26.473726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:26.483142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e1e7bed-b780-401a-9467-2256b29f3e5c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.369120 Oct 19 07:03:26.496736 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1759/3422] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:26 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:26.507876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d658b2a6-b156-4d5c-9e1f-8e5701932aa9 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d68be1040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:26.557813 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-011c6b1d-1c9e-4ba2-84df-4a81e3447731 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7" status: 202 len: 0 microversion: 2.1 time: 1.547250 Oct 19 07:03:26.559041 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1664/3423] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:25 2022] DELETE /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 => generated 0 bytes in 1549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:26.581767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e3d43aa0-9e9e-4c7a-8432-73285ce7c779 req-86b16050-b327-44a3-8306-ad0066feefc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "name": "network-vif-plugged", "status": "completed", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:26.642132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e3d43aa0-9e9e-4c7a-8432-73285ce7c779 req-86b16050-b327-44a3-8306-ad0066feefc3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:26.647338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e3d43aa0-9e9e-4c7a-8432-73285ce7c779 req-86b16050-b327-44a3-8306-ad0066feefc3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:26.648645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e3d43aa0-9e9e-4c7a-8432-73285ce7c779 req-86b16050-b327-44a3-8306-ad0066feefc3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:26.699228 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e3d43aa0-9e9e-4c7a-8432-73285ce7c779 req-86b16050-b327-44a3-8306-ad0066feefc3 service nova] Creating event network-vif-plugged:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:03:26.711655 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e3d43aa0-9e9e-4c7a-8432-73285ce7c779 req-86b16050-b327-44a3-8306-ad0066feefc3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151845 Oct 19 07:03:26.715079 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1665/3424] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:26.744536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4aaccc33-6d7e-4e51-a28d-f3a253094e6e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa16160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:26.808608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-4aaccc33-6d7e-4e51-a28d-f3a253094e6e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:03:26.809211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-4aaccc33-6d7e-4e51-a28d-f3a253094e6e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:03:26.809740 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4aaccc33-6d7e-4e51-a28d-f3a253094e6e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:03:26.809740 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-7264988c-5958-4d48-99d8-6e0c28275c87'] Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4aaccc33-6d7e-4e51-a28d-f3a253094e6e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 HTTP/1.1 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-7264988c-5958-4d48-99d8-6e0c28275c87'] Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7'} Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:03:26.813146 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7264988c-5958-4d48-99d8-6e0c28275c87'] Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7264988c-5958-4d48-99d8-6e0c28275c87'] Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7264988c-5958-4d48-99d8-6e0c28275c87'] Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7264988c-5958-4d48-99d8-6e0c28275c87'] Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4aaccc33-6d7e-4e51-a28d-f3a253094e6e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-7264988c-5958-4d48-99d8-6e0c28275c87'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4aaccc33-6d7e-4e51-a28d-f3a253094e6e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7" status: 404 len: 194 microversion: 2.1 time: 0.094402 Oct 19 07:03:26.817869 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1666/3425] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:03:26 2022] GET /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:26.829155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:26.832399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:26.885975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:26.886903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:26.890853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:26.891838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:26.892574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:26.894092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:27.088685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:27.106281 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-344acd3a-e9cf-4728-8ad2-131be7c91f4e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1274 microversion: 2.1 time: 0.280490 Oct 19 07:03:27.138855 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1667/3426] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:26 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1274 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:27.168927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80ba90eb-b280-4a6c-8a05-588d75ea15e1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: .version_select at 0x7f6d645969d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-820149752", "description": "tempest-description-1932309024"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:27.849801 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-80ba90eb-b280-4a6c-8a05-588d75ea15e1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.706738 Oct 19 07:03:27.860070 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1668/3427] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:27.883501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:27.884217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:27.895437 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d658b2a6-b156-4d5c-9e1f-8e5701932aa9 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/1995e578-2bd1-4bca-af74-b51b04adc174" status: 202 len: 0 microversion: 2.1 time: 1.397114 Oct 19 07:03:27.896018 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1760/3428] 10.222.0.39 () {58 vars in 1287 bytes} [Wed Oct 19 07:03:26 2022] DELETE /compute/v2.1/os-security-group-rules/1995e578-2bd1-4bca-af74-b51b04adc174 => generated 0 bytes in 1399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:27.902434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0447e4e5-6fbc-45f7-875d-ad8a25adf4f4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: .version_select at 0x7f6d68a94f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-793725001", "description": "tempest-description-164874005"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:27.906807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:27.907734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:27.909058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:27.910374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:27.914113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:27.914834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:28.337262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:28.349228 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c900f646-7ca8-4ced-bab7-fcfefa1d746a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.484615 Oct 19 07:03:28.353252 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1669/3429] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:27 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:28.366002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a62d7f8-1ef0-476d-bccf-cd8eef6fe518 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d5fa16dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:29.106315 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0447e4e5-6fbc-45f7-875d-ad8a25adf4f4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.208870 Oct 19 07:03:29.106857 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1761/3430] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:27 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:29.112396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:29.113016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:29.153536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:29.154686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:29.156575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:29.161155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:29.161861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:29.162522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:29.328377 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a62d7f8-1ef0-476d-bccf-cd8eef6fe518 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/ed9b1233-b323-4321-99c8-e2e8ebb03fbf" status: 202 len: 0 microversion: 2.1 time: 0.973377 Oct 19 07:03:29.329174 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1670/3431] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:28 2022] DELETE /compute/v2.1/os-security-groups/ed9b1233-b323-4321-99c8-e2e8ebb03fbf => generated 0 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:29.334567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb05e966-64af-4989-90c0-bf46f50750f0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: .version_select at 0x7f6d68b29940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1496769164", "description": "tempest-description-662386260"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:29.714875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:29.726259 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-875aa2bd-3dee-4875-833c-b8e66a8be1f9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1316 microversion: 2.1 time: 0.617978 Oct 19 07:03:29.727102 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1762/3432] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:29 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1316 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:29.743745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19dcf8a5-11fd-4d09-819b-ee1cdc395114 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d68adcb80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:29.840295 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb05e966-64af-4989-90c0-bf46f50750f0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.505754 Oct 19 07:03:29.843115 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1671/3433] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:29.851849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-19dcf8a5-11fd-4d09-819b-ee1cdc395114 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b091fd4f-69c2-4425-81cc-5fd8769ee310 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:03:29.852703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-19dcf8a5-11fd-4d09-819b-ee1cdc395114 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Neutron security group b091fd4f-69c2-4425-81cc-5fd8769ee310 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:03:29.853824 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-19dcf8a5-11fd-4d09-819b-ee1cdc395114 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] HTTP exception thrown: Security group b091fd4f-69c2-4425-81cc-5fd8769ee310 does not exist Oct 19 07:03:29.853824 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-23bfbd7f-da69-47e9-b709-340a644bdda2'] Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19dcf8a5-11fd-4d09-819b-ee1cdc395114 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Request method failure captured: Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/b091fd4f-69c2-4425-81cc-5fd8769ee310 HTTP/1.1 Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6EtpNM-R0FHTBWwX8ehotkFceDt-5LyMTQc0LEic5sR0SwbabV0Hj0Jxw3sF7aAVrfi8qOr4Pc9Y8Opyff3gGkdkjxi3LN0bU7Q6Ges95f3hl7OecwUafM9WJynsOpoEp9STdUduFgjK2Fo-YUX9GPJZfemnBVB6_jSdQwR1PDA8Es Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0b30c84b5f1c4ebb93cf7413b585455b Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2065203435 Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0b30c84b5f1c4ebb93cf7413b585455b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b30c84b5f1c4ebb93cf7413b585455b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b30c84b5f1c4ebb93cf7413b585455b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0b30c84b5f1c4ebb93cf7413b585455b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2065203435 Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0b30c84b5f1c4ebb93cf7413b585455b Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2065203435 Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupRulesTestJSON-2065203435-project Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: a751ca6a15a24e86be84d884f120866f Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2065203435-project Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: exception: Security group b091fd4f-69c2-4425-81cc-5fd8769ee310 does not exist Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-23bfbd7f-da69-47e9-b709-340a644bdda2'] Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'b091fd4f-69c2-4425-81cc-5fd8769ee310'} Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:03:29.857082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b091fd4f-69c2-4425-81cc-5fd8769ee310 does not exist Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23bfbd7f-da69-47e9-b709-340a644bdda2'] Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b091fd4f-69c2-4425-81cc-5fd8769ee310 does not exist Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23bfbd7f-da69-47e9-b709-340a644bdda2'] Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b091fd4f-69c2-4425-81cc-5fd8769ee310 does not exist Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23bfbd7f-da69-47e9-b709-340a644bdda2'] Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b091fd4f-69c2-4425-81cc-5fd8769ee310 does not exist Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23bfbd7f-da69-47e9-b709-340a644bdda2'] Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19dcf8a5-11fd-4d09-819b-ee1cdc395114 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Returning 404 to user: Security group b091fd4f-69c2-4425-81cc-5fd8769ee310 does not exist Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-23bfbd7f-da69-47e9-b709-340a644bdda2'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19dcf8a5-11fd-4d09-819b-ee1cdc395114 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/b091fd4f-69c2-4425-81cc-5fd8769ee310" status: 404 len: 194 microversion: 2.1 time: 0.126347 Oct 19 07:03:29.863202 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1763/3434] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:29 2022] DELETE /compute/v2.1/os-security-groups/b091fd4f-69c2-4425-81cc-5fd8769ee310 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:29.869558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:29.872078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:29.882192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf3cdf56-e846-460f-8890-ee5b5d6aef7a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d68be1670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:29.944746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:29.945299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:29.945751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:29.951942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:29.956184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:29.958838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:30.283929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:30.357531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:30.475502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:30.489577 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf1a113b-8d12-477a-81f9-2e57d7477a98 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.644408 Oct 19 07:03:30.513277 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1672/3435] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:29 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:30.533842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f6390ce-59f5-4eb7-8c12-b1ed2e402c49 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d64596670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:30.800642 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf3cdf56-e846-460f-8890-ee5b5d6aef7a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.935318 Oct 19 07:03:30.801971 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1764/3436] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 07:03:29 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:30.813242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2aeea7d2-b38b-4d26-99cc-8203e330b2c1 req-2ac8e766-1908-4e8e-9b30-fee916aec0db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9446bfe5-f9bf-4a66-aee7-557849e71971", "tag": "d07f2e78-dd73-47cc-a9c4-5450a25ac681"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:30.838446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2aeea7d2-b38b-4d26-99cc-8203e330b2c1 req-2ac8e766-1908-4e8e-9b30-fee916aec0db service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:30.839296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2aeea7d2-b38b-4d26-99cc-8203e330b2c1 req-2ac8e766-1908-4e8e-9b30-fee916aec0db service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:30.841236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2aeea7d2-b38b-4d26-99cc-8203e330b2c1 req-2ac8e766-1908-4e8e-9b30-fee916aec0db service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:30.885382 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2aeea7d2-b38b-4d26-99cc-8203e330b2c1 req-2ac8e766-1908-4e8e-9b30-fee916aec0db service nova] Creating event network-changed:d07f2e78-dd73-47cc-a9c4-5450a25ac681 for instance 9446bfe5-f9bf-4a66-aee7-557849e71971 on n-h2-861333-10 Oct 19 07:03:30.899940 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2aeea7d2-b38b-4d26-99cc-8203e330b2c1 req-2ac8e766-1908-4e8e-9b30-fee916aec0db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094752 Oct 19 07:03:30.900870 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1765/3437] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:30.909118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:30.910212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:30.926489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:30.929094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:30.929475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:30.930288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:30.931398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:30.932562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:31.304057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:31.314244 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a0ee55b-2402-4aaf-be81-da25dbb48038 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1316 microversion: 2.1 time: 0.411779 Oct 19 07:03:31.318473 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1766/3438] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:30 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:31.325934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2ce850a-2870-4912-b95a-cdd02d82df34 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d68a9d820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:31.541701 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f6390ce-59f5-4eb7-8c12-b1ed2e402c49 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/f3b87867-ba2d-4390-a609-f5c7906866c7" status: 202 len: 0 microversion: 2.1 time: 1.024736 Oct 19 07:03:31.542467 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1673/3439] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:30 2022] DELETE /compute/v2.1/os-security-groups/f3b87867-ba2d-4390-a609-f5c7906866c7 => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:31.826662 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2ce850a-2870-4912-b95a-cdd02d82df34 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9ad65ae5-bf41-4aae-8c55-9337abeffae7" status: 202 len: 0 microversion: 2.1 time: 0.503561 Oct 19 07:03:31.826662 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1767/3440] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:31 2022] DELETE /compute/v2.1/os-security-groups/9ad65ae5-bf41-4aae-8c55-9337abeffae7 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:31.831785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:31.832750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:31.857771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:31.858509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:31.859141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:31.860016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:31.864762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:31.865611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:32.116646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30ce9556-8a0e-48ff-b7a9-01473698eede tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] Calling method '.version_select at 0x7f6d68bb49d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:32.191631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:32.218971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:32.240991 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a05b9a9-8a21-43bc-92bc-f6760374ab7c tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.408514 Oct 19 07:03:32.240991 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1768/3441] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:31 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:32.254704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f8d3a20-30b8-4ad6-86de-abec5c5ab69e tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d68b8cd30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:32.378138 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30ce9556-8a0e-48ff-b7a9-01473698eede tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.833965 Oct 19 07:03:32.379384 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1674/3442] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 07:03:31 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:32.392143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7ff5761-af41-4d13-a79a-0a04270b9ab7 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d68bb4700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:32.463157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-d7ff5761-af41-4d13-a79a-0a04270b9ab7 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:03:32.463763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-d7ff5761-af41-4d13-a79a-0a04270b9ab7 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:03:32.464322 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-d7ff5761-af41-4d13-a79a-0a04270b9ab7 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:03:32.464322 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-c778fc15-02e1-4b81-8cad-d92ad48a8f9b'] Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7ff5761-af41-4d13-a79a-0a04270b9ab7 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-security-groups/9ad65ae5-bf41-4aae-8c55-9337abeffae7 HTTP/1.1 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-c778fc15-02e1-4b81-8cad-d92ad48a8f9b'] Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9ad65ae5-bf41-4aae-8c55-9337abeffae7'} Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:03:32.466245 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c778fc15-02e1-4b81-8cad-d92ad48a8f9b'] Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c778fc15-02e1-4b81-8cad-d92ad48a8f9b'] Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c778fc15-02e1-4b81-8cad-d92ad48a8f9b'] Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c778fc15-02e1-4b81-8cad-d92ad48a8f9b'] Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7ff5761-af41-4d13-a79a-0a04270b9ab7 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-c778fc15-02e1-4b81-8cad-d92ad48a8f9b'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7ff5761-af41-4d13-a79a-0a04270b9ab7 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/9ad65ae5-bf41-4aae-8c55-9337abeffae7" status: 404 len: 194 microversion: 2.1 time: 0.086998 Oct 19 07:03:32.473419 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1675/3443] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:03:32 2022] GET /compute/v2.1/os-security-groups/9ad65ae5-bf41-4aae-8c55-9337abeffae7 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:32.479408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:32.479408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:32.493838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:32.494339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:32.494786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:32.495499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:32.495959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:32.496415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:32.872367 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f8d3a20-30b8-4ad6-86de-abec5c5ab69e tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/8a24fa16-c508-4836-b68b-c1f777e62847" status: 202 len: 0 microversion: 2.1 time: 0.635298 Oct 19 07:03:32.873774 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1769/3444] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:32 2022] DELETE /compute/v2.1/os-security-groups/8a24fa16-c508-4836-b68b-c1f777e62847 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:32.882330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dbc27b9d-6da3-4fb6-80ee-69e4a14d18ba tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] Action: 'create', calling method: .version_select at 0x7f6d68a560d0>, body: {"pool": "non_exist_pool"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:32.884943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:32.893612 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e9f4db11-514a-4c80-bd93-509397f7e15a tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1316 microversion: 2.1 time: 0.424373 Oct 19 07:03:32.894250 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1676/3445] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:32 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:32.933156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9c6f040-93f1-4ee3-95e0-599414109b45 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d645a0d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:33.012886 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-dbc27b9d-6da3-4fb6-80ee-69e4a14d18ba tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] HTTP exception thrown: Floating IP pool not found. Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dbc27b9d-6da3-4fb6-80ee-69e4a14d18ba tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] Request method failure captured: Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 26 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FCf0phBIf9Z5hFjzr6wLPl9qaLe3P6PGNxOyuvmHDN1IADl7xRap_-VzBqWRslYrz1nlOAHwkjz-lQd79eASzyz56Xr7k_f5SbjcnVBClNuYNUH0NSVQFO4-a4QiicQ8CZCgwBUtoBHK8n5o0r9tZCqojfenDmAMauMMYjDJQzc4k Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 7b274e88fb0b494cbd28ef3d8251bd98 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-96329877 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7b274e88fb0b494cbd28ef3d8251bd98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b274e88fb0b494cbd28ef3d8251bd98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b274e88fb0b494cbd28ef3d8251bd98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7b274e88fb0b494cbd28ef3d8251bd98", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-96329877 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 7b274e88fb0b494cbd28ef3d8251bd98 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-96329877 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsNegativeTestJSON-96329877-project Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: bd92b678098d4487bab7bd3bef85d823 Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-96329877-project Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: {"pool": "non_exist_pool"} Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: exception: Floating IP pool not found. Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:33.014538 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:33.019112 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 19 07:03:33.019112 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.019112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dbc27b9d-6da3-4fb6-80ee-69e4a14d18ba tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] Returning 404 to user: Floating IP pool not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:33.019112 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dbc27b9d-6da3-4fb6-80ee-69e4a14d18ba tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.138096 Oct 19 07:03:33.020957 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1770/3446] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 07:03:32 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:03:33.026275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:33.026776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:33.043548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:33.044046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:33.044605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:33.045607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:33.046351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:33.046795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:33.075806 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] HTTP exception thrown: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Request method failure captured: Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 HTTP/1.1 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CxpbzAHxQOKvQTsILB4qFNu4l2IRiGnmtaI6tz74B_ARxhYa4crz4w0-8Vln3USBV83YQjr1HB1FKq58iJLlQ2sinh3rOGu4g9_ZW8NoS5OHhdlHyftEU2OAXiKeZNeDGc6wP7_1ODDOpLiTs9E0-9e6ywXhfZ3IXrclqe-9CSHKc Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b64d433fbb74f5b89ab02e4572ddc45", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 41810b44169748bd97b407696a681dc7 Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '745f6b1c-f983-46eb-9948-dc986b45ba87'} Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:03:33.078996 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.085520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Returning 404 to user: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:33.087786 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5cb2067-9033-4603-a0f6-d8a1a3dba196 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "DELETE /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 404 len: 111 microversion: 2.1 time: 0.065207 Oct 19 07:03:33.091567 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1771/3447] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:03:33 2022] DELETE /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:33.096960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cc00783-6c18-497b-a3fe-8b0907f5a848 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d64200ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:33.447772 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cc00783-6c18-497b-a3fe-8b0907f5a848 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/4b8510f9-d1bf-464f-b584-23d7917f9c0a" status: 202 len: 0 microversion: 2.1 time: 0.355000 Oct 19 07:03:33.448577 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1772/3448] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:33 2022] DELETE /compute/v2.1/os-security-groups/4b8510f9-d1bf-464f-b584-23d7917f9c0a => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:33.454556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b734d3bc-751c-4c62-8b47-8889efa5af0e tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] Calling method '.version_select at 0x7f6d68aad940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:33.538861 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e9c6f040-93f1-4ee3-95e0-599414109b45 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9ccc4efb-0142-4bd1-9172-15ddaf4778b7" status: 202 len: 0 microversion: 2.1 time: 0.643580 Oct 19 07:03:33.539449 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1677/3449] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:32 2022] DELETE /compute/v2.1/os-security-groups/9ccc4efb-0142-4bd1-9172-15ddaf4778b7 => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:33.545511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:33.546922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 745f6b1c-f983-46eb-9948-dc986b45ba87] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:33.560140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:33.572935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:33.575084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:33.577689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:33.580572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:33.583094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:33.617333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-b734d3bc-751c-4c62-8b47-8889efa5af0e tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ac3d2753-5b07-47f9-b631-4e32f6c523a0 could not be found", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:03:33.618051 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b734d3bc-751c-4c62-8b47-8889efa5af0e tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] HTTP exception thrown: Floating IP not found for ID ac3d2753-5b07-47f9-b631-4e32f6c523a0 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b734d3bc-751c-4c62-8b47-8889efa5af0e tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] Request method failure captured: Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-floating-ips/ac3d2753-5b07-47f9-b631-4e32f6c523a0 HTTP/1.1 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FCf0phBIf9Z5hFjzr6wLPl9qaLe3P6PGNxOyuvmHDN1IADl7xRap_-VzBqWRslYrz1nlOAHwkjz-lQd79eASzyz56Xr7k_f5SbjcnVBClNuYNUH0NSVQFO4-a4QiicQ8CZCgwBUtoBHK8n5o0r9tZCqojfenDmAMauMMYjDJQzc4k Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 7b274e88fb0b494cbd28ef3d8251bd98 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-96329877 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7b274e88fb0b494cbd28ef3d8251bd98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b274e88fb0b494cbd28ef3d8251bd98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b274e88fb0b494cbd28ef3d8251bd98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7b274e88fb0b494cbd28ef3d8251bd98", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-96329877 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 7b274e88fb0b494cbd28ef3d8251bd98 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-96329877 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsNegativeTestJSON-96329877-project Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: bd92b678098d4487bab7bd3bef85d823 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-96329877-project Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: exception: Floating IP not found for ID ac3d2753-5b07-47f9-b631-4e32f6c523a0 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'ac3d2753-5b07-47f9-b631-4e32f6c523a0'} Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ac3d2753-5b07-47f9-b631-4e32f6c523a0 could not be found Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8780767-8985-4bc3-af04-11c2819e8bf1'] Oct 19 07:03:33.619922 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ac3d2753-5b07-47f9-b631-4e32f6c523a0. Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ac3d2753-5b07-47f9-b631-4e32f6c523a0 Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ac3d2753-5b07-47f9-b631-4e32f6c523a0 Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b734d3bc-751c-4c62-8b47-8889efa5af0e tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] Returning 404 to user: Floating IP not found for ID ac3d2753-5b07-47f9-b631-4e32f6c523a0 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b734d3bc-751c-4c62-8b47-8889efa5af0e tempest-FloatingIPsNegativeTestJSON-96329877 tempest-FloatingIPsNegativeTestJSON-96329877-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/ac3d2753-5b07-47f9-b631-4e32f6c523a0" status: 404 len: 111 microversion: 2.1 time: 0.171679 Oct 19 07:03:33.628720 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1773/3450] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 07:03:33 2022] DELETE /compute/v2.1/os-floating-ips/ac3d2753-5b07-47f9-b631-4e32f6c523a0 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:33.632765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:33.632765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:33.636144 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] HTTP exception thrown: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Request method failure captured: Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 HTTP/1.1 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6CxpbzAHxQOKvQTsILB4qFNu4l2IRiGnmtaI6tz74B_ARxhYa4crz4w0-8Vln3USBV83YQjr1HB1FKq58iJLlQ2sinh3rOGu4g9_ZW8NoS5OHhdlHyftEU2OAXiKeZNeDGc6wP7_1ODDOpLiTs9E0-9e6ywXhfZ3IXrclqe-9CSHKc Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b64d433fbb74f5b89ab02e4572ddc45", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 41810b44169748bd97b407696a681dc7 Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '745f6b1c-f983-46eb-9948-dc986b45ba87'} Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.638926 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.643594 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.643594 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.643594 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.643594 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:33.643594 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:33.643594 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. Oct 19 07:03:33.643594 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.647092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Returning 404 to user: Instance 745f6b1c-f983-46eb-9948-dc986b45ba87 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:33.649358 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d9cbe23-a229-450c-a649-5f31cb208a1f tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87" status: 404 len: 111 microversion: 2.1 time: 0.108968 Oct 19 07:03:33.651408 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1678/3451] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:33 2022] GET /compute/v2.1/servers/745f6b1c-f983-46eb-9948-dc986b45ba87 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:33.655378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:33.655880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:33.656388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:33.657085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:33.657549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:33.657989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:33.663341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba3fd921-5302-45b3-a66c-39cceb9c8cc0 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d68bb4790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:33.912463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:33.924365 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-099f66f7-3fe4-4d52-9b2f-68976b6d1237 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.300859 Oct 19 07:03:33.927127 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1774/3452] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:33 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:33.937191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e66221df-1cad-4eed-8a22-5dbca45fb8ad tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d68af7820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:33.965752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-e66221df-1cad-4eed-8a22-5dbca45fb8ad tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:03:33.966436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-e66221df-1cad-4eed-8a22-5dbca45fb8ad tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:03:33.967041 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e66221df-1cad-4eed-8a22-5dbca45fb8ad tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:03:33.967041 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-6e0b42b5-d21c-48d4-9aee-f2980a5782d9'] Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e66221df-1cad-4eed-8a22-5dbca45fb8ad tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-security-groups/9ccc4efb-0142-4bd1-9172-15ddaf4778b7 HTTP/1.1 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: exception: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-6e0b42b5-d21c-48d4-9aee-f2980a5782d9'] Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '9ccc4efb-0142-4bd1-9172-15ddaf4778b7'} Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:03:33.969022 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e0b42b5-d21c-48d4-9aee-f2980a5782d9'] Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e0b42b5-d21c-48d4-9aee-f2980a5782d9'] Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e0b42b5-d21c-48d4-9aee-f2980a5782d9'] Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e0b42b5-d21c-48d4-9aee-f2980a5782d9'] Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e66221df-1cad-4eed-8a22-5dbca45fb8ad tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-6e0b42b5-d21c-48d4-9aee-f2980a5782d9'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:33.973736 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e66221df-1cad-4eed-8a22-5dbca45fb8ad tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/9ccc4efb-0142-4bd1-9172-15ddaf4778b7" status: 404 len: 194 microversion: 2.1 time: 0.043128 Oct 19 07:03:33.976820 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1775/3453] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:03:33 2022] GET /compute/v2.1/os-security-groups/9ccc4efb-0142-4bd1-9172-15ddaf4778b7 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:33.987514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:33.988126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:33.995407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:33.996021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:33.996551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:33.997331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:33.997885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:33.998384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:34.016671 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] HTTP exception thrown: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Request method failure captured: Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e HTTP/1.1 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CxpbzAHxQOKvQTsILB4qFNu4l2IRiGnmtaI6tz74B_ARxhYa4crz4w0-8Vln3USBV83YQjr1HB1FKq58iJLlQ2sinh3rOGu4g9_ZW8NoS5OHhdlHyftEU2OAXiKeZNeDGc6wP7_1ODDOpLiTs9E0-9e6ywXhfZ3IXrclqe-9CSHKc Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b64d433fbb74f5b89ab02e4572ddc45", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 41810b44169748bd97b407696a681dc7 Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '1155b0c5-6521-4c4e-8197-41e0672c618e'} Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:03:34.018654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.024935 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.027151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Returning 404 to user: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:34.028433 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04b5b281-9add-4713-93ac-2f1295cf20f8 tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 404 len: 111 microversion: 2.1 time: 0.050548 Oct 19 07:03:34.029411 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1776/3454] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:03:33 2022] DELETE /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:34.036414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:34.037509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:34.044807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:34.045667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:34.046107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:34.046825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:34.047284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:34.047863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:34.238781 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba3fd921-5302-45b3-a66c-39cceb9c8cc0 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/81932174-2c64-4b81-8db5-9953cc86e0b1" status: 202 len: 0 microversion: 2.1 time: 0.585073 Oct 19 07:03:34.239569 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1679/3455] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:33 2022] DELETE /compute/v2.1/os-security-groups/81932174-2c64-4b81-8db5-9953cc86e0b1 => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:34.245566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f990a9e-f20e-4945-9287-e9ae85a8da20 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa16d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:34.278476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:34.296669 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19c8f362-65d3-4526-8de8-382a3de2c8f2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1316 microversion: 2.1 time: 0.265990 Oct 19 07:03:34.320482 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1777/3456] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:34 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:34.327670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:34.328657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] [instance: 1155b0c5-6521-4c4e-8197-41e0672c618e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:34.337871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:34.339492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:34.339759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:34.340529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:34.340975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:34.341604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:34.362373 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] HTTP exception thrown: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Request method failure captured: Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e HTTP/1.1 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6CxpbzAHxQOKvQTsILB4qFNu4l2IRiGnmtaI6tz74B_ARxhYa4crz4w0-8Vln3USBV83YQjr1HB1FKq58iJLlQ2sinh3rOGu4g9_ZW8NoS5OHhdlHyftEU2OAXiKeZNeDGc6wP7_1ODDOpLiTs9E0-9e6ywXhfZ3IXrclqe-9CSHKc Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b64d433fbb74f5b89ab02e4572ddc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b64d433fbb74f5b89ab02e4572ddc45", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 4b64d433fbb74f5b89ab02e4572ddc45 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestMultiNic-209800037 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 41810b44169748bd97b407696a681dc7 Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestMultiNic-209800037-project Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '1155b0c5-6521-4c4e-8197-41e0672c618e'} Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:34.364886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] Returning 404 to user: Instance 1155b0c5-6521-4c4e-8197-41e0672c618e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e61cceb-3571-44c9-9968-d13748039a0d tempest-ServersTestMultiNic-209800037 tempest-ServersTestMultiNic-209800037-project] 10.222.0.39 "GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e" status: 404 len: 111 microversion: 2.1 time: 0.045440 Oct 19 07:03:34.376645 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1778/3457] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:34 2022] GET /compute/v2.1/servers/1155b0c5-6521-4c4e-8197-41e0672c618e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:34.403785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a7affbc-e098-4740-a256-7c12f51cd762 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] Calling method '.version_select at 0x7f6d68a2c430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:35.617320 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f990a9e-f20e-4945-9287-e9ae85a8da20 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/bbaf2459-7621-4a04-92f3-b2cb141112d3" status: 202 len: 0 microversion: 2.1 time: 1.376400 Oct 19 07:03:35.618129 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1680/3458] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:34 2022] DELETE /compute/v2.1/os-security-groups/bbaf2459-7621-4a04-92f3-b2cb141112d3 => generated 0 bytes in 1378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:35.635813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:35.636808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:35.693166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:35.698280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:35.698280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:35.698280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:35.698280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:35.700414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:35.873069 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a7affbc-e098-4740-a256-7c12f51cd762 tempest-SecurityGroupRulesTestJSON-2065203435 tempest-SecurityGroupRulesTestJSON-2065203435-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9f2ea34e-d87c-460c-98c6-4c651db9631d" status: 202 len: 0 microversion: 2.1 time: 1.502945 Oct 19 07:03:35.874916 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1779/3459] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:03:34 2022] DELETE /compute/v2.1/os-security-groups/9f2ea34e-d87c-460c-98c6-4c651db9631d => generated 0 bytes in 1506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:03:35.887558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:35.888810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:35.907855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:35.909868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:35.911581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:35.914627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:35.915697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:35.918779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:36.237056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:36.250650 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-338545a1-0d5d-41c8-84da-b01086a95b3f tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.623490 Oct 19 07:03:36.253148 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1681/3460] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:35 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:36.269537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f73f875b-8578-4039-aa2f-e2b48d6b4e3f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa16700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:36.370161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-f73f875b-8578-4039-aa2f-e2b48d6b4e3f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:03:36.370768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-f73f875b-8578-4039-aa2f-e2b48d6b4e3f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group bbaf2459-7621-4a04-92f3-b2cb141112d3 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:03:36.371592 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f73f875b-8578-4039-aa2f-e2b48d6b4e3f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:03:36.371592 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-4bc519c5-1252-4f3d-8b3d-1e227ad7d518'] Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f73f875b-8578-4039-aa2f-e2b48d6b4e3f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-security-groups/bbaf2459-7621-4a04-92f3-b2cb141112d3 HTTP/1.1 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-4bc519c5-1252-4f3d-8b3d-1e227ad7d518'] Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'bbaf2459-7621-4a04-92f3-b2cb141112d3'} Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:03:36.376442 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4bc519c5-1252-4f3d-8b3d-1e227ad7d518'] Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4bc519c5-1252-4f3d-8b3d-1e227ad7d518'] Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4bc519c5-1252-4f3d-8b3d-1e227ad7d518'] Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4bc519c5-1252-4f3d-8b3d-1e227ad7d518'] Oct 19 07:03:36.380941 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:03:36.386357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f73f875b-8578-4039-aa2f-e2b48d6b4e3f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:03:36.386357 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-4bc519c5-1252-4f3d-8b3d-1e227ad7d518'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:36.396984 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f73f875b-8578-4039-aa2f-e2b48d6b4e3f tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/bbaf2459-7621-4a04-92f3-b2cb141112d3" status: 404 len: 194 microversion: 2.1 time: 0.132668 Oct 19 07:03:36.396984 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1682/3461] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:03:36 2022] GET /compute/v2.1/os-security-groups/bbaf2459-7621-4a04-92f3-b2cb141112d3 => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:03:36.414882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b1dbc3c-35b3-4837-9c9d-f053f9ff3cec tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa1c310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:36.525367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:36.542676 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b108caab-0653-47b7-931d-67ec2ce6a089 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1316 microversion: 2.1 time: 0.666221 Oct 19 07:03:36.543273 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1780/3462] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:35 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1316 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:36.954165 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b1dbc3c-35b3-4837-9c9d-f053f9ff3cec tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.552533 Oct 19 07:03:36.954787 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1683/3463] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 07:03:36 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:36.976616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ed0a219-a990-41f0-b03a-59318a00140d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: .version_select at 0x7f6d68a2c1f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2055224906", "description": "tempest-description-1208389164"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:37.275459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:37.276343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:37.295997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:37.300148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:37.300148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:37.300148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:37.300148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:37.300148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:37.593748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:37.612581 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1dcada6-3056-4478-8b66-9d501aa380ce tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.341048 Oct 19 07:03:37.616662 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1684/3464] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:37 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:37.630521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:37.631670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:37.643417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:37.644257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:37.646488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:37.650591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:37.651344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:37.653148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:38.120519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:38.148331 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-388f4c6d-8f40-4ae6-a696-d27205bc4692 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1316 microversion: 2.1 time: 0.529895 Oct 19 07:03:38.150068 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1685/3465] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:37 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:38.295889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d30e4eaf-7070-4c50-a8ff-d28ef9cf4593 req-42dc8acd-6154-4f7f-8393-8caa42a9eba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9446bfe5-f9bf-4a66-aee7-557849e71971", "name": "network-vif-plugged", "status": "completed", "tag": "d07f2e78-dd73-47cc-a9c4-5450a25ac681"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:38.309528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d30e4eaf-7070-4c50-a8ff-d28ef9cf4593 req-42dc8acd-6154-4f7f-8393-8caa42a9eba4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:38.317062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d30e4eaf-7070-4c50-a8ff-d28ef9cf4593 req-42dc8acd-6154-4f7f-8393-8caa42a9eba4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:38.317521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d30e4eaf-7070-4c50-a8ff-d28ef9cf4593 req-42dc8acd-6154-4f7f-8393-8caa42a9eba4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:38.349339 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d30e4eaf-7070-4c50-a8ff-d28ef9cf4593 req-42dc8acd-6154-4f7f-8393-8caa42a9eba4 service nova] Creating event network-vif-plugged:d07f2e78-dd73-47cc-a9c4-5450a25ac681 for instance 9446bfe5-f9bf-4a66-aee7-557849e71971 on n-h2-861333-10 Oct 19 07:03:38.363388 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d30e4eaf-7070-4c50-a8ff-d28ef9cf4593 req-42dc8acd-6154-4f7f-8393-8caa42a9eba4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068588 Oct 19 07:03:38.364385 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1686/3466] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:03:38.514104 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ed0a219-a990-41f0-b03a-59318a00140d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.541396 Oct 19 07:03:38.515362 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1781/3467] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:38.531151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-696a6c8b-2629-4e3c-889b-9fc7eb6afcfd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: .version_select at 0x7f6d68b29550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1683792230", "description": "tempest-description-534509144"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:38.647421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:38.648437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:38.667766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:38.668596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:38.669210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:38.670274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:38.670908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:38.671504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:39.458315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:39.489579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-330b4b0c-08ab-4a41-b59d-52ec347efb96 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.847206 Oct 19 07:03:39.490082 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1782/3468] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:38 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:39.526716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:39.533830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:39.553856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:39.554605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:39.555345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:39.556334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:39.561344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:39.561344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:39.635342 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-696a6c8b-2629-4e3c-889b-9fc7eb6afcfd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.108325 Oct 19 07:03:39.636094 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1687/3469] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:03:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:39.924380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-493791810", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "3540d671-9bee-4fde-bb25-277092fca2cb"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:40.079846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] validate_networks() for [('3540d671-9bee-4fde-bb25-277092fca2cb', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:03:40.133940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:40.142944 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14340d98-0d4c-4116-a233-45ba5cc3b0c2 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1316 microversion: 2.1 time: 0.651761 Oct 19 07:03:40.143523 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1783/3470] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:39 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1316 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:40.513560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:40.514448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:40.525559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:40.526111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:40.528752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:40.531931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:40.532733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:40.534014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:41.156467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:03:41.156842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:03:41.163027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:03:41.163859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:03:41.164747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:03:41.181406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:41.182341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:41.183185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:41.185108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:41.186311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:41.186972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:41.220839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Getting quotas for project 230afab7d7eb4d98950bece49d03ded6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:41.240831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Getting quotas for user 54f1ed18a0014aefa8d9a01259b83730 and project 230afab7d7eb4d98950bece49d03ded6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:41.280989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:03:41.284041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:03:41.450495 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19473e53-9308-4f1a-81f1-97fe413636ee tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533267 Oct 19 07:03:41.462710 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1688/3471] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:03:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:03:41.476498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:41.477500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:41.496696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:41.498150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:41.500688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:41.501646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:41.505758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:41.506795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:41.621986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:41.645140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c56d4dcc-5287-4e89-8bfe-c15d82454235 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 1.132548 Oct 19 07:03:41.649482 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1784/3472] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:40 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:41.670866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-973f7629-4b35-4db4-9959-8226ffd0c764 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:41.671873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-973f7629-4b35-4db4-9959-8226ffd0c764 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:41.803479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:41.812379 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ac3e98b-6906-492d-96ff-a4c63b1c5dcb tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1505 microversion: 2.1 time: 0.347091 Oct 19 07:03:41.813208 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1689/3473] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:41 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:41.847904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6dedf104-e9a8-4ffd-9388-571f820d3ee6 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:41.853680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6dedf104-e9a8-4ffd-9388-571f820d3ee6 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:41.889589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dedf104-e9a8-4ffd-9388-571f820d3ee6 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:41.892251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dedf104-e9a8-4ffd-9388-571f820d3ee6 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:41.895879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dedf104-e9a8-4ffd-9388-571f820d3ee6 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:41.897668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dedf104-e9a8-4ffd-9388-571f820d3ee6 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:41.897668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dedf104-e9a8-4ffd-9388-571f820d3ee6 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:41.901763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dedf104-e9a8-4ffd-9388-571f820d3ee6 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:41.949096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-973f7629-4b35-4db4-9959-8226ffd0c764 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:41.958082 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-973f7629-4b35-4db4-9959-8226ffd0c764 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1215 microversion: 2.1 time: 0.304891 Oct 19 07:03:41.961368 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1785/3474] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:41 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:42.042181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:42.161617 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6dedf104-e9a8-4ffd-9388-571f820d3ee6 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.325534 Oct 19 07:03:42.171532 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1690/3475] 10.222.0.39 () {58 vars in 1296 bytes} [Wed Oct 19 07:03:41 2022] DELETE /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971/os-server-password => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:03:42.179264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-883cb0a6-0f7e-4f79-ba79-bdad71177e59 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:42.181719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-883cb0a6-0f7e-4f79-ba79-bdad71177e59 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:42.187810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883cb0a6-0f7e-4f79-ba79-bdad71177e59 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:42.188698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883cb0a6-0f7e-4f79-ba79-bdad71177e59 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:42.189425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883cb0a6-0f7e-4f79-ba79-bdad71177e59 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:42.190388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883cb0a6-0f7e-4f79-ba79-bdad71177e59 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:42.191112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883cb0a6-0f7e-4f79-ba79-bdad71177e59 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:42.191803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883cb0a6-0f7e-4f79-ba79-bdad71177e59 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:42.243002 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-883cb0a6-0f7e-4f79-ba79-bdad71177e59 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.073862 Oct 19 07:03:42.248597 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1786/3476] 10.222.0.39 () {58 vars in 1293 bytes} [Wed Oct 19 07:03:42 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971/os-server-password => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 07:03:42.258377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:42.258820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:42.270560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:42.271338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:42.273573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:42.274493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:42.274963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:42.275848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:42.379860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:03:42.673407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:42.675523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:42.695561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:42.696135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:42.696600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:42.697380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:42.697857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:42.698298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:43.204442 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2109553a-cb97-45bb-8003-5ed4c1a62a57 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 204 len: 0 microversion: 2.1 time: 0.947719 Oct 19 07:03:43.204442 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1691/3477] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:03:42 2022] DELETE /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 0 bytes in 950 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:03:43.221186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:43.225164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:43.241580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:43.242346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:43.243016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:43.243918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:43.244570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:43.250330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:43.415289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:43.425485 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba77c0ce-79b2-488a-b484-761bc035c57d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.757255 Oct 19 07:03:43.428726 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1787/3478] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:42 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:43.452153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:43.452788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:43.479343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:43.479864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:43.480348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:43.487184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:43.487703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:43.488203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:43.521895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:43.536820 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c20b0056-78ec-4c78-8ff9-13dd16c18df8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1219 microversion: 2.1 time: 0.331882 Oct 19 07:03:43.540792 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1692/3479] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:43 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1219 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:43.945238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:43.963702 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-335ab6e9-511f-4b8b-8b78-8cc22a2c2486 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1511 microversion: 2.1 time: 0.533329 Oct 19 07:03:43.964329 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1788/3480] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:43 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1511 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:44.459269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:44.464047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:44.480327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:44.481158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:44.482085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:44.483308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:44.484008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:44.485105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:44.564634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:44.565545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:44.572993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:44.582386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:44.589077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:44.590101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:44.592453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:44.596317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:44.723950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:44.870252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:44.882613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0df77eeb-f1af-4f03-b218-d022da2521ff tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.428620 Oct 19 07:03:44.886041 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1693/3481] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:44 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:44.947464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:44.976986 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a26b9a1-1434-4c4a-955e-336f62a7f197 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1267 microversion: 2.1 time: 0.416184 Oct 19 07:03:44.979409 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1789/3482] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:44 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1267 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:44.998570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:44.999530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:45.017317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:45.019184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:45.023440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:45.024782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:45.025470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:45.026096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:45.705997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:45.721878 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9f116d3-ed62-48de-8f02-94c0c2932db9 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1511 microversion: 2.1 time: 0.735131 Oct 19 07:03:45.723030 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1694/3483] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:44 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1511 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:45.917063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:45.919749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:45.950171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:45.951478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:45.953711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:45.956657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:45.959768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:45.962626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:46.012552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:46.022559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:46.029998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:46.032738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:46.033453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:46.037733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:46.041152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:46.049903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:46.409358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:46.422214 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01ac1919-d1aa-4acb-9816-96d22bc08eeb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1273 microversion: 2.1 time: 0.420641 Oct 19 07:03:46.441070 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1695/3484] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:45 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1273 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:46.731266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:46.741961 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a2f7789-7e04-4b02-989e-b324e46937fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1486 microversion: 2.1 time: 0.832698 Oct 19 07:03:46.747077 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1790/3485] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:45 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1486 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:46.772973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:46.773683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:46.786916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0eb2e0be-f73f-4a07-aba2-b43c07acb412 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:46.786916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0eb2e0be-f73f-4a07-aba2-b43c07acb412 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:46.787757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb2e0be-f73f-4a07-aba2-b43c07acb412 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:46.790959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb2e0be-f73f-4a07-aba2-b43c07acb412 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:46.791603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb2e0be-f73f-4a07-aba2-b43c07acb412 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:46.793848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:46.795628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb2e0be-f73f-4a07-aba2-b43c07acb412 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:46.796904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb2e0be-f73f-4a07-aba2-b43c07acb412 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:46.797544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb2e0be-f73f-4a07-aba2-b43c07acb412 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:46.798034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:46.799868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:46.802943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:46.807080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:46.807960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:47.165349 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0eb2e0be-f73f-4a07-aba2-b43c07acb412 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "POST /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089/action" status: 202 len: 0 microversion: 2.1 time: 0.393984 Oct 19 07:03:47.171608 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1791/3486] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:03:46 2022] POST /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:03:47.178562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:47.185531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:47.208065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:47.208502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:47.208950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:47.209670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:47.210202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:47.212027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:47.975603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:47.995150 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a2fbdfa-dfb1-40f7-b73e-aa0ffb80ab6a tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1494 microversion: 2.1 time: 0.821029 Oct 19 07:03:47.995781 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1792/3487] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:47 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1494 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:48.018063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:48.018693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:48.038003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:48.038700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:48.039159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:48.039908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:48.040655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:48.043946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:48.049822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6883b78d9d4260a6e90dfcbb3dca4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8582aa8284734a249ce3cc6d6a765be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:48.067694 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-09c0af66-1ae9-4849-b7c2-b614c48d313e tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 200 len: 1511 microversion: 2.1 time: 1.306265 Oct 19 07:03:48.071294 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1696/3488] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:46 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 1511 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:48.092039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-90991ee9-7650-4261-bab9-648a994cfaf8 req-7eccac58-0510-4395-816c-821b8ecb8a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9446bfe5-f9bf-4a66-aee7-557849e71971", "name": "network-vif-deleted", "tag": "d07f2e78-dd73-47cc-a9c4-5450a25ac681"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:48.126167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-90991ee9-7650-4261-bab9-648a994cfaf8 req-7eccac58-0510-4395-816c-821b8ecb8a59 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:48.131702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-90991ee9-7650-4261-bab9-648a994cfaf8 req-7eccac58-0510-4395-816c-821b8ecb8a59 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:48.132415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-90991ee9-7650-4261-bab9-648a994cfaf8 req-7eccac58-0510-4395-816c-821b8ecb8a59 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:48.183388 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-90991ee9-7650-4261-bab9-648a994cfaf8 req-7eccac58-0510-4395-816c-821b8ecb8a59 service nova] Creating event network-vif-deleted:d07f2e78-dd73-47cc-a9c4-5450a25ac681 for instance 9446bfe5-f9bf-4a66-aee7-557849e71971 on n-h2-861333-10 Oct 19 07:03:48.192558 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-90991ee9-7650-4261-bab9-648a994cfaf8 req-7eccac58-0510-4395-816c-821b8ecb8a59 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117239 Oct 19 07:03:48.197140 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1697/3489] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:48.237091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:48.249326 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf6b3dca-61ce-49e5-9f7a-4376e549ab40 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1273 microversion: 2.1 time: 0.248208 Oct 19 07:03:48.264835 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1793/3490] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:47 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:49.022914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:49.024397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:49.040970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:49.045661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:49.050092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:49.052380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:49.053424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:49.057283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:49.065286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:49.094183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:49.094805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] [instance: 9446bfe5-f9bf-4a66-aee7-557849e71971] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:49.116614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:49.117171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:49.117634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:49.118383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:49.118850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:49.119290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:49.177031 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] HTTP exception thrown: Instance 9446bfe5-f9bf-4a66-aee7-557849e71971 could not be found. Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Request method failure captured: Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 HTTP/1.1 Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6E2jdkwf2CtoJJo3r6sIpWasrER3cKX-h2ZAyFmOa6KTlYWpqmr-GORxf4NpFT7Y61KXMFz0738oc7puddkmPt3JHBx9BxjKsN52KUqk7ICQEHvFQebOvzb_ze9M1fD4qcxWa7LMM6Lz4Alu64MS6jp8lBVPzPAescd5C5If3IGqVM Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8582aa8284734a249ce3cc6d6a765be2 Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerPasswordTestJSON-841008615 Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8582aa8284734a249ce3cc6d6a765be2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8582aa8284734a249ce3cc6d6a765be2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8582aa8284734a249ce3cc6d6a765be2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8582aa8284734a249ce3cc6d6a765be2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerPasswordTestJSON-841008615 Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8582aa8284734a249ce3cc6d6a765be2 Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerPasswordTestJSON-841008615 Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerPasswordTestJSON-841008615-project Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: bc6883b78d9d4260a6e90dfcbb3dca4e Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerPasswordTestJSON-841008615-project Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 9446bfe5-f9bf-4a66-aee7-557849e71971 could not be found. Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '9446bfe5-f9bf-4a66-aee7-557849e71971'} Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9446bfe5-f9bf-4a66-aee7-557849e71971 could not be found. Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9446bfe5-f9bf-4a66-aee7-557849e71971 could not be found. Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:03:49.180524 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:49.185687 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:03:49.185687 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:03:49.185687 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:03:49.185687 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:03:49.185687 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:03:49.185687 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9446bfe5-f9bf-4a66-aee7-557849e71971 could not be found. Oct 19 07:03:49.185687 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:03:49.188980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] Returning 404 to user: Instance 9446bfe5-f9bf-4a66-aee7-557849e71971 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:03:49.193366 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60b5f082-3f54-4c7d-9556-558c06f2d494 tempest-ServerPasswordTestJSON-841008615 tempest-ServerPasswordTestJSON-841008615-project] 10.222.0.39 "GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971" status: 404 len: 111 microversion: 2.1 time: 0.100389 Oct 19 07:03:49.194576 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1794/3491] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:49 2022] GET /compute/v2.1/servers/9446bfe5-f9bf-4a66-aee7-557849e71971 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:03:49.275225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:49.276807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:49.297138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:49.297138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:49.297138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:49.297138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:49.297138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:49.297138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:50.130406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:50.166451 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cafc6069-f54d-4272-a5ea-985bd3b376a1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1494 microversion: 2.1 time: 1.141439 Oct 19 07:03:50.170093 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1698/3492] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:49 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1494 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:50.458749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:50.470718 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-446c9894-b39e-46d0-a717-44162cfce94b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1315 microversion: 2.1 time: 1.198089 Oct 19 07:03:50.471975 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1795/3493] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:49 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1315 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:50.758373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd760b81-b770-445d-ad64-71e8bbabb4bb tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Calling method '.version_select at 0x7f6d5fa2b280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:50.842961 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd760b81-b770-445d-ad64-71e8bbabb4bb tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de" status: 200 len: 637 microversion: 2.1 time: 0.089173 Oct 19 07:03:50.854853 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1699/3494] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Oct 19 07:03:50 2022] GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de => generated 637 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:50.860296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-de941ae9-e2b9-4bac-a3b6-9f133567c769 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Action: 'update_all', calling method: .version_select at 0x7f6d68a2c9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:50.958110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=82 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:50.975683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-de941ae9-e2b9-4bac-a3b6-9f133567c769 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:51.004071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-de941ae9-e2b9-4bac-a3b6-9f133567c769 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for user 4157f553d7174ee2a08b5fa7c2b3eeb6 and project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:51.192674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:51.193432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:51.205377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:51.217838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:51.218344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:51.218794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:51.219521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:51.220077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:51.220761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:51.271360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:51.459380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:51.468016 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a5d51f9-9108-4912-9dd3-535673903d93 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1494 microversion: 2.1 time: 0.281516 Oct 19 07:03:51.487657 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1700/3495] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:51 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1494 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:51.499244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:51.502619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:51.507086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:51.507562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:51.508179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:51.508908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:51.509524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:51.510115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:51.650774 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-de941ae9-e2b9-4bac-a3b6-9f133567c769 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 61 microversion: 2.1 time: 0.795329 Oct 19 07:03:51.656526 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1796/3496] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:03:50 2022] PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 61 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:51.662596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0b2a82fb-a41f-4205-95b9-d0386d50e12d req-64e6d6af-a1d0-4e1b-b614-95bec6115be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf28f7b-2526-4c9d-9934-8caa07997eca", "tag": "2fe8604e-4075-4a11-b76b-0fe8bb107f0e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:51.676765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b2a82fb-a41f-4205-95b9-d0386d50e12d req-64e6d6af-a1d0-4e1b-b614-95bec6115be5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:51.678643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b2a82fb-a41f-4205-95b9-d0386d50e12d req-64e6d6af-a1d0-4e1b-b614-95bec6115be5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:51.678643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b2a82fb-a41f-4205-95b9-d0386d50e12d req-64e6d6af-a1d0-4e1b-b614-95bec6115be5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:51.693957 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0b2a82fb-a41f-4205-95b9-d0386d50e12d req-64e6d6af-a1d0-4e1b-b614-95bec6115be5 service nova] Creating event network-changed:2fe8604e-4075-4a11-b76b-0fe8bb107f0e for instance eaf28f7b-2526-4c9d-9934-8caa07997eca on n-h1-861333-10 Oct 19 07:03:51.700481 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0b2a82fb-a41f-4205-95b9-d0386d50e12d req-64e6d6af-a1d0-4e1b-b614-95bec6115be5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042356 Oct 19 07:03:51.701626 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1797/3497] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:51.713063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8c48e9b-b0ac-4411-b9d1-e49a0bb3b938 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Calling method '.version_select at 0x7f6d68a9d8b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:51.911763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:51.928743 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-927532d8-1652-4c26-bb7b-a2488b5189c0 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1315 microversion: 2.1 time: 0.433682 Oct 19 07:03:51.932206 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1701/3498] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:51 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:52.376339 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8c48e9b-b0ac-4411-b9d1-e49a0bb3b938 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "DELETE /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.673233 Oct 19 07:03:52.377397 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1798/3499] 10.222.0.39 () {58 vars in 1296 bytes} [Wed Oct 19 07:03:51 2022] DELETE /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata/os_version => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:03:52.386027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd7e6bdc-03e2-4b2d-84ae-f63590c37f3c tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Calling method '.version_select at 0x7f6d5fa1c9d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:52.478983 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd7e6bdc-03e2-4b2d-84ae-f63590c37f3c tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 37 microversion: 2.1 time: 0.095172 Oct 19 07:03:52.478983 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1702/3500] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 07:03:52 2022] GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 37 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:52.489501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7d2f562-2237-448f-9448-5702f8cc243f tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Action: 'update_all', calling method: .version_select at 0x7f6d68a2ca60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:52.494965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:52.498031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:52.518851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:52.519362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:52.519907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:52.522849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:52.523342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:52.523786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:52.627125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d7d2f562-2237-448f-9448-5702f8cc243f tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:52.649802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d7d2f562-2237-448f-9448-5702f8cc243f tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for user 4157f553d7174ee2a08b5fa7c2b3eeb6 and project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:53.303445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:53.315407 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8d06a1f-9c67-4b53-92d5-69ca3cc12a6d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1500 microversion: 2.1 time: 0.823978 Oct 19 07:03:53.330118 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1703/3501] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:52 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1500 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:53.330118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:53.330622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:53.358277 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7d2f562-2237-448f-9448-5702f8cc243f tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 61 microversion: 2.1 time: 0.873608 Oct 19 07:03:53.362658 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1799/3502] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:03:52 2022] PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 61 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:53.369407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:53.374883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:53.376895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:53.385184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:53.389831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:53.389831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:53.389831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:53.389831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:53.407522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:53.410065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:53.410725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:53.413378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:53.413875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:53.414323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:53.514577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:03:53.602423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:53.613707 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b7a92dc-3ebd-4386-bd6a-e5fc728617cd tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1315 microversion: 2.1 time: 0.287388 Oct 19 07:03:53.614831 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1704/3503] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:53 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:53.634223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b01045f-dac5-4c1b-abc9-bafb62e40b5e tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Calling method '.version_select at 0x7f6d64729550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:53.730191 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b01045f-dac5-4c1b-abc9-bafb62e40b5e tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.113839 Oct 19 07:03:53.730896 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1705/3504] 10.222.0.39 () {58 vars in 1290 bytes} [Wed Oct 19 07:03:53 2022] GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata/os_distro => generated 33 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:53.742160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f47134bd-3275-4cb3-8e57-bc61107480b4 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Action: 'update_all', calling method: .version_select at 0x7f6d5fa0fdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:53.811338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f47134bd-3275-4cb3-8e57-bc61107480b4 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:53.819765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f47134bd-3275-4cb3-8e57-bc61107480b4 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for user 4157f553d7174ee2a08b5fa7c2b3eeb6 and project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:54.012380 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-de321345-7666-450a-9d89-192c392cd6fb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 204 len: 0 microversion: 2.1 time: 0.648357 Oct 19 07:03:54.016756 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1800/3505] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:03:53 2022] DELETE /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:03:54.026295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:54.026295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:54.038647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:54.039182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:54.039627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:54.043003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:54.046755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:54.048323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:54.079291 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f47134bd-3275-4cb3-8e57-bc61107480b4 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 61 microversion: 2.1 time: 0.340577 Oct 19 07:03:54.085147 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1706/3506] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:03:53 2022] PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 61 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:54.091730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55b4908b-b221-433a-89a0-170eef886fcb tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Calling method '.version_select at 0x7f6d645d3430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:54.160779 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55b4908b-b221-433a-89a0-170eef886fcb tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 61 microversion: 2.1 time: 0.074045 Oct 19 07:03:54.170112 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1707/3507] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 07:03:54 2022] GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 61 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:54.187728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4448f59f-ad18-47bc-92f5-518b4fc2ee7b tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Action: 'update_all', calling method: .version_select at 0x7f6d5fa3d310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:54.286066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4448f59f-ad18-47bc-92f5-518b4fc2ee7b tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:54.303121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4448f59f-ad18-47bc-92f5-518b4fc2ee7b tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for user 4157f553d7174ee2a08b5fa7c2b3eeb6 and project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:54.340765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:54.349128 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6613744a-0281-47ff-90db-247422a560eb tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.330861 Oct 19 07:03:54.349899 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1801/3508] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:54 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:54.508558 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4448f59f-ad18-47bc-92f5-518b4fc2ee7b tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 61 microversion: 2.1 time: 0.333492 Oct 19 07:03:54.508558 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1708/3509] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:03:54 2022] PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 61 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:54.515755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aeff72d0-8154-4285-bcbe-9ae957eee5f2 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Action: 'update_all', calling method: .version_select at 0x7f6d5fbf3a60>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:54.583043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-aeff72d0-8154-4285-bcbe-9ae957eee5f2 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:54.613922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-aeff72d0-8154-4285-bcbe-9ae957eee5f2 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for user 4157f553d7174ee2a08b5fa7c2b3eeb6 and project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:54.642561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:54.646412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:54.680564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:54.710613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:54.711789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:54.716668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:54.716668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:54.716668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:55.143518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:55.184519 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48951f76-aa44-48dd-b5dc-4e431222ce1c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1315 microversion: 2.1 time: 0.543929 Oct 19 07:03:55.186698 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1709/3510] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:54 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:55.205320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:55.206814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:55.253166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:55.254642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:55.255301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:55.256506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:55.257432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:55.258136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:55.314058 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aeff72d0-8154-4285-bcbe-9ae957eee5f2 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 64 microversion: 2.1 time: 0.802113 Oct 19 07:03:55.314702 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1802/3511] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:03:54 2022] PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 64 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:55.549456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cd6b6d9-3f1e-43ec-9ba0-d69492de23b1 tempest-AZV2TestJSON-466128883 tempest-AZV2TestJSON-466128883-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:55.549456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd6b6d9-3f1e-43ec-9ba0-d69492de23b1 tempest-AZV2TestJSON-466128883 tempest-AZV2TestJSON-466128883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:55.549456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd6b6d9-3f1e-43ec-9ba0-d69492de23b1 tempest-AZV2TestJSON-466128883 tempest-AZV2TestJSON-466128883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:55.549456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd6b6d9-3f1e-43ec-9ba0-d69492de23b1 tempest-AZV2TestJSON-466128883 tempest-AZV2TestJSON-466128883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:55.550399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd6b6d9-3f1e-43ec-9ba0-d69492de23b1 tempest-AZV2TestJSON-466128883 tempest-AZV2TestJSON-466128883-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:55.551431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd6b6d9-3f1e-43ec-9ba0-d69492de23b1 tempest-AZV2TestJSON-466128883 tempest-AZV2TestJSON-466128883-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:55.552034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd6b6d9-3f1e-43ec-9ba0-d69492de23b1 tempest-AZV2TestJSON-466128883 tempest-AZV2TestJSON-466128883-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:55.586186 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cd6b6d9-3f1e-43ec-9ba0-d69492de23b1 tempest-AZV2TestJSON-466128883 tempest-AZV2TestJSON-466128883-project] 10.222.0.39 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.270415 Oct 19 07:03:55.586895 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1803/3512] 10.222.0.39 () {58 vars in 1164 bytes} [Wed Oct 19 07:03:55 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:55.593279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7d73de4-c5ad-419d-ab66-27f3e279436f tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Calling method '.version_select at 0x7f6d68adca60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:55.653686 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7d73de4-c5ad-419d-ab66-27f3e279436f tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 64 microversion: 2.1 time: 0.065464 Oct 19 07:03:55.664634 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1804/3513] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 07:03:55 2022] GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 64 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:55.676502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:55.677130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:55.687145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:55.687919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:55.691799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:55.693070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:55.693712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:55.694317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:55.885821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:55.895024 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bae4c3c7-a20f-4a34-82b9-10d7fda4425a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.702291 Oct 19 07:03:55.895621 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1710/3514] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:55 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:55.934180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88c7163f-d2ce-4ec7-b14b-750fb9e05d64 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Action: 'update_all', calling method: .version_select at 0x7f6d64025550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:56.046278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-88c7163f-d2ce-4ec7-b14b-750fb9e05d64 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:56.070732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-88c7163f-d2ce-4ec7-b14b-750fb9e05d64 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for user 4157f553d7174ee2a08b5fa7c2b3eeb6 and project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:56.525396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:56.536343 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ae81f0a-0b95-4a33-a0bf-0236a494206e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.876351 Oct 19 07:03:56.537037 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1805/3515] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:55 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:56.541640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4969ad99-d134-49d1-96a5-c9b349b2e9ac tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-577330772"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:56.545282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4969ad99-d134-49d1-96a5-c9b349b2e9ac tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:56.581064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4969ad99-d134-49d1-96a5-c9b349b2e9ac tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:56.581710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4969ad99-d134-49d1-96a5-c9b349b2e9ac tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:56.582062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4969ad99-d134-49d1-96a5-c9b349b2e9ac tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:56.582782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4969ad99-d134-49d1-96a5-c9b349b2e9ac tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:56.583251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4969ad99-d134-49d1-96a5-c9b349b2e9ac tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:56.583680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4969ad99-d134-49d1-96a5-c9b349b2e9ac tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:56.766617 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-88c7163f-d2ce-4ec7-b14b-750fb9e05d64 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 61 microversion: 2.1 time: 0.856692 Oct 19 07:03:56.767659 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1711/3516] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:03:55 2022] PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 61 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:56.772941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:56.773524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:56.790141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:56.790668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:56.794801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:56.796056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:56.798155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:56.798627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:57.110792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:57.114495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:03:57.125254 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a93f73dc-c7d4-469d-9838-a9ba1b7ab951 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1315 microversion: 2.1 time: 0.356417 Oct 19 07:03:57.128919 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1712/3517] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:56 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:57.150492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20e89a8c-7fb5-4bcd-8bf1-062e51065204 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Action: 'update', calling method: .version_select at 0x7f6d5fa0f1f0>, body: {"meta": {"os_version": "alt"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:57.236766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-20e89a8c-7fb5-4bcd-8bf1-062e51065204 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:57.243828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-20e89a8c-7fb5-4bcd-8bf1-062e51065204 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for user 4157f553d7174ee2a08b5fa7c2b3eeb6 and project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:57.429597 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4969ad99-d134-49d1-96a5-c9b349b2e9ac tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.891270 Oct 19 07:03:57.437627 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1806/3518] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:03:56 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 19 07:03:57.565193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:57.566535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:57.573231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:57.574309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:57.574830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:57.575762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:57.576753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:57.577396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:57.804738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:57.826782 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ef44da6-e551-458a-8d55-8d20b65c640e tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1506 microversion: 2.1 time: 0.268146 Oct 19 07:03:57.828024 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1807/3519] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:57 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:03:57.831140 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20e89a8c-7fb5-4bcd-8bf1-062e51065204 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.684382 Oct 19 07:03:57.837369 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1713/3520] 10.222.0.39 () {60 vars in 1313 bytes} [Wed Oct 19 07:03:57 2022] PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata/os_version => generated 31 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:57.842873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cb9ba2b-8ddf-4e62-a2cd-8af099860ab2 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Calling method '.version_select at 0x7f6d5fa5b280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:57.900441 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cb9ba2b-8ddf-4e62-a2cd-8af099860ab2 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 58 microversion: 2.1 time: 0.061604 Oct 19 07:03:57.901369 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1808/3521] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 07:03:57 2022] GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 58 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:57.911921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41bbb4e5-56c5-4015-931b-978babc53c39 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Action: 'update_all', calling method: .version_select at 0x7f6d5fa36e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:57.970436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-41bbb4e5-56c5-4015-931b-978babc53c39 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:57.980385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-41bbb4e5-56c5-4015-931b-978babc53c39 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for user 4157f553d7174ee2a08b5fa7c2b3eeb6 and project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:58.158755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:58.159580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:58.176269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:58.176860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:58.180421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:58.181254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:58.181802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:58.182313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:58.542190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:58.555380 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-caa3d545-3894-48b1-9ee5-5b919a3b4728 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1315 microversion: 2.1 time: 0.401323 Oct 19 07:03:58.556194 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1809/3522] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:58 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:58.612862 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41bbb4e5-56c5-4015-931b-978babc53c39 tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 61 microversion: 2.1 time: 0.705045 Oct 19 07:03:58.614135 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1714/3523] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:03:57 2022] PUT /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 61 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:58.624381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-767acd06-7ed3-4362-8f48-f5f15708a13d tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Action: 'create', calling method: .version_select at 0x7f6d68be1670>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:58.709869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-767acd06-7ed3-4362-8f48-f5f15708a13d tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:03:58.722109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-767acd06-7ed3-4362-8f48-f5f15708a13d tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Getting quotas for user 4157f553d7174ee2a08b5fa7c2b3eeb6 and project 10008ffc0ed14a8bb20a947aa5cbe845. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:03:58.812079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4f6895e2-d538-4c2a-a71d-a5a4b4588571 req-d3c574dd-8531-415c-b93b-63258419d98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "name": "network-vif-unplugged", "status": "completed", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:58.836229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f6895e2-d538-4c2a-a71d-a5a4b4588571 req-d3c574dd-8531-415c-b93b-63258419d98b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:58.836709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f6895e2-d538-4c2a-a71d-a5a4b4588571 req-d3c574dd-8531-415c-b93b-63258419d98b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:58.837723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f6895e2-d538-4c2a-a71d-a5a4b4588571 req-d3c574dd-8531-415c-b93b-63258419d98b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:58.868249 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4f6895e2-d538-4c2a-a71d-a5a4b4588571 req-d3c574dd-8531-415c-b93b-63258419d98b service nova] Creating event network-vif-unplugged:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:03:58.881457 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4f6895e2-d538-4c2a-a71d-a5a4b4588571 req-d3c574dd-8531-415c-b93b-63258419d98b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074310 Oct 19 07:03:58.885434 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1715/3524] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:03:58.897608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:58.898314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:58.916177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:58.918686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:58.919329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:58.921215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:58.922583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:58.925238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:59.230668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:03:59.247299 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a345b2b-e0b5-4ca9-9caa-e2da74afa272 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1464 microversion: 2.1 time: 0.359957 Oct 19 07:03:59.249133 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1716/3525] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:58 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1464 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:03:59.279197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ad8c74e1-fb87-4804-8208-181c8a28aa47 req-4bf74155-a329-487b-b783-80cb9edb91be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45331ac2-d336-45d0-9dc8-7aa7e655b089", "name": "network-vif-deleted", "tag": "403707ee-a10d-4498-97d0-2d584dd43cf6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:03:59.307104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ad8c74e1-fb87-4804-8208-181c8a28aa47 req-4bf74155-a329-487b-b783-80cb9edb91be service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:59.307593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ad8c74e1-fb87-4804-8208-181c8a28aa47 req-4bf74155-a329-487b-b783-80cb9edb91be service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:59.308025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ad8c74e1-fb87-4804-8208-181c8a28aa47 req-4bf74155-a329-487b-b783-80cb9edb91be service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:59.351621 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ad8c74e1-fb87-4804-8208-181c8a28aa47 req-4bf74155-a329-487b-b783-80cb9edb91be service nova] Creating event network-vif-deleted:403707ee-a10d-4498-97d0-2d584dd43cf6 for instance 45331ac2-d336-45d0-9dc8-7aa7e655b089 on n-h2-861333-10 Oct 19 07:03:59.361865 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ad8c74e1-fb87-4804-8208-181c8a28aa47 req-4bf74155-a329-487b-b783-80cb9edb91be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100789 Oct 19 07:03:59.363383 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1717/3526] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:03:59.448992 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-767acd06-7ed3-4362-8f48-f5f15708a13d tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "POST /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 85 microversion: 2.1 time: 0.829512 Oct 19 07:03:59.450560 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1810/3527] 10.222.0.39 () {60 vars in 1281 bytes} [Wed Oct 19 07:03:58 2022] POST /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 85 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:59.462635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17a5ea58-3de3-4005-a715-e4a6bba92dbe tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] Calling method '.version_select at 0x7f6d64c38700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:59.532672 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17a5ea58-3de3-4005-a715-e4a6bba92dbe tempest-ImagesMetadataTestJSON-850238855 tempest-ImagesMetadataTestJSON-850238855-project] 10.222.0.39 "GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata" status: 200 len: 85 microversion: 2.1 time: 0.074580 Oct 19 07:03:59.541114 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1718/3528] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 07:03:59 2022] GET /compute/v2.1/images/1f80e2e7-e8dc-4975-91be-6138978dc2de/metadata => generated 85 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:03:59.583506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:03:59.584390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:03:59.606524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:59.607187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:59.610581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:59.612471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:03:59.612987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:03:59.623575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:03:59.693747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:00.033387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:00.044877 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60982424-76e0-4aac-aba9-548b12ac7c49 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1315 microversion: 2.1 time: 0.466891 Oct 19 07:04:00.045885 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1811/3529] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:03:59 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:00.279610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:00.281540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:00.310796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:00.310796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:00.310796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:00.310796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:00.311247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:00.312277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:00.412742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:00.413572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:00.414320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:00.415943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lazy-loading 'fault' on Instance uuid 45331ac2-d336-45d0-9dc8-7aa7e655b089 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:04:00.571543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:00.584018 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37b17d31-b467-489a-8630-c9707a23ba4d tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 200 len: 1304 microversion: 2.1 time: 0.310286 Oct 19 07:04:00.586726 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1719/3530] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:00 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 1304 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:01.072919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:01.075029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:01.093100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:01.094936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:01.098194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:01.099573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:01.100917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:01.103245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:01.448726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b4a5b90c-fdf4-462e-9771-19c4fe3382fb req-78ee3ec4-296e-4c7f-8693-2b94530e1ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf28f7b-2526-4c9d-9934-8caa07997eca", "name": "network-vif-plugged", "status": "completed", "tag": "2fe8604e-4075-4a11-b76b-0fe8bb107f0e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:01.493482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b4a5b90c-fdf4-462e-9771-19c4fe3382fb req-78ee3ec4-296e-4c7f-8693-2b94530e1ecb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:01.496308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b4a5b90c-fdf4-462e-9771-19c4fe3382fb req-78ee3ec4-296e-4c7f-8693-2b94530e1ecb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:01.499105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b4a5b90c-fdf4-462e-9771-19c4fe3382fb req-78ee3ec4-296e-4c7f-8693-2b94530e1ecb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:01.521406 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b4a5b90c-fdf4-462e-9771-19c4fe3382fb req-78ee3ec4-296e-4c7f-8693-2b94530e1ecb service nova] Creating event network-vif-plugged:2fe8604e-4075-4a11-b76b-0fe8bb107f0e for instance eaf28f7b-2526-4c9d-9934-8caa07997eca on n-h1-861333-10 Oct 19 07:04:01.527038 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b4a5b90c-fdf4-462e-9771-19c4fe3382fb req-78ee3ec4-296e-4c7f-8693-2b94530e1ecb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090599 Oct 19 07:04:01.528788 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1720/3531] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:01.617603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:01.618581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 45331ac2-d336-45d0-9dc8-7aa7e655b089] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:01.639634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:01.641235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:01.642396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:01.644676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:01.646525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:01.647276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:01.648322 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5db91f93-e18b-404a-a5ad-3d348ad40c2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1315 microversion: 2.1 time: 0.581588 Oct 19 07:04:01.649979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:01.653884 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1812/3532] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:01 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:01.682296 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] HTTP exception thrown: Instance 45331ac2-d336-45d0-9dc8-7aa7e655b089 could not be found. Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Request method failure captured: Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 HTTP/1.1 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DMbgfyNeOmowUdAIZJazlLrx5_JzlQ6hTOu7FWwjyDtC3MW4gOr_N5ESlyFzdhYP-8ziIt2_TjD7FCpfMeUYElIOo0zBfixqJCbfT49m8586MaSiLeIM2dm8A1UoX7Iu7lHgRVQcO1y6xEkaKGieSRCEtOKiDzb0gj8HclVRdtxf4 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b3dbcf548a5843b3987aba2aac6028b6 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueTestJSON-1215217453 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3dbcf548a5843b3987aba2aac6028b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3dbcf548a5843b3987aba2aac6028b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3dbcf548a5843b3987aba2aac6028b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3dbcf548a5843b3987aba2aac6028b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueTestJSON-1215217453 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b3dbcf548a5843b3987aba2aac6028b6 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueTestJSON-1215217453 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerRescueTestJSON-1215217453-project Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 260c88b50daf4cdd8048282cea957f93 Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueTestJSON-1215217453-project Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 45331ac2-d336-45d0-9dc8-7aa7e655b089 could not be found. Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '45331ac2-d336-45d0-9dc8-7aa7e655b089'} Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45331ac2-d336-45d0-9dc8-7aa7e655b089 could not be found. Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45331ac2-d336-45d0-9dc8-7aa7e655b089 could not be found. Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:01.695522 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:01.702064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:01.702064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:01.702064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:01.702064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:01.702064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:01.702064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45331ac2-d336-45d0-9dc8-7aa7e655b089 could not be found. Oct 19 07:04:01.702064 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:01.702064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Returning 404 to user: Instance 45331ac2-d336-45d0-9dc8-7aa7e655b089 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:01.703918 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0ed76435-9945-4021-86b1-ea891eaa6546 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089" status: 404 len: 111 microversion: 2.1 time: 0.086323 Oct 19 07:04:01.707310 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1721/3533] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:01 2022] GET /compute/v2.1/servers/45331ac2-d336-45d0-9dc8-7aa7e655b089 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:04:01.715793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:01.716321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:01.727442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:01.728011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:01.732695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:01.733920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:01.735051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:01.735659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:01.774242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:04:02.099574 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6d57e12-058c-44b5-832f-a523a0b69cd9 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 204 len: 0 microversion: 2.1 time: 0.386045 Oct 19 07:04:02.102477 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1813/3534] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:04:01 2022] DELETE /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:04:02.112667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:02.113449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:02.121302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:02.122110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:02.122875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:02.123858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:02.124932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:02.125610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:02.439722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:02.452194 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c07c140-62ff-44c3-a2b8-fc81e2c96783 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1492 microversion: 2.1 time: 0.342221 Oct 19 07:04:02.464193 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1722/3535] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:02 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1492 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:02.686377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:02.691481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:02.715620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:02.716763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:02.720935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:02.724444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:02.725164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:02.728331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:03.104629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:03.114560 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85f5a39f-01f0-4805-b49d-99155e37a602 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1315 microversion: 2.1 time: 0.436452 Oct 19 07:04:03.121869 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1814/3536] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:02 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:03.479605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:03.481711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:03.493496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:03.500759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:03.501452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:03.502426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:03.506069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:03.507337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:03.993647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:04.005596 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63aeb9a4-6fc3-46d7-bae7-ddd63a857803 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1492 microversion: 2.1 time: 0.530498 Oct 19 07:04:04.016335 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1723/3537] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:03 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1492 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:04.148432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:04.149044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:04.163483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:04.167334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:04.169824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:04.174986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:04.174986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:04.174986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:04.848638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:04.864140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9d8a2c9-ddd1-454b-a218-63efc3d83a66 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1503 microversion: 2.1 time: 0.715035 Oct 19 07:04:04.865165 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1815/3538] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:04 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1503 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:04.891261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2055224906"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:04.895099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:04.912162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:04.912928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:04.913539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:04.915347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:04.921877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:04.922774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:05.322748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3794c938-1cc5-42e6-a121-3f6f32309982 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Calling method '.version_select at 0x7f6d68aade50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:05.386001 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3794c938-1cc5-42e6-a121-3f6f32309982 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] HTTP exception thrown: Image not found. Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3794c938-1cc5-42e6-a121-3f6f32309982 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Request method failure captured: Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/f0755064-19ba-4c23-bb5d-f2baf9e9902a/metadata/os_distro HTTP/1.1 Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FkqS42F_j0rVrySVj5-2SmPrpqtgRMuwEXs1_qtDXCmwgtIZuUPHJcllwfK4tj1kWRueF79XaeDkBWf927o_c16aRR5rGRw6OvA5v-A8p17d17YWEixY2dWUy59iWx7K0Iv8J4_PMq7Le7rgSjyF-xTqTh0U9XzZoJWpwk5e8trmI Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_be6ff980882d4cc0992d7a70d447d003", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 481fbb373caa465dbc782d022fda01dd Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'image_id': 'f0755064-19ba-4c23-bb5d-f2baf9e9902a', 'id': 'os_distro'} Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f0755064-19ba-4c23-bb5d-f2baf9e9902a Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 07:04:05.398732 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0755064-19ba-4c23-bb5d-f2baf9e9902a could not be found. Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:04:05.407086 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:05.417682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3794c938-1cc5-42e6-a121-3f6f32309982 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:05.421245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3794c938-1cc5-42e6-a121-3f6f32309982 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] 10.222.0.39 "DELETE /compute/v2.1/images/f0755064-19ba-4c23-bb5d-f2baf9e9902a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.400526 Oct 19 07:04:05.428495 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1816/3539] 10.222.0.39 () {58 vars in 1293 bytes} [Wed Oct 19 07:04:05 2022] DELETE /compute/v2.1/images/f0755064-19ba-4c23-bb5d-f2baf9e9902a/metadata/os_distro => generated 62 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:04:05.435880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:05.446240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:05.460690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:05.463438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:05.468706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:05.469735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:05.470390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:05.471045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:05.566240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:05.584723 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.network.security_group_api [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Adding security group bf3be404-9cea-4714-8989-4973f5fe39b4 to port 2fe8604e-4075-4a11-b76b-0fe8bb107f0e Oct 19 07:04:06.618357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:06.629736 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38ac9690-fbdb-43d9-9257-6e66115bf9f1 tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1492 microversion: 2.1 time: 1.203352 Oct 19 07:04:06.654640 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1817/3540] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:05 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1492 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:06.685122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54581372-ec78-4659-8382-e0186a401ccd tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Calling method '.version_select at 0x7f6d5fa564c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:06.735247 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-54581372-ec78-4659-8382-e0186a401ccd tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] HTTP exception thrown: Image not found. Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54581372-ec78-4659-8382-e0186a401ccd tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Request method failure captured: Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/images/742d412f-2651-4fd7-9a04-ce0971bba0ac/metadata/os_version HTTP/1.1 Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FkqS42F_j0rVrySVj5-2SmPrpqtgRMuwEXs1_qtDXCmwgtIZuUPHJcllwfK4tj1kWRueF79XaeDkBWf927o_c16aRR5rGRw6OvA5v-A8p17d17YWEixY2dWUy59iWx7K0Iv8J4_PMq7Le7rgSjyF-xTqTh0U9XzZoJWpwk5e8trmI Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_be6ff980882d4cc0992d7a70d447d003", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 481fbb373caa465dbc782d022fda01dd Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'image_id': '742d412f-2651-4fd7-9a04-ce0971bba0ac', 'id': 'os_version'} Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 742d412f-2651-4fd7-9a04-ce0971bba0ac Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 07:04:06.737811 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 742d412f-2651-4fd7-9a04-ce0971bba0ac could not be found. Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.742010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54581372-ec78-4659-8382-e0186a401ccd tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:06.756874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54581372-ec78-4659-8382-e0186a401ccd tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] 10.222.0.39 "GET /compute/v2.1/images/742d412f-2651-4fd7-9a04-ce0971bba0ac/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.075828 Oct 19 07:04:06.756874 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1818/3541] 10.222.0.39 () {58 vars in 1293 bytes} [Wed Oct 19 07:04:06 2022] GET /compute/v2.1/images/742d412f-2651-4fd7-9a04-ce0971bba0ac/metadata/os_version => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:04:06.760911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec06b659-b303-4793-adc2-f2187a1055d9 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Calling method '.version_select at 0x7f6d5fa5b790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:06.805898 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ec06b659-b303-4793-adc2-f2187a1055d9 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] HTTP exception thrown: Image not found. Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec06b659-b303-4793-adc2-f2187a1055d9 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Request method failure captured: Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/images/a9bd9f71-f21f-4976-993a-40b4f3053bf0/metadata HTTP/1.1 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FkqS42F_j0rVrySVj5-2SmPrpqtgRMuwEXs1_qtDXCmwgtIZuUPHJcllwfK4tj1kWRueF79XaeDkBWf927o_c16aRR5rGRw6OvA5v-A8p17d17YWEixY2dWUy59iWx7K0Iv8J4_PMq7Le7rgSjyF-xTqTh0U9XzZoJWpwk5e8trmI Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_be6ff980882d4cc0992d7a70d447d003", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 481fbb373caa465dbc782d022fda01dd Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'image_id': 'a9bd9f71-f21f-4976-993a-40b4f3053bf0'} Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a9bd9f71-f21f-4976-993a-40b4f3053bf0 Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 07:04:06.809602 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9bd9f71-f21f-4976-993a-40b4f3053bf0 could not be found. Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:04:06.814460 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.821561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec06b659-b303-4793-adc2-f2187a1055d9 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:06.821561 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec06b659-b303-4793-adc2-f2187a1055d9 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] 10.222.0.39 "GET /compute/v2.1/images/a9bd9f71-f21f-4976-993a-40b4f3053bf0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.064683 Oct 19 07:04:06.822099 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1819/3542] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 07:04:06 2022] GET /compute/v2.1/images/a9bd9f71-f21f-4976-993a-40b4f3053bf0/metadata => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:04:06.833753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-067deec3-eebb-48ee-a82e-27b46b20f35b tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Action: 'update_all', calling method: .version_select at 0x7f6d5fa56dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:06.931970 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-067deec3-eebb-48ee-a82e-27b46b20f35b tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] HTTP exception thrown: Image not found. Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-067deec3-eebb-48ee-a82e-27b46b20f35b tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Request method failure captured: Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/images/8424e5c3-b07e-429d-b249-06dc734bcc7b/metadata HTTP/1.1 Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 57 Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FkqS42F_j0rVrySVj5-2SmPrpqtgRMuwEXs1_qtDXCmwgtIZuUPHJcllwfK4tj1kWRueF79XaeDkBWf927o_c16aRR5rGRw6OvA5v-A8p17d17YWEixY2dWUy59iWx7K0Iv8J4_PMq7Le7rgSjyF-xTqTh0U9XzZoJWpwk5e8trmI Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_be6ff980882d4cc0992d7a70d447d003", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 481fbb373caa465dbc782d022fda01dd Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'image_id': '8424e5c3-b07e-429d-b249-06dc734bcc7b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8424e5c3-b07e-429d-b249-06dc734bcc7b Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 07:04:06.934265 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8424e5c3-b07e-429d-b249-06dc734bcc7b could not be found. Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:06.940431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-067deec3-eebb-48ee-a82e-27b46b20f35b tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:06.945962 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-067deec3-eebb-48ee-a82e-27b46b20f35b tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] 10.222.0.39 "PUT /compute/v2.1/images/8424e5c3-b07e-429d-b249-06dc734bcc7b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.110434 Oct 19 07:04:06.945962 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1820/3543] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:04:06 2022] PUT /compute/v2.1/images/8424e5c3-b07e-429d-b249-06dc734bcc7b/metadata => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:04:06.969718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2682e31-f61f-492b-8f63-788fde0d0c64 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Action: 'update', calling method: .version_select at 0x7f6d64db35e0>, body: {"meta": {"os_distro": "alt"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:07.003930 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-446f1b49-80c7-4cb7-bec9-883dd56ffab8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca/action" status: 202 len: 0 microversion: 2.1 time: 2.120005 Oct 19 07:04:07.005128 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1724/3544] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:04:04 2022] POST /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca/action => generated 0 bytes in 2122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:04:07.013528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a53148c0-659e-4787-ac34-05d284f49d7a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa28f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:07.044761 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b2682e31-f61f-492b-8f63-788fde0d0c64 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] HTTP exception thrown: Image not found. Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2682e31-f61f-492b-8f63-788fde0d0c64 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Request method failure captured: Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/images/d13f6fa2-49ee-4434-a1fe-c4cedc133418/metadata/os_distro HTTP/1.1 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 30 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FkqS42F_j0rVrySVj5-2SmPrpqtgRMuwEXs1_qtDXCmwgtIZuUPHJcllwfK4tj1kWRueF79XaeDkBWf927o_c16aRR5rGRw6OvA5v-A8p17d17YWEixY2dWUy59iWx7K0Iv8J4_PMq7Le7rgSjyF-xTqTh0U9XzZoJWpwk5e8trmI Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_be6ff980882d4cc0992d7a70d447d003", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 481fbb373caa465dbc782d022fda01dd Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: {"meta": {"os_distro": "alt"}} Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'image_id': 'd13f6fa2-49ee-4434-a1fe-c4cedc133418', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d13f6fa2-49ee-4434-a1fe-c4cedc133418 Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 07:04:07.047704 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d13f6fa2-49ee-4434-a1fe-c4cedc133418 could not be found. Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2682e31-f61f-492b-8f63-788fde0d0c64 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:07.053048 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2682e31-f61f-492b-8f63-788fde0d0c64 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] 10.222.0.39 "PUT /compute/v2.1/images/d13f6fa2-49ee-4434-a1fe-c4cedc133418/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.101851 Oct 19 07:04:07.059556 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1821/3545] 10.222.0.39 () {60 vars in 1310 bytes} [Wed Oct 19 07:04:06 2022] PUT /compute/v2.1/images/d13f6fa2-49ee-4434-a1fe-c4cedc133418/metadata/os_distro => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:04:07.074338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7ccf43f4-331b-4657-bb11-a5e0b56b67c3 req-c629d1c8-185a-4f7a-ace9-fe3ba3b7dddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf28f7b-2526-4c9d-9934-8caa07997eca", "tag": "2fe8604e-4075-4a11-b76b-0fe8bb107f0e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:07.121641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7ccf43f4-331b-4657-bb11-a5e0b56b67c3 req-c629d1c8-185a-4f7a-ace9-fe3ba3b7dddb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:07.122160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7ccf43f4-331b-4657-bb11-a5e0b56b67c3 req-c629d1c8-185a-4f7a-ace9-fe3ba3b7dddb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:07.122617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7ccf43f4-331b-4657-bb11-a5e0b56b67c3 req-c629d1c8-185a-4f7a-ace9-fe3ba3b7dddb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:07.188906 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7ccf43f4-331b-4657-bb11-a5e0b56b67c3 req-c629d1c8-185a-4f7a-ace9-fe3ba3b7dddb service nova] Creating event network-changed:2fe8604e-4075-4a11-b76b-0fe8bb107f0e for instance eaf28f7b-2526-4c9d-9934-8caa07997eca on n-h1-861333-10 Oct 19 07:04:07.243298 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7ccf43f4-331b-4657-bb11-a5e0b56b67c3 req-c629d1c8-185a-4f7a-ace9-fe3ba3b7dddb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184846 Oct 19 07:04:07.248753 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1822/3546] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:07.309241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d402120-920d-4fb2-b013-120d2af0e553 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Action: 'create', calling method: .version_select at 0x7f6d5fa56c10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:07.391476 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7d402120-920d-4fb2-b013-120d2af0e553 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] HTTP exception thrown: Image not found. Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d402120-920d-4fb2-b013-120d2af0e553 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Request method failure captured: Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/images/2a0cf20e-33c2-4afe-8494-7995f55bda68/metadata HTTP/1.1 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 57 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FkqS42F_j0rVrySVj5-2SmPrpqtgRMuwEXs1_qtDXCmwgtIZuUPHJcllwfK4tj1kWRueF79XaeDkBWf927o_c16aRR5rGRw6OvA5v-A8p17d17YWEixY2dWUy59iWx7K0Iv8J4_PMq7Le7rgSjyF-xTqTh0U9XzZoJWpwk5e8trmI Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/be6ff980882d4cc0992d7a70d447d003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_be6ff980882d4cc0992d7a70d447d003", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: be6ff980882d4cc0992d7a70d447d003 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-344723011 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 481fbb373caa465dbc782d022fda01dd Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-344723011-project Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: exception: Image not found. Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'image_id': '2a0cf20e-33c2-4afe-8494-7995f55bda68', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2a0cf20e-33c2-4afe-8494-7995f55bda68 Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 07:04:07.397761 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2a0cf20e-33c2-4afe-8494-7995f55bda68 could not be found. Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d402120-920d-4fb2-b013-120d2af0e553 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d402120-920d-4fb2-b013-120d2af0e553 tempest-ImagesMetadataNegativeTestJSON-344723011 tempest-ImagesMetadataNegativeTestJSON-344723011-project] 10.222.0.39 "POST /compute/v2.1/images/2a0cf20e-33c2-4afe-8494-7995f55bda68/metadata" status: 404 len: 62 microversion: 2.1 time: 0.138757 Oct 19 07:04:07.403505 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1823/3547] 10.222.0.39 () {60 vars in 1281 bytes} [Wed Oct 19 07:04:07 2022] POST /compute/v2.1/images/2a0cf20e-33c2-4afe-8494-7995f55bda68/metadata => generated 62 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:04:07.659313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:07.660075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:07.677056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:07.688001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:07.688516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:07.689294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:07.697595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:07.698798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:07.856152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:07.858496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:07.859235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:07.864754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lazy-loading 'fault' on Instance uuid 4f796c13-81fd-477b-9bc4-cd4abd638858 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:04:07.990775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=20 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:08.015332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-a53148c0-659e-4787-ac34-05d284f49d7a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group bf3be404-9cea-4714-8989-4973f5fe39b4 in use.", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:04:08.016086 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a53148c0-659e-4787-ac34-05d284f49d7a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security Group bf3be404-9cea-4714-8989-4973f5fe39b4 in use. Oct 19 07:04:08.016086 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-95693d97-1e2e-4b0c-bd6e-efc498104c91'] Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a53148c0-659e-4787-ac34-05d284f49d7a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/bf3be404-9cea-4714-8989-4973f5fe39b4 HTTP/1.1 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: exception: Security Group bf3be404-9cea-4714-8989-4973f5fe39b4 in use. Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-95693d97-1e2e-4b0c-bd6e-efc498104c91'] Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'bf3be404-9cea-4714-8989-4973f5fe39b4'} Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:04:08.018763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group bf3be404-9cea-4714-8989-4973f5fe39b4 in use. Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95693d97-1e2e-4b0c-bd6e-efc498104c91'] Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group bf3be404-9cea-4714-8989-4973f5fe39b4 in use. Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95693d97-1e2e-4b0c-bd6e-efc498104c91'] Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group bf3be404-9cea-4714-8989-4973f5fe39b4 in use. Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95693d97-1e2e-4b0c-bd6e-efc498104c91'] Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group bf3be404-9cea-4714-8989-4973f5fe39b4 in use. Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95693d97-1e2e-4b0c-bd6e-efc498104c91'] Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a53148c0-659e-4787-ac34-05d284f49d7a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 400 to user: Security Group bf3be404-9cea-4714-8989-4973f5fe39b4 in use. Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-95693d97-1e2e-4b0c-bd6e-efc498104c91'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a53148c0-659e-4787-ac34-05d284f49d7a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/bf3be404-9cea-4714-8989-4973f5fe39b4" status: 400 len: 185 microversion: 2.1 time: 1.011749 Oct 19 07:04:08.023318 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1725/3548] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:07 2022] DELETE /compute/v2.1/os-security-groups/bf3be404-9cea-4714-8989-4973f5fe39b4 => generated 185 bytes in 1013 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:04:08.031800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-577cd5d7-4d30-410f-bbc5-578875903722 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:08.044439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-577cd5d7-4d30-410f-bbc5-578875903722 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:08.074626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-577cd5d7-4d30-410f-bbc5-578875903722 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:08.075065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-577cd5d7-4d30-410f-bbc5-578875903722 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:08.080019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-577cd5d7-4d30-410f-bbc5-578875903722 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:08.082578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-577cd5d7-4d30-410f-bbc5-578875903722 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:08.084264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-577cd5d7-4d30-410f-bbc5-578875903722 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:08.084769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-577cd5d7-4d30-410f-bbc5-578875903722 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:08.183891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260c88b50daf4cdd8048282cea957f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3dbcf548a5843b3987aba2aac6028b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:08.197830 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3212b123-6cff-4cfe-90e7-ab706c827e8b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 200 len: 1303 microversion: 2.1 time: 0.543881 Oct 19 07:04:08.227290 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1824/3549] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:07 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 1303 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:08.481310 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-577cd5d7-4d30-410f-bbc5-578875903722 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca/action" status: 202 len: 0 microversion: 2.1 time: 0.454918 Oct 19 07:04:08.482131 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1726/3550] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:04:08 2022] POST /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:04:08.498398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:08.500240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:08.528394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:08.529340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:08.530913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:08.534791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:08.535549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:08.536691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:08.746774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:08.972749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1383441952", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "737f0953-92be-4377-a7d8-73cd2ce52ac7"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:09.080996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] validate_networks() for [('737f0953-92be-4377-a7d8-73cd2ce52ac7', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:04:09.514052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:09.523627 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf82e448-3b2a-456f-8869-087f529ad4d6 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1574 microversion: 2.1 time: 1.037141 Oct 19 07:04:09.529506 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1825/3551] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:08 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1574 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:09.542204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:09.542975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] [instance: 4f796c13-81fd-477b-9bc4-cd4abd638858] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:09.559371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:09.559873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:09.562160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:09.563105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:09.564719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:09.567572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:09.608465 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] HTTP exception thrown: Instance 4f796c13-81fd-477b-9bc4-cd4abd638858 could not be found. Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Request method failure captured: Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 HTTP/1.1 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6DMbgfyNeOmowUdAIZJazlLrx5_JzlQ6hTOu7FWwjyDtC3MW4gOr_N5ESlyFzdhYP-8ziIt2_TjD7FCpfMeUYElIOo0zBfixqJCbfT49m8586MaSiLeIM2dm8A1UoX7Iu7lHgRVQcO1y6xEkaKGieSRCEtOKiDzb0gj8HclVRdtxf4 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b3dbcf548a5843b3987aba2aac6028b6 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueTestJSON-1215217453 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3dbcf548a5843b3987aba2aac6028b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3dbcf548a5843b3987aba2aac6028b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3dbcf548a5843b3987aba2aac6028b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3dbcf548a5843b3987aba2aac6028b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueTestJSON-1215217453 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b3dbcf548a5843b3987aba2aac6028b6 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueTestJSON-1215217453 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueTestJSON-1215217453-project Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 260c88b50daf4cdd8048282cea957f93 Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueTestJSON-1215217453-project Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 4f796c13-81fd-477b-9bc4-cd4abd638858 could not be found. Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '4f796c13-81fd-477b-9bc4-cd4abd638858'} Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f796c13-81fd-477b-9bc4-cd4abd638858 could not be found. Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f796c13-81fd-477b-9bc4-cd4abd638858 could not be found. Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:09.610115 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:09.616221 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:09.616221 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:09.616221 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:09.616221 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:09.616221 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:09.616221 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f796c13-81fd-477b-9bc4-cd4abd638858 could not be found. Oct 19 07:04:09.616221 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:09.616221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] Returning 404 to user: Instance 4f796c13-81fd-477b-9bc4-cd4abd638858 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:09.616221 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03ccf0b2-4090-48db-87d9-7d83ac48684b tempest-ServerRescueTestJSON-1215217453 tempest-ServerRescueTestJSON-1215217453-project] 10.222.0.39 "GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858" status: 404 len: 111 microversion: 2.1 time: 0.084580 Oct 19 07:04:09.616925 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1826/3552] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:09 2022] GET /compute/v2.1/servers/4f796c13-81fd-477b-9bc4-cd4abd638858 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:09.931659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e2ea3e8a-4f35-41f3-acfb-f98183c035d1 req-12fedc21-4bce-4583-82b9-cda63510c148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f796c13-81fd-477b-9bc4-cd4abd638858", "name": "network-vif-deleted", "tag": "cbebb461-c975-4224-b923-3bf36717886f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:09.956932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e2ea3e8a-4f35-41f3-acfb-f98183c035d1 req-12fedc21-4bce-4583-82b9-cda63510c148 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:09.957726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e2ea3e8a-4f35-41f3-acfb-f98183c035d1 req-12fedc21-4bce-4583-82b9-cda63510c148 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:09.958331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e2ea3e8a-4f35-41f3-acfb-f98183c035d1 req-12fedc21-4bce-4583-82b9-cda63510c148 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:09.992893 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e2ea3e8a-4f35-41f3-acfb-f98183c035d1 req-12fedc21-4bce-4583-82b9-cda63510c148 service nova] Creating event network-vif-deleted:cbebb461-c975-4224-b923-3bf36717886f for instance 4f796c13-81fd-477b-9bc4-cd4abd638858 on n-h2-861333-10 Oct 19 07:04:10.007625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e2ea3e8a-4f35-41f3-acfb-f98183c035d1 req-12fedc21-4bce-4583-82b9-cda63510c148 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076649 Oct 19 07:04:10.009991 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1827/3553] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:04:10.230216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-739bf333-fcc6-4392-a766-de6e0f3ca323 req-df4ccaf3-5f72-4c28-9a6f-afe875767e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "name": "network-vif-plugged", "status": "completed", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:10.258643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-739bf333-fcc6-4392-a766-de6e0f3ca323 req-df4ccaf3-5f72-4c28-9a6f-afe875767e69 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:10.259495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-739bf333-fcc6-4392-a766-de6e0f3ca323 req-df4ccaf3-5f72-4c28-9a6f-afe875767e69 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:10.261686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-739bf333-fcc6-4392-a766-de6e0f3ca323 req-df4ccaf3-5f72-4c28-9a6f-afe875767e69 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:10.311137 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-739bf333-fcc6-4392-a766-de6e0f3ca323 req-df4ccaf3-5f72-4c28-9a6f-afe875767e69 service nova] Creating event network-vif-plugged:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:04:10.336689 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-739bf333-fcc6-4392-a766-de6e0f3ca323 req-df4ccaf3-5f72-4c28-9a6f-afe875767e69 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104297 Oct 19 07:04:10.337912 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1828/3554] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:04:10.555911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:10.559487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:10.575159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:10.575957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:10.576610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:10.582510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:10.582510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:10.584646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:11.203333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:11.234253 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c9d40733-50e7-4309-a5fb-024dfd91ad37 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1574 microversion: 2.1 time: 0.682347 Oct 19 07:04:11.238955 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1829/3555] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:10 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1574 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:12.265133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:12.265776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:12.281140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:12.281636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:12.295658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:12.296614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:12.299558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:12.301904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:12.797304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:04:12.797780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:04:12.798276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:04:12.798693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:04:12.799677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:04:12.875828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:12.883055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:12.888221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:12.890583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:12.891270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:12.893237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:13.007676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:04:13.046323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for user 44114105ac6d4e1daf262bbd4b212f5e and project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:04:13.118717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:04:13.118717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:04:13.347219 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15a16cfa-aed2-40d9-900c-7ace14dcf544 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.725736 Oct 19 07:04:13.348601 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1727/3556] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:04:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:04:13.360622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5fb8dde-0566-4095-8444-9f10e41fc2ee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:13.366521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5fb8dde-0566-4095-8444-9f10e41fc2ee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:13.725949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5fb8dde-0566-4095-8444-9f10e41fc2ee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:13.742836 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5fb8dde-0566-4095-8444-9f10e41fc2ee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1215 microversion: 2.1 time: 0.382451 Oct 19 07:04:13.743757 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1728/3557] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:13 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1215 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:13.880863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:13.891321 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d71e9eba-bac9-4040-b638-8cf9692d2a4c tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1574 microversion: 2.1 time: 1.630081 Oct 19 07:04:13.897406 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1830/3558] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:12 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1574 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:14.770074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-824e851e-34d8-4881-9609-9370c6eab005 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:14.770672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-824e851e-34d8-4881-9609-9370c6eab005 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:14.797399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:14.927185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:14.927811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:14.940452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:14.940951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:14.941484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:14.965459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:14.965971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:14.966423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:15.029906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-824e851e-34d8-4881-9609-9370c6eab005 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:15.039818 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-824e851e-34d8-4881-9609-9370c6eab005 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1215 microversion: 2.1 time: 0.272237 Oct 19 07:04:15.045540 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1729/3559] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:14 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1215 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:15.430081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:15.449392 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2b0589c-0c33-490f-91d7-0d970faa7107 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1574 microversion: 2.1 time: 0.527932 Oct 19 07:04:15.452947 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1831/3560] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:14 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1574 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:16.070644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:16.072524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:16.091751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:16.098601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:16.099563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:16.103919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:16.108796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:16.110777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:16.222916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:16.238127 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35f65abb-f830-408f-b578-681774d32cc6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1211 microversion: 2.1 time: 0.174834 Oct 19 07:04:16.241100 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1730/3561] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:16 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1211 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:16.477465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:16.478994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:16.493694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:16.494536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:16.496362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:16.502359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:16.502359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:16.502359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:17.265775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:17.267058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:17.280942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:17.282441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:17.283104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:17.284056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:17.284931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:17.285695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:17.585308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:17.600054 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da572970-0005-4438-87bb-01fc646cf2c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1275 microversion: 2.1 time: 0.336902 Oct 19 07:04:17.605303 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1731/3562] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:17 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1275 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:17.723893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:17.732425 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27615f1c-3889-4dcb-914e-8f7da31a6d64 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1572 microversion: 2.1 time: 1.259869 Oct 19 07:04:17.733012 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1832/3563] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:16 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1572 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:17.762453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1683792230"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:17.763270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:17.773500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:17.775826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:17.778062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:17.779009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:17.780785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:17.782205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:18.581185 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.network.security_group_api [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Adding security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd to port 2fe8604e-4075-4a11-b76b-0fe8bb107f0e Oct 19 07:04:18.695377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-691271142", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "aa98d310-8817-4289-89a3-cd40fe3b1024"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:18.809897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] validate_networks() for [('aa98d310-8817-4289-89a3-cd40fe3b1024', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:04:20.853553 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc8b3092-0a54-4d57-89a3-867fdee719f8 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca/action" status: 202 len: 0 microversion: 2.1 time: 3.092280 Oct 19 07:04:20.853553 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1732/3564] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:04:17 2022] POST /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca/action => generated 0 bytes in 3094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:04:20.855029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:20.855642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:20.862418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:20.862920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:20.863357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:20.864071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:20.864550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:20.864979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:21.381543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:04:21.383068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:04:21.388572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:04:21.388572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:04:21.388572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:04:21.413972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:21.417311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:21.417311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:21.417311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:21.417311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:21.417311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:21.476371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:21.510047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Getting quotas for project 58b219af459e4952859c28e03e081f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:04:21.546315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Getting quotas for user cc8adbb04351494aba53855be51a6565 and project 58b219af459e4952859c28e03e081f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:04:21.581655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:04:21.585936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:04:21.806749 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.320489 Oct 19 07:04:21.819164 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1833/3565] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 07:04:21.824236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f5b0d19-a365-4085-b25e-2b5cc2ff1355 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa6aee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:22.393680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-2f5b0d19-a365-4085-b25e-2b5cc2ff1355 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd in use.", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:04:22.394376 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2f5b0d19-a365-4085-b25e-2b5cc2ff1355 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security Group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd in use. Oct 19 07:04:22.394376 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-89b19586-0b9b-4573-9a05-4ccbb6428268'] Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f5b0d19-a365-4085-b25e-2b5cc2ff1355 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/9f49ce75-df7d-4052-bf2e-a2be5abe2acd HTTP/1.1 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: exception: Security Group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd in use. Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-89b19586-0b9b-4573-9a05-4ccbb6428268'] Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '9f49ce75-df7d-4052-bf2e-a2be5abe2acd'} Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:04:22.396534 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd in use. Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89b19586-0b9b-4573-9a05-4ccbb6428268'] Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd in use. Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89b19586-0b9b-4573-9a05-4ccbb6428268'] Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd in use. Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89b19586-0b9b-4573-9a05-4ccbb6428268'] Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd in use. Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89b19586-0b9b-4573-9a05-4ccbb6428268'] Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f5b0d19-a365-4085-b25e-2b5cc2ff1355 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 400 to user: Security Group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd in use. Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-89b19586-0b9b-4573-9a05-4ccbb6428268'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f5b0d19-a365-4085-b25e-2b5cc2ff1355 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9f49ce75-df7d-4052-bf2e-a2be5abe2acd" status: 400 len: 185 microversion: 2.1 time: 0.577630 Oct 19 07:04:22.401475 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1834/3566] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:21 2022] DELETE /compute/v2.1/os-security-groups/9f49ce75-df7d-4052-bf2e-a2be5abe2acd => generated 185 bytes in 579 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:04:22.409805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2aff8166-de36-45bf-a739-f85b205a69e3 req-883c090a-8614-4df3-baab-7faaf7451b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf28f7b-2526-4c9d-9934-8caa07997eca", "tag": "2fe8604e-4075-4a11-b76b-0fe8bb107f0e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:22.468429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2aff8166-de36-45bf-a739-f85b205a69e3 req-883c090a-8614-4df3-baab-7faaf7451b61 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:22.468925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2aff8166-de36-45bf-a739-f85b205a69e3 req-883c090a-8614-4df3-baab-7faaf7451b61 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:22.469446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2aff8166-de36-45bf-a739-f85b205a69e3 req-883c090a-8614-4df3-baab-7faaf7451b61 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:22.494685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2aff8166-de36-45bf-a739-f85b205a69e3 req-883c090a-8614-4df3-baab-7faaf7451b61 service nova] Creating event network-changed:2fe8604e-4075-4a11-b76b-0fe8bb107f0e for instance eaf28f7b-2526-4c9d-9934-8caa07997eca on n-h1-861333-10 Oct 19 07:04:22.514148 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2aff8166-de36-45bf-a739-f85b205a69e3 req-883c090a-8614-4df3-baab-7faaf7451b61 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114413 Oct 19 07:04:22.515084 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1835/3567] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:22.521062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-437ce13b-fe5a-4ac2-aff6-a40e1333089d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:22.522017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-437ce13b-fe5a-4ac2-aff6-a40e1333089d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:22.645868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-437ce13b-fe5a-4ac2-aff6-a40e1333089d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:22.654320 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-437ce13b-fe5a-4ac2-aff6-a40e1333089d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1216 microversion: 2.1 time: 0.137816 Oct 19 07:04:22.654916 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1836/3568] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:22 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:22.670481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:22.675699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:22.704155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:22.704689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:22.705187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:22.730311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:22.730820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:22.731278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:22.826168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:04:22.839602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:22.922992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:23.051084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:23.064981 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd935adc-3bb9-4b64-ba9c-ae00bf0a432b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 2.209059 Oct 19 07:04:23.067639 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1733/3569] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:20 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:23.513397 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6384b718-6ecc-4d23-a34d-81ea3472e5ca tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 204 len: 0 microversion: 2.1 time: 0.854202 Oct 19 07:04:23.524913 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1837/3570] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:04:22 2022] DELETE /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 0 bytes in 857 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:04:23.525780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:23.526584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:23.546937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:23.547919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:23.551237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:23.553758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:23.555191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:23.556958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:23.686322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-56386f03-b6b0-4949-8399-e4c20196ae5d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:23.687346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-56386f03-b6b0-4949-8399-e4c20196ae5d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:23.822201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-56386f03-b6b0-4949-8399-e4c20196ae5d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:23.836863 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-56386f03-b6b0-4949-8399-e4c20196ae5d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1216 microversion: 2.1 time: 0.161079 Oct 19 07:04:23.857459 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1838/3571] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:23 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:24.095322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:24.100041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:24.134031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:24.140481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:24.143476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:24.144694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:24.145164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:24.159770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:24.445415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:24.457728 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a082176d-72a9-47a4-8e37-786e9ff8aaf4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.370691 Oct 19 07:04:24.459574 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1839/3572] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:24 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:24.864342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:24.865873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:24.894446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:24.905292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:24.907474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:24.912753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:24.912753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:24.912753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:25.042240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:25.151374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:25.178788 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2faed9c1-1b63-4b60-8085-e5e3a891a8b1 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1212 microversion: 2.1 time: 0.315998 Oct 19 07:04:25.195150 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1840/3573] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:24 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1212 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:25.485872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:25.486872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:25.504436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:25.505635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:25.507475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:25.509767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:25.510256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:25.510696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:25.791834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:25.800584 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4366eab0-2ef6-4bc2-84d8-29e9d82d07f2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.319642 Oct 19 07:04:25.802860 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1841/3574] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:25 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:26.208522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:26.210329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:26.230442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:26.230946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:26.239604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:26.239604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:26.239604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:26.247577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:26.520809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:26.532579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2e7a02c-0cf9-4d48-9015-202bec06d8b3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1276 microversion: 2.1 time: 0.328666 Oct 19 07:04:26.535655 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1842/3575] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:26 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1276 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:26.826845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:26.827635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:26.836237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:26.837647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:26.838420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:26.840606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:26.841977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:26.843187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:27.097900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:27.108076 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ef2a1d8-7a78-4c81-a711-bc5309491bcd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.283333 Oct 19 07:04:27.110250 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1843/3576] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:26 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:27.359837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1714356775", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:27.396030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:27.410515 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5acce33-a8a2-4a7d-b7be-88cd8b3cb035 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1647 microversion: 2.1 time: 3.886136 Oct 19 07:04:27.418361 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1734/3577] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:23 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1647 bytes in 3898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:27.499393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:04:27.500451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:04:27.501275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:04:27.501862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:04:27.508282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:04:27.529219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:27.530226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:27.530850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:27.531869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:27.533833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:27.534496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:27.559412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:27.560032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:27.580555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Getting quotas for project a1ec95f262ea469a954994616433d9e2. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:04:27.580974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:27.581467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:27.581904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:27.582611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:27.583088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:27.584057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:27.592679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Getting quotas for user 90dc2516c2f04264905fe35cf11f4b90 and project a1ec95f262ea469a954994616433d9e2. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:04:27.616148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:04:27.623752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:04:27.868222 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d023dd4-742f-47c1-b87f-8024de866f0b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.749920 Oct 19 07:04:27.871644 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1844/3578] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 07:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 07:04:27.904845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea54cb30-9b45-4af5-bbde-27601951f180 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:27.906068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea54cb30-9b45-4af5-bbde-27601951f180 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:27.978329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:27.987259 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f618d10-eea6-4593-82de-836a30525168 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1274 microversion: 2.1 time: 0.431604 Oct 19 07:04:28.000506 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1735/3579] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:27 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1274 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:28.051351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea54cb30-9b45-4af5-bbde-27601951f180 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:28.068718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea54cb30-9b45-4af5-bbde-27601951f180 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:28.070163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea54cb30-9b45-4af5-bbde-27601951f180 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:28.071334 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea54cb30-9b45-4af5-bbde-27601951f180 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1278 microversion: 2.57 time: 0.195081 Oct 19 07:04:28.072079 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1845/3580] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:27 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:28.136347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:28.137054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:28.144925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:28.145770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:28.146369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:28.147465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:28.148197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:28.148793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:28.437160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:28.438373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:28.453664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:28.460969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:28.461584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:28.463506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:28.466379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:28.468281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:28.560306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:28.569837 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a26dcd4-29f5-46b5-8caa-a50f0cf6dece tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1467 microversion: 2.1 time: 0.136747 Oct 19 07:04:28.571341 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1846/3581] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:28 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1467 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:28.706475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-854e00b2-610d-458d-9a41-4499d318bd69 req-40a5083d-55ef-474f-afb4-2dade662dcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf28f7b-2526-4c9d-9934-8caa07997eca", "name": "network-vif-deleted", "tag": "2fe8604e-4075-4a11-b76b-0fe8bb107f0e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:28.725916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-854e00b2-610d-458d-9a41-4499d318bd69 req-40a5083d-55ef-474f-afb4-2dade662dcc0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:28.727577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-854e00b2-610d-458d-9a41-4499d318bd69 req-40a5083d-55ef-474f-afb4-2dade662dcc0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:28.728226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-854e00b2-610d-458d-9a41-4499d318bd69 req-40a5083d-55ef-474f-afb4-2dade662dcc0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:28.767984 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-854e00b2-610d-458d-9a41-4499d318bd69 req-40a5083d-55ef-474f-afb4-2dade662dcc0 service nova] Creating event network-vif-deleted:2fe8604e-4075-4a11-b76b-0fe8bb107f0e for instance eaf28f7b-2526-4c9d-9934-8caa07997eca on n-h1-861333-10 Oct 19 07:04:28.779045 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-854e00b2-610d-458d-9a41-4499d318bd69 req-40a5083d-55ef-474f-afb4-2dade662dcc0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076556 Oct 19 07:04:28.782124 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1847/3582] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:04:29.018505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:29.020544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:29.032575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:29.036407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:29.036407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:29.038612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:29.041652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:29.043641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:29.250833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:29.265510 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7dfbe19-7764-4486-8229-6d5670836858 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1274 microversion: 2.1 time: 0.249915 Oct 19 07:04:29.285647 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1848/3583] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:29 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:29.296717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2000848-d1a8-4792-83b7-4ff77a2801f0 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:29.304902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2000848-d1a8-4792-83b7-4ff77a2801f0 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:29.434837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2000848-d1a8-4792-83b7-4ff77a2801f0 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:29.442534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2000848-d1a8-4792-83b7-4ff77a2801f0 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:29.443991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2000848-d1a8-4792-83b7-4ff77a2801f0 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:29.453301 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2000848-d1a8-4792-83b7-4ff77a2801f0 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1278 microversion: 2.57 time: 0.166368 Oct 19 07:04:29.460486 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1849/3584] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:29 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:29.512935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:29.515834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:29.523364 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9a38db3-ee53-4b0c-8763-a54d1b579082 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 1.391151 Oct 19 07:04:29.525107 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1736/3585] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:28 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:29.595843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:29.597201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:29.617956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:29.618967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:29.620225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:29.621330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:29.622007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:29.622610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:29.727108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:29.729232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:29.732933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:29.733505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lazy-loading 'fault' on Instance uuid eaf28f7b-2526-4c9d-9934-8caa07997eca {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:04:29.818253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:29.831621 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2a1cd12-f15f-4332-ab8a-87ff6a39cd7d tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 200 len: 1305 microversion: 2.1 time: 0.240477 Oct 19 07:04:29.848343 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1850/3586] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:29 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 1305 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:30.295915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:30.296970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:30.315727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:30.316785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:30.317453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:30.318910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:30.319594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:30.320946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:30.491751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:30.493193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:30.522522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:30.524846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:30.525745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:30.527134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:30.528700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:30.529744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:30.620755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:30.655321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:30.663322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:30.665486 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3638d81b-b008-4116-935c-cfba96efd190 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1330 microversion: 2.57 time: 0.181636 Oct 19 07:04:30.669920 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1851/3587] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:30 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1330 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:04:30.676020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:30.677621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:30.684843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:30.685726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:30.699010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:30.718765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:30.720452 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-faa96edf-29b9-4466-bbcc-4ef7880322f6 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1274 microversion: 2.1 time: 0.429636 Oct 19 07:04:30.722427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:30.722784 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1737/3588] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:30 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1274 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:30.723412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:30.724830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:30.861106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:30.864009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:30.879080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:30.883498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:30.884822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:30.885851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:30.891859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:30.893493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:30.935717 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca HTTP/1.1 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'eaf28f7b-2526-4c9d-9934-8caa07997eca'} Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:30.941132 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:30.945529 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:30.945529 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:30.945529 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:30.945529 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:30.945529 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:30.945529 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:30.945529 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:30.951641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:30.953960 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0aaad7c-4d3e-4be5-a1b0-d24938f0fcd9 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 404 len: 111 microversion: 2.1 time: 0.101605 Oct 19 07:04:30.958525 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1738/3589] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:30 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:30.962448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cb8ae183-f34f-4a88-a48c-ab5835796595 req-7300b13a-9d56-4333-8ff3-ba54de550759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c15c629-a490-4e4a-82bb-0b6f166b451b", "tag": "01ada7f3-0271-48db-aa5d-5669f271f2f1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:30.995056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cb8ae183-f34f-4a88-a48c-ab5835796595 req-7300b13a-9d56-4333-8ff3-ba54de550759 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:30.997077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cb8ae183-f34f-4a88-a48c-ab5835796595 req-7300b13a-9d56-4333-8ff3-ba54de550759 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:31.004723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cb8ae183-f34f-4a88-a48c-ab5835796595 req-7300b13a-9d56-4333-8ff3-ba54de550759 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:31.027084 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cb8ae183-f34f-4a88-a48c-ab5835796595 req-7300b13a-9d56-4333-8ff3-ba54de550759 service nova] Creating event network-changed:01ada7f3-0271-48db-aa5d-5669f271f2f1 for instance 4c15c629-a490-4e4a-82bb-0b6f166b451b on n-h2-861333-10 Oct 19 07:04:31.036370 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cb8ae183-f34f-4a88-a48c-ab5835796595 req-7300b13a-9d56-4333-8ff3-ba54de550759 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076334 Oct 19 07:04:31.037585 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1739/3590] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:31.049933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-480d8ce2-0d4a-43d3-bf37-624b6ff868e5 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d6513d1f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:31.059575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:31.069808 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4dbfecaf-2419-4c4c-b401-bb4414824e59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.398394 Oct 19 07:04:31.070867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1852/3591] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:30 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:31.705470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:31.706741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:31.717848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:31.718764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:31.719472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:31.720486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:31.721205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:31.721869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:31.835844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:31.852764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:31.854709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:31.856749 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0501910-60eb-4fcf-8ed7-fc46f47aa125 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1338 microversion: 2.57 time: 0.155236 Oct 19 07:04:31.857985 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1853/3592] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:31 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1338 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:31.867984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:31.868860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:31.876057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:31.876859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:31.878081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:31.879116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:31.879747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:31.880394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:32.184920 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-480d8ce2-0d4a-43d3-bf37-624b6ff868e5 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/bf3be404-9cea-4714-8989-4973f5fe39b4" status: 202 len: 0 microversion: 2.1 time: 1.145697 Oct 19 07:04:32.185881 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1740/3593] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:31 2022] DELETE /compute/v2.1/os-security-groups/bf3be404-9cea-4714-8989-4973f5fe39b4 => generated 0 bytes in 1147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:04:32.190814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:32.191553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:32.197493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:32.206459 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-334e1ea2-24ed-4ceb-be46-ed72181ce82d tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.347149 Oct 19 07:04:32.208960 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1854/3594] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:31 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:32.216716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-684e52ed-66c7-4f17-a1fd-0f3f9e370319 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa56a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:32.225401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:32.225910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:32.226357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:32.227481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:32.227899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:32.238433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:32.582955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:32.590102 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4d3428c-dcf5-4972-bc22-b47bc947e7b7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.403112 Oct 19 07:04:32.609762 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1741/3595] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:32 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:32.666104 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-684e52ed-66c7-4f17-a1fd-0f3f9e370319 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9f49ce75-df7d-4052-bf2e-a2be5abe2acd" status: 202 len: 0 microversion: 2.1 time: 0.454762 Oct 19 07:04:32.667076 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1855/3596] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:32 2022] DELETE /compute/v2.1/os-security-groups/9f49ce75-df7d-4052-bf2e-a2be5abe2acd => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:04:32.683247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efcd80fe-029d-4ecf-82dd-3af75312d644 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'create', calling method: .version_select at 0x7f6d5fa6a9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1853647061", "description": "tempest-description-1416124253"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:33.092822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-806731080", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "09baf8fc-b4cc-43ec-a2c8-b889349b6b32"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:33.273938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] validate_networks() for [('09baf8fc-b4cc-43ec-a2c8-b889349b6b32', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:04:33.418045 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efcd80fe-029d-4ecf-82dd-3af75312d644 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.740984 Oct 19 07:04:33.419732 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1856/3597] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:04:32 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:04:33.428196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:33.429353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:33.437983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:33.438750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:33.440206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:33.441123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:33.442436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:33.443211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:33.675656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:33.689501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:33.695024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:33.696831 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1562805-5899-4da6-ad06-e70120d6ff1b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1336 microversion: 2.57 time: 0.275857 Oct 19 07:04:33.697417 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1857/3598] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:33 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1336 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:33.702878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:33.708699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:33.728537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:33.729558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:33.730741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:33.733167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:33.735848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:33.737089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:34.070652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:34.078792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:34.086375 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bce7ec62-76b2-4e0c-aac6-427784dd3b18 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.387001 Oct 19 07:04:34.090679 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1858/3599] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:33 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:34.119900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54f5ba87-2773-4e4b-af0d-d2c04d312cdf tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Action: 'update', calling method: .version_select at 0x7f6d68a560d0>, body: {"security_group": {"name": "tempest-sg-hth-530651626", "description": "tempest-description-hth-1121322588"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:34.684235 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54f5ba87-2773-4e4b-af0d-d2c04d312cdf tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "PUT /compute/v2.1/os-security-groups/eca02d7c-f2ff-4907-b2bc-f2df242d1b97" status: 200 len: 217 microversion: 2.1 time: 0.573992 Oct 19 07:04:34.685241 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1859/3600] 10.222.0.39 () {60 vars in 1290 bytes} [Wed Oct 19 07:04:34 2022] PUT /compute/v2.1/os-security-groups/eca02d7c-f2ff-4907-b2bc-f2df242d1b97 => generated 217 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:34.691312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:34.692866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:34.708198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:34.709644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:34.710368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:34.713893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:34.713893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:34.713893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:35.139573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:04:35.140287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:04:35.140881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:04:35.141833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:04:35.142364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:04:35.197258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:35.203600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:35.206986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:35.207948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:35.218545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:35.221313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:35.322150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:35.329656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Getting quotas for project 98ba6c31abdd4006912d7a7d36dbefd6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:04:35.332064 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b76a000-2463-40f1-9346-19072aa120e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.645679 Oct 19 07:04:35.336244 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1860/3601] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:34 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:35.345177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:35.345839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:35.355203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Getting quotas for user 629efc37145540fea4429992ecd0f318 and project 98ba6c31abdd4006912d7a7d36dbefd6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:04:35.386912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:35.387747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:35.389891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:35.390823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:35.393386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:35.394079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:35.412389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:04:35.416251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:04:35.687968 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2cbd558-55b4-49df-9cac-03c6ea06d602 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.082087 Oct 19 07:04:35.688663 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1742/3602] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 07:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3083 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 07:04:35.707406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b98f71f-a716-4a56-8940-b2bc16096f12 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa3d160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:35.718832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:35.729729 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f69e910e-2902-47ec-8de4-4e88eb08cac5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.392386 Oct 19 07:04:35.732428 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1861/3603] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:35 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:35.737782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:35.745607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:35.761169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:35.761391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:35.761839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:35.770594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:35.771318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:35.771941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:35.993757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:36.014801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:36.021451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:36.023017 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bca508e1-2483-45f3-8047-80e4ac152a87 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1357 microversion: 2.57 time: 0.289627 Oct 19 07:04:36.037668 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1862/3604] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:35 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1357 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:36.052610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:36.055260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:36.060927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:36.061602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:36.062284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:36.063228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:36.063854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:36.064607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:36.130819 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b98f71f-a716-4a56-8940-b2bc16096f12 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/eca02d7c-f2ff-4907-b2bc-f2df242d1b97" status: 200 len: 217 microversion: 2.1 time: 0.438801 Oct 19 07:04:36.131547 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1743/3605] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:04:35 2022] GET /compute/v2.1/os-security-groups/eca02d7c-f2ff-4907-b2bc-f2df242d1b97 => generated 217 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:36.136775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0af896b-150c-4307-8c92-e4a56f049705 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:36.137520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0af896b-150c-4307-8c92-e4a56f049705 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:36.295190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0af896b-150c-4307-8c92-e4a56f049705 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:36.307255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0af896b-150c-4307-8c92-e4a56f049705 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:36.311528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0af896b-150c-4307-8c92-e4a56f049705 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:36.318752 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0af896b-150c-4307-8c92-e4a56f049705 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1261 microversion: 2.26 time: 0.185951 Oct 19 07:04:36.319703 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1744/3606] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:36 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:36.331702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cdae373-1eb6-4875-9801-ef3a83c06ccd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-592473736"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:36.334467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cdae373-1eb6-4875-9801-ef3a83c06ccd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:36.348246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdae373-1eb6-4875-9801-ef3a83c06ccd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:36.349027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdae373-1eb6-4875-9801-ef3a83c06ccd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:36.349649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdae373-1eb6-4875-9801-ef3a83c06ccd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:36.350544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdae373-1eb6-4875-9801-ef3a83c06ccd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:36.351173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdae373-1eb6-4875-9801-ef3a83c06ccd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:36.351774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdae373-1eb6-4875-9801-ef3a83c06ccd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:36.513786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:36.538212 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b86d44e-de6e-40a2-a55c-c43cc422723a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.499316 Oct 19 07:04:36.559379 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1863/3607] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:36 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:36.571575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-014d74f4-a167-4613-b8c6-313b686defd8 req-3b3e85e9-7cde-4de5-ae93-258f896f00c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd3cec50-7f84-4777-a083-66cb80f01148", "tag": "bfa63ee0-aed6-48d1-8337-7a9fac6bbca7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:36.594342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-014d74f4-a167-4613-b8c6-313b686defd8 req-3b3e85e9-7cde-4de5-ae93-258f896f00c8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:36.594983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-014d74f4-a167-4613-b8c6-313b686defd8 req-3b3e85e9-7cde-4de5-ae93-258f896f00c8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:36.596222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-014d74f4-a167-4613-b8c6-313b686defd8 req-3b3e85e9-7cde-4de5-ae93-258f896f00c8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:36.610331 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-014d74f4-a167-4613-b8c6-313b686defd8 req-3b3e85e9-7cde-4de5-ae93-258f896f00c8 service nova] Creating event network-changed:bfa63ee0-aed6-48d1-8337-7a9fac6bbca7 for instance cd3cec50-7f84-4777-a083-66cb80f01148 on n-h2-861333-10 Oct 19 07:04:36.617239 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-014d74f4-a167-4613-b8c6-313b686defd8 req-3b3e85e9-7cde-4de5-ae93-258f896f00c8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056735 Oct 19 07:04:36.617867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1864/3608] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:36.623915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:36.627812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:36.635878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:36.637085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:36.637755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:36.638697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:36.639374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:36.640309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:36.817265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:04:36.820301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:04:36.820953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:04:36.825392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:04:36.828361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:04:37.093304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:37.101242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:37.106023 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cdae373-1eb6-4875-9801-ef3a83c06ccd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.779733 Oct 19 07:04:37.106923 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1745/3609] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:04:36 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 19 07:04:37.118876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a67eea9-2cb6-48bd-9280-b4039d8207ed tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d64025a60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:37.120955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.121866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.124075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.126566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.128549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.129471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.253391 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97c4780e-310d-40db-945e-3cb4116e4fc7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "POST /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890/action" status: 202 len: 1138 microversion: 2.57 time: 0.623033 Oct 19 07:04:37.258664 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1865/3610] 10.222.0.39 () {62 vars in 1320 bytes} [Wed Oct 19 07:04:36 2022] POST /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890/action => generated 1138 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 07:04:37.289769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:37.289769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:37.307526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.314307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.315458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.318808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.324392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.325249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.563840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:37.624027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:37.637379 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1610d03d-4bbb-4832-8241-22a8ab96f7ad tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.367855 Oct 19 07:04:37.652656 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1866/3611] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:37 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:37.660891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:37.667052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:37.670583 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a67eea9-2cb6-48bd-9280-b4039d8207ed tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/eca02d7c-f2ff-4907-b2bc-f2df242d1b97" status: 202 len: 0 microversion: 2.1 time: 0.562247 Oct 19 07:04:37.673357 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1746/3612] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:37 2022] DELETE /compute/v2.1/os-security-groups/eca02d7c-f2ff-4907-b2bc-f2df242d1b97 => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:04:37.676529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.677295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.677441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:37.678109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.679831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.680556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.681191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.682320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:37.698173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.698670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.700370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.703040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.703040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.703040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.794166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:37.804548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:37.806195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:37.807639 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0616cacb-0880-43ae-8104-fa6c6552b99d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.134904 Oct 19 07:04:37.808317 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1747/3613] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:37 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:37.820286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:37.822710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:37.827376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.827858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.828349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.829056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.829591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.830020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.884968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:37.895557 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98f7b4fa-65dd-469f-bbb9-01935e0b0ad4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.240937 Oct 19 07:04:37.896389 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1867/3614] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:37 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:37.901389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-22df83fe-a2d6-440a-b823-54dc4bff9e93 req-1059d6ff-ba2b-4363-bc98-3cccee442355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "name": "network-vif-unplugged", "status": "completed", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:37.911377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:37.924950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:37.926879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:37.942092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-22df83fe-a2d6-440a-b823-54dc4bff9e93 req-1059d6ff-ba2b-4363-bc98-3cccee442355 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.942236 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-435e0c33-9ffc-4148-bdec-0360b463e6fa tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1265 microversion: 2.26 time: 0.118875 Oct 19 07:04:37.942344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-22df83fe-a2d6-440a-b823-54dc4bff9e93 req-1059d6ff-ba2b-4363-bc98-3cccee442355 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.942344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-22df83fe-a2d6-440a-b823-54dc4bff9e93 req-1059d6ff-ba2b-4363-bc98-3cccee442355 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.942495 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1748/3615] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:37 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:37.946144 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-22df83fe-a2d6-440a-b823-54dc4bff9e93 req-1059d6ff-ba2b-4363-bc98-3cccee442355 service nova] Creating event network-vif-unplugged:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:04:37.958021 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-22df83fe-a2d6-440a-b823-54dc4bff9e93 req-1059d6ff-ba2b-4363-bc98-3cccee442355 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057964 Oct 19 07:04:37.958515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:37.959264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:37.961424 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1868/3616] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:37.966822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.967679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.968998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:37.970724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:37.971979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:37.972548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:38.277353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:38.298713 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bb3303b-5f6c-49c0-80ed-97fffe95320e tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.364450 Oct 19 07:04:38.299896 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1749/3617] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:37 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:38.306236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:38.306728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:38.330805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:38.331563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:38.331994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:38.332738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:38.332986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-226859343", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b6f9b214-7293-4a2e-9e94-819a8d99ba2c"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:38.333198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:38.337009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca HTTP/1.1 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'eaf28f7b-2526-4c9d-9934-8caa07997eca'} Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:04:38.383557 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd81483e-620e-4ae8-9dd9-190499841254 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 404 len: 111 microversion: 2.1 time: 0.078738 Oct 19 07:04:38.389147 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1750/3618] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:04:38 2022] DELETE /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:38.391628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:38.392066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: eaf28f7b-2526-4c9d-9934-8caa07997eca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:38.399851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:38.403969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:38.404801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:38.405733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:38.406366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:38.407018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:38.426484 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca HTTP/1.1 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'eaf28f7b-2526-4c9d-9934-8caa07997eca'} Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.428506 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.432828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.432828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.432828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.432828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:38.432828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:38.432828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. Oct 19 07:04:38.432828 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.434247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Instance eaf28f7b-2526-4c9d-9934-8caa07997eca could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:38.435335 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0ea5d98-2297-4d79-ac18-da1810026696 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca" status: 404 len: 111 microversion: 2.1 time: 0.049375 Oct 19 07:04:38.436463 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1751/3619] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:38 2022] GET /compute/v2.1/servers/eaf28f7b-2526-4c9d-9934-8caa07997eca => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:38.454827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1af05426-519d-4804-a6df-fb8f0fd11e2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d64025670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:38.455304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] validate_networks() for [('b6f9b214-7293-4a2e-9e94-819a8d99ba2c', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:04:38.504689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-1af05426-519d-4804-a6df-fb8f0fd11e2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:04:38.505304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-1af05426-519d-4804-a6df-fb8f0fd11e2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:04:38.505816 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1af05426-519d-4804-a6df-fb8f0fd11e2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd does not exist Oct 19 07:04:38.505816 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-55437328-ac40-45c5-a7c0-eb865f09bb69'] Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1af05426-519d-4804-a6df-fb8f0fd11e2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/9f49ce75-df7d-4052-bf2e-a2be5abe2acd HTTP/1.1 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd does not exist Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-55437328-ac40-45c5-a7c0-eb865f09bb69'] Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9f49ce75-df7d-4052-bf2e-a2be5abe2acd'} Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:04:38.507981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd does not exist Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55437328-ac40-45c5-a7c0-eb865f09bb69'] Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd does not exist Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55437328-ac40-45c5-a7c0-eb865f09bb69'] Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd does not exist Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55437328-ac40-45c5-a7c0-eb865f09bb69'] Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd does not exist Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55437328-ac40-45c5-a7c0-eb865f09bb69'] Oct 19 07:04:38.514247 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.519944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1af05426-519d-4804-a6df-fb8f0fd11e2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group 9f49ce75-df7d-4052-bf2e-a2be5abe2acd does not exist Oct 19 07:04:38.519944 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-55437328-ac40-45c5-a7c0-eb865f09bb69'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:38.525234 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1af05426-519d-4804-a6df-fb8f0fd11e2b tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9f49ce75-df7d-4052-bf2e-a2be5abe2acd" status: 404 len: 194 microversion: 2.1 time: 0.077717 Oct 19 07:04:38.525668 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1752/3620] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:38 2022] DELETE /compute/v2.1/os-security-groups/9f49ce75-df7d-4052-bf2e-a2be5abe2acd => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:38.530672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9da1af73-b874-472b-9037-95a8b3f795b3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d6494cf70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:38.585704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-9da1af73-b874-472b-9037-95a8b3f795b3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bf3be404-9cea-4714-8989-4973f5fe39b4 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:04:38.586301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-9da1af73-b874-472b-9037-95a8b3f795b3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group bf3be404-9cea-4714-8989-4973f5fe39b4 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:04:38.586817 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9da1af73-b874-472b-9037-95a8b3f795b3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group bf3be404-9cea-4714-8989-4973f5fe39b4 does not exist Oct 19 07:04:38.586817 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-4d4e76d6-66b4-475b-a62b-2f7966cc259e'] Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9da1af73-b874-472b-9037-95a8b3f795b3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/bf3be404-9cea-4714-8989-4973f5fe39b4 HTTP/1.1 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group bf3be404-9cea-4714-8989-4973f5fe39b4 does not exist Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-4d4e76d6-66b4-475b-a62b-2f7966cc259e'] Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'bf3be404-9cea-4714-8989-4973f5fe39b4'} Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:04:38.588772 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bf3be404-9cea-4714-8989-4973f5fe39b4 does not exist Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d4e76d6-66b4-475b-a62b-2f7966cc259e'] Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bf3be404-9cea-4714-8989-4973f5fe39b4 does not exist Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d4e76d6-66b4-475b-a62b-2f7966cc259e'] Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bf3be404-9cea-4714-8989-4973f5fe39b4 does not exist Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d4e76d6-66b4-475b-a62b-2f7966cc259e'] Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bf3be404-9cea-4714-8989-4973f5fe39b4 does not exist Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d4e76d6-66b4-475b-a62b-2f7966cc259e'] Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9da1af73-b874-472b-9037-95a8b3f795b3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group bf3be404-9cea-4714-8989-4973f5fe39b4 does not exist Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-4d4e76d6-66b4-475b-a62b-2f7966cc259e'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9da1af73-b874-472b-9037-95a8b3f795b3 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/bf3be404-9cea-4714-8989-4973f5fe39b4" status: 404 len: 194 microversion: 2.1 time: 0.063314 Oct 19 07:04:38.593330 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1753/3621] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:38 2022] DELETE /compute/v2.1/os-security-groups/bf3be404-9cea-4714-8989-4973f5fe39b4 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:38.601952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbbb2b21-9291-49df-8ac8-9cd4804b9377 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa36ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:38.658168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-dbbb2b21-9291-49df-8ac8-9cd4804b9377 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:04:38.658168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-dbbb2b21-9291-49df-8ac8-9cd4804b9377 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group bbaf2459-7621-4a04-92f3-b2cb141112d3 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:04:38.658168 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-dbbb2b21-9291-49df-8ac8-9cd4804b9377 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:04:38.658168 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-26f1351b-2f38-441a-a273-b537a77de80f'] Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbbb2b21-9291-49df-8ac8-9cd4804b9377 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/bbaf2459-7621-4a04-92f3-b2cb141112d3 HTTP/1.1 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-26f1351b-2f38-441a-a273-b537a77de80f'] Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'bbaf2459-7621-4a04-92f3-b2cb141112d3'} Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:04:38.660866 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26f1351b-2f38-441a-a273-b537a77de80f'] Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26f1351b-2f38-441a-a273-b537a77de80f'] Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26f1351b-2f38-441a-a273-b537a77de80f'] Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26f1351b-2f38-441a-a273-b537a77de80f'] Oct 19 07:04:38.666112 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:38.674628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbbb2b21-9291-49df-8ac8-9cd4804b9377 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group bbaf2459-7621-4a04-92f3-b2cb141112d3 does not exist Oct 19 07:04:38.674628 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-26f1351b-2f38-441a-a273-b537a77de80f'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:38.676501 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbbb2b21-9291-49df-8ac8-9cd4804b9377 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/bbaf2459-7621-4a04-92f3-b2cb141112d3" status: 404 len: 194 microversion: 2.1 time: 0.080806 Oct 19 07:04:38.677650 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1754/3622] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:38 2022] DELETE /compute/v2.1/os-security-groups/bbaf2459-7621-4a04-92f3-b2cb141112d3 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:04:38.694340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:38.695206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:38.703364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:38.704060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:38.704710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:38.705738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:38.706380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:38.706979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.012999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:04:39.013839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:04:39.014391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:04:39.014812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:04:39.015236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:04:39.045271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.045271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.045271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.045271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.045271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.045271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.066509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Getting quotas for project b06da8cf306a446b93df8ff111ff56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:04:39.072400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Getting quotas for user 1007e861ec744d299c2aef39119f3684 and project b06da8cf306a446b93df8ff111ff56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:04:39.089726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:04:39.092589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:04:39.125334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.135391 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-109d21e0-1f81-4017-9cbd-d273abe3b615 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.447119 Oct 19 07:04:39.136311 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1755/3623] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:38 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:39.141188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85b567b2-af66-4217-90ac-82db77f4264e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d64c5a4c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:39.173541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-85b567b2-af66-4217-90ac-82db77f4264e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:04:39.182256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-85b567b2-af66-4217-90ac-82db77f4264e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:04:39.189125 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-85b567b2-af66-4217-90ac-82db77f4264e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:04:39.189125 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-d0e177e1-59ad-4bda-92ee-4b5e9291f67f'] Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85b567b2-af66-4217-90ac-82db77f4264e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/9ccc4efb-0142-4bd1-9172-15ddaf4778b7 HTTP/1.1 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-d0e177e1-59ad-4bda-92ee-4b5e9291f67f'] Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9ccc4efb-0142-4bd1-9172-15ddaf4778b7'} Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:04:39.190819 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0e177e1-59ad-4bda-92ee-4b5e9291f67f'] Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0e177e1-59ad-4bda-92ee-4b5e9291f67f'] Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0e177e1-59ad-4bda-92ee-4b5e9291f67f'] Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0e177e1-59ad-4bda-92ee-4b5e9291f67f'] Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85b567b2-af66-4217-90ac-82db77f4264e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group 9ccc4efb-0142-4bd1-9172-15ddaf4778b7 does not exist Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-d0e177e1-59ad-4bda-92ee-4b5e9291f67f'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:39.194793 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85b567b2-af66-4217-90ac-82db77f4264e tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9ccc4efb-0142-4bd1-9172-15ddaf4778b7" status: 404 len: 194 microversion: 2.1 time: 0.056022 Oct 19 07:04:39.200565 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1756/3624] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:39 2022] DELETE /compute/v2.1/os-security-groups/9ccc4efb-0142-4bd1-9172-15ddaf4778b7 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:39.207046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:39.214575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:39.225458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.225740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.226193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.227104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.227748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.228254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.285878 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c63956f-df1d-4f2d-9619-9669ed476caf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.316568 Oct 19 07:04:39.287739 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1869/3625] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:04:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:04:39.313223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.322782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:39.323464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:39.337360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.338936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.340183 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a6ebe34-b2b9-433b-b3ba-284d804de099 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.142705 Oct 19 07:04:39.360133 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1757/3626] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:39 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:39.360356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.360356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.360356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.360356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.360356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.360356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.360819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:39.360819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:39.368803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.369301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.369752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.370469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.370929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.371674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.479930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.495030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.496941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.498133 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2aa242a9-78e0-43e6-80be-8287cb23ea32 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1321 microversion: 2.26 time: 0.150343 Oct 19 07:04:39.498704 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1758/3627] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:39 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:39.509175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3031c588-502f-4bae-b264-cd5da3ee7027 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d64800af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:39.579471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.587614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-3031c588-502f-4bae-b264-cd5da3ee7027 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:04:39.587614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-3031c588-502f-4bae-b264-cd5da3ee7027 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:04:39.587995 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3031c588-502f-4bae-b264-cd5da3ee7027 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:04:39.587995 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-3384dda2-d60d-4563-a4b9-d3e6305c7e1c'] Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3031c588-502f-4bae-b264-cd5da3ee7027 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/9ad65ae5-bf41-4aae-8c55-9337abeffae7 HTTP/1.1 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-3384dda2-d60d-4563-a4b9-d3e6305c7e1c'] Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9ad65ae5-bf41-4aae-8c55-9337abeffae7'} Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:04:39.589744 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3384dda2-d60d-4563-a4b9-d3e6305c7e1c'] Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3384dda2-d60d-4563-a4b9-d3e6305c7e1c'] Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3384dda2-d60d-4563-a4b9-d3e6305c7e1c'] Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3384dda2-d60d-4563-a4b9-d3e6305c7e1c'] Oct 19 07:04:39.594852 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.602191 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a63938f-565f-4c10-9976-19abc0e0f903 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1688 microversion: 2.1 time: 0.292396 Oct 19 07:04:39.602363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3031c588-502f-4bae-b264-cd5da3ee7027 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group 9ad65ae5-bf41-4aae-8c55-9337abeffae7 does not exist Oct 19 07:04:39.602363 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-3384dda2-d60d-4563-a4b9-d3e6305c7e1c'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:39.602664 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1870/3628] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:39 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1688 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:39.602664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8065c27b-079c-4937-9a9c-6f816fbe6b1a tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:39.602664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8065c27b-079c-4937-9a9c-6f816fbe6b1a tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:39.610292 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3031c588-502f-4bae-b264-cd5da3ee7027 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9ad65ae5-bf41-4aae-8c55-9337abeffae7" status: 404 len: 194 microversion: 2.1 time: 0.110462 Oct 19 07:04:39.618482 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1759/3629] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:39 2022] DELETE /compute/v2.1/os-security-groups/9ad65ae5-bf41-4aae-8c55-9337abeffae7 => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:39.630691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:39.634265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:39.649837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.650525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.658759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.658759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.658759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.658759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.711948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8065c27b-079c-4937-9a9c-6f816fbe6b1a tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.727554 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8065c27b-079c-4937-9a9c-6f816fbe6b1a tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1215 microversion: 2.1 time: 0.130522 Oct 19 07:04:39.728231 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1871/3630] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:39 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:39.733820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74443771-692e-408b-85af-543b405e76c2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d68b8c4c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:39.762006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-74443771-692e-408b-85af-543b405e76c2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:04:39.764790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-74443771-692e-408b-85af-543b405e76c2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Neutron security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:04:39.765324 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-74443771-692e-408b-85af-543b405e76c2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:04:39.765324 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-d87aee94-399c-46ce-8381-7b9bfddac689'] Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74443771-692e-408b-85af-543b405e76c2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 HTTP/1.1 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: exception: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-d87aee94-399c-46ce-8381-7b9bfddac689'] Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7'} Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:04:39.772218 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d87aee94-399c-46ce-8381-7b9bfddac689'] Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d87aee94-399c-46ce-8381-7b9bfddac689'] Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d87aee94-399c-46ce-8381-7b9bfddac689'] Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d87aee94-399c-46ce-8381-7b9bfddac689'] Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74443771-692e-408b-85af-543b405e76c2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Security group 3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 does not exist Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-d87aee94-399c-46ce-8381-7b9bfddac689'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74443771-692e-408b-85af-543b405e76c2 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7" status: 404 len: 194 microversion: 2.1 time: 0.049481 Oct 19 07:04:39.784843 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1872/3631] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:39 2022] DELETE /compute/v2.1/os-security-groups/3ef755bc-88b1-4ca3-a77f-ea49fd2e7bf7 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:39.791640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:39.791640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:39.798812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.799851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.800351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.801063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:39.801530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:39.802857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:39.841258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:04:39.911178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:39.919491 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-540c6036-bb23-4f48-b12a-edc4ac6eea92 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.302415 Oct 19 07:04:39.920060 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1760/3632] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:39 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:39.987458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-00e8bc1e-c5dd-47b8-b6e6-cf4864051687 req-2f5db308-31b7-4d5c-beb1-6f752a1102c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c15c629-a490-4e4a-82bb-0b6f166b451b", "name": "network-vif-plugged", "status": "completed", "tag": "01ada7f3-0271-48db-aa5d-5669f271f2f1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:40.006979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-00e8bc1e-c5dd-47b8-b6e6-cf4864051687 req-2f5db308-31b7-4d5c-beb1-6f752a1102c4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.008562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-00e8bc1e-c5dd-47b8-b6e6-cf4864051687 req-2f5db308-31b7-4d5c-beb1-6f752a1102c4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.009216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-00e8bc1e-c5dd-47b8-b6e6-cf4864051687 req-2f5db308-31b7-4d5c-beb1-6f752a1102c4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.013635 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:04:40.014086 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:04:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 (ip 10.222.0.39) !!! Oct 19 07:04:40.040261 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-00e8bc1e-c5dd-47b8-b6e6-cf4864051687 req-2f5db308-31b7-4d5c-beb1-6f752a1102c4 service nova] Creating event network-vif-plugged:01ada7f3-0271-48db-aa5d-5669f271f2f1 for instance 4c15c629-a490-4e4a-82bb-0b6f166b451b on n-h2-861333-10 Oct 19 07:04:40.046312 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-00e8bc1e-c5dd-47b8-b6e6-cf4864051687 req-2f5db308-31b7-4d5c-beb1-6f752a1102c4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064348 Oct 19 07:04:40.047897 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1761/3633] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:04:40.160318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:40.161163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:40.176927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.177486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.178099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.180597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.183031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.183671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.218775 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77e27ae9-0b81-451a-9562-0646003a4adb tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 204 len: 0 microversion: 2.1 time: 0.434529 Oct 19 07:04:40.219366 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1873/3634] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:04:39 2022] DELETE /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:04:40.228594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:40.229542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:40.237544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.238282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.242438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.243273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.243803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.244267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.443406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.466968 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a48ae8d-daa8-4f55-8dbb-e2d0d3735380 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1648 microversion: 2.1 time: 0.228677 Oct 19 07:04:40.468465 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1874/3635] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:40 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1648 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:40.482054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:40.483383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:40.492243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.493064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.493740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.494703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.495521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.496050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.512910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.521847 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c50d7ac-79a2-44e8-a38b-90657def9ae1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.366171 Oct 19 07:04:40.522270 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1762/3636] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:40 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:40.538115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:40.539120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:40.552072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.554675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.555353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.558332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.558903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.560266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.616910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.628039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.629924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.631233 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3743b33b-193a-4d74-8f5d-b55cb02cba31 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.161500 Oct 19 07:04:40.644747 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1875/3637] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:40 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:40.651999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:40.652791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:40.659292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.661227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.661812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.662335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.663118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.663662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.664406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.671335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.673652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.674856 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d21e5eae-a906-4c28-b734-dc995ea7552c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1319 microversion: 2.26 time: 0.144078 Oct 19 07:04:40.675737 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1763/3638] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:40 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:04:40.754857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8490f1a9-9bbf-4dc3-92c3-7fd6901d3879 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:40.756093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8490f1a9-9bbf-4dc3-92c3-7fd6901d3879 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:40.838616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.839865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8490f1a9-9bbf-4dc3-92c3-7fd6901d3879 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:40.844421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:40.851622 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8490f1a9-9bbf-4dc3-92c3-7fd6901d3879 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1215 microversion: 2.1 time: 0.099468 Oct 19 07:04:40.853173 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1764/3639] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:40 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:40.858012 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e508755-8cb0-4c97-95ff-46197ee2f62f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1688 microversion: 2.1 time: 0.224711 Oct 19 07:04:40.859867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1876/3640] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:40 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1688 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:40.944487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:40.945367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:40.962496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.965647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.966973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:40.967732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:40.971085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:40.971723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:41.150670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:41.160789 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45f81d6f-b866-46e1-b333-39c14d57efb7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.221970 Oct 19 07:04:41.166266 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1765/3641] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:40 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:41.486139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:41.490293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:41.507925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:41.510901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:41.511924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:41.515295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:41.517851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:41.535226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:41.547073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:41.547929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:41.555868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:41.556439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:41.572817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:41.572817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:41.572817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:41.572817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:41.579951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:41.884495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:41.893658 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21d0c057-a616-473e-9218-062051bb3f01 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1648 microversion: 2.1 time: 0.414053 Oct 19 07:04:41.894948 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1877/3642] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:41 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1648 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:41.901767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:41.902659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:41.932524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:41.933473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:41.935090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:41.936195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:41.944076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:41.944767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.031093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.042395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.044280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.045935 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6815fb82-18cd-4d53-a1c2-c56a2a7a09d5 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.149595 Oct 19 07:04:42.058956 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1878/3643] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:41 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:42.075059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:42.076363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:42.083961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.084609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.085169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.086111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.087071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.087745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.159918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.180154 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39227ee3-1ea3-4736-ab4e-d3fe5bf5bbbe tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1315 microversion: 2.1 time: 0.637152 Oct 19 07:04:42.192697 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1766/3644] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:41 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:42.209029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:42.209645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:42.217018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.217512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.217949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.218653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.219107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.219535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.302524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.313539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.315444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.316857 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-26dbc1ac-a91d-4963-bd17-8ea2d6181c85 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1361 microversion: 2.26 time: 0.256715 Oct 19 07:04:42.334394 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1879/3645] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:42 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:42.345011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:42.346434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:42.354582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.355313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.355919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.356971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.357619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.358213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.375340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.391003 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c2ad9c1-b60b-4c3f-8526-c7dcf6c5c375 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1267 microversion: 2.1 time: 0.192161 Oct 19 07:04:42.392418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1767/3646] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:42 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:42.404943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a1a9bff6-2d0e-4ea4-b7ea-768d8386a920 req-3e03655f-0382-487f-a800-81a7e60d8617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "name": "network-vif-plugged", "status": "completed", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:42.436547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a1a9bff6-2d0e-4ea4-b7ea-768d8386a920 req-3e03655f-0382-487f-a800-81a7e60d8617 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.437035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a1a9bff6-2d0e-4ea4-b7ea-768d8386a920 req-3e03655f-0382-487f-a800-81a7e60d8617 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.437472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a1a9bff6-2d0e-4ea4-b7ea-768d8386a920 req-3e03655f-0382-487f-a800-81a7e60d8617 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.469059 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a1a9bff6-2d0e-4ea4-b7ea-768d8386a920 req-3e03655f-0382-487f-a800-81a7e60d8617 service nova] Creating event network-vif-plugged:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:04:42.480498 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a1a9bff6-2d0e-4ea4-b7ea-768d8386a920 req-3e03655f-0382-487f-a800-81a7e60d8617 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080951 Oct 19 07:04:42.480498 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1768/3647] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:42.486442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:42.487317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:42.497787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.498748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.499275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.500791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.503554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.504699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.685108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.698273 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c630c1c-881f-4198-abba-32c10f0d52db tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.362492 Oct 19 07:04:42.708324 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1880/3648] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:42 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:42.919887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:42.921037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:42.933141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.936548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.937270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.940239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:42.962040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:42.962787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:42.963456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:42.969739 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ca3583b-af7f-4fa3-a581-db1f7aab83ea tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.491903 Oct 19 07:04:42.970311 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1769/3649] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:42 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:43.078568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:43.079631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:43.093146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:43.095506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:43.099145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:43.100168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:43.100719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:43.101219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:43.300923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:43.317849 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf7edc2e-9f93-4cbc-ae8b-53102811f378 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1648 microversion: 2.1 time: 0.401898 Oct 19 07:04:43.318456 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1881/3650] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:42 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1648 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:43.355793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:43.356915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:43.365553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:43.367492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:43.367492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:43.369633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:43.370592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:43.371706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:43.632654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:43.644333 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bbce5c92-f767-4b13-b8ed-a1231c9ca243 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1502 microversion: 2.1 time: 0.320762 Oct 19 07:04:43.669074 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1882/3651] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:43 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:43.669074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:43.669074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:43.684015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:43.685084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:43.686026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:43.687403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:43.688385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:43.690456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:43.973658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:43.983025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:43.985088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:43.987330 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-877ae526-786d-4a92-8660-d1357949cab1 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1361 microversion: 2.26 time: 0.337199 Oct 19 07:04:44.004139 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1883/3652] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:43 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1361 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:44.004139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:44.004139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:44.004643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.004836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.005476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.006420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.007094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.007753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.013964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:44.026689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:44.028499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:44.032434 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a18e15d2-4592-4928-a4ac-e325d963c25f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.955384 Oct 19 07:04:44.033033 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1770/3653] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:43 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:04:44.046624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:44.047570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:44.069890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.076068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.078361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.082225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.083471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.084920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.171698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:44.186653 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b011aa9d-9eb5-4d46-8216-30b526a9ddb4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1273 microversion: 2.1 time: 0.194947 Oct 19 07:04:44.186653 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1884/3654] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:43 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:44.188151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:04:44.196917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:44.197594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:44.215738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.217268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.217943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.218869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.219516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.220163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.440572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:44.453961 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f490fe53-34b2-4799-baf3-3c313b5d2f00 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.267534 Oct 19 07:04:44.454999 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1885/3655] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:44 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:44.473594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:44.474357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:44.481242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.482046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.482701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.483651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.484324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.485194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.736663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:44.746192 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-855a32b0-d7e0-4c08-b9a6-89031ac48f4a tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.289255 Oct 19 07:04:44.764673 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1886/3656] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:44 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:44.776927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:44.779474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:44.800570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.805022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.806867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.808838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.813143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.815155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.819026 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd45d4fe-f06b-49d7-9679-5fe107b29072 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 204 len: 0 microversion: 2.1 time: 0.778139 Oct 19 07:04:44.820393 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1771/3657] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:04:44 2022] DELETE /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 0 bytes in 786 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:04:44.836509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1df68c6d-850b-446d-9b9f-dc8e675fd8d3 req-0dfe0ab7-d533-4310-ab47-ea54a1498fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee29286-42c5-4ccb-81b5-fa88405ad098", "name": "network-vif-deleted", "tag": "9f4f26bc-df31-4e43-841b-ead84f8e6346"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:44.866357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1df68c6d-850b-446d-9b9f-dc8e675fd8d3 req-0dfe0ab7-d533-4310-ab47-ea54a1498fd7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.867278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1df68c6d-850b-446d-9b9f-dc8e675fd8d3 req-0dfe0ab7-d533-4310-ab47-ea54a1498fd7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.869538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1df68c6d-850b-446d-9b9f-dc8e675fd8d3 req-0dfe0ab7-d533-4310-ab47-ea54a1498fd7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.912020 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1df68c6d-850b-446d-9b9f-dc8e675fd8d3 req-0dfe0ab7-d533-4310-ab47-ea54a1498fd7 service nova] Creating event network-vif-deleted:9f4f26bc-df31-4e43-841b-ead84f8e6346 for instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 on n-h1-861333-10 Oct 19 07:04:44.924793 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1df68c6d-850b-446d-9b9f-dc8e675fd8d3 req-0dfe0ab7-d533-4310-ab47-ea54a1498fd7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095081 Oct 19 07:04:44.925912 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1772/3658] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:44.932839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0d66268d-bace-43f0-b057-d87df069e8c1 req-37391d44-42ad-44e6-809c-8ca0ee710593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd3cec50-7f84-4777-a083-66cb80f01148", "name": "network-vif-plugged", "status": "completed", "tag": "bfa63ee0-aed6-48d1-8337-7a9fac6bbca7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:44.945852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:44.966797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:44.971733 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6578b600-5a26-417e-910a-3a1d65ffe449 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1301 microversion: 2.1 time: 0.205347 Oct 19 07:04:44.973665 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1887/3659] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:44 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1301 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:44.975307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0d66268d-bace-43f0-b057-d87df069e8c1 req-37391d44-42ad-44e6-809c-8ca0ee710593 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.976147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0d66268d-bace-43f0-b057-d87df069e8c1 req-37391d44-42ad-44e6-809c-8ca0ee710593 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.981063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0d66268d-bace-43f0-b057-d87df069e8c1 req-37391d44-42ad-44e6-809c-8ca0ee710593 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.984990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:44.988076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:44.996490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.996755 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0d66268d-bace-43f0-b057-d87df069e8c1 req-37391d44-42ad-44e6-809c-8ca0ee710593 service nova] Creating event network-vif-plugged:bfa63ee0-aed6-48d1-8337-7a9fac6bbca7 for instance cd3cec50-7f84-4777-a083-66cb80f01148 on n-h2-861333-10 Oct 19 07:04:44.997422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:44.998046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:44.999110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:44.999953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.000704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.004434 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0d66268d-bace-43f0-b057-d87df069e8c1 req-37391d44-42ad-44e6-809c-8ca0ee710593 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075933 Oct 19 07:04:45.006492 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1773/3660] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:45.063153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:45.068323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:45.078304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.079362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.080074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.082579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.084149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.084834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.247075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:45.258316 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f20a32c8-9701-4d35-8e07-3f52bdfdc495 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1508 microversion: 2.1 time: 0.283582 Oct 19 07:04:45.268923 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1888/3661] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:44 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:45.272736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:45.282826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:45.284394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:45.294270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.295001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.295704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.297461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.298088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.298680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.427212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:45.447700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:45.451240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:45.451957 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18fd3d60-2c68-43f3-aa99-b6d12fbf695b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.180983 Oct 19 07:04:45.453476 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1889/3662] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:45 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:45.458987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:45.460185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:45.470322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.471733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.472455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.473847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.474553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.475679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.559761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:45.574237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:45.575698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:45.577176 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a01ca6e7-e88e-401b-90af-02d090213bcf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1361 microversion: 2.26 time: 0.522633 Oct 19 07:04:45.583661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:45.592644 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1774/3663] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:45 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1361 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:45.600064 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1540aa8e-782e-46f1-9b6f-d0af43eccb0d tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1273 microversion: 2.1 time: 0.144261 Oct 19 07:04:45.601856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:45.602255 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1890/3664] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:45 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:45.602873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:45.609391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.611300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.611300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.611300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.612191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.612486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.775546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:45.777103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:45.785714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.786612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.787396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:45.788482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:45.789226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:45.790128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.004005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.015723 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eaab39ed-87ae-4a45-b6a4-595ea6794ed8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.246843 Oct 19 07:04:46.017621 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1891/3665] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:45 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:46.028817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:46.029463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:46.042447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.043338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.043950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.045017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.045646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.046248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.087442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.088235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.088854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.089478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lazy-loading 'fault' on Instance uuid 5ee29286-42c5-4ccb-81b5-fa88405ad098 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:04:46.124327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.138758 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-783dd037-f84b-4328-aaf8-1dc759f9289c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.541349 Oct 19 07:04:46.139914 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1775/3666] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:45 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:46.285786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:46.286506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:46.292720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.293216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.293660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.294382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.294844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.295278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.458495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1ed18a0014aefa8d9a01259b83730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230afab7d7eb4d98950bece49d03ded6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.471821 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3e7ba23-7b17-426c-8807-feef251084a4 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 200 len: 1306 microversion: 2.1 time: 0.452574 Oct 19 07:04:46.472458 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1892/3667] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:46 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 1306 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:46.482108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:46.482778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:46.490574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.490994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.491432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.492263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.492619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.493054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.499220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:46.581356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.597192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.600629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.600926 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a66bae8-f9da-402d-babe-2ae02a744c7a tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.124246 Oct 19 07:04:46.625053 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1893/3668] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:46 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:46.637893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:46.638520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:46.647311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.647311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.647311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.655779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.656535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.657185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.865820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.879459 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c265e84b-85e1-41ed-b824-174d642a5623 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1508 microversion: 2.1 time: 0.596765 Oct 19 07:04:46.881740 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1776/3669] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:46 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1508 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:46.891575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.901127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.902607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:46.902841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:46.903752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:46.903885 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4143420-a864-45ec-a788-8b5ac6d4a499 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1361 microversion: 2.26 time: 0.274818 Oct 19 07:04:46.904389 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1894/3670] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:46 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:46.913198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.915626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.917090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:46.919896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:46.931218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:46.931996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:47.031723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-72e7c4ec-ef9d-4d3e-9486-006616d90af2 req-6c4aa6ad-81cb-44ac-a164-444ca4fe48c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7eae87e-de7a-44d6-8ce4-a1d129e41770", "tag": "69a837ca-1301-4a48-9640-eb0eef267d83"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:47.050666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72e7c4ec-ef9d-4d3e-9486-006616d90af2 req-6c4aa6ad-81cb-44ac-a164-444ca4fe48c9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:47.056497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72e7c4ec-ef9d-4d3e-9486-006616d90af2 req-6c4aa6ad-81cb-44ac-a164-444ca4fe48c9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:47.057017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72e7c4ec-ef9d-4d3e-9486-006616d90af2 req-6c4aa6ad-81cb-44ac-a164-444ca4fe48c9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:47.080786 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-72e7c4ec-ef9d-4d3e-9486-006616d90af2 req-6c4aa6ad-81cb-44ac-a164-444ca4fe48c9 service nova] Creating event network-changed:69a837ca-1301-4a48-9640-eb0eef267d83 for instance b7eae87e-de7a-44d6-8ce4-a1d129e41770 on n-h1-861333-10 Oct 19 07:04:47.094017 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-72e7c4ec-ef9d-4d3e-9486-006616d90af2 req-6c4aa6ad-81cb-44ac-a164-444ca4fe48c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065723 Oct 19 07:04:47.095396 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1895/3671] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:04:47.102917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:47.104016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:47.112803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:47.113855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:47.115477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:47.116632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:47.117384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:47.118028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:47.226538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:47.241544 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-88285f05-8181-4479-9339-f05ef7ea7ee5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1315 microversion: 2.1 time: 0.358545 Oct 19 07:04:47.250641 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1777/3672] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:46 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:47.267466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:47.279653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:47.291400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:47.291978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:47.292611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:47.294189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:47.294850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:47.295719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:47.469459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:47.482473 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4062c312-286f-47b8-8e5b-aec021907c5f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1316 microversion: 2.1 time: 0.385113 Oct 19 07:04:47.484501 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1896/3673] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:47 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:47.508237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:47.510712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] [instance: 5ee29286-42c5-4ccb-81b5-fa88405ad098] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:47.519556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:47.521246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:47.521246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:47.521447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:47.521926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:47.522369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:47.548706 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] HTTP exception thrown: Instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 could not be found. Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Request method failure captured: Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 HTTP/1.1 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6EP-qn6gb6s2_wJ0jkswoe9KI8rXlCFPRz5gmEfdW2nw3H-TVQLF3v1ywGNXOGKPUuV6bS_D2izqkBwH5NxuI7drANqBcOAHJEFKEnXDPtP49YEh69pjyfXLn0hkm3ZAY-ogpgOloiQKbnC1ADQpg4stb5qEoEkFBowztyipdcjsZw Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/230afab7d7eb4d98950bece49d03ded6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_230afab7d7eb4d98950bece49d03ded6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 230afab7d7eb4d98950bece49d03ded6 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1361863459 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 54f1ed18a0014aefa8d9a01259b83730 Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-1361863459-project Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 could not be found. Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '5ee29286-42c5-4ccb-81b5-fa88405ad098'} Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 could not be found. Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 could not be found. Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:47.550848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:47.556562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:47.556562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:47.556562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:47.556562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:47.556562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:47.556562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 could not be found. Oct 19 07:04:47.556562 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:04:47.556562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Returning 404 to user: Instance 5ee29286-42c5-4ccb-81b5-fa88405ad098 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:47.556562 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32057c95-d709-489c-a47d-d296f0d453c1 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098" status: 404 len: 111 microversion: 2.1 time: 0.059319 Oct 19 07:04:47.557306 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1897/3674] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:47 2022] GET /compute/v2.1/servers/5ee29286-42c5-4ccb-81b5-fa88405ad098 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:47.575623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-306e2dec-52c8-4bf6-8003-cdd08c6e6b1a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa460d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:48.025428 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-306e2dec-52c8-4bf6-8003-cdd08c6e6b1a tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/c80082a6-a10f-49bd-b622-8b9b37e65041" status: 202 len: 0 microversion: 2.1 time: 0.466990 Oct 19 07:04:48.031496 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1898/3675] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:47 2022] DELETE /compute/v2.1/os-security-groups/c80082a6-a10f-49bd-b622-8b9b37e65041 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:04:48.035574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:48.035574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:48.037831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:48.052389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.052803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.053507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:48.054435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.055122 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e95024bd-c18b-4bdf-b956-a16cf66c3dfe tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.802951 Oct 19 07:04:48.055263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.055724 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1778/3676] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:47 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:48.056070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:48.060574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:48.061185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:48.074255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.074762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.075207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:48.075925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.076472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.081431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:48.190788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:48.199507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:48.207275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:48.208590 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e78428d-85b5-4836-8af5-49eb5036f613 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.181143 Oct 19 07:04:48.209163 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1899/3677] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:48 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:48.228927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:48.229895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:48.244148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.244854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.245428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:48.247680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.248257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.249579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:48.313625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:48.323673 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d789838c-0d49-4e8a-913e-79f04312c891 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 200 len: 1300 microversion: 2.1 time: 0.266857 Oct 19 07:04:48.326153 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1779/3678] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:48 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:48.340068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1656dd9c-f1cf-4ace-987a-860e4c2ae915 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] Calling method '.version_select at 0x7f6d5fa28280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:48.488628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:48.508003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:48.510778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:48.513780 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea012190-45c2-4d1d-bba8-8270d056a337 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1361 microversion: 2.26 time: 0.302791 Oct 19 07:04:48.515633 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1900/3679] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:48 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:48.521763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:48.522171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:48.529738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.530862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.531109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:48.531708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.532190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.532689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:48.787635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:48.798594 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-284549e1-b615-46ca-ac8b-bf24ff800cca tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1315 microversion: 2.1 time: 0.281988 Oct 19 07:04:48.799899 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1901/3680] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:48 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:48.827243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:48.827837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:48.847719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.849149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.850046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:48.853738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:48.854430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:48.855784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.053109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:49.083602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:49.099183 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92e11adb-cd67-4d70-a303-6875a3b1795c tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1505 microversion: 2.1 time: 0.284402 Oct 19 07:04:49.121733 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1902/3681] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:48 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:49.135028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:49.136839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:49.144883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.145690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.146917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.147848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.148593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.149243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.353001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:49.363796 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c431fdad-728b-4826-a3b3-e230d3f6282c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.236343 Oct 19 07:04:49.364422 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1903/3682] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:49 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:49.369297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:49.370044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:49.376378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.377299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.377919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.378931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.379705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.380353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.442608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:49.444587 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d12a9ab-d699-40a4-8aed-a66108a5eb42 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148/os-instance-actions/req-3c314fc9-de68-43b8-9bbd-1f62f13743b8" status: 200 len: 313 microversion: 2.1 time: 0.078987 Oct 19 07:04:49.454894 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1904/3683] 10.222.0.39 () {58 vars in 1419 bytes} [Wed Oct 19 07:04:49 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148/os-instance-actions/req-3c314fc9-de68-43b8-9bbd-1f62f13743b8 => generated 313 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:49.460360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ea39cc88-83a3-462e-bf7c-39d24c61f826 req-bfa4842f-e06f-44ab-a926-8aa9c1ca1cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c15c629-a490-4e4a-82bb-0b6f166b451b", "name": "network-vif-deleted", "tag": "01ada7f3-0271-48db-aa5d-5669f271f2f1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:49.466456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:49.493396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ea39cc88-83a3-462e-bf7c-39d24c61f826 req-bfa4842f-e06f-44ab-a926-8aa9c1ca1cee service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.493922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ea39cc88-83a3-462e-bf7c-39d24c61f826 req-bfa4842f-e06f-44ab-a926-8aa9c1ca1cee service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.494376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ea39cc88-83a3-462e-bf7c-39d24c61f826 req-bfa4842f-e06f-44ab-a926-8aa9c1ca1cee service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.556456 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ea39cc88-83a3-462e-bf7c-39d24c61f826 req-bfa4842f-e06f-44ab-a926-8aa9c1ca1cee service nova] Creating event network-vif-deleted:01ada7f3-0271-48db-aa5d-5669f271f2f1 for instance 4c15c629-a490-4e4a-82bb-0b6f166b451b on n-h2-861333-10 Oct 19 07:04:49.569901 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ea39cc88-83a3-462e-bf7c-39d24c61f826 req-bfa4842f-e06f-44ab-a926-8aa9c1ca1cee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113336 Oct 19 07:04:49.574962 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1905/3684] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:49.581083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:49.588081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:49.605229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.606273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.606907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.607438 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1656dd9c-f1cf-4ace-987a-860e4c2ae915 tempest-SecurityGroupsTestJSON-1361863459 tempest-SecurityGroupsTestJSON-1361863459-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/338fe563-9bc0-41ab-86ba-a177ca90a447" status: 202 len: 0 microversion: 2.1 time: 1.279872 Oct 19 07:04:49.608601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.612217 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1780/3685] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:04:48 2022] DELETE /compute/v2.1/os-security-groups/338fe563-9bc0-41ab-86ba-a177ca90a447 => generated 0 bytes in 1282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:04:49.614728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.615360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.617818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:49.618826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:49.640395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.640896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.641412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.645883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.645883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.646203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.683502 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b HTTP/1.1 Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4c15c629-a490-4e4a-82bb-0b6f166b451b'} Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:04:49.692681 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:49.697981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:04:49.697981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:04:49.697981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:04:49.697981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:04:49.697981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:04:49.697981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:04:49.697981 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:04:49.701245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:04:49.703206 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f46248a-5050-4665-9fb4-bbe0555e0b00 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 404 len: 111 microversion: 2.1 time: 0.093529 Oct 19 07:04:49.716048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=28 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:49.717453 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1781/3686] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:49 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:04:49.728641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46f0e16a-b720-4529-ae02-d394cd45c8f8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:49.731113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:49.747948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46f0e16a-b720-4529-ae02-d394cd45c8f8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:49.750200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:49.751672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:49.754054 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-041ab061-a94e-4e4a-adef-7814f8c5c7b9 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.177915 Oct 19 07:04:49.759820 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1906/3687] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:49 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:49.774410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f0e16a-b720-4529-ae02-d394cd45c8f8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.775023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f0e16a-b720-4529-ae02-d394cd45c8f8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.783172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f0e16a-b720-4529-ae02-d394cd45c8f8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.783172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f0e16a-b720-4529-ae02-d394cd45c8f8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.783172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f0e16a-b720-4529-ae02-d394cd45c8f8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.783172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f0e16a-b720-4529-ae02-d394cd45c8f8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.792055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:49.805814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:49.825826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.826703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.827458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:49.829501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:49.831612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:49.832498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:50.239142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:50.248180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:50.250074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:50.251492 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f8bc891-da99-414d-98ad-1459dcc02023 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1361 microversion: 2.26 time: 0.463449 Oct 19 07:04:50.253202 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1907/3688] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:49 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1361 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:50.258446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:50.259557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:50.277592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:50.278097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:50.278545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:50.279287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:50.279749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:50.280212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:50.437027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:50.445307 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ec38863-e12f-4f60-bc94-2e8bd628d4c5 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1315 microversion: 2.1 time: 0.190792 Oct 19 07:04:50.451593 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1908/3689] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:50 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:50.451792 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46f0e16a-b720-4529-ae02-d394cd45c8f8 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "POST /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148/action" status: 202 len: 0 microversion: 2.1 time: 0.732334 Oct 19 07:04:50.451891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-86765407", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "737f0953-92be-4377-a7d8-73cd2ce52ac7"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:50.455968 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1782/3690] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:04:49 2022] POST /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148/action => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:04:50.466462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:50.468244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:50.489442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:50.490194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:50.490810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:50.492012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:50.492673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:50.493308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:50.532044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] validate_networks() for [('737f0953-92be-4377-a7d8-73cd2ce52ac7', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:04:50.844943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:51.010299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:04:51.011003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:04:51.011613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:04:51.012149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:04:51.012673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:04:51.024976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.025589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.026226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.027083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.027735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.028210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.051320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:04:51.058594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for user 44114105ac6d4e1daf262bbd4b212f5e and project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:04:51.074424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:04:51.077191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:04:51.213989 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb19bd27-20f4-46b5-bd76-9b71b1cb0644 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766940 Oct 19 07:04:51.214644 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1909/3691] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:04:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:04:51.229619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:51.230296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:51.263596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.264148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.271092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.271092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.271092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.271092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.360336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:51.363178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:51.376239 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21c16266-8b2b-4a95-9697-753c8bd0dd6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.914729 Oct 19 07:04:51.377861 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1783/3692] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:50 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:51.390279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:51.393956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:51.411411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.412350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.413546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.417699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.418402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.419027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.538144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:51.550124 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1bfd5f0-8fe5-4b06-9e74-2282c5888635 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1507 microversion: 2.1 time: 0.332922 Oct 19 07:04:51.551854 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1910/3693] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:51 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:51.557413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29fe0eba-08d8-4b58-a9bb-0d31937b09d7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:51.558401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29fe0eba-08d8-4b58-a9bb-0d31937b09d7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:51.641567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29fe0eba-08d8-4b58-a9bb-0d31937b09d7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:51.650916 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29fe0eba-08d8-4b58-a9bb-0d31937b09d7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1213 microversion: 2.1 time: 0.097157 Oct 19 07:04:51.656715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:51.661076 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1911/3694] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:51 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:51.676329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:51.680552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:51.682278 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0d3a22b-c6de-47de-bcc2-08b16550d72e tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.303183 Oct 19 07:04:51.682842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d2048e1c-9776-4790-b452-35092196bf61 req-bf7ccfea-9a03-4354-b312-2cd458cb2bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7eae87e-de7a-44d6-8ce4-a1d129e41770", "name": "network-vif-plugged", "status": "completed", "tag": "69a837ca-1301-4a48-9640-eb0eef267d83"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:51.700151 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1784/3695] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:51 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:51.713001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:51.714831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:51.724718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d2048e1c-9776-4790-b452-35092196bf61 req-bf7ccfea-9a03-4354-b312-2cd458cb2bb7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.725732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d2048e1c-9776-4790-b452-35092196bf61 req-bf7ccfea-9a03-4354-b312-2cd458cb2bb7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.726226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.726723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d2048e1c-9776-4790-b452-35092196bf61 req-bf7ccfea-9a03-4354-b312-2cd458cb2bb7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.727051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.727563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.728363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.729117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.729726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.741378 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d2048e1c-9776-4790-b452-35092196bf61 req-bf7ccfea-9a03-4354-b312-2cd458cb2bb7 service nova] Creating event network-vif-plugged:69a837ca-1301-4a48-9640-eb0eef267d83 for instance b7eae87e-de7a-44d6-8ce4-a1d129e41770 on n-h1-861333-10 Oct 19 07:04:51.748798 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d2048e1c-9776-4790-b452-35092196bf61 req-bf7ccfea-9a03-4354-b312-2cd458cb2bb7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084719 Oct 19 07:04:51.749692 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1912/3696] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:51.758243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:51.759739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:51.776233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.777121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.777849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:51.779040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:51.780723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:51.781375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:52.315723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:52.331613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:52.338647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:52.340330 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9db4284e-bd06-4d99-a8dc-9155c69ebb06 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1361 microversion: 2.26 time: 0.642977 Oct 19 07:04:52.348459 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1785/3697] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:51 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1361 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:52.367728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7103443e-378b-41b8-ab4a-5bb83b9dc743 req-fa343662-fe3a-49c9-8b24-6ea669c07c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100824f4-a1a7-4986-8640-553dd4b16604", "tag": "0a83b865-7619-434e-88d6-ffeaf8d8dfdd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:04:52.393863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7103443e-378b-41b8-ab4a-5bb83b9dc743 req-fa343662-fe3a-49c9-8b24-6ea669c07c19 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:52.394728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7103443e-378b-41b8-ab4a-5bb83b9dc743 req-fa343662-fe3a-49c9-8b24-6ea669c07c19 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:52.399275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7103443e-378b-41b8-ab4a-5bb83b9dc743 req-fa343662-fe3a-49c9-8b24-6ea669c07c19 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:52.430049 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7103443e-378b-41b8-ab4a-5bb83b9dc743 req-fa343662-fe3a-49c9-8b24-6ea669c07c19 service nova] Creating event network-changed:0a83b865-7619-434e-88d6-ffeaf8d8dfdd for instance 100824f4-a1a7-4986-8640-553dd4b16604 on n-h2-861333-10 Oct 19 07:04:52.438898 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7103443e-378b-41b8-ab4a-5bb83b9dc743 req-fa343662-fe3a-49c9-8b24-6ea669c07c19 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088343 Oct 19 07:04:52.440743 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1786/3698] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:52.447671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:52.448802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:52.457792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:52.458713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:52.459453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:52.460871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:52.461601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:52.462629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:52.553063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:52.562026 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d982d872-3a1f-41af-99c3-5befc2f108ec tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1315 microversion: 2.1 time: 0.810855 Oct 19 07:04:52.564478 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1913/3699] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:51 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:52.583312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:52.584549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:52.599886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:52.603083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:52.608856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:52.609709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:52.610196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:52.611926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:52.827299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:52.840718 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35df808c-4671-4539-b6b9-03d5ab0f2ac7 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1507 microversion: 2.1 time: 0.265863 Oct 19 07:04:52.841659 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1914/3700] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:52 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:52.852860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:52.873348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:52.883171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:52.885133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:52.885575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:52.886286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:52.886741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:52.887171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:52.902233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:52.979500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:52.988914 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bb164d2-bc20-45f8-88da-4bd750b63477 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1217 microversion: 2.1 time: 0.145047 Oct 19 07:04:52.990137 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1915/3701] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:52 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:53.009258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:53.009876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:53.023107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:53.023642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:53.024319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:53.025409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:53.027094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:53.027568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:53.145851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:53.154751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:53.164098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:53.165542 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1043dad0-bcaf-49b5-ad4f-4bad428b2411 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.173810 Oct 19 07:04:53.183735 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1916/3702] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:52 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:53.377910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:53.382990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:53.402451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:53.403320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:53.404293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:53.405505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:53.407886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:53.408596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:53.642748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:53.651104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:53.656562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:53.658887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:53.660180 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fff0b07e-e182-4cab-8145-46a4774f895d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 1.217743 Oct 19 07:04:53.660695 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8778df3f-2eaf-45c0-aee2-b3f5b027127e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1361 microversion: 2.26 time: 0.288962 Oct 19 07:04:53.660948 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1787/3703] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:52 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:53.662256 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1917/3704] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:53 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:04:53.666909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:53.667873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:53.676300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:53.677170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:53.678059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:53.678854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:53.679374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:53.679864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:53.866393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:53.867653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:53.888859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:53.890635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:53.891536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:53.897117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:53.897841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:53.898308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:54.117332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:54.127221 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37f4e26e-90f6-45c4-96dc-8405f37aaef9 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1507 microversion: 2.1 time: 0.266682 Oct 19 07:04:54.129052 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1918/3705] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:53 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:54.134416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:54.135303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:54.143723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:54.144745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:54.145466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:54.146671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:54.147346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:54.147992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:54.196073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:54.211661 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7e005e9-57f1-4b04-99b2-6512f78f1e20 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1315 microversion: 2.1 time: 0.549026 Oct 19 07:04:54.214049 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1788/3706] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:53 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:54.219184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:54.241077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:54.253934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:54.263223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7aac35d0-b8d7-48cf-9dba-f5aa62f14676 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1265 microversion: 2.1 time: 0.132881 Oct 19 07:04:54.266036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:54.266549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:54.267048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:54.268772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:54.269454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:54.270273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:54.271372 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1919/3707] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:54 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:54.465552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:54.480035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:54.483128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:54.484438 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-77bca2fa-1262-4f51-9df6-48ca9c3f4cb4 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.269035 Oct 19 07:04:54.485298 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1789/3708] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:54 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:54.697396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:54.697396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:54.698048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:54.698655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:54.735943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:54.737254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:54.753408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:54.754668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:54.755616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:54.757366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:54.758161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:54.759083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:54.759767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:54.762575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:54.766038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:54.767157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.032144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:55.043341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:55.045217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:55.046576 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa345e73-94ca-4e4b-94e9-cfc2c333ce16 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1545 microversion: 2.26 time: 0.361138 Oct 19 07:04:55.047533 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1920/3709] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:54 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1545 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:55.075763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5fa3d4c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:55.090240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:55.095707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:55.096644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.097232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:55.108841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:55.109355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:55.109811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.110538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:55.111060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:55.125611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.203109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:55.205272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:55.206150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.302039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:55.304051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:55.304546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.436413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:04:55.493178 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1a0f07d-00af-4c79-9c29-f3a3b68f4c36 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1393541499" status: 201 len: 0 microversion: 2.26 time: 0.414805 Oct 19 07:04:55.500032 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1921/3710] 10.222.0.39 () {62 vars in 1380 bytes} [Wed Oct 19 07:04:55 2022] PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1393541499 => generated 0 bytes in 425 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 07:04:55.517956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:55.518583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:55.559610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:55.560422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:55.561303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.562391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:55.563104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:55.564695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.915278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:55.928798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:55.929976 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-455f4bac-d2c5-46ef-9016-d50405515533 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 1.239475 Oct 19 07:04:55.930930 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1790/3711] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:54 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:04:55.944391 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc33f391-65ba-4c36-a32f-c585dcfdb4e4 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1512 microversion: 2.1 time: 0.440993 Oct 19 07:04:55.949580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:55.955168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:55.964901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:55.969746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:55.970523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.971647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:55.972323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:55.973191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:55.976655 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1922/3712] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:55 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:55.996069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:56.016469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:56.033022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.034089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.036786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.037882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.038519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.040987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b43d6759-a16c-4d0f-a7ef-38d162a21f48 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1271 microversion: 2.1 time: 0.218746 Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1923/3713] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:55 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-681776f6-10d7-4a3f-80a1-6f8e7ff06250 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5f9d6d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-681776f6-10d7-4a3f-80a1-6f8e7ff06250 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-681776f6-10d7-4a3f-80a1-6f8e7ff06250 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-681776f6-10d7-4a3f-80a1-6f8e7ff06250 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-681776f6-10d7-4a3f-80a1-6f8e7ff06250 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1393541499" status: 204 len: 0 microversion: 2.26 time: 0.060435 Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1924/3714] 10.222.0.39 () {60 vars in 1361 bytes} [Wed Oct 19 07:04:56 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1393541499 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.321023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.322594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.322594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.322594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.322594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.395757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:56.410379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:56.412050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:56.414483 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1576555-f159-4f96-a951-929a3402d45d tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.153653 Oct 19 07:04:56.428156 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1925/3715] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:56 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:56.428156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5fa21e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:56.442802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.450544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.450879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.451647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:56.467346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.468303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.468997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.470500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.471815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.472519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.550606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.551755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.552491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.683347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:04:56.690860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:56.703620 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b62b5391-b1a7-4532-a83e-a6692900b8fc tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1315 microversion: 2.1 time: 0.770988 Oct 19 07:04:56.704140 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1791/3716] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:55 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:56.739691 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf91ee89-19dd-4c06-bc64-e9b367e75baf tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 204 len: 0 microversion: 2.26 time: 0.316479 Oct 19 07:04:56.743814 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1926/3717] 10.222.0.39 () {60 vars in 1295 bytes} [Wed Oct 19 07:04:56 2022] DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:04:56.758377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7298479-2d1e-4c5e-a086-5bc9901b5600 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5fa28f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:56.805320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7298479-2d1e-4c5e-a086-5bc9901b5600 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.805320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7298479-2d1e-4c5e-a086-5bc9901b5600 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.805320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7298479-2d1e-4c5e-a086-5bc9901b5600 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.855024 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c7298479-2d1e-4c5e-a086-5bc9901b5600 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 200 len: 12 microversion: 2.26 time: 0.102568 Oct 19 07:04:56.864809 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1792/3718] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 07:04:56 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 12 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:56.874367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5fa2c0d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:56.907675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.917292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.921066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.928268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:56.953525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.955822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.958506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:56.959261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:56.959915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.968594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.969602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.971049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.972763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.980483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.981050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:56.987514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:56.988734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:56.991833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.057773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.058527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.060592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.084836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.089161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.091103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.226645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:04:57.283172 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c0476e0-187e-436e-8657-965cc84f61d4 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1548186271" status: 201 len: 0 microversion: 2.26 time: 0.418516 Oct 19 07:04:57.285027 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1927/3719] 10.222.0.39 () {62 vars in 1380 bytes} [Wed Oct 19 07:04:56 2022] PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1548186271 => generated 0 bytes in 424 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 07:04:57.295446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:57.300091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:57.313775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.318791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.320202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.323017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.328914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.328914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.344297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:57.431810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:57.442323 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21be57a6-bbb3-472d-9b30-03256e72bd18 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.489321 Oct 19 07:04:57.443985 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1793/3720] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:56 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:57.448922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:57.449807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:57.457371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.458133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.458762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.459646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.460355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.460958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.769973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:57.770497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:57.778420 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81f29799-e520-468f-9b7d-62d7e546d8f3 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1505 microversion: 2.1 time: 0.492041 Oct 19 07:04:57.780004 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1928/3721] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:57 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:57.805071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d251c4c-e266-45de-a59f-2fd858171a86 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5f9d6280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:57.807111 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-daa91e4d-6994-4a10-b475-7a5a45322349 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1271 microversion: 2.1 time: 0.361797 Oct 19 07:04:57.810737 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1794/3722] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:57 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1271 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:57.836556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:57.837530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:57.838897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d251c4c-e266-45de-a59f-2fd858171a86 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.841549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d251c4c-e266-45de-a59f-2fd858171a86 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.844035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d251c4c-e266-45de-a59f-2fd858171a86 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.851850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.854100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.855531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.858162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.858865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.860815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.869319 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d251c4c-e266-45de-a59f-2fd858171a86 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 200 len: 36 microversion: 2.26 time: 0.087952 Oct 19 07:04:57.873761 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1929/3723] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 07:04:57 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 36 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:57.885996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:57.886637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:57.901405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.901923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.902425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:57.903151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:57.903660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:57.906551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.079980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:58.098169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:58.105385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:58.107565 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c473e84-c8aa-40f1-90bc-0a48f78617e6 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.295634 Oct 19 07:04:58.109738 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1795/3724] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:57 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:04:58.123394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-650f9a86-d1c7-4471-aa3c-8ff34786f3dc tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '.version_select at 0x7f6d5f996700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:58.126461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-650f9a86-d1c7-4471-aa3c-8ff34786f3dc tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:58.152533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-650f9a86-d1c7-4471-aa3c-8ff34786f3dc tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.153335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-650f9a86-d1c7-4471-aa3c-8ff34786f3dc tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.154762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-650f9a86-d1c7-4471-aa3c-8ff34786f3dc tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.165132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-650f9a86-d1c7-4471-aa3c-8ff34786f3dc tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.166307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-650f9a86-d1c7-4471-aa3c-8ff34786f3dc tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.167091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-650f9a86-d1c7-4471-aa3c-8ff34786f3dc tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.207474 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-650f9a86-d1c7-4471-aa3c-8ff34786f3dc tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.096456 Oct 19 07:04:58.216159 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1796/3725] 10.222.0.39 () {58 vars in 1296 bytes} [Wed Oct 19 07:04:58 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148/os-instance-actions => generated 611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:04:58.216159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d64025550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:58.223618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.224094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.225202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.225202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:58.231570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.232070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.232602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.233282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.233795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.234748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.262993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.267616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.267616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.379518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:04:58.428275 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afebc110-810c-46d8-9012-7fe81992bc9e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1548186271" status: 204 len: 0 microversion: 2.26 time: 0.217622 Oct 19 07:04:58.432569 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1797/3726] 10.222.0.39 () {60 vars in 1364 bytes} [Wed Oct 19 07:04:58 2022] DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1548186271 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:04:58.441703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:58.442213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:58.474405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.475242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.475754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.488903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.489689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.490378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.517013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:58.548136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:04:58.555539 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a75b835-4e2e-410c-b10c-5536bf6271a1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1315 microversion: 2.1 time: 0.673520 Oct 19 07:04:58.575682 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1930/3727] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:57 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:58.597457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3d620f1-5c5a-4acb-b5a0-98edfda56953 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5f9d6f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:58.634266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d620f1-5c5a-4acb-b5a0-98edfda56953 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.634781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d620f1-5c5a-4acb-b5a0-98edfda56953 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.639848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d620f1-5c5a-4acb-b5a0-98edfda56953 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.669045 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3d620f1-5c5a-4acb-b5a0-98edfda56953 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 200 len: 12 microversion: 2.26 time: 0.091984 Oct 19 07:04:58.673401 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1931/3728] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 07:04:58 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 12 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:58.686680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:04:58.696453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:58.696453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:58.709980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.717298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.717947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.722566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.723191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.723721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.876311 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a624bf60-18db-4bfb-96a7-ba2f2328b845 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 204 len: 0 microversion: 2.1 time: 0.441976 Oct 19 07:04:58.878083 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1798/3729] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:04:58 2022] DELETE /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:04:58.885731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5fa285e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:58.903293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.904136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.905707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.919630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:58.935964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.938336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.938848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.940412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.941136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:58.941785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:58.998463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:58.999394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.000059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.028733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:04:59.050535 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b764bab-d9f4-41b9-bcc5-81d816eb1e89 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 204 len: 0 microversion: 2.26 time: 0.169821 Oct 19 07:04:59.056685 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1799/3730] 10.222.0.39 () {60 vars in 1295 bytes} [Wed Oct 19 07:04:58 2022] DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:04:59.062048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:59.063057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:59.070186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.071200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.071855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.072851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.073528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.074170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.162966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:59.170902 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a875cbd-d8c7-4bf7-86fa-8a2bcf9390f4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.495849 Oct 19 07:04:59.193334 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1932/3731] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:58 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:59.198324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:59.198890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:59.249816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.250143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.250588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.254615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.254615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.254615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.763191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:59.780021 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8282f858-07af-489e-abca-605d76e0355f tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1511 microversion: 2.1 time: 0.584342 Oct 19 07:04:59.781045 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1933/3732] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:59 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1511 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:59.790544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5f9e1ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:59.812454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.813346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.814020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.816064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:59.824061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.824587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.825252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.826741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.827373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.828023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.831328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:04:59.844644 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f695f15a-86df-478b-b412-9365de295de1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1313 microversion: 2.1 time: 0.786492 Oct 19 07:04:59.846031 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1800/3733] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:04:59 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1313 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:04:59.860731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:04:59.863859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:04:59.874635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.875372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.877718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.881392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.882091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.883758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.919655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.920497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.921195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:04:59.948018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:04:59.948018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:04:59.948018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.070282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:00.102231 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-884fc27d-ef5f-420f-8283-308408dda07e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-2117092278" status: 201 len: 0 microversion: 2.26 time: 0.315450 Oct 19 07:05:00.114758 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1934/3734] 10.222.0.39 () {62 vars in 1380 bytes} [Wed Oct 19 07:04:59 2022] PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-2117092278 => generated 0 bytes in 328 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 07:05:00.123809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-82147ff0-671f-4de1-8b71-f3355170205a req-390ada4f-b4f1-4033-96ab-81c14fe0afec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100824f4-a1a7-4986-8640-553dd4b16604", "name": "network-vif-plugged", "status": "completed", "tag": "0a83b865-7619-434e-88d6-ffeaf8d8dfdd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:00.136308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-82147ff0-671f-4de1-8b71-f3355170205a req-390ada4f-b4f1-4033-96ab-81c14fe0afec service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.137105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-82147ff0-671f-4de1-8b71-f3355170205a req-390ada4f-b4f1-4033-96ab-81c14fe0afec service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.137776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-82147ff0-671f-4de1-8b71-f3355170205a req-390ada4f-b4f1-4033-96ab-81c14fe0afec service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.153981 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-82147ff0-671f-4de1-8b71-f3355170205a req-390ada4f-b4f1-4033-96ab-81c14fe0afec service nova] Creating event network-vif-plugged:0a83b865-7619-434e-88d6-ffeaf8d8dfdd for instance 100824f4-a1a7-4986-8640-553dd4b16604 on n-h2-861333-10 Oct 19 07:05:00.175664 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-82147ff0-671f-4de1-8b71-f3355170205a req-390ada4f-b4f1-4033-96ab-81c14fe0afec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054510 Oct 19 07:05:00.175664 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1935/3735] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:00.191426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:00.203593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:00.211634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.213264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.213264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.213945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.216278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.216954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.522790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:00.534663 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf5088ce-3594-4427-b31c-650217ff67b4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1315 microversion: 2.1 time: 0.360929 Oct 19 07:05:00.550165 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1936/3736] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:00 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:00.557307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5f9d65e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:00.572685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.574326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.575304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.576129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:00.584942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.586086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.588662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.589668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.590695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.591478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.601904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:00.616277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:00.623303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:00.626557 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa4b263e-52ec-4d85-9704-40c53142d1d8 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.779533 Oct 19 07:05:00.630163 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1801/3737] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:04:59 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:00.659232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:00.666297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:00.691448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.700526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.705361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.706067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.707017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.707305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.707499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.707937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.708471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.739882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.742867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.744216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.855802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:00.887359 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73c0e508-f7ad-41c3-ab11-0cf4c382c121 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1111750343" status: 201 len: 0 microversion: 2.26 time: 0.332976 Oct 19 07:05:00.888437 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1937/3738] 10.222.0.39 () {62 vars in 1380 bytes} [Wed Oct 19 07:05:00 2022] PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1111750343 => generated 0 bytes in 338 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 07:05:00.902501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:00.906100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:00.917573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.918851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.921527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:00.922363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:00.922939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:00.925794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.040024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:01.118357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:01.127199 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8810836-5462-422a-a183-142615ac63b2 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1511 microversion: 2.1 time: 0.232010 Oct 19 07:05:01.128531 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1938/3739] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:00 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:01.135408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:01.136028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:01.144953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.145458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.145902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.146621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.147202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.148332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.327306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:01.336997 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f531dd6-1c4a-4919-b290-90e96ff1deeb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1313 microversion: 2.1 time: 0.207581 Oct 19 07:05:01.358866 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1939/3740] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:01 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:01.365901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5fa3dee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:01.375348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.376267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.377134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.377637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:01.380650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:01.384784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.385296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.385747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.386462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.386930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.387668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.400225 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9eb3abde-d657-4106-b7bb-8623898e8165 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.766549 Oct 19 07:05:01.402844 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1802/3741] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:00 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:01.413925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.414429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.414878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.496224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:01.516571 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d489f9ff-1f20-416f-b2c4-d10992a1ba65 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 204 len: 0 microversion: 2.26 time: 0.156344 Oct 19 07:05:01.517598 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1940/3742] 10.222.0.39 () {60 vars in 1295 bytes} [Wed Oct 19 07:05:01 2022] DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:05:01.526799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cec3bb68-9a0f-4430-a3d4-2d300561f350 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5f9f0a60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:01.542729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cec3bb68-9a0f-4430-a3d4-2d300561f350 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.546098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cec3bb68-9a0f-4430-a3d4-2d300561f350 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.547785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cec3bb68-9a0f-4430-a3d4-2d300561f350 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.561565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:01.562343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:01.571277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:01.573542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.574277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.574783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.575747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.577691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.577691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.577925 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cec3bb68-9a0f-4430-a3d4-2d300561f350 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 200 len: 12 microversion: 2.26 time: 0.053902 Oct 19 07:05:01.579396 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1803/3743] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 07:05:01 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:01.591461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5fa284c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:01.608483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.610510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.613882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.614857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:01.630122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.631621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.632293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.633244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.634566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.635264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.650484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:01.671863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.672716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.675790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.694455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:01.721544 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b369e2c-8b33-42e8-a5c7-3283b71b40ac tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 204 len: 0 microversion: 2.26 time: 0.134456 Oct 19 07:05:01.722725 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1804/3744] 10.222.0.39 () {60 vars in 1295 bytes} [Wed Oct 19 07:05:01 2022] DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 07:05:01.730824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:01.733380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:01.742310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.743067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.743700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.745324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.746009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.748581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.833701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:01.847707 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0584bccc-250a-46ea-9589-7a16d9b59030 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1315 microversion: 2.1 time: 0.293137 Oct 19 07:05:01.865622 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1941/3745] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:01 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:01.871620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5f9d84c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:01.882669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.883971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.883971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.884876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:01.894393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.895136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.896465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.897915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.898905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.899547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.938586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:01.940947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.941576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.943175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:01.955224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:01.956755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:01.958075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.042459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:02.056847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:02.063107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:02.065769 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bb69137-bd02-4686-974e-56e95d6ac97f tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.340398 Oct 19 07:05:02.070651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:02.081308 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1805/3746] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:01 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:02.123288 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a025630-f89e-41b0-a059-9488c5c7c7b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1191502667" status: 201 len: 0 microversion: 2.26 time: 0.255702 Oct 19 07:05:02.126732 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1942/3747] 10.222.0.39 () {62 vars in 1380 bytes} [Wed Oct 19 07:05:01 2022] PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1191502667 => generated 0 bytes in 260 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 07:05:02.145583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5fa3d430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:02.179703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.184237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.186752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.187297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:02.202445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.203773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.204557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.208463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.209133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.210108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.318077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.318885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.319654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.352890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.357156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.358450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.465667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b45dc721-c1b1-4506-89bb-fef2b1a231ea req-0cc6a383-26bc-4056-a3a1-db8011a2bde2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9", "tag": "6bc8a5cc-5493-4884-9e5b-6ed594a88670"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:02.482457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b45dc721-c1b1-4506-89bb-fef2b1a231ea req-0cc6a383-26bc-4056-a3a1-db8011a2bde2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.483252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b45dc721-c1b1-4506-89bb-fef2b1a231ea req-0cc6a383-26bc-4056-a3a1-db8011a2bde2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.483958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b45dc721-c1b1-4506-89bb-fef2b1a231ea req-0cc6a383-26bc-4056-a3a1-db8011a2bde2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.498401 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b45dc721-c1b1-4506-89bb-fef2b1a231ea req-0cc6a383-26bc-4056-a3a1-db8011a2bde2 service nova] Creating event network-changed:6bc8a5cc-5493-4884-9e5b-6ed594a88670 for instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 on n-h2-861333-10 Oct 19 07:05:02.504474 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b45dc721-c1b1-4506-89bb-fef2b1a231ea req-0cc6a383-26bc-4056-a3a1-db8011a2bde2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.421661 Oct 19 07:05:02.505484 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1806/3748] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:02.511147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:02.511867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:02.542787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.543540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.544905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.549188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:02.555447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.556335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.561906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.599029 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8841481b-f17f-40c6-a828-e22da69f304f tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1984741670" status: 201 len: 0 microversion: 2.26 time: 0.466882 Oct 19 07:05:02.600475 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1943/3749] 10.222.0.39 () {62 vars in 1380 bytes} [Wed Oct 19 07:05:02 2022] PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags/tempest-tag-1984741670 => generated 0 bytes in 469 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 07:05:02.613015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:02.614626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:02.624483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.625323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.625998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.626952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.627751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.628451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.653805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.654309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.657371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.658151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lazy-loading 'fault' on Instance uuid cd3cec50-7f84-4777-a083-66cb80f01148 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:02.822035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:02.833595 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e83836c7-692d-4f7b-8399-c115329c8a61 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1306 microversion: 2.1 time: 0.323951 Oct 19 07:05:02.834202 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1807/3750] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:02 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1306 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:02.865556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:02.867254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:02.892578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:02.899207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.905951 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bd74055-b429-494b-8c51-73c530341f6b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1313 microversion: 2.1 time: 0.301713 Oct 19 07:05:02.914772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.928862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.928862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.928862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.928862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.929244 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1944/3751] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:02 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:02.936946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Action: 'update_all', calling method: .version_select at 0x7f6d5f981b80>, body: {"tags": ["tempest-tag-1908666073", "tempest-tag-1230559573"]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:02.962838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.963777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.965740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.967126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:02.975404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.975898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.978078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:02.979791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:02.981100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:02.981542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.058929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.059357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.059803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.191588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:03.199142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:03.210748 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32178419-099c-43eb-8145-08b10aba5ffb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.372415 Oct 19 07:05:03.225487 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1808/3752] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:02 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:03.232771 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afb473b3-521b-42f1-b7b5-0ac7528b3416 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 200 len: 62 microversion: 2.26 time: 0.306319 Oct 19 07:05:03.233744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:03.234872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:03.237127 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1945/3753] 10.222.0.39 () {62 vars in 1312 bytes} [Wed Oct 19 07:05:02 2022] PUT /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 62 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:03.242456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.242642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:03.242999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.243122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:03.243435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.244150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.245230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.245719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.251011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.251011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.253605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.253605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.253605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.253605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.373852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:03.389627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:03.391119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:03.392324 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1e5626a-e5ff-481e-9709-b7592b61b4af tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.154145 Oct 19 07:05:03.409980 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1946/3754] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:03 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:03.415690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0277e12-15dd-4f2d-a31e-750860d8ee91 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5f9d8c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:03.425359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0277e12-15dd-4f2d-a31e-750860d8ee91 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.425849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0277e12-15dd-4f2d-a31e-750860d8ee91 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.426291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0277e12-15dd-4f2d-a31e-750860d8ee91 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.441105 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0277e12-15dd-4f2d-a31e-750860d8ee91 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 200 len: 62 microversion: 2.26 time: 0.029375 Oct 19 07:05:03.442041 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1947/3755] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 07:05:03 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 62 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:03.452129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '.version_select at 0x7f6d5f981e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:03.458518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:03.463706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.464613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.465067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.466215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:03.472616 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1162174d-0810-4f4a-96c6-1a595e074e7b tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1504 microversion: 2.1 time: 0.245791 Oct 19 07:05:03.473398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.473760 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1809/3756] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:03 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:03.473885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.474316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.475022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.475628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.476071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.503677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.504198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.504644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.512773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:03.516779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:03.522170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.522663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.523105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.523862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.524340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.524990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.575261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:05:03.598843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'flavor' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:03.618422 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19311aae-81b3-47c9-bfc6-b9745217681c tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags" status: 204 len: 0 microversion: 2.26 time: 0.170382 Oct 19 07:05:03.619535 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1948/3757] 10.222.0.39 () {60 vars in 1295 bytes} [Wed Oct 19 07:05:03 2022] DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770/tags => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 07:05:03.633790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:03.635741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:03.642865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.643413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.643851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.644591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:03.645057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:03.645488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:03.675747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:05:04.121515 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa22a031-a112-4a42-a617-3667bf80f9f4 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "DELETE /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 204 len: 0 microversion: 2.1 time: 0.621897 Oct 19 07:05:04.122136 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1810/3758] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:05:03 2022] DELETE /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:05:04.127184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:04.127880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:04.133837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.134616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.135101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.135795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.136285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.136902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.173228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.173720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.174164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.174629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lazy-loading 'fault' on Instance uuid cd3cec50-7f84-4777-a083-66cb80f01148 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:04.321629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8adbb04351494aba53855be51a6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b219af459e4952859c28e03e081f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:04.329509 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6307e4d1-6f96-4468-b441-900544629628 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 200 len: 1306 microversion: 2.1 time: 0.206007 Oct 19 07:05:04.344645 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1811/3759] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:04 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 1306 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:04.351111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:04.351733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:04.359965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.361010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.361475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.362918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.363695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.367773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.384679 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ff3e3b4-babc-4a8d-a32e-0c131c62d8b0 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 204 len: 0 microversion: 2.26 time: 0.755831 Oct 19 07:05:04.386635 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1949/3760] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:05:03 2022] DELETE /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:05:04.392299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:04.393809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:04.401798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.401798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.402542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.404039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.404884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.405599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.566428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:04.577063 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3b52a53-ed42-4d7d-838f-b7ec696757ac tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1313 microversion: 2.1 time: 0.231205 Oct 19 07:05:04.578446 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1812/3761] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:04 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:04.584535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:04.585759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:04.592534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:04.594239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.594936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.595637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.596663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.597370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.597998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.622671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=2,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:04.689137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:04.715848 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-449dc85a-799f-4a32-acd7-c5db75721471 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1510 microversion: 2.1 time: 0.327745 Oct 19 07:05:04.727886 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1950/3762] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:04 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:04.727886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:04.727886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:04.748952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.751176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.751821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.755875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.756673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.758747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.868875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:04.877668 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17978511-8730-450a-b593-1527d383d073 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.296863 Oct 19 07:05:04.878441 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1813/3763] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:04 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:04.883177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:04.883780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:04.889868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.890352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.891008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:04.892019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:04.892496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:04.893122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:05.032701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:05.063460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:05.064186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:05.066614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:05.068820 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f20c4c8-bbff-43f7-b114-f342d6672c44 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.189191 Oct 19 07:05:05.080548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:05.080548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:05.080548 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-876d6e16-9d20-473d-9018-0d16ed3edd35 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1551 microversion: 2.26 time: 0.359474 Oct 19 07:05:05.095326 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1814/3765] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:04 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:05.100212 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1951/3765] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:04 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1551 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:05.104374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-38f5d12a-bfeb-4e0a-b075-0641445b6534 req-19961715-6f18-4470-855d-3145aac980cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd3cec50-7f84-4777-a083-66cb80f01148", "name": "network-vif-deleted", "tag": "bfa63ee0-aed6-48d1-8337-7a9fac6bbca7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:05.118131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-38f5d12a-bfeb-4e0a-b075-0641445b6534 req-19961715-6f18-4470-855d-3145aac980cb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:05.119270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-38f5d12a-bfeb-4e0a-b075-0641445b6534 req-19961715-6f18-4470-855d-3145aac980cb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:05.119926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-38f5d12a-bfeb-4e0a-b075-0641445b6534 req-19961715-6f18-4470-855d-3145aac980cb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:05.132790 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-38f5d12a-bfeb-4e0a-b075-0641445b6534 req-19961715-6f18-4470-855d-3145aac980cb service nova] Creating event network-vif-deleted:bfa63ee0-aed6-48d1-8337-7a9fac6bbca7 for instance cd3cec50-7f84-4777-a083-66cb80f01148 on n-h2-861333-10 Oct 19 07:05:05.142330 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-38f5d12a-bfeb-4e0a-b075-0641445b6534 req-19961715-6f18-4470-855d-3145aac980cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043424 Oct 19 07:05:05.143386 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1815/3766] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:05.358961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:05.359345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] [instance: cd3cec50-7f84-4777-a083-66cb80f01148] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:05.374851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:05.375359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:05.375800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:05.378260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:05.390206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:05.391570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:05.414429 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] HTTP exception thrown: Instance cd3cec50-7f84-4777-a083-66cb80f01148 could not be found. Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Request method failure captured: Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 HTTP/1.1 Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6Fy1pOJ-ShZZ9-U5htbcqRszxIcTX8_tQE4b9L_afz_Khv76LImB3lDjw9kmMSqZyysXlfdi18G8YCdz4zcOsOazUfQAYC-CA_l2adeycr1jtpvCt47AhHfh1JcMx0AhycI-0-q3bkgGBjo7FqrgVQcsekVegNs5ZUWTCL-ux3UyYg Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 58b219af459e4952859c28e03e081f7d Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsTestJSON-138448983 Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/58b219af459e4952859c28e03e081f7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/58b219af459e4952859c28e03e081f7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/58b219af459e4952859c28e03e081f7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_58b219af459e4952859c28e03e081f7d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsTestJSON-138448983 Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 58b219af459e4952859c28e03e081f7d Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsTestJSON-138448983 Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsTestJSON-138448983-project Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: cc8adbb04351494aba53855be51a6565 Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsTestJSON-138448983-project Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance cd3cec50-7f84-4777-a083-66cb80f01148 could not be found. Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'cd3cec50-7f84-4777-a083-66cb80f01148'} Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd3cec50-7f84-4777-a083-66cb80f01148 could not be found. Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd3cec50-7f84-4777-a083-66cb80f01148 could not be found. Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:05.417630 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:05.424035 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:05.424035 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:05.424035 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:05.424035 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:05.424035 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:05.424035 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd3cec50-7f84-4777-a083-66cb80f01148 could not be found. Oct 19 07:05:05.424035 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:05.426169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] Returning 404 to user: Instance cd3cec50-7f84-4777-a083-66cb80f01148 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:05.427484 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3f1dafb-8341-4c86-b816-3f2251e58275 tempest-InstanceActionsTestJSON-138448983 tempest-InstanceActionsTestJSON-138448983-project] 10.222.0.39 "GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148" status: 404 len: 111 microversion: 2.1 time: 0.073392 Oct 19 07:05:05.429184 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1952/3767] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:05 2022] GET /compute/v2.1/servers/cd3cec50-7f84-4777-a083-66cb80f01148 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:05.617108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:05.625630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:05.647890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:05.648908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:05.649368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:05.650105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:05.661390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:05.665355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:05.751101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:05.752054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:05.762033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:05.765331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:05.766179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:05.768837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:05.771389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:05.772063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:05.794201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:06.097141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:06.108813 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7b234a3-4cbd-4809-a150-5592b709e32d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1313 microversion: 2.1 time: 0.507923 Oct 19 07:05:06.109440 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1816/3768] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:05 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:06.132442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:06.132979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:06.158150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:06.158691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:06.159139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:06.159864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:06.160350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:06.160975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:06.242101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:06.250038 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4a3531c-13ec-44ad-8818-4f193a270baf tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1510 microversion: 2.1 time: 0.503701 Oct 19 07:05:06.250687 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1953/3769] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:05 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1510 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:06.275321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:06.276420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:06.284718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:06.289156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:06.289156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:06.289156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:06.289156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:06.289156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:06.447299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:06.460434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:06.464366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:06.468000 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4bc2ab5-ca4c-473a-8da0-2f9bfca4a2d7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1366 microversion: 2.57 time: 0.200092 Oct 19 07:05:06.468835 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1954/3770] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:06 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:06.475979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:06.476535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:06.482908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:06.483626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:06.484320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:06.490821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:06.491402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:06.491844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:06.824390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:06.834374 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1406cf8-f11c-4d68-957f-4d6fc657c5b4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1683 microversion: 2.1 time: 0.709053 Oct 19 07:05:06.841507 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1817/3771] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:06 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1683 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:06.868792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:06.877906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:06.884133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:06.885960 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6e8c21f-0241-4e45-bcc3-e8e5fc729178 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1551 microversion: 2.26 time: 0.414876 Oct 19 07:05:06.904250 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1955/3772] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:06 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1551 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:07.136709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:07.137425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:07.146491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:07.150526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:07.153804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:07.154704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:07.156636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:07.158075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:07.283274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:07.287482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:07.297618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:07.298572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:07.299638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:07.301417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:07.302135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:07.302583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:07.789309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:07.798890 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ebe8c3f4-36ef-4862-ad0f-5d02a51900a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1313 microversion: 2.1 time: 0.666995 Oct 19 07:05:07.800806 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1818/3773] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:07 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:07.807865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:07.809993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:07.821188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:07.822637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:07.824224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:07.825528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:07.826836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:07.827542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:07.900495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:07.916422 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7305684b-f7db-4f0e-9c3e-66524fec0dc1 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1468 microversion: 2.1 time: 0.639922 Oct 19 07:05:07.917008 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1956/3774] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:07 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1468 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:07.928932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:07.929750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:07.945533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:07.945533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:07.945533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:07.945533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:07.948334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:07.953388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:08.050867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:08.068822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:08.074505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:08.076923 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3fdc8998-c13b-4cf4-bda7-2306d5925ce7 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1372 microversion: 2.57 time: 0.274798 Oct 19 07:05:08.077906 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1819/3775] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:07 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:08.086174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:08.088594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:08.096932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:08.097917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:08.098585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:08.100084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:08.100961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:08.102011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:08.227383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:08.240322 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6367be2-5bcb-4dd0-8601-76ce66560e2e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.319074 Oct 19 07:05:08.240920 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1957/3776] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:07 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:08.250793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-98eb859b-eb61-4b2c-b025-dd48620a083d req-4c6a4558-fe73-48bd-9a03-cf4b8be16ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100824f4-a1a7-4986-8640-553dd4b16604", "name": "network-vif-deleted", "tag": "0a83b865-7619-434e-88d6-ffeaf8d8dfdd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:08.281132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-98eb859b-eb61-4b2c-b025-dd48620a083d req-4c6a4558-fe73-48bd-9a03-cf4b8be16ff2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:08.281623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-98eb859b-eb61-4b2c-b025-dd48620a083d req-4c6a4558-fe73-48bd-9a03-cf4b8be16ff2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:08.284320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-98eb859b-eb61-4b2c-b025-dd48620a083d req-4c6a4558-fe73-48bd-9a03-cf4b8be16ff2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:08.354060 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-98eb859b-eb61-4b2c-b025-dd48620a083d req-4c6a4558-fe73-48bd-9a03-cf4b8be16ff2 service nova] Creating event network-vif-deleted:0a83b865-7619-434e-88d6-ffeaf8d8dfdd for instance 100824f4-a1a7-4986-8640-553dd4b16604 on n-h2-861333-10 Oct 19 07:05:08.374393 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-98eb859b-eb61-4b2c-b025-dd48620a083d req-4c6a4558-fe73-48bd-9a03-cf4b8be16ff2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129918 Oct 19 07:05:08.397447 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1958/3777] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:08.845481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:08.849901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:08.852079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:08.863210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:08.864809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:08.871162 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41749552-7fb4-4fca-99df-8fc4bd84c936 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1551 microversion: 2.26 time: 0.791916 Oct 19 07:05:08.872640 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1820/3778] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:08 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1551 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:08.878099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:08.878099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:08.878099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:08.882764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:08.883283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:08.883763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:08.943823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:08.944487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:08.957116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:08.957116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:08.958586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:08.958586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:08.959011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:08.963162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:09.059315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:09.059803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:09.064173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:09.065563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lazy-loading 'fault' on Instance uuid 100824f4-a1a7-4986-8640-553dd4b16604 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:09.485740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1007e861ec744d299c2aef39119f3684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06da8cf306a446b93df8ff111ff56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:09.499865 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d51228d-5f8c-4e31-9e84-38cc3ddf9842 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 200 len: 1305 microversion: 2.1 time: 0.560939 Oct 19 07:05:09.501295 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1821/3779] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:08 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 1305 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:09.506635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a6c070a0-2887-456b-b859-b256adf458dc req-4007e5ac-f965-43dc-ad0e-f2b357145645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9", "name": "network-vif-plugged", "status": "completed", "tag": "6bc8a5cc-5493-4884-9e5b-6ed594a88670"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:09.518461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a6c070a0-2887-456b-b859-b256adf458dc req-4007e5ac-f965-43dc-ad0e-f2b357145645 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:09.519990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a6c070a0-2887-456b-b859-b256adf458dc req-4007e5ac-f965-43dc-ad0e-f2b357145645 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:09.520857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a6c070a0-2887-456b-b859-b256adf458dc req-4007e5ac-f965-43dc-ad0e-f2b357145645 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:09.535157 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a6c070a0-2887-456b-b859-b256adf458dc req-4007e5ac-f965-43dc-ad0e-f2b357145645 service nova] Creating event network-vif-plugged:6bc8a5cc-5493-4884-9e5b-6ed594a88670 for instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 on n-h2-861333-10 Oct 19 07:05:09.541957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:09.544462 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a6c070a0-2887-456b-b859-b256adf458dc req-4007e5ac-f965-43dc-ad0e-f2b357145645 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041280 Oct 19 07:05:09.545610 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1822/3780] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:09.552238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:09.553318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:09.555057 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-34b01b93-e8da-4fdd-8dbe-eb7e589ef57f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1313 microversion: 2.1 time: 0.733139 Oct 19 07:05:09.560203 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1959/3781] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:08 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:09.582381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:09.583092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:09.588777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:09.589730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:09.591062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:09.591709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:09.799681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:09.808344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:09.810096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:09.811505 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7305845a-0fd1-4ce6-b989-1e9ec4887695 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1372 microversion: 2.57 time: 0.264554 Oct 19 07:05:09.812700 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1823/3782] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:09 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:09.906229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:09.906856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:09.920702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:09.924088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:09.924685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:09.925564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:09.926285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:09.927041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.400710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:10.412888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:10.414901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:10.418795 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e52bd56-d5c3-4753-bfe0-59b3be5f0913 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1551 microversion: 2.26 time: 0.520226 Oct 19 07:05:10.419876 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1960/3783] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:09 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1551 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:10.534598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:10.536384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:10.539886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:10.540046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:10.548127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:10.548688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:10.554636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:10.555243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:10.555599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.556356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:10.556819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:10.557249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.558258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.562442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:10.563161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:10.568449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.612483 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] HTTP exception thrown: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Request method failure captured: Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 HTTP/1.1 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GFqpvxn7KkUyx-tBVe-KQQdQDON7un4wIp47ANiVd8uePmVdrzWE2swLrVjHbEOig-mOTcOAFMTKqOd_a2ADZhs0_C3kU4V5qtU3H3jlngQWZ40gsPgpp10Rxizg37ffwjKsDUUwZ3UBuhwpby9Cd7gr3WcK96qx2cf44cjtSMOi0 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b06da8cf306a446b93df8ff111ff56f1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1007e861ec744d299c2aef39119f3684 Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '100824f4-a1a7-4986-8640-553dd4b16604'} Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:10.619743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.632258 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:10.632258 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:10.632258 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:10.632258 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:10.632258 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:10.632258 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.632258 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.632258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Returning 404 to user: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:10.632258 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bd097dd-7c21-43d5-8369-e6e6ed5bc314 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 404 len: 111 microversion: 2.1 time: 0.101399 Oct 19 07:05:10.633651 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1824/3784] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:10 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:05:10.645464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:10.646309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:10.653726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:10.654473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:10.655077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.656053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:10.656711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:10.657307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.816926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:10.826339 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f613ab8e-af46-45c5-b561-997ab618ba8e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.303238 Oct 19 07:05:10.829754 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1961/3785] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:10 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:10.836050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2087294111", "metadata": {"image_type": "test"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:10.849316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:10.858827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:10.863217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:10.863980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.865002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:10.865701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:10.866394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.883397 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] HTTP exception thrown: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Request method failure captured: Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604/action HTTP/1.1 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 112 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6GFqpvxn7KkUyx-tBVe-KQQdQDON7un4wIp47ANiVd8uePmVdrzWE2swLrVjHbEOig-mOTcOAFMTKqOd_a2ADZhs0_C3kU4V5qtU3H3jlngQWZ40gsPgpp10Rxizg37ffwjKsDUUwZ3UBuhwpby9Cd7gr3WcK96qx2cf44cjtSMOi0 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b06da8cf306a446b93df8ff111ff56f1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 1007e861ec744d299c2aef39119f3684 Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2087294111", "metadata": {"image_type": "test"}}} Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '100824f4-a1a7-4986-8640-553dd4b16604', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2087294111', 'metadata': {'image_type': 'test'}}}} Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 07:05:10.885945 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:10.890269 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:10.894170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Returning 404 to user: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:10.895812 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f2a0e27-01b1-4eca-9ce3-4f69f99ece09 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "POST /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604/action" status: 404 len: 111 microversion: 2.1 time: 0.064954 Oct 19 07:05:10.897020 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1962/3786] 10.222.0.39 () {60 vars in 1279 bytes} [Wed Oct 19 07:05:10 2022] POST /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:10.908739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3ceabf5c-e92d-424d-91d6-170a127fe9e1 req-a55c86ee-b657-406a-8aed-74fcadaee219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7eae87e-de7a-44d6-8ce4-a1d129e41770", "name": "network-vif-deleted", "tag": "69a837ca-1301-4a48-9640-eb0eef267d83"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:10.920883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ceabf5c-e92d-424d-91d6-170a127fe9e1 req-a55c86ee-b657-406a-8aed-74fcadaee219 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:10.921694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ceabf5c-e92d-424d-91d6-170a127fe9e1 req-a55c86ee-b657-406a-8aed-74fcadaee219 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:10.922242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ceabf5c-e92d-424d-91d6-170a127fe9e1 req-a55c86ee-b657-406a-8aed-74fcadaee219 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:10.955487 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3ceabf5c-e92d-424d-91d6-170a127fe9e1 req-a55c86ee-b657-406a-8aed-74fcadaee219 service nova] Creating event network-vif-deleted:69a837ca-1301-4a48-9640-eb0eef267d83 for instance b7eae87e-de7a-44d6-8ce4-a1d129e41770 on n-h1-861333-10 Oct 19 07:05:10.967092 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3ceabf5c-e92d-424d-91d6-170a127fe9e1 req-a55c86ee-b657-406a-8aed-74fcadaee219 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067945 Oct 19 07:05:10.968757 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1963/3787] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:10.999018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:11.016469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:11.036367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.037036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.037494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.038808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.038808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.039120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.156335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:11.169062 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6620d1c-dd85-4216-8191-9463322eefc5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1313 microversion: 2.1 time: 0.533656 Oct 19 07:05:11.170005 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1825/3788] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:10 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:11.176801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5dc44674-4053-465a-9585-4fb2daeca0af tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-684634788", "metadata": {"image_type": "test"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:11.179221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5dc44674-4053-465a-9585-4fb2daeca0af tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Failed to fetch instance by id tempest-invalid-161732249 {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 07:05:11.179739 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5dc44674-4053-465a-9585-4fb2daeca0af tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] HTTP exception thrown: Instance tempest-invalid-161732249 could not be found. Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5dc44674-4053-465a-9585-4fb2daeca0af tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Request method failure captured: Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/tempest-invalid-161732249/action HTTP/1.1 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 111 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GFqpvxn7KkUyx-tBVe-KQQdQDON7un4wIp47ANiVd8uePmVdrzWE2swLrVjHbEOig-mOTcOAFMTKqOd_a2ADZhs0_C3kU4V5qtU3H3jlngQWZ40gsPgpp10Rxizg37ffwjKsDUUwZ3UBuhwpby9Cd7gr3WcK96qx2cf44cjtSMOi0 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b06da8cf306a446b93df8ff111ff56f1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1007e861ec744d299c2aef39119f3684 Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-684634788", "metadata": {"image_type": "test"}}} Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance tempest-invalid-161732249 could not be found. Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'tempest-invalid-161732249', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-684634788', 'metadata': {'image_type': 'test'}}}} Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-161732249 could not be found. Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:11.185784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-161732249 could not be found. Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-161732249 could not be found. Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5dc44674-4053-465a-9585-4fb2daeca0af tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Returning 404 to user: Instance tempest-invalid-161732249 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:11.195150 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5dc44674-4053-465a-9585-4fb2daeca0af tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "POST /compute/v2.1/servers/tempest-invalid-161732249/action" status: 404 len: 100 microversion: 2.1 time: 0.016248 Oct 19 07:05:11.200509 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1826/3789] 10.222.0.39 () {60 vars in 1246 bytes} [Wed Oct 19 07:05:11 2022] POST /compute/v2.1/servers/tempest-invalid-161732249/action => generated 100 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:11.214984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04194430-f6c5-4ddb-9294-470ced082a84 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2136679734"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:11.217269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04194430-f6c5-4ddb-9294-470ced082a84 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-04194430-f6c5-4ddb-9294-470ced082a84 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04194430-f6c5-4ddb-9294-470ced082a84 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Request method failure captured: Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 57 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GFqpvxn7KkUyx-tBVe-KQQdQDON7un4wIp47ANiVd8uePmVdrzWE2swLrVjHbEOig-mOTcOAFMTKqOd_a2ADZhs0_C3kU4V5qtU3H3jlngQWZ40gsPgpp10Rxizg37ffwjKsDUUwZ3UBuhwpby9Cd7gr3WcK96qx2cf44cjtSMOi0 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b06da8cf306a446b93df8ff111ff56f1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1007e861ec744d299c2aef39119f3684 Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: {"createImage": {"name": "tempest-test-snap-2136679734"}} Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2136679734'}}} Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:11.221531 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04194430-f6c5-4ddb-9294-470ced082a84 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04194430-f6c5-4ddb-9294-470ced082a84 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.022029 Oct 19 07:05:11.228568 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1827/3790] 10.222.0.39 () {60 vars in 1275 bytes} [Wed Oct 19 07:05:11 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:11.264222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:11.268719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d122613-1f56-4acf-85ef-0303755a23a8 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-181838841"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:11.271352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d122613-1f56-4acf-85ef-0303755a23a8 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 07:05:11.272068 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1d122613-1f56-4acf-85ef-0303755a23a8 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d122613-1f56-4acf-85ef-0303755a23a8 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Request method failure captured: Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 56 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GFqpvxn7KkUyx-tBVe-KQQdQDON7un4wIp47ANiVd8uePmVdrzWE2swLrVjHbEOig-mOTcOAFMTKqOd_a2ADZhs0_C3kU4V5qtU3H3jlngQWZ40gsPgpp10Rxizg37ffwjKsDUUwZ3UBuhwpby9Cd7gr3WcK96qx2cf44cjtSMOi0 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b06da8cf306a446b93df8ff111ff56f1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1007e861ec744d299c2aef39119f3684 Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: {"createImage": {"name": "tempest-test-snap-181838841"}} Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-181838841'}}} Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.273856 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.278784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.278784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.278784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.278784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.278784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.278784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:11.278784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:11.278784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 07:05:11.278784 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.283726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d122613-1f56-4acf-85ef-0303755a23a8 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:11.284819 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d122613-1f56-4acf-85ef-0303755a23a8 tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.052674 Oct 19 07:05:11.290458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:11.294332 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1828/3791] 10.222.0.39 () {60 vars in 1281 bytes} [Wed Oct 19 07:05:11 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:11.298281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:11.299759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:11.300306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:11.301990 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e6a9ce6-633e-45a4-b45d-d4479f5f3b5b tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1357 microversion: 2.57 time: 0.329817 Oct 19 07:05:11.310773 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1964/3792] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:10 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:11.323790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.324583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.325196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.326077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.339286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:11.340145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:11.346259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.347080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.371561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.372098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.372583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.373444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.380417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.381115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.393121 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] HTTP exception thrown: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Request method failure captured: Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 HTTP/1.1 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GFqpvxn7KkUyx-tBVe-KQQdQDON7un4wIp47ANiVd8uePmVdrzWE2swLrVjHbEOig-mOTcOAFMTKqOd_a2ADZhs0_C3kU4V5qtU3H3jlngQWZ40gsPgpp10Rxizg37ffwjKsDUUwZ3UBuhwpby9Cd7gr3WcK96qx2cf44cjtSMOi0 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b06da8cf306a446b93df8ff111ff56f1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1007e861ec744d299c2aef39119f3684 Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '100824f4-a1a7-4986-8640-553dd4b16604'} Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:11.394732 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.400929 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.411000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Returning 404 to user: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:11.412255 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75de656c-92ec-436e-bc85-ebe32cdac0eb tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "DELETE /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 404 len: 111 microversion: 2.1 time: 0.116813 Oct 19 07:05:11.416284 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1829/3793] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:05:11 2022] DELETE /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:11.425603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:05:11.427181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:11.433719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] [instance: 100824f4-a1a7-4986-8640-553dd4b16604] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:11.449097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.449603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.451423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.451423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.452691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.453226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.490913 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] HTTP exception thrown: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Request method failure captured: Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 HTTP/1.1 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GFqpvxn7KkUyx-tBVe-KQQdQDON7un4wIp47ANiVd8uePmVdrzWE2swLrVjHbEOig-mOTcOAFMTKqOd_a2ADZhs0_C3kU4V5qtU3H3jlngQWZ40gsPgpp10Rxizg37ffwjKsDUUwZ3UBuhwpby9Cd7gr3WcK96qx2cf44cjtSMOi0 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06da8cf306a446b93df8ff111ff56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b06da8cf306a446b93df8ff111ff56f1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b06da8cf306a446b93df8ff111ff56f1 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2129353834 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 1007e861ec744d299c2aef39119f3684 Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesNegativeTestJSON-2129353834-project Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '100824f4-a1a7-4986-8640-553dd4b16604'} Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:11.492365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] Returning 404 to user: Instance 100824f4-a1a7-4986-8640-553dd4b16604 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b69669e6-82a1-44ca-a523-649d53bb8bed tempest-ImagesNegativeTestJSON-2129353834 tempest-ImagesNegativeTestJSON-2129353834-project] 10.222.0.39 "GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604" status: 404 len: 111 microversion: 2.1 time: 0.075950 Oct 19 07:05:11.496697 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1830/3794] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:11 2022] GET /compute/v2.1/servers/100824f4-a1a7-4986-8640-553dd4b16604 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:11.516322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:11.516948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:11.533064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.533606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.534055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.535318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.545064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.545717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.647305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.647801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.648274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.648729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lazy-loading 'fault' on Instance uuid b7eae87e-de7a-44d6-8ce4-a1d129e41770 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:11.878403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:11.891345 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7901c5ca-1594-4da1-ab0d-c9ecf4641afe tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "DELETE /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 204 len: 0 microversion: 2.57 time: 0.555879 Oct 19 07:05:11.892217 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1965/3795] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:05:11 2022] DELETE /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:05:11.905124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bbc29325-3e42-49b4-8004-8f8b3d2983da req-0c534a48-7737-41bb-ae7a-21cf9cf64e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "name": "network-vif-unplugged", "status": "completed", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:11.913816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:11.922513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '629efc37145540fea4429992ecd0f318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ba6c31abdd4006912d7a7d36dbefd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:11.925398 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f540e4b3-7cee-49ca-9cf2-31f7a45f7b5e tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 200 len: 1351 microversion: 2.26 time: 0.428775 Oct 19 07:05:11.933892 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1831/3796] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:11 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 1351 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:11.948451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bbc29325-3e42-49b4-8004-8f8b3d2983da req-0c534a48-7737-41bb-ae7a-21cf9cf64e1b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.953463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:11.954074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bbc29325-3e42-49b4-8004-8f8b3d2983da req-0c534a48-7737-41bb-ae7a-21cf9cf64e1b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.955361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bbc29325-3e42-49b4-8004-8f8b3d2983da req-0c534a48-7737-41bb-ae7a-21cf9cf64e1b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.958728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:11.976125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.976735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.978072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:11.979443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:11.980831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:11.981546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:12.012246 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bbc29325-3e42-49b4-8004-8f8b3d2983da req-0c534a48-7737-41bb-ae7a-21cf9cf64e1b service nova] Creating event network-vif-unplugged:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:05:12.028587 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bbc29325-3e42-49b4-8004-8f8b3d2983da req-0c534a48-7737-41bb-ae7a-21cf9cf64e1b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133112 Oct 19 07:05:12.031041 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1966/3797] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:12.196426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:12.197440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:12.212752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:12.213853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:12.214451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:12.215361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:12.215996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:12.223211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:12.574766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:12.583702 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-215b0083-f7a1-4c7f-96ce-916c4c2a22e3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1501 microversion: 2.1 time: 0.392109 Oct 19 07:05:12.584720 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1967/3798] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:12 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1501 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:12.782106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:12.796602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:12.803045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:12.804994 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2bc108eb-e613-4b5e-84d4-ebb6dc9deb80 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1363 microversion: 2.57 time: 0.865392 Oct 19 07:05:12.842671 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1832/3799] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:11 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1363 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:12.957551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:12.960563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] [instance: b7eae87e-de7a-44d6-8ce4-a1d129e41770] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:12.974943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:12.976439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:12.979080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:12.980117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:12.982012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:12.982921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:13.000406 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] HTTP exception thrown: Instance b7eae87e-de7a-44d6-8ce4-a1d129e41770 could not be found. Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Request method failure captured: Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 HTTP/1.1 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6GAkwPXHEUq0_oRopG_1EgYBO81HvnD-zaf3Ci65uhW5jI_GYth0DCBqzyvgQn42pDMp1PwemFqSgNYIb0zbrhtK1tWvjRCCJu3U74d4unMhqwh4tjYOOJT3_wGk5rVxKLMKRRptWQFMBK7xbiuaL5YbUoQ6ezjp0mwXwUHGcEqiNM Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.26 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 98ba6c31abdd4006912d7a7d36dbefd6 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerTagsTestJSON-1037399909 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/98ba6c31abdd4006912d7a7d36dbefd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/98ba6c31abdd4006912d7a7d36dbefd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/98ba6c31abdd4006912d7a7d36dbefd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_98ba6c31abdd4006912d7a7d36dbefd6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerTagsTestJSON-1037399909 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 98ba6c31abdd4006912d7a7d36dbefd6 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerTagsTestJSON-1037399909 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerTagsTestJSON-1037399909-project Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 629efc37145540fea4429992ecd0f318 Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerTagsTestJSON-1037399909-project Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance b7eae87e-de7a-44d6-8ce4-a1d129e41770 could not be found. Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'b7eae87e-de7a-44d6-8ce4-a1d129e41770'} Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7eae87e-de7a-44d6-8ce4-a1d129e41770 could not be found. Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7eae87e-de7a-44d6-8ce4-a1d129e41770 could not be found. Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:13.007435 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:13.012180 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:13.012180 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:13.012180 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:13.012180 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:13.012180 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:13.012180 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7eae87e-de7a-44d6-8ce4-a1d129e41770 could not be found. Oct 19 07:05:13.012180 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:13.012180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] Returning 404 to user: Instance b7eae87e-de7a-44d6-8ce4-a1d129e41770 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:13.012180 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7bc4d121-235a-48d0-aaa0-02347c5e5ee8 tempest-ServerTagsTestJSON-1037399909 tempest-ServerTagsTestJSON-1037399909-project] 10.222.0.39 "GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770" status: 404 len: 111 microversion: 2.26 time: 0.054230 Oct 19 07:05:13.014087 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1968/3800] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:12 2022] GET /compute/v2.1/servers/b7eae87e-de7a-44d6-8ce4-a1d129e41770 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:05:13.838252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:13.839056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:13.850828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:13.851334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:13.851779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:13.856849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:13.857510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:13.858112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:14.062342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:14.083768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:14.086030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:14.088771 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04e4c693-5991-46d7-89b7-21f78c4981dc tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1363 microversion: 2.57 time: 0.254437 Oct 19 07:05:14.110467 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1833/3801] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:13 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:14.612561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:14.613854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:14.624574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:14.626491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:14.626491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:14.626491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:14.628831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:14.629450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:14.985403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:14.998518 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cea42989-9dc8-4719-b309-be499be40303 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.386065 Oct 19 07:05:14.999874 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1969/3802] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:14 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:15.025658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:15.026346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:15.036696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:15.037395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:15.038282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:15.039162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:15.039783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:15.040393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:15.119757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:15.120423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:15.129979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:15.130496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:15.130949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:15.132957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:15.137660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:15.144063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:15.249626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:15.255292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:15.256669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:15.258874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lazy-loading 'fault' on Instance uuid edfa6290-bc02-49cd-983c-a80ba2b71890 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:15.462353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:15.479250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:15.488884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90dc2516c2f04264905fe35cf11f4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec95f262ea469a954994616433d9e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:15.492336 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44d8c1ef-5f61-41bc-9ad0-fabb003fdc09 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 200 len: 1368 microversion: 2.57 time: 0.374863 Oct 19 07:05:15.495135 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1970/3803] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:15 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 1368 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:05:15.564134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:15.579151 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51a96f4a-8841-471c-b62d-a7f983b35472 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.557027 Oct 19 07:05:15.581200 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1834/3804] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:15 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:15.619461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:15.622421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:15.642561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:15.646769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:15.649895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:15.652825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:15.652825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:15.654591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:15.703153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:16.073032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:16.082120 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3dbf6358-bb4d-4eae-8e3a-54166b774ccf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.473943 Oct 19 07:05:16.082654 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1971/3805] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:15 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:16.115043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa9442c6-d99c-4ff6-ba37-3263fd7fe93e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:16.117548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa9442c6-d99c-4ff6-ba37-3263fd7fe93e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:16.131231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa9442c6-d99c-4ff6-ba37-3263fd7fe93e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:16.131825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa9442c6-d99c-4ff6-ba37-3263fd7fe93e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:16.134002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa9442c6-d99c-4ff6-ba37-3263fd7fe93e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:16.135018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa9442c6-d99c-4ff6-ba37-3263fd7fe93e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:16.135486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa9442c6-d99c-4ff6-ba37-3263fd7fe93e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:16.135914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa9442c6-d99c-4ff6-ba37-3263fd7fe93e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:16.200616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:16.418307 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa9442c6-d99c-4ff6-ba37-3263fd7fe93e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.314128 Oct 19 07:05:16.419996 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1835/3806] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:05:16 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:05:16.431016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:16.432366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:16.448415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:16.449601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:16.450729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:16.453339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:16.454070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:16.454857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:16.535457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:16.536192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] [instance: edfa6290-bc02-49cd-983c-a80ba2b71890] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:16.556690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:16.557192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:16.557627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:16.563904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:16.564689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:16.565994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:16.606697 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] HTTP exception thrown: Instance edfa6290-bc02-49cd-983c-a80ba2b71890 could not be found. Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Request method failure captured: Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 HTTP/1.1 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6F6p-RW7jlJk3kJ0NkMSUpNzjR1iFfRfiirwqZMnxYt_Zg9TwWqUskCdpuO4mZmGTcDCK9UwDRETesHW17Wx7fLkc7qW2DeCO26bxrLm-z33LQ9tUDvxPK7dzbUJay9v78qxQdyOEpMcFKPZgxZm8DZhDUVFSsxQ2y860_RipHX5P0 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.57 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: a1ec95f262ea469a954994616433d9e2 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerShowV257Test-1000757764 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a1ec95f262ea469a954994616433d9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1ec95f262ea469a954994616433d9e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1ec95f262ea469a954994616433d9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a1ec95f262ea469a954994616433d9e2", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerShowV257Test-1000757764 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: a1ec95f262ea469a954994616433d9e2 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerShowV257Test-1000757764 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerShowV257Test-1000757764-project Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 90dc2516c2f04264905fe35cf11f4b90 Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerShowV257Test-1000757764-project Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance edfa6290-bc02-49cd-983c-a80ba2b71890 could not be found. Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'edfa6290-bc02-49cd-983c-a80ba2b71890'} Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edfa6290-bc02-49cd-983c-a80ba2b71890 could not be found. Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edfa6290-bc02-49cd-983c-a80ba2b71890 could not be found. Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:16.612269 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edfa6290-bc02-49cd-983c-a80ba2b71890 could not be found. Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] Returning 404 to user: Instance edfa6290-bc02-49cd-983c-a80ba2b71890 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0ba9bd8b-0ed9-4db3-84bd-82540f66c484 tempest-ServerShowV257Test-1000757764 tempest-ServerShowV257Test-1000757764-project] 10.222.0.39 "GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890" status: 404 len: 111 microversion: 2.57 time: 0.078970 Oct 19 07:05:16.620287 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1836/3807] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:16 2022] GET /compute/v2.1/servers/edfa6290-bc02-49cd-983c-a80ba2b71890 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:05:16.878164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed8efbaa-1677-42d9-8132-61f2249c2643 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23985b0b-e9b8-4e74-89b3-db4bf0d4d986"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:16.880903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed8efbaa-1677-42d9-8132-61f2249c2643 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:16.901572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8efbaa-1677-42d9-8132-61f2249c2643 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:16.901572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8efbaa-1677-42d9-8132-61f2249c2643 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:16.903486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8efbaa-1677-42d9-8132-61f2249c2643 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:16.905554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8efbaa-1677-42d9-8132-61f2249c2643 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:16.906169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8efbaa-1677-42d9-8132-61f2249c2643 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:16.908646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8efbaa-1677-42d9-8132-61f2249c2643 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:17.542082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:17.552634 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e597a9b6-ccdd-40b4-a5e2-739a66d3a66f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1672 microversion: 2.1 time: 1.129382 Oct 19 07:05:17.562838 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1972/3808] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:16 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1672 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:17.917523 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed8efbaa-1677-42d9-8132-61f2249c2643 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.046219 Oct 19 07:05:17.920218 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1837/3809] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:05:16 2022] POST /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9/os-volume_attachments => generated 194 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:18.587019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:18.587687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:18.597768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:18.603265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:18.605387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:18.606349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:18.606999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:18.610273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:18.964138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-488503922", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "44f7fe01-58a9-4142-a885-e5258a4635cb"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:19.048975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] validate_networks() for [('44f7fe01-58a9-4142-a885-e5258a4635cb', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:05:19.536987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:19.546972 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73cd718f-4465-42ad-b494-a5e3c52242ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1672 microversion: 2.1 time: 0.963824 Oct 19 07:05:19.557004 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1973/3810] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:18 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1672 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:19.741594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-470b015a-33b2-40b6-9efc-5ec4bed44046 tempest-ComputeTenantNetworksTest-460965519 tempest-ComputeTenantNetworksTest-460965519-project] Calling method '.version_select at 0x7f6d5f999e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:20.329899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:05:20.330985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:05:20.331358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:05:20.331771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:05:20.332999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:05:20.352701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:20.353299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:20.353754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:20.354802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:20.355260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:20.355685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:20.403295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Getting quotas for project 575364405b4f4ba4943cbdd304d68438. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:20.414052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Getting quotas for user 86a505e47fd04138acb88552e0bf9c72 and project 575364405b4f4ba4943cbdd304d68438. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:20.452323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:05:20.454998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:05:20.684598 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-470b015a-33b2-40b6-9efc-5ec4bed44046 tempest-ComputeTenantNetworksTest-460965519 tempest-ComputeTenantNetworksTest-460965519-project] 10.222.0.39 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.073142 Oct 19 07:05:20.691266 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1974/3811] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 07:05:19 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:20.692054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:20.693177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:20.718416 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58d8ac09-5ae0-4350-82ab-060761e20509 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.939176 Oct 19 07:05:20.719206 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1838/3812] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 07:05:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 19 07:05:20.722823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:20.727603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:20.728082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:20.728868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-390ec627-8aeb-4ef8-9558-5b1b8b1adfaa tempest-ComputeTenantNetworksTest-460965519 tempest-ComputeTenantNetworksTest-460965519-project] Calling method '.version_select at 0x7f6d5f96a160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:20.740366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:20.740897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:20.741354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:20.946713 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-390ec627-8aeb-4ef8-9558-5b1b8b1adfaa tempest-ComputeTenantNetworksTest-460965519 tempest-ComputeTenantNetworksTest-460965519-project] 10.222.0.39 "GET /compute/v2.1/os-tenant-networks/cee10321-0cf9-4540-9bc0-6a64c98af76d" status: 200 len: 139 microversion: 2.1 time: 0.226151 Oct 19 07:05:20.953340 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1839/3813] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:05:20 2022] GET /compute/v2.1/os-tenant-networks/cee10321-0cf9-4540-9bc0-6a64c98af76d => generated 139 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:20.955199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90a1d7d4-3afb-4112-adc5-559337861561 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:20.957020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90a1d7d4-3afb-4112-adc5-559337861561 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:21.260843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-90a1d7d4-3afb-4112-adc5-559337861561 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:21.276831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-90a1d7d4-3afb-4112-adc5-559337861561 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:21.283598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-90a1d7d4-3afb-4112-adc5-559337861561 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:21.288789 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90a1d7d4-3afb-4112-adc5-559337861561 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1258 microversion: 2.21 time: 0.339490 Oct 19 07:05:21.305616 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1840/3814] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:20 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1258 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:21.584135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:21.605807 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3690c393-22db-4fc5-8864-ce7fed07662e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.919229 Oct 19 07:05:21.606590 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1975/3815] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:20 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:21.633976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a83aeb2-a6c0-4d4b-b998-7d8df2810f45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:21.650018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a83aeb2-a6c0-4d4b-b998-7d8df2810f45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:21.663933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a83aeb2-a6c0-4d4b-b998-7d8df2810f45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:21.664996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a83aeb2-a6c0-4d4b-b998-7d8df2810f45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:21.666586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a83aeb2-a6c0-4d4b-b998-7d8df2810f45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:21.668151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a83aeb2-a6c0-4d4b-b998-7d8df2810f45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:21.669078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a83aeb2-a6c0-4d4b-b998-7d8df2810f45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:21.671345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a83aeb2-a6c0-4d4b-b998-7d8df2810f45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:21.770327 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a83aeb2-a6c0-4d4b-b998-7d8df2810f45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 200 len: 322 microversion: 2.1 time: 0.140718 Oct 19 07:05:21.771440 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1841/3816] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:05:21 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:21.781782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:21.783994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:21.805685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:21.806463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:21.807163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:21.808182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:21.808979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:21.812659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:22.120522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0cb91a1c-7be4-4883-8d70-e514bc916209 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Action: 'create', calling method: .version_select at 0x7f6d5f979820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-278855595"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:22.626882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:22.682182 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-100489f2-96b0-4d5d-a962-72cc3d8d27f2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.903325 Oct 19 07:05:22.708301 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1976/3817] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:21 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:22.719151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-712be483-5d26-4e23-8621-09c099dd6333 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:22.720035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-712be483-5d26-4e23-8621-09c099dd6333 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:23.423350 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0cb91a1c-7be4-4883-8d70-e514bc916209 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.563992 Oct 19 07:05:23.424955 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1842/3818] 10.222.0.39 () {60 vars in 1155 bytes} [Wed Oct 19 07:05:21 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1567 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 19 07:05:23.431615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:23.434803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:23.476866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:23.483666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:23.491538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:23.491538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:23.491538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:23.491538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:23.685406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-712be483-5d26-4e23-8621-09c099dd6333 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:23.698143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-712be483-5d26-4e23-8621-09c099dd6333 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:23.703463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-712be483-5d26-4e23-8621-09c099dd6333 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:23.705412 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-712be483-5d26-4e23-8621-09c099dd6333 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1258 microversion: 2.21 time: 1.001865 Oct 19 07:05:23.722553 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1977/3819] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:22 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1258 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:23.731404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ed19c2e-98b6-45bc-8762-96121a11a856 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f95e280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:23.859813 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ed19c2e-98b6-45bc-8762-96121a11a856 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 200 len: 344 microversion: 2.1 time: 0.136000 Oct 19 07:05:23.870013 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1978/3820] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:05:23 2022] GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:23.994541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:24.008258 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-031096fb-f415-4ccf-9afe-25e4ee803159 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.581924 Oct 19 07:05:24.011271 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1843/3821] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:23 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:24.038728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:24.039894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:24.053858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:24.057149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:24.057831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:24.059339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:24.059812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:24.062851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:24.649940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:24.664260 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a7b2d70-6d77-4022-9796-0cf3c85d418c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.632264 Oct 19 07:05:24.668826 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1979/3822] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:24 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:24.693400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:24.694012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:24.714402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:24.715075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:24.717704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:24.719928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:24.723979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:24.724660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:24.740752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:24.741562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:24.756646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:24.757571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:24.759570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:24.764067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:24.766571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:24.767650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:25.097547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:25.110886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:25.117033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:25.121275 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7343285a-5d99-44ff-9bfc-9e778b6c0fd0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1318 microversion: 2.21 time: 0.386732 Oct 19 07:05:25.122437 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1980/3823] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:24 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:25.127393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40bf9765-2e89-48c8-b26c-7462bb1991cf tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f9613a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:25.183278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:25.194294 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e941cda-7628-4384-a74c-a2c50598b7be tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.506193 Oct 19 07:05:25.209075 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1844/3824] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:24 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:25.320441 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40bf9765-2e89-48c8-b26c-7462bb1991cf tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 200 len: 344 microversion: 2.1 time: 0.196623 Oct 19 07:05:25.321632 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1981/3825] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:05:25 2022] GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 344 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:25.646916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-301115159", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "6982a92b-3116-4178-8c1d-06fbcd358c52"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:25.769369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] validate_networks() for [('6982a92b-3116-4178-8c1d-06fbcd358c52', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:05:26.152394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:26.152394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:26.167525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:26.181247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:26.181247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:26.181247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:26.183416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:26.184695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:26.185470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:26.625965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:05:26.626395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:05:26.626935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:05:26.628033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:05:26.628491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:05:26.656307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:26.657003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:26.658820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:26.661365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:26.668153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:26.671650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:26.696824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:26.706421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:26.707557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:26.731311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:26.734652 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65992ead-69ea-4689-abc4-9ea375051caf tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1358 microversion: 2.21 time: 0.587711 Oct 19 07:05:26.742361 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1982/3826] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:26 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1358 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:05:26.745938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for user 2543970e80c84e109961fc84bfaaedd1 and project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:26.758378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d796cdd5-7823-4618-a8f7-a313c5e04073 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f955af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:26.786411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:05:26.792362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:05:26.900559 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d796cdd5-7823-4618-a8f7-a313c5e04073 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 200 len: 345 microversion: 2.1 time: 0.146122 Oct 19 07:05:26.900559 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1983/3827] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:05:26 2022] GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:26.900559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d796cdd5-7823-4618-a8f7-a313c5e04073 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:26.902280 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d796cdd5-7823-4618-a8f7-a313c5e04073 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.009366 Oct 19 07:05:26.902750 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1984/3828] 10.222.0.39 () {56 vars in 886 bytes} [Wed Oct 19 07:05:26 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 07:05:26.907512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9378a0b7-7691-4afc-a680-0c25a15ec2b3 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Action: 'create', calling method: .version_select at 0x7f6d5f95eaf0>, body: {"snapshot": {"volume_id": "1475ec8a-6b88-4474-ae26-6c307c42c63d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-378982929"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:27.007114 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.366473 Oct 19 07:05:27.008224 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1845/3829] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 07:05:27.017553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:27.021882 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e6413d8-fce1-4786-a9c6-f5450c997557 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004165 Oct 19 07:05:27.029156 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1846/3830] 10.222.0.39 () {54 vars in 1035 bytes} [Wed Oct 19 07:05:27 2022] GET /compute/v2/ => generated 379 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 19 07:05:27.029962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f43a0e0c-3886-44c0-b966-bf384d765dfc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:27.030812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f43a0e0c-3886-44c0-b966-bf384d765dfc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:27.184064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f43a0e0c-3886-44c0-b966-bf384d765dfc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:27.193032 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f43a0e0c-3886-44c0-b966-bf384d765dfc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1214 microversion: 2.1 time: 0.169053 Oct 19 07:05:27.206253 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1847/3831] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:27 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:27.207204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f43a0e0c-3886-44c0-b966-bf384d765dfc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:27.208418 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f43a0e0c-3886-44c0-b966-bf384d765dfc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002978 Oct 19 07:05:27.211324 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1848/3832] 10.222.0.39 () {54 vars in 1041 bytes} [Wed Oct 19 07:05:27 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:27.223264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f43a0e0c-3886-44c0-b966-bf384d765dfc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:27.225160 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f43a0e0c-3886-44c0-b966-bf384d765dfc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002310 Oct 19 07:05:27.225935 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1849/3833] 10.222.0.39 () {56 vars in 886 bytes} [Wed Oct 19 07:05:27 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 07:05:27.687577 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9378a0b7-7691-4afc-a680-0c25a15ec2b3 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.783502 Oct 19 07:05:27.690796 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1985/3834] 10.222.0.39 () {60 vars in 1162 bytes} [Wed Oct 19 07:05:26 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:27.702310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ef91a54-502c-4aee-be86-83b00b5d8e05 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f976160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:27.766281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:27.767176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:27.781815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:27.784849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:27.784849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:27.784849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:27.785445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:27.786081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:27.855254 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ef91a54-502c-4aee-be86-83b00b5d8e05 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 200 len: 286 microversion: 2.1 time: 0.156795 Oct 19 07:05:27.857066 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1850/3835] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 07:05:27 2022] GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:27.870146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93e93919-de97-4d05-82b9-a2b5f2240bd5 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d64025a60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:28.000950 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93e93919-de97-4d05-82b9-a2b5f2240bd5 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.135547 Oct 19 07:05:28.001805 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1851/3836] 10.222.0.39 () {58 vars in 1140 bytes} [Wed Oct 19 07:05:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:28.012358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:28.015049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a882a30-7e45-45ac-b740-e3e521329356 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f9814c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:28.022406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:28.028604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:28.028604 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f19816c0-550f-416d-bc65-19dbefe9dca4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1358 microversion: 2.21 time: 0.264422 Oct 19 07:05:28.028604 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1986/3837] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:27 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:05:28.103350 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a882a30-7e45-45ac-b740-e3e521329356 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 200 len: 286 microversion: 2.1 time: 0.093936 Oct 19 07:05:28.104504 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1852/3838] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 07:05:28 2022] GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:05:28.218315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-77230ad7-36a4-4204-a80a-e37e2d313995 req-b2a1c340-d660-4b1b-8caf-198ddac1264e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f", "tag": "d97a57e4-701b-4057-95d9-d43552074fb3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:28.224758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26015d5a-20be-4960-afe6-15a422cad1ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:28.224758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26015d5a-20be-4960-afe6-15a422cad1ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:28.249666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-77230ad7-36a4-4204-a80a-e37e2d313995 req-b2a1c340-d660-4b1b-8caf-198ddac1264e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:28.255553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-77230ad7-36a4-4204-a80a-e37e2d313995 req-b2a1c340-d660-4b1b-8caf-198ddac1264e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:28.256422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-77230ad7-36a4-4204-a80a-e37e2d313995 req-b2a1c340-d660-4b1b-8caf-198ddac1264e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:28.298337 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-77230ad7-36a4-4204-a80a-e37e2d313995 req-b2a1c340-d660-4b1b-8caf-198ddac1264e service nova] Creating event network-changed:d97a57e4-701b-4057-95d9-d43552074fb3 for instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f on n-h1-861333-10 Oct 19 07:05:28.307571 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-77230ad7-36a4-4204-a80a-e37e2d313995 req-b2a1c340-d660-4b1b-8caf-198ddac1264e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098676 Oct 19 07:05:28.307571 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1987/3839] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:28.360859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26015d5a-20be-4960-afe6-15a422cad1ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:28.372001 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26015d5a-20be-4960-afe6-15a422cad1ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1214 microversion: 2.1 time: 0.158659 Oct 19 07:05:28.373161 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1853/3840] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:28 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:29.054264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:29.055420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:29.063472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:29.064416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:29.070055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:29.071072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:29.071709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:29.073014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:29.116648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a267677-2d20-42e2-a436-f58ff82a27e5 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f96aa60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:29.250870 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a267677-2d20-42e2-a436-f58ff82a27e5 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 200 len: 286 microversion: 2.1 time: 0.138301 Oct 19 07:05:29.251447 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1854/3841] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 07:05:29 2022] GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:05:29.387677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:29.401060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:29.401842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:29.403746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:29.411544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:29.412494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:29.413129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:29.414407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:29.414843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:29.415579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:29.418428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:29.434313 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b0dea25-3205-437f-9a6d-7bcaa9c8543b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1358 microversion: 2.21 time: 0.374391 Oct 19 07:05:29.438132 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1988/3842] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:29 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1358 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:29.542454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:29.553386 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa6490e0-e05e-44eb-ad98-25feb878dfb0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1266 microversion: 2.1 time: 0.157187 Oct 19 07:05:29.556006 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1855/3843] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:29 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:29.649326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e501c251-5dec-41d9-9779-bd5f23070b1c tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Action: 'create', calling method: .version_select at 0x7f6d5f955a60>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJGMwOnjCkppFpR88EIpReJoRh+0h3SZkR+w4LLop0Ofxt8wrfx6iznRp6z8OrsqAHOpcEYpjnHkR7+SuHsCu+yRGPJBrUedC0RBnHkH5DHgAIaVKj/VHOi0JjsGYkh3g=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e501c251-5dec-41d9-9779-bd5f23070b1c tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Request method failure captured: Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 257 Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6G5XcUdHYjiLu0dcdY3QpIdQYCulAEXRUqFIzBE80eO_JlwwMe-OF2TqCCptA_VVmvcNv37u7zoBQw3QvsM6CgAFj6Q3wQB1nLK3Ot5vbsz0cMbOT45-SixKBo7f-FJh1xpPgQ_k3ZObdoqqURRVi36VF6Y8cqYJ-I-TCfZQmDEQfk Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d9875f3e20c8479fb398c4e06f39549a", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJGMwOnjCkppFpR88EIpReJoRh+0h3SZkR+w4LLop0Ofxt8wrfx6iznRp6z8OrsqAHOpcEYpjnHkR7+SuHsCu+yRGPJBrUedC0RBnHkH5DHgAIaVKj/VHOi0JjsGYkh3g=="}} Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJGMwOnjCkppFpR88EIpReJoRh+0h3SZkR+w4LLop0Ofxt8wrfx6iznRp6z8OrsqAHOpcEYpjnHkR7+SuHsCu+yRGPJBrUedC0RBnHkH5DHgAIaVKj/VHOi0JjsGYkh3g=='}}} Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 19 07:05:29.653621 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e501c251-5dec-41d9-9779-bd5f23070b1c tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:29.658840 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e501c251-5dec-41d9-9779-bd5f23070b1c tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.216524 Oct 19 07:05:29.664124 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1989/3844] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:05:29 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:05:29.676860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2798f03-a589-4cff-9e68-99d09dbc954b tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Action: 'create', calling method: .version_select at 0x7f6d5f954790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-499651943", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:29.683113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:29.695740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e2798f03-a589-4cff-9e68-99d09dbc954b tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:29.702120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e2798f03-a589-4cff-9e68-99d09dbc954b tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for user cd5a28315de4436f8e26c159a9ff5c80 and project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:29.718763 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e2798f03-a589-4cff-9e68-99d09dbc954b tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2798f03-a589-4cff-9e68-99d09dbc954b tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Request method failure captured: Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 2166 Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6G5XcUdHYjiLu0dcdY3QpIdQYCulAEXRUqFIzBE80eO_JlwwMe-OF2TqCCptA_VVmvcNv37u7zoBQw3QvsM6CgAFj6Q3wQB1nLK3Ot5vbsz0cMbOT45-SixKBo7f-FJh1xpPgQ_k3ZObdoqqURRVi36VF6Y8cqYJ-I-TCfZQmDEQfk Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d9875f3e20c8479fb398c4e06f39549a", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-499651943", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:29.739670 n-d-861333-10 devstack@n-api.service[127568]: exception: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-499651943', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:29.744797 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2798f03-a589-4cff-9e68-99d09dbc954b tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2798f03-a589-4cff-9e68-99d09dbc954b tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.076023 Oct 19 07:05:29.748414 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1856/3845] 10.222.0.39 () {60 vars in 1160 bytes} [Wed Oct 19 07:05:29 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 07:05:29.755034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b574d52-97e0-44d8-aa07-11e47421d5c6 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Action: 'create', calling method: .version_select at 0x7f6d5f9b7700>, body: {"keypair": {"name": "tempest-keypair-1215510083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNICgFMcDT62K+Fw2uMjNRUIDUJ8swJrRdOFrr0nt86EvKpmuNz+tPb3DZ9dQAYpzPJtFeMJsn4GHscm3Odk5jfKisiTKg2RUH4MPAp+8TbXRIBEaP+Bq/3zDsdjZ8fUw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:29.782383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5b574d52-97e0-44d8-aa07-11e47421d5c6 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:29.791953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5b574d52-97e0-44d8-aa07-11e47421d5c6 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for user cd5a28315de4436f8e26c159a9ff5c80 and project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:29.891040 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b574d52-97e0-44d8-aa07-11e47421d5c6 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140355 Oct 19 07:05:29.891997 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1990/3846] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:05:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:29.913253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee6ae6e9-927a-410b-8908-424a321fc0a2 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Action: 'create', calling method: .version_select at 0x7f6d5f913280>, body: {"keypair": {"name": "tempest-keypair-1215510083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsppBr3TIRaxFQ80Z5Vzf91tQV6LJuRLU03o6/JmaqakMfxX+o5FAQBT5kV5HrFzE1E3wTr9SPuY2IaremcWcfB8Klh+qbGenVtfTOJHCOuvHRRu1B5iBcd6hJoWdJ9UA=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:30.036980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ee6ae6e9-927a-410b-8908-424a321fc0a2 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:30.060700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ee6ae6e9-927a-410b-8908-424a321fc0a2 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for user cd5a28315de4436f8e26c159a9ff5c80 and project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:30.169016 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ee6ae6e9-927a-410b-8908-424a321fc0a2 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] HTTP exception thrown: Key pair 'tempest-keypair-1215510083' already exists. Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee6ae6e9-927a-410b-8908-424a321fc0a2 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Request method failure captured: Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 273 Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6G5XcUdHYjiLu0dcdY3QpIdQYCulAEXRUqFIzBE80eO_JlwwMe-OF2TqCCptA_VVmvcNv37u7zoBQw3QvsM6CgAFj6Q3wQB1nLK3Ot5vbsz0cMbOT45-SixKBo7f-FJh1xpPgQ_k3ZObdoqqURRVi36VF6Y8cqYJ-I-TCfZQmDEQfk Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d9875f3e20c8479fb398c4e06f39549a", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: {"keypair": {"name": "tempest-keypair-1215510083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsppBr3TIRaxFQ80Z5Vzf91tQV6LJuRLU03o6/JmaqakMfxX+o5FAQBT5kV5HrFzE1E3wTr9SPuY2IaremcWcfB8Klh+qbGenVtfTOJHCOuvHRRu1B5iBcd6hJoWdJ9UA=="}} Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: exception: Key pair 'tempest-keypair-1215510083' already exists. Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1215510083', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsppBr3TIRaxFQ80Z5Vzf91tQV6LJuRLU03o6/JmaqakMfxX+o5FAQBT5kV5HrFzE1E3wTr9SPuY2IaremcWcfB8Klh+qbGenVtfTOJHCOuvHRRu1B5iBcd6hJoWdJ9UA=='}}} Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'cd5a28315de4436f8e26c159a9ff5c80-tempest-keypair-1215510083' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 19 07:05:30.177561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi session.flush() Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 07:05:30.185648 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'cd5a28315de4436f8e26c159a9ff5c80-tempest-keypair-1215510083' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 19, 7, 5, 30, 106582), 'updated_at': None, 'name': 'tempest-keypair-1215510083', 'user_id': 'cd5a28315de4436f8e26c159a9ff5c80', 'fingerprint': '77:d8:f9:ef:1b:53:2d:4b:fc:18:8b:c4:64:ad:e1:79', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsppBr3TIRaxFQ80Z5Vzf91tQV6LJuRLU03o6/JmaqakMfxX+o5FAQBT5kV5HrFzE1E3wTr9SPuY2IaremcWcfB8Klh+qbGenVtfTOJHCOuvHRRu1B5iBcd6hJoWdJ9UA==', 'type': 'ssh'}] Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair.create() Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._create() Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1215510083' already exists. Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 19 07:05:30.192672 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1215510083' already exists. Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1215510083' already exists. Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee6ae6e9-927a-410b-8908-424a321fc0a2 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Returning 409 to user: Key pair 'tempest-keypair-1215510083' already exists. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:30.205022 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ee6ae6e9-927a-410b-8908-424a321fc0a2 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.277159 Oct 19 07:05:30.206669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07f553dd-5e83-4244-a485-d5209a0d09df tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Calling method '.version_select at 0x7f6d5f9990d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:30.207118 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1857/3847] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:05:29 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 288 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:05:30.265508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6e5b8f7-e3fd-4b02-9d71-d3c0e2dab226 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f913af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:30.272741 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07f553dd-5e83-4244-a485-d5209a0d09df tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215510083" status: 202 len: 0 microversion: 2.1 time: 0.081347 Oct 19 07:05:30.274254 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1991/3848] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:05:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215510083 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:05:30.286946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5260ed21-6497-420c-b2f7-35280c2c9ec1 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Action: 'create', calling method: .version_select at 0x7f6d5f9e1f70>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEeoKqmPQyLubIedQJUVPVm/2l+R7SQjYmUTTvmS9sk/msHPeezpixg8MrGyqsnyoJSCm6B3uU27dFFOujyIAVtLu+ReyylHSGoYe1BNdXbt7Zq5pqD6vNgqGbuKLaiGg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5260ed21-6497-420c-b2f7-35280c2c9ec1 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Request method failure captured: Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 247 Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6G5XcUdHYjiLu0dcdY3QpIdQYCulAEXRUqFIzBE80eO_JlwwMe-OF2TqCCptA_VVmvcNv37u7zoBQw3QvsM6CgAFj6Q3wQB1nLK3Ot5vbsz0cMbOT45-SixKBo7f-FJh1xpPgQ_k3ZObdoqqURRVi36VF6Y8cqYJ-I-TCfZQmDEQfk Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d9875f3e20c8479fb398c4e06f39549a", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEeoKqmPQyLubIedQJUVPVm/2l+R7SQjYmUTTvmS9sk/msHPeezpixg8MrGyqsnyoJSCm6B3uU27dFFOujyIAVtLu+ReyylHSGoYe1BNdXbt7Zq5pqD6vNgqGbuKLaiGg=="}} Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEeoKqmPQyLubIedQJUVPVm/2l+R7SQjYmUTTvmS9sk/msHPeezpixg8MrGyqsnyoJSCm6B3uU27dFFOujyIAVtLu+ReyylHSGoYe1BNdXbt7Zq5pqD6vNgqGbuKLaiGg=='}}} Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '' Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:05:30.290698 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5260ed21-6497-420c-b2f7-35280c2c9ec1 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5260ed21-6497-420c-b2f7-35280c2c9ec1 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.011627 Oct 19 07:05:30.297289 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1992/3849] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:05:30 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:05:30.309597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c12f46-82c8-410a-96ab-df9a5f0d6a1f tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Action: 'create', calling method: .version_select at 0x7f6d5f97aa60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1174783801", "public_key": " "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:30.333685 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6e5b8f7-e3fd-4b02-9d71-d3c0e2dab226 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 200 len: 286 microversion: 2.1 time: 0.072900 Oct 19 07:05:30.334769 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1858/3850] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 07:05:30 2022] GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:05:30.339408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-29c12f46-82c8-410a-96ab-df9a5f0d6a1f tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:30.349423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-29c12f46-82c8-410a-96ab-df9a5f0d6a1f tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for user cd5a28315de4436f8e26c159a9ff5c80 and project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:30.373213 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-29c12f46-82c8-410a-96ab-df9a5f0d6a1f tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c12f46-82c8-410a-96ab-df9a5f0d6a1f tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Request method failure captured: Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 95 Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6G5XcUdHYjiLu0dcdY3QpIdQYCulAEXRUqFIzBE80eO_JlwwMe-OF2TqCCptA_VVmvcNv37u7zoBQw3QvsM6CgAFj6Q3wQB1nLK3Ot5vbsz0cMbOT45-SixKBo7f-FJh1xpPgQ_k3ZObdoqqURRVi36VF6Y8cqYJ-I-TCfZQmDEQfk Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d9875f3e20c8479fb398c4e06f39549a", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1174783801", "public_key": " "}} Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: exception: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1174783801', 'public_key': ' '}}} Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.376681 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c12f46-82c8-410a-96ab-df9a5f0d6a1f tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:30.383676 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29c12f46-82c8-410a-96ab-df9a5f0d6a1f tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.080460 Oct 19 07:05:30.391489 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1993/3851] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Oct 19 07:05:30 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 19 07:05:30.399663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3dfbc4d3-38d3-4570-a4d9-cc23d5b3237a tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Action: 'create', calling method: .version_select at 0x7f6d5f996dc0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeuH7/Hx51Fn18nMfboXncJWMZOu/Lhq9T8PqyoUGbFFLZbV397R12YSKDfCPDFJVvV7lcETzRRWV9PrpDQsbJ2twp5yW5VKyn7BjO0H9rvNbvPAQZs8quSvziPWRG0dA=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3dfbc4d3-38d3-4570-a4d9-cc23d5b3237a tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Request method failure captured: Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 507 Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6G5XcUdHYjiLu0dcdY3QpIdQYCulAEXRUqFIzBE80eO_JlwwMe-OF2TqCCptA_VVmvcNv37u7zoBQw3QvsM6CgAFj6Q3wQB1nLK3Ot5vbsz0cMbOT45-SixKBo7f-FJh1xpPgQ_k3ZObdoqqURRVi36VF6Y8cqYJ-I-TCfZQmDEQfk Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d9875f3e20c8479fb398c4e06f39549a", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeuH7/Hx51Fn18nMfboXncJWMZOu/Lhq9T8PqyoUGbFFLZbV397R12YSKDfCPDFJVvV7lcETzRRWV9PrpDQsbJ2twp5yW5VKyn7BjO0H9rvNbvPAQZs8quSvziPWRG0dA=="}} Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeuH7/Hx51Fn18nMfboXncJWMZOu/Lhq9T8PqyoUGbFFLZbV397R12YSKDfCPDFJVvV7lcETzRRWV9PrpDQsbJ2twp5yW5VKyn7BjO0H9rvNbvPAQZs8quSvziPWRG0dA=='}}} Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 19 07:05:30.404527 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3dfbc4d3-38d3-4570-a4d9-cc23d5b3237a tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3dfbc4d3-38d3-4570-a4d9-cc23d5b3237a tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.014955 Oct 19 07:05:30.411433 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1859/3852] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:05:30 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:05:30.420852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48fd4aaf-b5b1-4f4b-a0fb-a9aa67edfb72 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Action: 'create', calling method: .version_select at 0x7f6d5fa3d310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-253983661", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:30.442703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-48fd4aaf-b5b1-4f4b-a0fb-a9aa67edfb72 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:30.450126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-48fd4aaf-b5b1-4f4b-a0fb-a9aa67edfb72 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Getting quotas for user cd5a28315de4436f8e26c159a9ff5c80 and project d9875f3e20c8479fb398c4e06f39549a. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:30.465258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:30.466129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:30.483459 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-48fd4aaf-b5b1-4f4b-a0fb-a9aa67edfb72 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48fd4aaf-b5b1-4f4b-a0fb-a9aa67edfb72 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Request method failure captured: Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 117 Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6G5XcUdHYjiLu0dcdY3QpIdQYCulAEXRUqFIzBE80eO_JlwwMe-OF2TqCCptA_VVmvcNv37u7zoBQw3QvsM6CgAFj6Q3wQB1nLK3Ot5vbsz0cMbOT45-SixKBo7f-FJh1xpPgQ_k3ZObdoqqURRVi36VF6Y8cqYJ-I-TCfZQmDEQfk Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d9875f3e20c8479fb398c4e06f39549a", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-253983661", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: exception: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-253983661', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 19 07:05:30.485820 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 19 07:05:30.498251 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.501577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:30.501704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48fd4aaf-b5b1-4f4b-a0fb-a9aa67edfb72 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:30.501808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:30.501808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:30.502012 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48fd4aaf-b5b1-4f4b-a0fb-a9aa67edfb72 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071594 Oct 19 07:05:30.502122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:30.502122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:30.502122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:30.502937 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1994/3853] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:05:30 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 07:05:30.676766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1037747755", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:30.748799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:05:30.749567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:05:30.750483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:05:30.751142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:05:30.751749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:05:30.764135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:30.765073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:30.765691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:30.766668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:30.767358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:30.768608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:30.793460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Getting quotas for project 01818e11c082485688fe7fc640e7613e. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:30.801886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Getting quotas for user 271f5c8219c9454385c3bf42fe2979dd and project 01818e11c082485688fe7fc640e7613e. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:30.813833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:30.818937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:05:30.821498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: cd9719f5-7d78-412f-a59a-931b8ce9c735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:05:30.826620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:30.828075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:30.829234 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fcae3c30-7bb9-4bac-926e-786f096a77f0 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1358 microversion: 2.21 time: 0.367914 Oct 19 07:05:30.829802 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1860/3854] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:30 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1358 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:05:30.843725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17625a36-202b-45e2-92e9-f5b9d3a50ce4 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Calling method '.version_select at 0x7f6d5f913430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:30.860726 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-17625a36-202b-45e2-92e9-f5b9d3a50ce4 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1523848616 not found for user cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17625a36-202b-45e2-92e9-f5b9d3a50ce4 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Request method failure captured: Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1523848616 HTTP/1.1 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6G5XcUdHYjiLu0dcdY3QpIdQYCulAEXRUqFIzBE80eO_JlwwMe-OF2TqCCptA_VVmvcNv37u7zoBQw3QvsM6CgAFj6Q3wQB1nLK3Ot5vbsz0cMbOT45-SixKBo7f-FJh1xpPgQ_k3ZObdoqqURRVi36VF6Y8cqYJ-I-TCfZQmDEQfk Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d9875f3e20c8479fb398c4e06f39549a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d9875f3e20c8479fb398c4e06f39549a", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: d9875f3e20c8479fb398c4e06f39549a Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1416654820 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1416654820-project Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: exception: Keypair tempest-keypair-non-existent-1523848616 not found for user cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'tempest-keypair-non-existent-1523848616'} Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1523848616 not found for user cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.863134 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1523848616 not found for user cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1523848616 not found for user cd5a28315de4436f8e26c159a9ff5c80 Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17625a36-202b-45e2-92e9-f5b9d3a50ce4 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1523848616 not found for user cd5a28315de4436f8e26c159a9ff5c80 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17625a36-202b-45e2-92e9-f5b9d3a50ce4 tempest-KeyPairsNegativeTestJSON-1416654820 tempest-KeyPairsNegativeTestJSON-1416654820-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1523848616" status: 404 len: 145 microversion: 2.1 time: 0.033827 Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1861/3855] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 07:05:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1523848616 => generated 145 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:30.872244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:30.880277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:30.882943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:30.882943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:30.882943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:30.883417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:30.883819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:30.988717 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b87c5dbe-8c39-4009-9817-52eebbd71ff4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.494671 Oct 19 07:05:30.989385 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1995/3856] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 07:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 07:05:31.005177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d1c20bc-d64b-4288-88a7-0d5ba0b1dd51 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:31.006287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d1c20bc-d64b-4288-88a7-0d5ba0b1dd51 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: cd9719f5-7d78-412f-a59a-931b8ce9c735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:31.011197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:31.026356 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9ed45a5-078d-4f0c-9f77-b501938ddb3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1272 microversion: 2.1 time: 0.158926 Oct 19 07:05:31.027581 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1862/3857] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:30 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:31.121651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d1c20bc-d64b-4288-88a7-0d5ba0b1dd51 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:31.136571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d1c20bc-d64b-4288-88a7-0d5ba0b1dd51 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:31.145390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d1c20bc-d64b-4288-88a7-0d5ba0b1dd51 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:31.146936 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d1c20bc-d64b-4288-88a7-0d5ba0b1dd51 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735" status: 200 len: 1278 microversion: 2.47 time: 0.150092 Oct 19 07:05:31.148075 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1996/3858] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:30 2022] GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:05:31.347780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73be6857-042f-4f7a-b6bd-59b5e198391a tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f996c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:31.386331 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73be6857-042f-4f7a-b6bd-59b5e198391a tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 200 len: 287 microversion: 2.1 time: 0.043257 Oct 19 07:05:31.387632 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1863/3859] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 07:05:31 2022] GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:31.392461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1224996984", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:31.399102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10ac0285-a965-4d1e-a5ca-053ee4980951 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f913160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:31.485160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:05:31.485761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:05:31.486116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:05:31.487311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:05:31.487913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:05:31.497095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:31.498425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:31.499053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:31.499992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:31.500477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:31.501082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:31.521824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Getting quotas for project 01818e11c082485688fe7fc640e7613e. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:31.527520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Getting quotas for user 271f5c8219c9454385c3bf42fe2979dd and project 01818e11c082485688fe7fc640e7613e. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:31.541818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:05:31.544072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:05:31.643601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10ac0285-a965-4d1e-a5ca-053ee4980951 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 202 len: 0 microversion: 2.1 time: 0.248309 Oct 19 07:05:31.644598 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1864/3860] 10.222.0.39 () {58 vars in 1254 bytes} [Wed Oct 19 07:05:31 2022] DELETE /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:05:31.654815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be89cd51-9741-48f1-bb74-de737fee72aa tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5fa28f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:31.700954 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be89cd51-9741-48f1-bb74-de737fee72aa tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 200 len: 286 microversion: 2.1 time: 0.052108 Oct 19 07:05:31.701533 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1865/3861] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 07:05:31 2022] GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:31.726009 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67b70c70-e3ff-4e9c-94c5-859c3c5e36c8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.338236 Oct 19 07:05:31.733555 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1997/3862] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 07:05:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 346 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 07:05:31.752781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0d8e13c-4690-4344-a968-fad4cd3b7df4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:31.756890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0d8e13c-4690-4344-a968-fad4cd3b7df4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:31.856405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:31.857523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:31.873859 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0d8e13c-4690-4344-a968-fad4cd3b7df4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "PUT /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 992 microversion: 2.47 time: 0.138515 Oct 19 07:05:31.875264 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1866/3863] 10.222.0.39 () {62 vars in 1297 bytes} [Wed Oct 19 07:05:31 2022] PUT /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 992 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 07:05:31.883178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:31.885449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:31.890047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:31.890047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:31.890047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:31.890047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:31.906201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00bde904-0ed6-4c4b-bf37-148b869e43f5 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:31.909332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00bde904-0ed6-4c4b-bf37-148b869e43f5 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:32.096512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00bde904-0ed6-4c4b-bf37-148b869e43f5 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:32.118238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00bde904-0ed6-4c4b-bf37-148b869e43f5 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:32.126155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00bde904-0ed6-4c4b-bf37-148b869e43f5 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:32.129753 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00bde904-0ed6-4c4b-bf37-148b869e43f5 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1278 microversion: 2.47 time: 0.233439 Oct 19 07:05:32.133000 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1867/3864] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:31 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:32.153126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:32.153927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:32.181519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:32.183120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:32.184892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:32.188505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:32.190370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:32.192503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:32.303515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:32.321115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:32.322781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:32.331952 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f13a5b4-53a9-48c4-8930-28c81d1a2f7f tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1358 microversion: 2.21 time: 0.481133 Oct 19 07:05:32.332812 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1998/3865] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:31 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1358 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:32.681828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:32.693465 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb47a63e-072d-4183-bef6-bedc0701445d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1314 microversion: 2.1 time: 0.558781 Oct 19 07:05:32.694173 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1868/3866] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:32 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:32.714152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be820316-c07d-417d-97bf-e49836456750 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f999820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:32.747938 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be820316-c07d-417d-97bf-e49836456750 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 200 len: 286 microversion: 2.1 time: 0.037830 Oct 19 07:05:32.748797 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1999/3867] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 07:05:32 2022] GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:33.174736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1645b93-8585-4d41-acd3-0a89142e980a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:33.174938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1645b93-8585-4d41-acd3-0a89142e980a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:33.348128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1645b93-8585-4d41-acd3-0a89142e980a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:33.356509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1645b93-8585-4d41-acd3-0a89142e980a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:33.358614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1645b93-8585-4d41-acd3-0a89142e980a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:33.361040 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1645b93-8585-4d41-acd3-0a89142e980a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1278 microversion: 2.47 time: 0.198939 Oct 19 07:05:33.363895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:33.364892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:33.383134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:33.383947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:33.385075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:33.387881 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1869/3868] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:33 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:33.388838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:33.389951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:33.391008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:33.694831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:33.705229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:33.707485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:33.708767 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37d988a2-b93a-4621-8267-63308cf1ef8b tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1358 microversion: 2.21 time: 0.349703 Oct 19 07:05:33.719885 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2000/3869] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:33 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1358 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:33.732655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:33.736712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:33.750409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:33.751003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:33.751446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:33.752804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:33.753346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:33.753858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:33.952876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:33.976610 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a57b471-98dd-46ea-8069-ba658a136ade tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1314 microversion: 2.1 time: 0.245167 Oct 19 07:05:33.976610 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2001/3870] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:33 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:33.976610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb962c39-7e10-4a3e-8f29-4b1976097d49 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f9990d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:34.042931 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb962c39-7e10-4a3e-8f29-4b1976097d49 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 200 len: 286 microversion: 2.1 time: 0.074089 Oct 19 07:05:34.043629 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2002/3871] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 07:05:33 2022] GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:34.055900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a477f0c1-ec20-494d-9bfc-d5b7559d284c req-35ffb749-1b1d-4690-aef2-afd7d0f95e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed028ead-fa3b-491a-80fa-4fe766097ef2", "tag": "0fbb0704-c6b4-4768-be40-7a4928fdda40"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:34.075214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a477f0c1-ec20-494d-9bfc-d5b7559d284c req-35ffb749-1b1d-4690-aef2-afd7d0f95e04 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:34.076018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a477f0c1-ec20-494d-9bfc-d5b7559d284c req-35ffb749-1b1d-4690-aef2-afd7d0f95e04 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:34.076674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a477f0c1-ec20-494d-9bfc-d5b7559d284c req-35ffb749-1b1d-4690-aef2-afd7d0f95e04 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:34.088505 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a477f0c1-ec20-494d-9bfc-d5b7559d284c req-35ffb749-1b1d-4690-aef2-afd7d0f95e04 service nova] Creating event network-changed:0fbb0704-c6b4-4768-be40-7a4928fdda40 for instance ed028ead-fa3b-491a-80fa-4fe766097ef2 on n-h2-861333-10 Oct 19 07:05:34.093620 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a477f0c1-ec20-494d-9bfc-d5b7559d284c req-35ffb749-1b1d-4690-aef2-afd7d0f95e04 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042707 Oct 19 07:05:34.094252 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2003/3872] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:34.300890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-aae5acfa-2ec1-43fb-9726-3683af1bebfb req-57d2f78e-88fe-4b29-8602-f54969e60c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f", "name": "network-vif-plugged", "status": "completed", "tag": "d97a57e4-701b-4057-95d9-d43552074fb3"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:34.316029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aae5acfa-2ec1-43fb-9726-3683af1bebfb req-57d2f78e-88fe-4b29-8602-f54969e60c4a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:34.316837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aae5acfa-2ec1-43fb-9726-3683af1bebfb req-57d2f78e-88fe-4b29-8602-f54969e60c4a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:34.317460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aae5acfa-2ec1-43fb-9726-3683af1bebfb req-57d2f78e-88fe-4b29-8602-f54969e60c4a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:34.328731 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-aae5acfa-2ec1-43fb-9726-3683af1bebfb req-57d2f78e-88fe-4b29-8602-f54969e60c4a service nova] Creating event network-vif-plugged:d97a57e4-701b-4057-95d9-d43552074fb3 for instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f on n-h1-861333-10 Oct 19 07:05:34.334531 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-aae5acfa-2ec1-43fb-9726-3683af1bebfb req-57d2f78e-88fe-4b29-8602-f54969e60c4a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.688618 Oct 19 07:05:34.335734 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1870/3873] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:34.391585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:34.392321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:34.406573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:34.407350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:34.408062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:34.409511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:34.410147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:34.410627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:34.499061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:34.526265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:34.529147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:34.532713 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b7688ed7-80c5-4593-a9d5-6f488ca660b8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1274 microversion: 2.47 time: 0.145458 Oct 19 07:05:34.549034 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2004/3874] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:34 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:34.627972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:34.628912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:34.638307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:34.639466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:34.639988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:34.641367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:34.641844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:34.642285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:34.678611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:05:34.736339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:34.736978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:34.743767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:34.744281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:34.744727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:34.745427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:34.745890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:34.746323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:34.925422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:34.950544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:34.952443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:34.959231 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c992d42-c8f0-44aa-9325-137682bb3205 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1358 microversion: 2.21 time: 0.226554 Oct 19 07:05:34.962046 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2005/3875] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:34 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:05:35.004769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:35.007471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:35.022163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:35.022681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:35.023181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:35.024347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:35.026297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:35.026297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:35.047576 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-185fd2a7-55b0-45f8-ab81-974b6db08d0d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 204 len: 0 microversion: 2.1 time: 0.423945 Oct 19 07:05:35.048417 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1871/3876] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:05:34 2022] DELETE /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:05:35.056426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b18c5f0-f724-47c1-b9a5-03219fa238ef tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f9584c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:35.086474 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-2b18c5f0-f724-47c1-b9a5-03219fa238ef tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] HTTP exception thrown: Snapshot 1f886b66-f647-4dad-b164-a2b3df129087 could not be found. Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b18c5f0-f724-47c1-b9a5-03219fa238ef tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Request method failure captured: Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 HTTP/1.1 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GxgjmQcPFZaJMIflbvmb9rIcZWdI2vjjX8mDX3GdJXgvHqgZrx10m5dObDbZUasNY2WAUpAenqnj8UhZct1uHxmpDDA7KZHwvxfDn2jSSXQTyerkH2CkjjvaT7ap-Rk4HHamalm6IlM4a0GqZG6MCexTcj1vCGyVhxfuSF0poAMNE Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 4910199e067048708d305c594845c3b3 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4910199e067048708d305c594845c3b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4910199e067048708d305c594845c3b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4910199e067048708d305c594845c3b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4910199e067048708d305c594845c3b3", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 4910199e067048708d305c594845c3b3 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesSnapshotsTestJSON-1770446995-project Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: ab81a868feed48a5926f0d133e75f5b2 Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1770446995-project Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: exception: Snapshot 1f886b66-f647-4dad-b164-a2b3df129087 could not be found. Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1f886b66-f647-4dad-b164-a2b3df129087'} Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1f886b66-f647-4dad-b164-a2b3df129087 could not be found. (HTTP 404) (Request-ID: req-c0bc8fe9-744b-4b55-9a95-0afc410c507c) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 07:05:35.095870 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1f886b66-f647-4dad-b164-a2b3df129087 could not be found. Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1f886b66-f647-4dad-b164-a2b3df129087 could not be found. Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1f886b66-f647-4dad-b164-a2b3df129087 could not be found. Oct 19 07:05:35.100993 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:35.105341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b18c5f0-f724-47c1-b9a5-03219fa238ef tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Returning 404 to user: Snapshot 1f886b66-f647-4dad-b164-a2b3df129087 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:35.106451 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b18c5f0-f724-47c1-b9a5-03219fa238ef tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087" status: 404 len: 111 microversion: 2.1 time: 0.054090 Oct 19 07:05:35.110601 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1872/3877] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 07:05:35 2022] GET /compute/v2.1/os-snapshots/1f886b66-f647-4dad-b164-a2b3df129087 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:35.119747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:35.120744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:35.130373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:35.130373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:35.130373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:35.130994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:35.131453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:35.131885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:35.193602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:35.200626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:35.203219 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ff4806f-948c-4ead-9ae5-07b06f3648a4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1314 microversion: 2.1 time: 0.208908 Oct 19 07:05:35.204059 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2006/3878] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:34 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:35.212017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a120b9d-ed9e-4795-9b90-b946b56ef276 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f95e700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:35.328483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:35.339528 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04668305-de70-4f34-9259-e904684c25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1553 microversion: 2.1 time: 0.227095 Oct 19 07:05:35.340137 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1873/3879] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:35 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:35.473695 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a120b9d-ed9e-4795-9b90-b946b56ef276 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 202 len: 0 microversion: 2.1 time: 0.264554 Oct 19 07:05:35.473695 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2007/3880] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:05:35 2022] DELETE /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:05:35.482430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00b599d9-8cc9-44de-ad5d-c4b9ec5078e0 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f979790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:35.536970 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00b599d9-8cc9-44de-ad5d-c4b9ec5078e0 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 200 len: 344 microversion: 2.1 time: 0.060101 Oct 19 07:05:35.540153 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1874/3881] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:05:35 2022] GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:35.562909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:35.563535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:35.571189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:35.571958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:35.572437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:35.573150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:35.573613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:35.576844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:35.656348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:35.662168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:35.667220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:35.669170 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f98765d-3fc1-41c6-9fdd-a3a929a2231d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1330 microversion: 2.47 time: 0.110066 Oct 19 07:05:35.670210 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2008/3882] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:35 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:35.990812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:35.991817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:36.004299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.005250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.006335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.007492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.009122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.009862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.189540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:36.206948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:36.208637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:36.210381 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47cb8987-3e71-4680-a259-49a13e40a01a tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1550 microversion: 2.21 time: 0.225492 Oct 19 07:05:36.223771 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1875/3883] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:35 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1550 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:36.233182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:36.233672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:36.236472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:36.237022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:36.241989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.242839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.243407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.244293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.245238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.245690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.246175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.246320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.246626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.247328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.247793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.248347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.265668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:36.279050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:05:36.575600 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c72e379-b6fd-4f2f-8ea0-0c9a0dd35dae tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "DELETE /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 204 len: 0 microversion: 2.21 time: 0.342731 Oct 19 07:05:36.576514 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1876/3884] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:05:36 2022] DELETE /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:05:36.585367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:36.587329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:36.593937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.604327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.604327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.604327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.604327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.604327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.640216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:36.649541 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ebdf61ce-3290-41b7-9288-1169ab7d9d5e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1314 microversion: 2.1 time: 0.422340 Oct 19 07:05:36.651736 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2009/3885] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:36 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:36.658242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e213236-01a9-40ab-a5f0-92f9b4cb66eb tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f9e1f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:36.682068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:36.747417 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e213236-01a9-40ab-a5f0-92f9b4cb66eb tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 200 len: 344 microversion: 2.1 time: 0.092451 Oct 19 07:05:36.748066 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2010/3886] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:05:36 2022] GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:36.763785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:36.764802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:36.803896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.804830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.806492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.811300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.812332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.813151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.822747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:36.834685 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbf049ef-926e-4629-ae90-55346aee6059 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1553 microversion: 2.1 time: 0.256864 Oct 19 07:05:36.836660 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1877/3887] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:36 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1553 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:36.842565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:36.843557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:36.850145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.850647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.851253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.851975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:36.852574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:36.853004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:36.969275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:36.977823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:36.979275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:36.980446 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed84e799-7d99-4fed-ac8b-725b31fdbf29 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1338 microversion: 2.47 time: 0.142516 Oct 19 07:05:36.981013 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1878/3888] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:36 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1338 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:37.118998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:37.128163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:37.129933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:37.131419 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d94c8704-d9fc-4de4-aebf-914cb6d7f3b4 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1556 microversion: 2.21 time: 0.381984 Oct 19 07:05:37.132572 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2011/3889] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:36 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1556 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:37.676906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:37.678251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:37.689587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:37.695977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:37.696726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:37.697633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:37.698466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:37.699056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:37.763993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c90def7-bb2f-4f37-a502-e1c19714358c tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f9e1790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:37.859348 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c90def7-bb2f-4f37-a502-e1c19714358c tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 200 len: 344 microversion: 2.1 time: 0.090983 Oct 19 07:05:37.859348 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2012/3890] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:05:37 2022] GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:37.864344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:37.864967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:37.866897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:37.874517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:37.884804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:37.885309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:37.886358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:37.889443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:37.889443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:38.156449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:38.166471 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39d1ec9b-f556-41a8-ba0d-7b97cc9587d4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1553 microversion: 2.1 time: 0.306871 Oct 19 07:05:38.167064 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2013/3891] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:37 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1553 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:38.191479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:38.192418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:38.199826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:38.204409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:38.204409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:38.204409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:38.204409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:38.204409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:38.367157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:38.382708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:38.385915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:38.387163 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-214bdea3-2ae9-47da-a803-3b82bdeb0bc6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1338 microversion: 2.47 time: 0.201204 Oct 19 07:05:38.400377 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2014/3892] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:38 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1338 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:38.402394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:38.409247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:38.414811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:38.415321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:38.415757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:38.416604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:38.417064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:38.417494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:38.555528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:38.571694 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d08b0cb1-b81a-44d6-bdbc-f6b086fadcb7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1314 microversion: 2.1 time: 0.898719 Oct 19 07:05:38.574645 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1879/3893] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:37 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1314 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:38.866546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26efb8cb-b67a-4d08-ad30-e758a977dd7b tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f958430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:38.932035 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-26efb8cb-b67a-4d08-ad30-e758a977dd7b tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] HTTP exception thrown: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26efb8cb-b67a-4d08-ad30-e758a977dd7b tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Request method failure captured: Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d HTTP/1.1 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GxgjmQcPFZaJMIflbvmb9rIcZWdI2vjjX8mDX3GdJXgvHqgZrx10m5dObDbZUasNY2WAUpAenqnj8UhZct1uHxmpDDA7KZHwvxfDn2jSSXQTyerkH2CkjjvaT7ap-Rk4HHamalm6IlM4a0GqZG6MCexTcj1vCGyVhxfuSF0poAMNE Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 4910199e067048708d305c594845c3b3 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4910199e067048708d305c594845c3b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4910199e067048708d305c594845c3b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4910199e067048708d305c594845c3b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4910199e067048708d305c594845c3b3", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 4910199e067048708d305c594845c3b3 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesSnapshotsTestJSON-1770446995-project Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: ab81a868feed48a5926f0d133e75f5b2 Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1770446995-project Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: exception: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1475ec8a-6b88-4474-ae26-6c307c42c63d'} Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. (HTTP 404) (Request-ID: req-3a01a241-0f05-472d-9ad3-2fcdded9a820) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 07:05:38.934729 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:38.940168 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:38.947873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26efb8cb-b67a-4d08-ad30-e758a977dd7b tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Returning 404 to user: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:38.950213 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26efb8cb-b67a-4d08-ad30-e758a977dd7b tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 404 len: 109 microversion: 2.1 time: 0.088669 Oct 19 07:05:38.952429 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1880/3894] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:05:38 2022] GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:38.965448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-295443fc-66e3-4531-ac47-118ec8951f58 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5fa28e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:39.060969 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-295443fc-66e3-4531-ac47-118ec8951f58 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] HTTP exception thrown: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-295443fc-66e3-4531-ac47-118ec8951f58 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Request method failure captured: Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d HTTP/1.1 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GxgjmQcPFZaJMIflbvmb9rIcZWdI2vjjX8mDX3GdJXgvHqgZrx10m5dObDbZUasNY2WAUpAenqnj8UhZct1uHxmpDDA7KZHwvxfDn2jSSXQTyerkH2CkjjvaT7ap-Rk4HHamalm6IlM4a0GqZG6MCexTcj1vCGyVhxfuSF0poAMNE Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 4910199e067048708d305c594845c3b3 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4910199e067048708d305c594845c3b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4910199e067048708d305c594845c3b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4910199e067048708d305c594845c3b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4910199e067048708d305c594845c3b3", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 4910199e067048708d305c594845c3b3 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesSnapshotsTestJSON-1770446995-project Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: ab81a868feed48a5926f0d133e75f5b2 Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1770446995-project Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: exception: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1475ec8a-6b88-4474-ae26-6c307c42c63d'} Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. (HTTP 404) (Request-ID: req-e2d3021e-0100-4bf4-bd06-522f477890b3) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 07:05:39.062967 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-295443fc-66e3-4531-ac47-118ec8951f58 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Returning 404 to user: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:39.067925 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-295443fc-66e3-4531-ac47-118ec8951f58 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 404 len: 109 microversion: 2.1 time: 0.105891 Oct 19 07:05:39.079283 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1881/3895] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:05:38 2022] DELETE /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:05:39.079283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bdb28115-a89a-4705-b235-efc1a1bb4b29 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Calling method '.version_select at 0x7f6d5f979dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:39.146013 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bdb28115-a89a-4705-b235-efc1a1bb4b29 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] HTTP exception thrown: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bdb28115-a89a-4705-b235-efc1a1bb4b29 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Request method failure captured: Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d HTTP/1.1 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GxgjmQcPFZaJMIflbvmb9rIcZWdI2vjjX8mDX3GdJXgvHqgZrx10m5dObDbZUasNY2WAUpAenqnj8UhZct1uHxmpDDA7KZHwvxfDn2jSSXQTyerkH2CkjjvaT7ap-Rk4HHamalm6IlM4a0GqZG6MCexTcj1vCGyVhxfuSF0poAMNE Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 4910199e067048708d305c594845c3b3 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4910199e067048708d305c594845c3b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4910199e067048708d305c594845c3b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4910199e067048708d305c594845c3b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4910199e067048708d305c594845c3b3", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 4910199e067048708d305c594845c3b3 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1770446995 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesSnapshotsTestJSON-1770446995-project Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: ab81a868feed48a5926f0d133e75f5b2 Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1770446995-project Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: exception: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1475ec8a-6b88-4474-ae26-6c307c42c63d'} Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. (HTTP 404) (Request-ID: req-cfa28bdb-4f85-481d-a5cd-24912b04b2bf) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 07:05:39.148020 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bdb28115-a89a-4705-b235-efc1a1bb4b29 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] Returning 404 to user: Volume 1475ec8a-6b88-4474-ae26-6c307c42c63d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bdb28115-a89a-4705-b235-efc1a1bb4b29 tempest-VolumesSnapshotsTestJSON-1770446995 tempest-VolumesSnapshotsTestJSON-1770446995-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d" status: 404 len: 109 microversion: 2.1 time: 0.080367 Oct 19 07:05:39.159203 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1882/3896] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:05:39 2022] GET /compute/v2.1/os-volumes/1475ec8a-6b88-4474-ae26-6c307c42c63d => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:39.215371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:39.216659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:39.224841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:39.225934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:39.235986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:39.236346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:39.246634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:39.247152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:39.334163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:39.347999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:39.352401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:39.364514 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1229877-f552-4b62-a4ed-e28bc1e1f1df tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1556 microversion: 2.21 time: 0.958622 Oct 19 07:05:39.364514 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2015/3897] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:38 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1556 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:39.417292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:39.422908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:39.427131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:39.436039 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d981aa9-18cb-4495-9e34-68befbf384d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1511 microversion: 2.1 time: 0.243277 Oct 19 07:05:39.437332 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1883/3898] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:39 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:39.445809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:39.447494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:39.448067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:39.450709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:39.451938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:39.452502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:39.602249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:39.602893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:39.611585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:39.621373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:39.634640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:39.636590 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17cd90bd-a811-4468-848b-7e380f775846 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1336 microversion: 2.47 time: 0.223589 Oct 19 07:05:39.637661 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2016/3899] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:39 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1336 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:05:39.639768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:39.640308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:39.640933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:39.642581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:39.643777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:39.644402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:39.834266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a992cde2-67f4-47aa-8b62-bdfc9306ed41 req-b896ad75-2cf8-4ba3-adb1-026dbe47d4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9", "name": "network-vif-deleted", "tag": "6bc8a5cc-5493-4884-9e5b-6ed594a88670"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:39.858647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a992cde2-67f4-47aa-8b62-bdfc9306ed41 req-b896ad75-2cf8-4ba3-adb1-026dbe47d4cd service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:39.859669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a992cde2-67f4-47aa-8b62-bdfc9306ed41 req-b896ad75-2cf8-4ba3-adb1-026dbe47d4cd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:39.860513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a992cde2-67f4-47aa-8b62-bdfc9306ed41 req-b896ad75-2cf8-4ba3-adb1-026dbe47d4cd service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:39.902663 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a992cde2-67f4-47aa-8b62-bdfc9306ed41 req-b896ad75-2cf8-4ba3-adb1-026dbe47d4cd service nova] Creating event network-vif-deleted:6bc8a5cc-5493-4884-9e5b-6ed594a88670 for instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 on n-h2-861333-10 Oct 19 07:05:39.907948 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a992cde2-67f4-47aa-8b62-bdfc9306ed41 req-b896ad75-2cf8-4ba3-adb1-026dbe47d4cd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077196 Oct 19 07:05:39.916063 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2017/3900] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:05:40.389069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:40.402374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:40.444254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:40.445200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:40.446147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:40.447075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:40.448724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:40.450917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:40.514837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:40.523931 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25a87a90-290f-49ae-9f95-0cf9492fbd1f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1314 microversion: 2.1 time: 0.928441 Oct 19 07:05:40.557835 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1884/3901] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:39 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1314 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:40.573645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:40.574443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:40.593665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:40.594054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:40.596772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:40.605245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:40.607826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:40.608789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:40.742660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:40.747620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:40.761317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:40.764756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:40.765974 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f53a7a6-807c-4faa-8f9e-763282300b3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1344 microversion: 2.1 time: 0.205741 Oct 19 07:05:40.776311 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1885/3902] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:40 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1344 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:40.778878 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e21a8c5a-0a5a-4f10-ae77-16e4166d88f1 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1514 microversion: 2.21 time: 0.398137 Oct 19 07:05:40.788008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:40.788870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:40.795268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:40.796002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:40.796622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:40.797474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:40.798156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:40.800575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:40.809680 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2018/3903] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:40 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1514 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:40.925549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:40.936904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:40.943615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:40.945160 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1de1c0ab-a999-49c8-ac6b-faf11848b8ac tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1336 microversion: 2.47 time: 0.165077 Oct 19 07:05:40.968913 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1886/3904] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:40 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1336 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:41.176028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-409b64dc-c4aa-4a56-af8f-4f4ff325ecb7 req-8157664a-8d96-44a4-bfa4-1545fd85f1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed028ead-fa3b-491a-80fa-4fe766097ef2", "name": "network-vif-plugged", "status": "completed", "tag": "0fbb0704-c6b4-4768-be40-7a4928fdda40"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:41.197584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-409b64dc-c4aa-4a56-af8f-4f4ff325ecb7 req-8157664a-8d96-44a4-bfa4-1545fd85f1f7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:41.198248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-409b64dc-c4aa-4a56-af8f-4f4ff325ecb7 req-8157664a-8d96-44a4-bfa4-1545fd85f1f7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:41.200552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-409b64dc-c4aa-4a56-af8f-4f4ff325ecb7 req-8157664a-8d96-44a4-bfa4-1545fd85f1f7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:41.226303 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-409b64dc-c4aa-4a56-af8f-4f4ff325ecb7 req-8157664a-8d96-44a4-bfa4-1545fd85f1f7 service nova] Creating event network-vif-plugged:0fbb0704-c6b4-4768-be40-7a4928fdda40 for instance ed028ead-fa3b-491a-80fa-4fe766097ef2 on n-h2-861333-10 Oct 19 07:05:41.253058 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-409b64dc-c4aa-4a56-af8f-4f4ff325ecb7 req-8157664a-8d96-44a4-bfa4-1545fd85f1f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078592 Oct 19 07:05:41.254666 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2019/3905] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:41.565506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:41.566596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:41.585587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:41.587189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:41.590092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:41.594182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:41.597725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:41.600126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:41.796162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:41.803386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:41.818177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:41.822330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=28 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:41.837683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:41.838760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:41.841624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:41.843773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:41.845834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:41.847219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:41.932495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:41.961376 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed7d2ed8-92a0-4b5b-ab80-b88f846f276c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1314 microversion: 2.1 time: 0.400166 Oct 19 07:05:41.964592 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1887/3906] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:41 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:41.998555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:42.000900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:42.016272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.021996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.021996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.021996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.021996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.021996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.056718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.057212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.057653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.068427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lazy-loading 'fault' on Instance uuid 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:42.079791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:42.097629 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6320625d-aa34-4507-a67d-71a20282d425 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1344 microversion: 2.1 time: 0.300550 Oct 19 07:05:42.098569 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2020/3907] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:41 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1344 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:42.103674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:42.111226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:42.127559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.128291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:42.128601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.129288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.130907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.131592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.133312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.146953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:42.148793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a505e47fd04138acb88552e0bf9c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575364405b4f4ba4943cbdd304d68438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:42.150424 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ee907d2-35df-43f0-ab88-5ee7b16408ac tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 200 len: 1348 microversion: 2.21 time: 0.184371 Oct 19 07:05:42.151269 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1888/3908] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:41 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 1348 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:42.176036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-65ee1a0c-4dd3-4347-8f87-2d195340c9c4 req-2521730a-ba02-4d8a-a92d-427dbb6bb14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f", "name": "network-vif-deleted", "tag": "d97a57e4-701b-4057-95d9-d43552074fb3"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:42.190635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-65ee1a0c-4dd3-4347-8f87-2d195340c9c4 req-2521730a-ba02-4d8a-a92d-427dbb6bb14e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.191339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-65ee1a0c-4dd3-4347-8f87-2d195340c9c4 req-2521730a-ba02-4d8a-a92d-427dbb6bb14e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.192415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-65ee1a0c-4dd3-4347-8f87-2d195340c9c4 req-2521730a-ba02-4d8a-a92d-427dbb6bb14e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.209168 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-65ee1a0c-4dd3-4347-8f87-2d195340c9c4 req-2521730a-ba02-4d8a-a92d-427dbb6bb14e service nova] Creating event network-vif-deleted:d97a57e4-701b-4057-95d9-d43552074fb3 for instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f on n-h1-861333-10 Oct 19 07:05:42.215473 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-65ee1a0c-4dd3-4347-8f87-2d195340c9c4 req-2521730a-ba02-4d8a-a92d-427dbb6bb14e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053148 Oct 19 07:05:42.217102 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1889/3909] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:42.373740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:42.384742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:42.388221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:42.389951 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d64500bb-620e-4515-b5d5-0df8891a38c1 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1357 microversion: 2.47 time: 0.290145 Oct 19 07:05:42.395958 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2021/3910] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:42 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1357 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:42.423574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:42.430281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:42.435389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.436209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.436934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.438054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.438761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.439470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.554210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:05:42.554874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:05:42.555742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:05:42.556701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:05:42.557535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:05:42.853773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:42.881041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.882170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.884752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.886550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:42.887730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:42.888262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:42.950020 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5089e2b9-bd87-4355-b7ed-8dee04edf9f8 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "POST /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57/action" status: 202 len: 1079 microversion: 2.47 time: 0.531124 Oct 19 07:05:42.958325 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1890/3911] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 07:05:42 2022] POST /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57/action => generated 1079 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 07:05:42.973267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:42.973956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:42.989015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:42.990100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:43.007452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.009320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.010184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.010980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.011892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.018027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.018027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.018518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.018518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.030496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.031265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.031719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.270144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:43.286442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:43.288394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:43.296449 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-187efa7b-26a9-415e-aae8-4311f4a0a73d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.327755 Oct 19 07:05:43.331851 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2022/3912] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:42 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:43.358319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=30 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:43.374017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:43.388670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:43.442553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.443207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.443663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.444438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.444976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.455914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.558146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:43.573686 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1307cd56-3d73-4145-b696-244b4cc4f169 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1502 microversion: 2.1 time: 0.590626 Oct 19 07:05:43.575806 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1891/3913] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:42 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1502 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:43.591235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:43.606761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:43.633787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.636883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.638214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.643525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.643525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.643525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.707336 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] HTTP exception thrown: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Request method failure captured: Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f HTTP/1.1 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6GujWyODR_RnbLyEvq3zUHIjCZUf9dYGMAEg4-YSZFmUjY2t4T-qqOoXhnn2wELRA9XCHzBM6HHn6KR7yKU8Ty-lFYnj9xXoWvRsOut6mv7_sodJhNKaUUQFHJqjRS_hbZQTGnqVr9ic0im6EEaqQTH4h1IfJWf6H0K1Y8km69_noM Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.21 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 575364405b4f4ba4943cbdd304d68438 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-InstanceActionsV221TestJSON-162843784 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/575364405b4f4ba4943cbdd304d68438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/575364405b4f4ba4943cbdd304d68438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/575364405b4f4ba4943cbdd304d68438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_575364405b4f4ba4943cbdd304d68438", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-InstanceActionsV221TestJSON-162843784 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 575364405b4f4ba4943cbdd304d68438 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-162843784 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-InstanceActionsV221TestJSON-162843784-project Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 86a505e47fd04138acb88552e0bf9c72 Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-InstanceActionsV221TestJSON-162843784-project Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f'} Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:43.726553 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Returning 404 to user: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43712d88-1805-4653-918d-21109ce64e46 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 404 len: 111 microversion: 2.21 time: 0.148661 Oct 19 07:05:43.737992 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1892/3914] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:43 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:05:43.739936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10e72972-bf45-4568-a8d9-532dd51f156e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:43.741778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:43.747666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:43.750419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10e72972-bf45-4568-a8d9-532dd51f156e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.751194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10e72972-bf45-4568-a8d9-532dd51f156e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.751873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10e72972-bf45-4568-a8d9-532dd51f156e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.764974 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-53496411-b6c1-482d-871d-aee9df582821 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1344 microversion: 2.1 time: 0.431160 Oct 19 07:05:43.767457 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2023/3915] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:43 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1344 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:43.796276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd930c06-faad-4729-82e3-d62191d65ed6 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '.version_select at 0x7f6d68a79040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:43.802074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd930c06-faad-4729-82e3-d62191d65ed6 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:43.827640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd930c06-faad-4729-82e3-d62191d65ed6 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.828262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd930c06-faad-4729-82e3-d62191d65ed6 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.830182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd930c06-faad-4729-82e3-d62191d65ed6 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.834413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd930c06-faad-4729-82e3-d62191d65ed6 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:43.839241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd930c06-faad-4729-82e3-d62191d65ed6 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:43.843485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd930c06-faad-4729-82e3-d62191d65ed6 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:43.906552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:43.934651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10e72972-bf45-4568-a8d9-532dd51f156e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 07:05:44.107295 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd930c06-faad-4729-82e3-d62191d65ed6 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.333981 Oct 19 07:05:44.108059 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2024/3916] 10.222.0.39 () {60 vars in 1337 bytes} [Wed Oct 19 07:05:43 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f/os-instance-actions => generated 611 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:05:44.131832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:44.138729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:44.158623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.159340 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10e72972-bf45-4568-a8d9-532dd51f156e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.428754 Oct 19 07:05:44.161621 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1893/3917] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:05:43 2022] POST /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:05:44.161984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.162927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.165072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.166062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.168600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.172259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:44.173139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:44.190574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.191072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.191511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.192241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.198556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.199143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.206854 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] HTTP exception thrown: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Request method failure captured: Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f HTTP/1.1 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6GujWyODR_RnbLyEvq3zUHIjCZUf9dYGMAEg4-YSZFmUjY2t4T-qqOoXhnn2wELRA9XCHzBM6HHn6KR7yKU8Ty-lFYnj9xXoWvRsOut6mv7_sodJhNKaUUQFHJqjRS_hbZQTGnqVr9ic0im6EEaqQTH4h1IfJWf6H0K1Y8km69_noM Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.21 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 575364405b4f4ba4943cbdd304d68438 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsV221TestJSON-162843784 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/575364405b4f4ba4943cbdd304d68438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/575364405b4f4ba4943cbdd304d68438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/575364405b4f4ba4943cbdd304d68438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_575364405b4f4ba4943cbdd304d68438", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsV221TestJSON-162843784 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 575364405b4f4ba4943cbdd304d68438 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-162843784 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsV221TestJSON-162843784-project Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 86a505e47fd04138acb88552e0bf9c72 Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsV221TestJSON-162843784-project Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f'} Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:44.211843 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Returning 404 to user: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fb15187-c488-449b-ad0d-087f86550f83 tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "DELETE /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 404 len: 111 microversion: 2.21 time: 0.086801 Oct 19 07:05:44.221873 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2025/3918] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:05:44 2022] DELETE /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:05:44.232404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:44.233396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] [instance: 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:44.258708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.262818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.263984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.266448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.270250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.270993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.302625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] HTTP exception thrown: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Request method failure captured: Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f HTTP/1.1 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6GujWyODR_RnbLyEvq3zUHIjCZUf9dYGMAEg4-YSZFmUjY2t4T-qqOoXhnn2wELRA9XCHzBM6HHn6KR7yKU8Ty-lFYnj9xXoWvRsOut6mv7_sodJhNKaUUQFHJqjRS_hbZQTGnqVr9ic0im6EEaqQTH4h1IfJWf6H0K1Y8km69_noM Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.21 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 575364405b4f4ba4943cbdd304d68438 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsV221TestJSON-162843784 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/575364405b4f4ba4943cbdd304d68438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/575364405b4f4ba4943cbdd304d68438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/575364405b4f4ba4943cbdd304d68438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_575364405b4f4ba4943cbdd304d68438", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsV221TestJSON-162843784 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 575364405b4f4ba4943cbdd304d68438 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-162843784 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsV221TestJSON-162843784-project Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 86a505e47fd04138acb88552e0bf9c72 Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsV221TestJSON-162843784-project Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f'} Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.304839 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:44.310333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.310333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:44.310333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:44.310333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:44.310333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:44.310333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:44.310333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. Oct 19 07:05:44.310333 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:44.314612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] Returning 404 to user: Instance 09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:44.318530 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d16e850-7350-4930-a033-c9214efc3ecd tempest-InstanceActionsV221TestJSON-162843784 tempest-InstanceActionsV221TestJSON-162843784-project] 10.222.0.39 "GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f" status: 404 len: 111 microversion: 2.21 time: 0.090413 Oct 19 07:05:44.319564 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2026/3919] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:44 2022] GET /compute/v2.1/servers/09fc2fe2-eb39-440b-9c8b-f3d3b06d9b1f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:05:44.330221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:44.333526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:44.353537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.356147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.357925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.363866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.366247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.367703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.606258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:44.626135 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a93dc6c-929b-42f8-8c2b-656a3985be6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.460232 Oct 19 07:05:44.628033 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1894/3920] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:44 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:44.795407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:44.796292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:44.812390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.812895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.813342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.814059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:44.814539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:44.814987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:44.845133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:44.866022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:44.867908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:44.869366 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60e45ed1-a315-4a1e-8f30-e9d2a6c6059f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.542946 Oct 19 07:05:44.870124 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2027/3921] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:44 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:05:44.965204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:44.982293 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7beb1cb-f6ec-4af2-8445-261d64eefe4e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1344 microversion: 2.1 time: 0.192264 Oct 19 07:05:44.985095 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1895/3922] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:44 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1344 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:45.655213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:45.656465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:45.674917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:45.678877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:45.682129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:45.683069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:45.685180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:45.686879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:45.901888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:45.902521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:45.926453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:45.928502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:45.928975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:45.929734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:45.936127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:45.936598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:46.153390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:46.166600 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e174d108-d526-417c-818b-c33b1d8ab73a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.513587 Oct 19 07:05:46.167228 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2028/3923] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:45 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:46.191656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:46.193452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:46.209499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:46.210489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:46.213704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:46.214694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:46.217287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:46.221804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:46.222129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:46.244624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:46.244934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:46.247726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:46.249372 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-897b0c53-825f-45b8-a4e6-7abe5fb0206a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.352377 Oct 19 07:05:46.250580 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1896/3924] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:45 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:46.488038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:46.529755 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5461e625-4a3e-47a9-be9e-ea30fca65692 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1344 microversion: 2.1 time: 0.328323 Oct 19 07:05:46.529755 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2029/3925] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:46 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1344 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:47.199261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:47.200003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:47.242319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:47.242919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:47.248836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:47.249750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:47.251839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:47.254550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:47.282451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:47.284651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:47.313176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:47.314085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:47.317779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:47.325463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:47.328744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:47.331099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:47.707203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:47.723677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:47.727733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:47.729039 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8867dc90-f73c-4b67-9b05-108adf40fbbd tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.452434 Oct 19 07:05:47.731398 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2030/3926] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:47 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:05:47.763796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:47.769238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:47.778884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:47.779392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:47.779844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:47.784757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:47.786368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:47.787910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:48.031048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:48.033402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:48.058880 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72178e46-219d-4474-ab9b-ba2d747ae02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.861321 Oct 19 07:05:48.064469 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a5d9be4-e0dd-451e-952e-2215f8aeba44 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1344 microversion: 2.1 time: 0.305258 Oct 19 07:05:48.069771 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1897/3927] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:47 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:48.087166 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2031/3928] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:47 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1344 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:48.766677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:48.767335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:48.800995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:48.808751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:48.808751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:48.808751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:48.808751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:48.808751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:49.031876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:49.037196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:49.038784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:49.045844 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf035193-ab9d-420b-a399-6712e90e7808 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.283417 Oct 19 07:05:49.048256 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1898/3929] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:48 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:49.085487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:49.086176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:49.092526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:49.094943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:49.111251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:49.112170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:49.115185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:49.116983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:49.117229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:49.117941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:49.118770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:49.119981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:49.122778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:49.124281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:49.124762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:49.125366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:49.206864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:49.211632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:49.215949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:49.216872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lazy-loading 'fault' on Instance uuid a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:05:49.358514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:49.379778 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f442881-0402-4443-9c9c-1787f60b25dd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 200 len: 1349 microversion: 2.1 time: 0.287490 Oct 19 07:05:49.381101 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1899/3930] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:49 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 1349 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:05:49.651662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:49.677034 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ab4f138-b884-4944-915c-b9f1500471cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.602818 Oct 19 07:05:49.699458 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2032/3931] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:49 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:50.079225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:50.079225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:50.082796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:50.083310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:50.084439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:50.085183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:50.085639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:50.086237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:50.251115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:50.270947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:50.274137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:50.279023 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d92e149d-62f0-43f1-8c80-414ec2f5b1f9 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.209462 Oct 19 07:05:50.282716 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2033/3932] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:50 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:50.392435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-305209bc-85c8-4b05-973c-06ead330232e tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Calling method '.version_select at 0x7f6d5f9794c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:50.411639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:50.413987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:50.425005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:50.425557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:50.433676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:50.440441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:50.441117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:50.443602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:50.470707 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 HTTP/1.1 Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9'} Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:50.474130 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.481561 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:50.481561 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:50.481561 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:50.481561 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:50.481561 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:50.481561 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:50.481561 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.482288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-305209bc-85c8-4b05-973c-06ead330232e tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:05:50.482288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-305209bc-85c8-4b05-973c-06ead330232e tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Neutron security group 475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:05:50.482288 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-305209bc-85c8-4b05-973c-06ead330232e tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] HTTP exception thrown: Security group 475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 does not exist Oct 19 07:05:50.482288 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-c74cf6ea-592e-4701-9423-aa4454391066'] Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-305209bc-85c8-4b05-973c-06ead330232e tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Request method failure captured: Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 HTTP/1.1 Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6HN4dV85pZHTKhqsoRLue0vapkg4h6q9ywrs-JVeilVlpz5OY3qF32S_gaapu4NqcKwNoSCNjEeEvkKXlth3uTIQXh6e48-QBFeRzN4g3QAaUDv71rrimlcUGa9GJUl4d0CJ4JwzkUh810OEwrvL8Q-9zovHp2l6lFaJt2s5alTa9w Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e81d0749951241e1a1cdd6e01d56bdbc Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e81d0749951241e1a1cdd6e01d56bdbc", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e81d0749951241e1a1cdd6e01d56bdbc Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsNegativeTestJSON-1609849464-project Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 07a1f77fa0f148ec9d8c5e15b0d7ca31 Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464-project Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group 475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 does not exist Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-c74cf6ea-592e-4701-9423-aa4454391066'] Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '475ecdb5-4f87-4afb-b0c1-ed6a781b0e77'} Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:05:50.483541 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 does not exist Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c74cf6ea-592e-4701-9423-aa4454391066'] Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 does not exist Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c74cf6ea-592e-4701-9423-aa4454391066'] Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 does not exist Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c74cf6ea-592e-4701-9423-aa4454391066'] Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 does not exist Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c74cf6ea-592e-4701-9423-aa4454391066'] Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-305209bc-85c8-4b05-973c-06ead330232e tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Returning 404 to user: Security group 475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 does not exist Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-c74cf6ea-592e-4701-9423-aa4454391066'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-305209bc-85c8-4b05-973c-06ead330232e tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/475ecdb5-4f87-4afb-b0c1-ed6a781b0e77" status: 404 len: 194 microversion: 2.1 time: 0.653476 Oct 19 07:05:50.498396 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1900/3933] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:05:49 2022] DELETE /compute/v2.1/os-security-groups/475ecdb5-4f87-4afb-b0c1-ed6a781b0e77 => generated 194 bytes in 655 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:50.508941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:50.508941 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8b16fae-5725-4810-9ee2-a4508ae24079 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 404 len: 111 microversion: 2.1 time: 0.088531 Oct 19 07:05:50.508941 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2034/3934] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:50 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:50.509299 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3399f5fc-f728-4e5e-a67f-9f849452d578 tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.009656 Oct 19 07:05:50.509299 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1901/3935] 10.222.0.39 () {58 vars in 1164 bytes} [Wed Oct 19 07:05:50 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 19 07:05:50.515998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f3c5765-f420-4946-89a7-7c0d4d5ad21c tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Calling method '.version_select at 0x7f6d5f88af70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:50.704664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:50.705398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:50.714221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:50.715113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:50.717619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:50.718790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:50.719856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:50.721192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:51.461524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:51.475458 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e105aa9-163a-4a0e-b1a4-d52a45bef4d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.775735 Oct 19 07:05:51.476631 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1902/3936] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:50 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:51.489948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:51.492467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:51.507662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:51.508328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:51.509878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:51.518473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:51.520024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:51.520805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:51.566636 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9/os-volume_attachments HTTP/1.1 Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'server_id': 'a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9'} Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:51.574505 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-502375b2-8fb1-4ccd-bf6f-c2a6b91f08be tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.102871 Oct 19 07:05:51.582048 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1903/3937] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:05:51 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9/os-volume_attachments => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:51.588493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:51.589226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:51.597737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:51.600347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:51.600347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:51.600347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:51.600347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:51.600953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:51.822121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:51.835772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:51.837320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:51.839007 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ec29bf5-a34a-4148-93b9-9ab416ae0714 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.254219 Oct 19 07:05:51.839136 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1904/3938] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:51 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:51.878236 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f3c5765-f420-4946-89a7-7c0d4d5ad21c tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.367075 Oct 19 07:05:51.891368 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2035/3939] 10.222.0.39 () {58 vars in 1158 bytes} [Wed Oct 19 07:05:50 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:05:51.900954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e463a21-0a7e-4f61-83e7-66877d2251fa tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Calling method '.version_select at 0x7f6d5f8679d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:52.164011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-960851595", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "737f0953-92be-4377-a7d8-73cd2ce52ac7"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:52.249607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] validate_networks() for [('737f0953-92be-4377-a7d8-73cd2ce52ac7', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:05:52.598572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-0e463a21-0a7e-4f61-83e7-66877d2251fa tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:05:52.599254 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0e463a21-0a7e-4f61-83e7-66877d2251fa tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 19 07:05:52.599254 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-962d815e-94db-4cd4-a392-7703f6465f0d'] Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e463a21-0a7e-4f61-83e7-66877d2251fa tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Request method failure captured: Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/b37cf6db-9728-4eb7-9e8d-a89b2c328fbe HTTP/1.1 Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6HN4dV85pZHTKhqsoRLue0vapkg4h6q9ywrs-JVeilVlpz5OY3qF32S_gaapu4NqcKwNoSCNjEeEvkKXlth3uTIQXh6e48-QBFeRzN4g3QAaUDv71rrimlcUGa9GJUl4d0CJ4JwzkUh810OEwrvL8Q-9zovHp2l6lFaJt2s5alTa9w Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e81d0749951241e1a1cdd6e01d56bdbc Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e81d0749951241e1a1cdd6e01d56bdbc", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e81d0749951241e1a1cdd6e01d56bdbc Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsNegativeTestJSON-1609849464-project Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 07a1f77fa0f148ec9d8c5e15b0d7ca31 Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464-project Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: exception: Insufficient rights for removing default security group. Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-962d815e-94db-4cd4-a392-7703f6465f0d'] Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'b37cf6db-9728-4eb7-9e8d-a89b2c328fbe'} Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:05:52.601150 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-962d815e-94db-4cd4-a392-7703f6465f0d'] Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-962d815e-94db-4cd4-a392-7703f6465f0d'] Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-962d815e-94db-4cd4-a392-7703f6465f0d'] Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-962d815e-94db-4cd4-a392-7703f6465f0d'] Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e463a21-0a7e-4f61-83e7-66877d2251fa tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-962d815e-94db-4cd4-a392-7703f6465f0d'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:52.606849 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e463a21-0a7e-4f61-83e7-66877d2251fa tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/b37cf6db-9728-4eb7-9e8d-a89b2c328fbe" status: 400 len: 182 microversion: 2.1 time: 0.705764 Oct 19 07:05:52.610399 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1905/3940] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:05:51 2022] DELETE /compute/v2.1/os-security-groups/b37cf6db-9728-4eb7-9e8d-a89b2c328fbe => generated 182 bytes in 713 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:05:52.615305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:52.615720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:52.635483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:52.636770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:52.638117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:52.642128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:52.647821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:52.647821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:53.391715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:05:53.393662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:05:53.394321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:05:53.394927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:05:53.395951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:05:53.416542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:53.416542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:53.416542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:53.416542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:53.416542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:53.416542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:53.438711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:53.453968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:53.458168 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f33b2b8d-934f-4b7b-a885-63c8b781da42 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.846840 Oct 19 07:05:53.458883 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1906/3941] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:52 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:53.462027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for user 44114105ac6d4e1daf262bbd4b212f5e and project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:53.468047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f25b3007-69d0-4bf9-b1f8-457d5a8c7958 tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Calling method '.version_select at 0x7f6d5fa28e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:53.488803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:05:53.491697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 95c278e5-bc7e-415e-b746-5d1d6b423ea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:05:53.543712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-f25b3007-69d0-4bf9-b1f8-457d5a8c7958 tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6318588f-a36b-4e58-8813-3e57a1122e1d does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:05:53.544696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-f25b3007-69d0-4bf9-b1f8-457d5a8c7958 tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Neutron security group 6318588f-a36b-4e58-8813-3e57a1122e1d not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:05:53.545256 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f25b3007-69d0-4bf9-b1f8-457d5a8c7958 tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] HTTP exception thrown: Security group 6318588f-a36b-4e58-8813-3e57a1122e1d does not exist Oct 19 07:05:53.545256 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-e0a14a2d-c22c-407e-a2a0-dae7b77e7e81'] Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f25b3007-69d0-4bf9-b1f8-457d5a8c7958 tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Request method failure captured: Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-security-groups/6318588f-a36b-4e58-8813-3e57a1122e1d HTTP/1.1 Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6HN4dV85pZHTKhqsoRLue0vapkg4h6q9ywrs-JVeilVlpz5OY3qF32S_gaapu4NqcKwNoSCNjEeEvkKXlth3uTIQXh6e48-QBFeRzN4g3QAaUDv71rrimlcUGa9GJUl4d0CJ4JwzkUh810OEwrvL8Q-9zovHp2l6lFaJt2s5alTa9w Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e81d0749951241e1a1cdd6e01d56bdbc Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e81d0749951241e1a1cdd6e01d56bdbc", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e81d0749951241e1a1cdd6e01d56bdbc Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsNegativeTestJSON-1609849464-project Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 07a1f77fa0f148ec9d8c5e15b0d7ca31 Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464-project Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group 6318588f-a36b-4e58-8813-3e57a1122e1d does not exist Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-e0a14a2d-c22c-407e-a2a0-dae7b77e7e81'] Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '6318588f-a36b-4e58-8813-3e57a1122e1d'} Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:05:53.547141 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6318588f-a36b-4e58-8813-3e57a1122e1d does not exist Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0a14a2d-c22c-407e-a2a0-dae7b77e7e81'] Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6318588f-a36b-4e58-8813-3e57a1122e1d does not exist Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0a14a2d-c22c-407e-a2a0-dae7b77e7e81'] Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6318588f-a36b-4e58-8813-3e57a1122e1d does not exist Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0a14a2d-c22c-407e-a2a0-dae7b77e7e81'] Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6318588f-a36b-4e58-8813-3e57a1122e1d does not exist Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0a14a2d-c22c-407e-a2a0-dae7b77e7e81'] Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f25b3007-69d0-4bf9-b1f8-457d5a8c7958 tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Returning 404 to user: Security group 6318588f-a36b-4e58-8813-3e57a1122e1d does not exist Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-e0a14a2d-c22c-407e-a2a0-dae7b77e7e81'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f25b3007-69d0-4bf9-b1f8-457d5a8c7958 tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/6318588f-a36b-4e58-8813-3e57a1122e1d" status: 404 len: 194 microversion: 2.1 time: 0.087433 Oct 19 07:05:53.551668 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1907/3942] 10.222.0.39 () {58 vars in 1269 bytes} [Wed Oct 19 07:05:53 2022] GET /compute/v2.1/os-security-groups/6318588f-a36b-4e58-8813-3e57a1122e1d => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:53.557239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:53.568306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:53.568306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:53.568306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:53.568306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:53.568306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:53.568306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:53.568990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:53.659336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:53.669636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:53.671543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:53.673807 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9cec1128-fed8-48f2-86e3-b3b299835082 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.123588 Oct 19 07:05:53.674578 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1908/3943] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:53 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:53.698414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c393c302-0ffc-405e-a80e-7c593827f1bd tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Action: 'update', calling method: .version_select at 0x7f6d5f979a60>, body: {"security_group": {"name": "tempest-sg-1689095519", "description": "tempest-description-460869734"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:53.726379 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4d46be6-6737-4c9c-b6dd-4a7384f82e65 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566584 Oct 19 07:05:53.733988 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2036/3944] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:05:53.740834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2df12c7b-c090-41cb-b9ca-3eaa0a74d81d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:53.741717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2df12c7b-c090-41cb-b9ca-3eaa0a74d81d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 95c278e5-bc7e-415e-b746-5d1d6b423ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:53.834963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-c393c302-0ffc-405e-a80e-7c593827f1bd tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d936e500-4624-4d35-8026-51fdbaee0e3b does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 07:05:53.835651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-c393c302-0ffc-405e-a80e-7c593827f1bd tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Neutron security group d936e500-4624-4d35-8026-51fdbaee0e3b not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 07:05:53.836217 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c393c302-0ffc-405e-a80e-7c593827f1bd tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] HTTP exception thrown: Security group d936e500-4624-4d35-8026-51fdbaee0e3b does not exist Oct 19 07:05:53.836217 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-3d335f6b-bf11-4124-87b2-034cef4b70a6'] Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c393c302-0ffc-405e-a80e-7c593827f1bd tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Request method failure captured: Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-security-groups/d936e500-4624-4d35-8026-51fdbaee0e3b HTTP/1.1 Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 101 Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6HN4dV85pZHTKhqsoRLue0vapkg4h6q9ywrs-JVeilVlpz5OY3qF32S_gaapu4NqcKwNoSCNjEeEvkKXlth3uTIQXh6e48-QBFeRzN4g3QAaUDv71rrimlcUGa9GJUl4d0CJ4JwzkUh810OEwrvL8Q-9zovHp2l6lFaJt2s5alTa9w Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e81d0749951241e1a1cdd6e01d56bdbc Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e81d0749951241e1a1cdd6e01d56bdbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e81d0749951241e1a1cdd6e01d56bdbc", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e81d0749951241e1a1cdd6e01d56bdbc Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464 Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsNegativeTestJSON-1609849464-project Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 07a1f77fa0f148ec9d8c5e15b0d7ca31 Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1609849464-project Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: {"security_group": {"name": "tempest-sg-1689095519", "description": "tempest-description-460869734"}} Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: exception: Security group d936e500-4624-4d35-8026-51fdbaee0e3b does not exist Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-3d335f6b-bf11-4124-87b2-034cef4b70a6'] Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'd936e500-4624-4d35-8026-51fdbaee0e3b', 'body': {'security_group': {'name': 'tempest-sg-1689095519', 'description': 'tempest-description-460869734'}}} Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 07:05:53.838181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d936e500-4624-4d35-8026-51fdbaee0e3b does not exist Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d335f6b-bf11-4124-87b2-034cef4b70a6'] Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d936e500-4624-4d35-8026-51fdbaee0e3b does not exist Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d335f6b-bf11-4124-87b2-034cef4b70a6'] Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d936e500-4624-4d35-8026-51fdbaee0e3b does not exist Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d335f6b-bf11-4124-87b2-034cef4b70a6'] Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d936e500-4624-4d35-8026-51fdbaee0e3b does not exist Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d335f6b-bf11-4124-87b2-034cef4b70a6'] Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c393c302-0ffc-405e-a80e-7c593827f1bd tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] Returning 404 to user: Security group d936e500-4624-4d35-8026-51fdbaee0e3b does not exist Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-3d335f6b-bf11-4124-87b2-034cef4b70a6'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:53.842780 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c393c302-0ffc-405e-a80e-7c593827f1bd tempest-SecurityGroupsNegativeTestJSON-1609849464 tempest-SecurityGroupsNegativeTestJSON-1609849464-project] 10.222.0.39 "PUT /compute/v2.1/os-security-groups/d936e500-4624-4d35-8026-51fdbaee0e3b" status: 404 len: 194 microversion: 2.1 time: 0.145877 Oct 19 07:05:53.848527 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1909/3945] 10.222.0.39 () {60 vars in 1290 bytes} [Wed Oct 19 07:05:53 2022] PUT /compute/v2.1/os-security-groups/d936e500-4624-4d35-8026-51fdbaee0e3b => generated 194 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:53.873535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2df12c7b-c090-41cb-b9ca-3eaa0a74d81d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:53.885493 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2df12c7b-c090-41cb-b9ca-3eaa0a74d81d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7" status: 200 len: 1214 microversion: 2.1 time: 0.149330 Oct 19 07:05:53.886629 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2037/3946] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:53 2022] GET /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:53.909395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d38421b-c229-4819-be00-05e99fbff658 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:53.909911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d38421b-c229-4819-be00-05e99fbff658 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 95c278e5-bc7e-415e-b746-5d1d6b423ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:53.977472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d38421b-c229-4819-be00-05e99fbff658 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 95c278e5-bc7e-415e-b746-5d1d6b423ea7] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:05:54.487447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:54.488757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:54.500076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:54.506632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:54.507242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:54.520733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:54.524187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:54.526543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:54.861773 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.scheduler.client.report [None req-4d38421b-c229-4819-be00-05e99fbff658 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Deleted allocations for instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 Oct 19 07:05:54.869010 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.compute.api [None req-4d38421b-c229-4819-be00-05e99fbff658 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 95c278e5-bc7e-415e-b746-5d1d6b423ea7] Instance Mapping does not exist while attempting local delete cleanup. Oct 19 07:05:54.870144 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d38421b-c229-4819-be00-05e99fbff658 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7" status: 204 len: 0 microversion: 2.1 time: 0.964546 Oct 19 07:05:54.875165 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1910/3947] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:05:53 2022] DELETE /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:05:54.899865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:54.900875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:54.914921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:54.923527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:54.924410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:54.927089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:54.928097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:54.928797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:54.972172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:54.991286 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1cf9d05-57f2-4f61-9866-d02d645ad99d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.510018 Oct 19 07:05:54.997215 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2038/3948] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:54 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:55.042409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-108031bc-d55e-4a0d-87ef-8a68d7a43b9f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:55.045356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-108031bc-d55e-4a0d-87ef-8a68d7a43b9f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 95c278e5-bc7e-415e-b746-5d1d6b423ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:55.057797 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-108031bc-d55e-4a0d-87ef-8a68d7a43b9f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-108031bc-d55e-4a0d-87ef-8a68d7a43b9f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7 HTTP/1.1 Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '95c278e5-bc7e-415e-b746-5d1d6b423ea7'} Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:05:55.075988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:05:55.082420 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:05:55.082420 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:05:55.082420 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:05:55.082420 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:05:55.082420 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:05:55.082420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-108031bc-d55e-4a0d-87ef-8a68d7a43b9f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:05:55.082420 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-108031bc-d55e-4a0d-87ef-8a68d7a43b9f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7" status: 404 len: 111 microversion: 2.1 time: 0.066591 Oct 19 07:05:55.082420 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2039/3949] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:54 2022] GET /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:05:55.236901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:55.247884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:55.253375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:55.256036 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47aed7f2-16c5-4a3f-8f55-3514487c4deb tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.379084 Oct 19 07:05:55.257659 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1911/3950] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:54 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:55.485737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-325771920", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "737f0953-92be-4377-a7d8-73cd2ce52ac7"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:05:55.561945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] validate_networks() for [('737f0953-92be-4377-a7d8-73cd2ce52ac7', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:05:56.016007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:56.017174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:56.026697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:56.027935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:56.028810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:56.030998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:56.031734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:56.032254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:56.261529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:05:56.262268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:05:56.269331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:05:56.269331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:05:56.269331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:05:56.282846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:56.285026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:56.286920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:56.288970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:56.291788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:56.292546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:56.328038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:05:56.335525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for user 44114105ac6d4e1daf262bbd4b212f5e and project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:05:56.352419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:05:56.355699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:05:56.527209 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c420291-200d-486b-b9da-0ec0c50795a1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045549 Oct 19 07:05:56.527857 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2040/3951] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:05:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:05:56.562257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:56.563748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:56.587467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:56.587467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:56.587467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:56.587467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:56.606264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:56.608411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:56.789460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:56.797710 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8923e938-746a-4169-a185-737462ac9e2d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.785841 Oct 19 07:05:56.808285 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1912/3952] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:56 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:56.820294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d380b04a-ac57-43a6-ad29-e79f016fd8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:56.834106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d380b04a-ac57-43a6-ad29-e79f016fd8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:56.911791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:56.925337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d380b04a-ac57-43a6-ad29-e79f016fd8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:56.932402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:56.935727 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d380b04a-ac57-43a6-ad29-e79f016fd8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1214 microversion: 2.1 time: 0.119339 Oct 19 07:05:56.938027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:56.948722 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af395695-b954-467b-9091-8e3a87a9e829 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.409651 Oct 19 07:05:56.948722 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2041/3953] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:56 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:56.948907 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1913/3954] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:56 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:57.834242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:57.835115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:57.842047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:57.842675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:57.843254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:57.848210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:57.848835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:57.849407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:57.965003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:57.966281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:57.985869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:57.986398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:57.986876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:57.988034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:57.989904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:57.990528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:58.110520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:58.124177 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad362706-5b14-489f-a061-67b8ae66ce89 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1218 microversion: 2.1 time: 0.165193 Oct 19 07:05:58.129665 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1914/3955] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:57 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:58.150004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:58.151037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:58.159356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:58.160153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:58.161022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:58.162027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:58.162868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:58.163560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:58.261986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:58.268868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:58.278692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:58.280016 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5dd23ad-fa28-4d51-820c-761354fd1160 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.452237 Oct 19 07:05:58.280734 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2042/3956] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:57 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:58.296644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:58.300897 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe683c33-8a2c-434c-a2e1-3874282f5e02 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.166050 Oct 19 07:05:58.300897 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1915/3957] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:58 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:59.155350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:59.156702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:59.187536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:59.190146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:59.192902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:59.198761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:59.200230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:59.201092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:59.309423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:59.311435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:59.326932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:59.329770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:59.331036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:59.335072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:59.335899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:59.336621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:59.382652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:05:59.392227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:59.409953 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60f14908-70f0-4b9b-9f78-1d3a294d9083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1266 microversion: 2.1 time: 0.258557 Oct 19 07:05:59.416129 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2043/3958] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:59 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:05:59.430357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:05:59.440956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:05:59.452334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:59.453353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:59.453810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:59.454600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:05:59.455286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:05:59.456696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:05:59.576659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:59.595501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:59.597824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:59.603702 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27fd8ea7-b17f-4fc7-8bc1-3ff0f074ff8b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.186229 Oct 19 07:05:59.604361 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2044/3959] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:05:59 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:05:59.908028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:05:59.916423 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5118a962-833f-4343-9024-02da28f27eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.617575 Oct 19 07:05:59.921111 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1916/3960] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:05:59 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:00.445749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:00.445749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:00.454524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:00.455070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:00.455562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:00.463159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:00.463755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:00.467628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:00.578226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:00.591580 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11df48d8-89ac-4f9c-9c4c-18cae9bfd323 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1272 microversion: 2.1 time: 0.156601 Oct 19 07:06:00.592183 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2045/3961] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:00 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:00.634648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:00.635859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:00.644354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:00.645094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:00.645761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:00.647600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:00.648357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:00.648961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:00.766942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:00.781992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:00.783348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:00.786322 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-edc9661e-3bb5-4f74-b951-131686380956 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.158984 Oct 19 07:06:00.786322 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1917/3962] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:00 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:00.947803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:00.948940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:00.970912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:00.972659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:00.973430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:00.975086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:00.977504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:00.978422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:01.231026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:01.243944 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-697808a3-7d71-4678-9c21-e6052ca2a07d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.302726 Oct 19 07:06:01.246484 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2046/3963] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:00 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:01.620376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:01.620996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:01.630733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:01.631232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:01.631675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:01.632417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:01.632876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:01.633305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:01.811845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:01.813139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:01.826472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:01.826982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:01.827426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:01.828531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:01.828719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:01.829057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:01.984082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:01.997101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:02.000801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:02.005926 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-886e47dd-0451-4a20-8631-a6a6b42fb719 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.198894 Oct 19 07:06:02.011551 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2047/3964] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:01 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:02.079887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:02.111750 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffeb51b3-c432-4a35-920c-3d3d79c02004 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1314 microversion: 2.1 time: 0.473299 Oct 19 07:06:02.111750 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1918/3965] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:01 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:02.272277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:02.273986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:02.284641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:02.285426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:02.287584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:02.288833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:02.289482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:02.290676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:02.657258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:02.670606 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cca49bd-a5b2-4403-b269-e5fd2014a709 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.405029 Oct 19 07:06:02.693154 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2048/3966] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:02 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:03.036348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:03.037211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:03.049033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:03.052399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:03.053141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:03.054096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:03.056218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:03.056836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:03.115845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:03.120956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:03.131046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:03.135481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:03.136604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:03.140731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:03.147099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:03.147099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:03.147099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:03.275723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:03.291200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:03.293740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:03.299742 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68df4c21-a974-4f57-a8a3-d1157c5774aa tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.266592 Oct 19 07:06:03.300974 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1919/3967] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:03 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:03.536380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e53125bf-b43b-43b3-b83a-ee16339a9f58 req-ea435da2-657d-4b68-8f1f-89a22fdcfb1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa9ebb5-481e-4e20-b395-95dd86979b90", "tag": "902a3221-c227-445b-9d53-b87b2ae8e877"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:03.553841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e53125bf-b43b-43b3-b83a-ee16339a9f58 req-ea435da2-657d-4b68-8f1f-89a22fdcfb1e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:03.554327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e53125bf-b43b-43b3-b83a-ee16339a9f58 req-ea435da2-657d-4b68-8f1f-89a22fdcfb1e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:03.554755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e53125bf-b43b-43b3-b83a-ee16339a9f58 req-ea435da2-657d-4b68-8f1f-89a22fdcfb1e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:03.570880 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e53125bf-b43b-43b3-b83a-ee16339a9f58 req-ea435da2-657d-4b68-8f1f-89a22fdcfb1e service nova] Creating event network-changed:902a3221-c227-445b-9d53-b87b2ae8e877 for instance ffa9ebb5-481e-4e20-b395-95dd86979b90 on n-h2-861333-10 Oct 19 07:06:03.576766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:03.594669 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e53125bf-b43b-43b3-b83a-ee16339a9f58 req-ea435da2-657d-4b68-8f1f-89a22fdcfb1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063698 Oct 19 07:06:03.595479 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1920/3968] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:06:03.602881 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ee1386a-9625-4dc4-b501-3088b7b8c2f8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1314 microversion: 2.1 time: 0.482800 Oct 19 07:06:03.604461 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2049/3969] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:03 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:03.698540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:03.699647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:03.707349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:03.707989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:03.708664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:03.709474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:03.710061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:03.710586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:04.331736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:04.332358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:04.339013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:04.339500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:04.340147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:04.341014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:04.341747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:04.342170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:04.402275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:04.412008 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f905e20-12fb-4ab6-9839-109a8bbb6eab tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.720037 Oct 19 07:06:04.412907 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1921/3970] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:03 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:04.452740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:04.466703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:04.472941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:04.474637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:04.475862 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4ad2af6-ef6a-4773-8175-e1896490599f tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.149502 Oct 19 07:06:04.476498 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2050/3971] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:04 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:04.629401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:04.630876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:04.639319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:04.640116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:04.640859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:04.641822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:04.642442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:04.643709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:05.147586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:05.173259 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-353d7422-7ff6-4014-940e-3d8c6f14761d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1314 microversion: 2.1 time: 0.547429 Oct 19 07:06:05.174817 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1922/3972] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:04 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:05.438466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:05.438977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:05.467258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:05.467778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:05.468484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:05.469880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:05.471986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:05.472653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:05.503498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:05.504327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:05.511767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:05.512611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:05.516438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:05.516438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:05.516438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:05.516438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:05.667540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:05.680536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:05.683769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:05.685999 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8aa914c-5956-43b1-a98e-5c82cb8ca307 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.186885 Oct 19 07:06:05.687650 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1923/3973] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:05 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:05.798006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:05.817125 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c318e798-4e07-476c-8bd2-b0f3bf5aba0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.384977 Oct 19 07:06:05.817719 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2051/3974] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:05 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:06.198254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:06.198873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:06.207938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:06.218874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:06.219627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:06.220598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:06.221945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:06.223420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:06.398653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:06.408292 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e9819a2-7ac4-465a-b846-ffd3c63c818b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1314 microversion: 2.1 time: 0.214318 Oct 19 07:06:06.411187 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1924/3975] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:06 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:06.713113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:06.714698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:06.734797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:06.738783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:06.744746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:06.748758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:06.754633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:06.761369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:06.762505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:06.764622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:06.843500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:06.844139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:06.854253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:06.860648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:06.863355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:06.863355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:06.863355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:06.863916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:06.935151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:06.958102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:06.970205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:06.975705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:06.977522 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e42cc28-cf12-4649-a672-3fd2d752df4d tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.268517 Oct 19 07:06:06.980051 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2052/3976] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:06 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:07.244829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:07.257822 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e15edc7c-e748-47d6-a7fd-dbf8c07e80e2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.418835 Oct 19 07:06:07.258774 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1925/3977] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:06 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:07.433110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:07.433794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:07.441427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:07.444750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:07.444750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:07.444750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:07.444750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:07.444750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:07.806650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:07.819111 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8cdab0e0-7cf1-4816-b839-2aa7596142e2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1314 microversion: 2.1 time: 0.389719 Oct 19 07:06:07.820066 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2053/3978] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:07 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:08.006847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:08.008584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:08.023221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:08.025785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:08.026264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:08.027010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:08.028208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:08.034472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:08.275093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:08.282345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:08.282968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:08.299880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:08.300531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:08.303229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:08.303685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:08.304453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:08.305474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:08.306702 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d3789c70-167d-4d03-ae9d-958b91a08bd7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.305858 Oct 19 07:06:08.313205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:08.314222 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1926/3979] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:07 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:08.314565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:08.845577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:08.847408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:08.854756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:08.855505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:08.855949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:08.856773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:08.857583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:08.858562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:08.940660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:08.954338 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b88f87f4-daf4-4752-be7b-f88ecbbbacc0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1512 microversion: 2.1 time: 0.674247 Oct 19 07:06:08.955331 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2054/3980] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:08 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1512 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:09.243691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:09.272080 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5905818-aea5-4787-9aaf-85fc69aa4124 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1314 microversion: 2.1 time: 0.426222 Oct 19 07:06:09.272080 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1927/3981] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:08 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:09.332430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:09.333312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:09.340236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:09.340846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:09.341281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:09.341986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:09.342437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:09.342862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:09.517978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:09.543825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:09.548598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:09.552460 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5358f6a-6eb5-4d82-85fb-f3c3b7b79b99 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1366 microversion: 2.47 time: 0.223901 Oct 19 07:06:09.554412 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2055/3982] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:09 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:09.982307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:09.982307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:09.998340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:09.999170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:09.999941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.001464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:10.001957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:10.002358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.292896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:10.305448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:10.310980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:10.311645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:10.312415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.313327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:10.314128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:10.315310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.369986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:10.392328 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a59870ff-3c15-4aab-a36d-f2f320711cd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1489 microversion: 2.1 time: 0.417019 Oct 19 07:06:10.411368 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1928/3983] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:09 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1489 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:10.423056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1880c5f5-be56-47a3-8d16-4c3c20b6da3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:10.425880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1880c5f5-be56-47a3-8d16-4c3c20b6da3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:10.433517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1880c5f5-be56-47a3-8d16-4c3c20b6da3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:10.434284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1880c5f5-be56-47a3-8d16-4c3c20b6da3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:10.434932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1880c5f5-be56-47a3-8d16-4c3c20b6da3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.435869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1880c5f5-be56-47a3-8d16-4c3c20b6da3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:10.436577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1880c5f5-be56-47a3-8d16-4c3c20b6da3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:10.437298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1880c5f5-be56-47a3-8d16-4c3c20b6da3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.520476 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1880c5f5-be56-47a3-8d16-4c3c20b6da3c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 200 len: 132 microversion: 2.1 time: 0.102104 Oct 19 07:06:10.526316 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1929/3984] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:10 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 132 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:06:10.537458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:10.538544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:10.570174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:10.570871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:10.571399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.574423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:10.579839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:10.580767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.625077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:10.648195 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5984d030-1228-463e-b03c-d51d54c11ee9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1314 microversion: 2.1 time: 0.359346 Oct 19 07:06:10.654927 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2056/3985] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:10 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:10.671345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:10.671975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:10.689620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:10.691581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:10.692034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.694670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:10.697053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:10.701816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:10.795895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:10.818170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:10.822754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:10.825004 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0539dc2-1c68-4dc6-b6d8-740e0cc2b967 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1384 microversion: 2.47 time: 0.168796 Oct 19 07:06:10.826647 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2057/3986] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:10 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1384 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:11.329390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c1e1fb85-31c4-4bb6-8a08-a3787ae261e2 req-0ebad194-481c-4a89-a80b-9736e906d8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa9ebb5-481e-4e20-b395-95dd86979b90", "name": "network-vif-plugged", "status": "completed", "tag": "902a3221-c227-445b-9d53-b87b2ae8e877"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:11.350642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1e1fb85-31c4-4bb6-8a08-a3787ae261e2 req-0ebad194-481c-4a89-a80b-9736e906d8a3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:11.351444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1e1fb85-31c4-4bb6-8a08-a3787ae261e2 req-0ebad194-481c-4a89-a80b-9736e906d8a3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:11.352179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1e1fb85-31c4-4bb6-8a08-a3787ae261e2 req-0ebad194-481c-4a89-a80b-9736e906d8a3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:11.378155 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c1e1fb85-31c4-4bb6-8a08-a3787ae261e2 req-0ebad194-481c-4a89-a80b-9736e906d8a3 service nova] Creating event network-vif-plugged:902a3221-c227-445b-9d53-b87b2ae8e877 for instance ffa9ebb5-481e-4e20-b395-95dd86979b90 on n-h2-861333-10 Oct 19 07:06:11.380190 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c1e1fb85-31c4-4bb6-8a08-a3787ae261e2 req-0ebad194-481c-4a89-a80b-9736e906d8a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055690 Oct 19 07:06:11.381394 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2058/3987] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:06:11.493824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:11.501574 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0e3d39c-a30c-4efb-af92-9471e63aca9e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.972595 Oct 19 07:06:11.502214 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1930/3988] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:10 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:11.542781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:11.543413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:11.551223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:11.551726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:11.553610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:11.554356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:11.554827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:11.555508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:11.682427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:11.684500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:11.703935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:11.705193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:11.710720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:11.710720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:11.710941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:11.711368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:11.910861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:11.936011 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-901c0b48-a449-40f9-ae15-4f48beee292f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.392720 Oct 19 07:06:11.941619 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2059/3989] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:11 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:11.970407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:11.980044 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e4c33f5-9651-4ed8-9170-446716c67b77 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1314 microversion: 2.1 time: 0.304378 Oct 19 07:06:11.981245 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1931/3990] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:11 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:11.989126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:11.990052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:11.998865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:11.999691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:12.000521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:12.005661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:12.006768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:12.007486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:12.154159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:12.164221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:12.167145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:12.168857 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-77bea3fa-a2f5-4334-b502-c232be80e9e4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1372 microversion: 2.47 time: 0.185653 Oct 19 07:06:12.170490 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1932/3991] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:11 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:12.199158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:12.199158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:12.199158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:12.199158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:12.199158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:12.201045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:12.201702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:12.202330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:12.405265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dffc56e2-f4e7-4b6f-8950-ebdcb1d1d709 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Action: 'create', calling method: .version_select at 0x7f6d5f966430>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:12.444666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dffc56e2-f4e7-4b6f-8950-ebdcb1d1d709 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Getting quotas for project 60b8c234a0ae4baea5026295b534a9c1. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:12.445265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:12.459413 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9baf816e-a0cd-4bc4-bd12-eb4971d9d47a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.286137 Oct 19 07:06:12.461671 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1933/3992] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:12 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:12.474265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dffc56e2-f4e7-4b6f-8950-ebdcb1d1d709 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Getting quotas for user 48d2edec97a64da6a3ff0231b430a59d and project 60b8c234a0ae4baea5026295b534a9c1. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:12.486501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:12.487826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:12.495034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:12.495756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:12.496326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:12.497233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:12.497791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:12.498319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:12.503352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:12.683784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dffc56e2-f4e7-4b6f-8950-ebdcb1d1d709 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Getting quotas for project 60b8c234a0ae4baea5026295b534a9c1. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:12.703879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dffc56e2-f4e7-4b6f-8950-ebdcb1d1d709 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Getting quotas for user 48d2edec97a64da6a3ff0231b430a59d and project 60b8c234a0ae4baea5026295b534a9c1. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:12.740074 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dffc56e2-f4e7-4b6f-8950-ebdcb1d1d709 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.802066 Oct 19 07:06:12.746076 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2060/3993] 10.222.0.39 () {62 vars in 1214 bytes} [Wed Oct 19 07:06:11 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:06:12.764832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-658a2131-5e2b-4d4f-89ae-9397dc0de551 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:12.804628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:12.813594 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-658a2131-5e2b-4d4f-89ae-9397dc0de551 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.055681 Oct 19 07:06:12.815914 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2061/3994] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 07:06:12 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:06:12.817453 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ad7d633-486e-4463-8ae3-c9232c5cab19 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.330953 Oct 19 07:06:12.818268 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1934/3995] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:12 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:12.848249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f323dca-885a-44da-b3bd-5528ce5118b3 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:12.866531 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f323dca-885a-44da-b3bd-5528ce5118b3 tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/745a2523-de4e-42b9-8119-510d1cdbd2ce" status: 200 len: 235 microversion: 2.64 time: 0.028188 Oct 19 07:06:12.866531 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2062/3996] 10.222.0.39 () {60 vars in 1304 bytes} [Wed Oct 19 07:06:12 2022] GET /compute/v2.1/os-server-groups/745a2523-de4e-42b9-8119-510d1cdbd2ce => generated 235 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:06:12.869797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d1861c5-9a5a-4997-97c6-d11c0c55026c tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:12.996432 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d1861c5-9a5a-4997-97c6-d11c0c55026c tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/745a2523-de4e-42b9-8119-510d1cdbd2ce" status: 204 len: 0 microversion: 2.64 time: 0.130709 Oct 19 07:06:12.997098 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1935/3997] 10.222.0.39 () {60 vars in 1307 bytes} [Wed Oct 19 07:06:12 2022] DELETE /compute/v2.1/os-server-groups/745a2523-de4e-42b9-8119-510d1cdbd2ce => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:06:13.010168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:13.010168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:13.026964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abf0f91e-5bd9-4b13-83d1-13cd6ab6858b tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:13.041362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:13.041909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:13.044787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:13.050573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:13.051077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:13.052876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:13.054768 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-abf0f91e-5bd9-4b13-83d1-13cd6ab6858b tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] HTTP exception thrown: Instance group 745a2523-de4e-42b9-8119-510d1cdbd2ce could not be found. Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abf0f91e-5bd9-4b13-83d1-13cd6ab6858b tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Request method failure captured: Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-server-groups/745a2523-de4e-42b9-8119-510d1cdbd2ce HTTP/1.1 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6HjhOM-IL3bTU-6H29QYlD5HXayRt1ZncLSqBzTOeYzNFqZKktMCxwdWLyZksJdVYXPc9D1IYtUm25k3ORHMGuYOuLk5FYAkyNSnAFKydtJmv8SYcdUymXQd-mUOoCRZmKmS2MEM1EOL7qpwQSTcbtOPfoKoi6PLeM6Iquof9W5nJI Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.64 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 60b8c234a0ae4baea5026295b534a9c1 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroup264TestJSON-1530682555 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60b8c234a0ae4baea5026295b534a9c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8c234a0ae4baea5026295b534a9c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8c234a0ae4baea5026295b534a9c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60b8c234a0ae4baea5026295b534a9c1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroup264TestJSON-1530682555 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 60b8c234a0ae4baea5026295b534a9c1 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1530682555 Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerGroup264TestJSON-1530682555-project Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 48d2edec97a64da6a3ff0231b430a59d Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroup264TestJSON-1530682555-project Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance group 745a2523-de4e-42b9-8119-510d1cdbd2ce could not be found. Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '745a2523-de4e-42b9-8119-510d1cdbd2ce'} Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 745a2523-de4e-42b9-8119-510d1cdbd2ce could not be found. Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 745a2523-de4e-42b9-8119-510d1cdbd2ce could not be found. Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:13.070487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:13.077122 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:13.077122 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:13.077122 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:06:13.077122 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:06:13.077122 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 745a2523-de4e-42b9-8119-510d1cdbd2ce could not be found. Oct 19 07:06:13.077122 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:13.081133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abf0f91e-5bd9-4b13-83d1-13cd6ab6858b tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] Returning 404 to user: Instance group 745a2523-de4e-42b9-8119-510d1cdbd2ce could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:06:13.081133 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abf0f91e-5bd9-4b13-83d1-13cd6ab6858b tempest-ServerGroup264TestJSON-1530682555 tempest-ServerGroup264TestJSON-1530682555-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/745a2523-de4e-42b9-8119-510d1cdbd2ce" status: 404 len: 117 microversion: 2.64 time: 0.068326 Oct 19 07:06:13.081713 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1936/3998] 10.222.0.39 () {60 vars in 1307 bytes} [Wed Oct 19 07:06:13 2022] DELETE /compute/v2.1/os-server-groups/745a2523-de4e-42b9-8119-510d1cdbd2ce => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:06:13.120411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-479942462", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "6982a92b-3116-4178-8c1d-06fbcd358c52"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:13.206826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] validate_networks() for [('6982a92b-3116-4178-8c1d-06fbcd358c52', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:06:13.272063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:13.280652 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75bf98d5-4239-4a69-9caa-eb61a058ad76 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1314 microversion: 2.1 time: 0.277188 Oct 19 07:06:13.282939 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2063/3999] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:13 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:13.287835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:13.288707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:13.294797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:13.295278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:13.295908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:13.297993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:13.298957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:13.299608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:13.410980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:13.438612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:13.440757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:13.441940 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-adef1991-d248-4c63-9c35-482538f3330b tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1372 microversion: 2.47 time: 0.157841 Oct 19 07:06:13.442498 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2064/4000] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:13 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:14.306545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:14.310097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:14.327713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:14.328639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:14.330666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:14.331669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:14.332410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:14.333071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:14.342441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:06:14.342978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:06:14.343390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:06:14.344008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:06:14.344621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:06:14.349271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:14.364241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:14.366053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:14.368127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:14.369107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:14.370751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:14.371434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:14.421239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:14.438070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for user 2543970e80c84e109961fc84bfaaedd1 and project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:14.484337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:06:14.489547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:06:14.714628 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76fa60d4-0521-4b01-83f6-09a5e23a1a57 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603137 Oct 19 07:06:14.718202 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1937/4001] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 07:06:14.729060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:14.731073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:14.747866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:14.748685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:14.751694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:14.754267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:14.754957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:14.755575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:14.838384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:14.849765 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1aa3b058-9190-4a02-bc79-77f176b75be9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1502 microversion: 2.1 time: 0.547375 Oct 19 07:06:14.851517 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2065/4002] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:14 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1502 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:14.857404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f12b25d5-8590-4443-8d8d-64429d9a0ff8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:14.858510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f12b25d5-8590-4443-8d8d-64429d9a0ff8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:14.938656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f12b25d5-8590-4443-8d8d-64429d9a0ff8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:14.952647 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f12b25d5-8590-4443-8d8d-64429d9a0ff8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1214 microversion: 2.1 time: 0.099521 Oct 19 07:06:14.953823 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2066/4003] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:14 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:14.968646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6085ceed-8fe2-4d30-aced-b578271e1683 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:14.969472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6085ceed-8fe2-4d30-aced-b578271e1683 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:14.994447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6085ceed-8fe2-4d30-aced-b578271e1683 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:14.998861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6085ceed-8fe2-4d30-aced-b578271e1683 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:15.001461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6085ceed-8fe2-4d30-aced-b578271e1683 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:15.003381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6085ceed-8fe2-4d30-aced-b578271e1683 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:15.006821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6085ceed-8fe2-4d30-aced-b578271e1683 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:15.008837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6085ceed-8fe2-4d30-aced-b578271e1683 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:15.012224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:15.022954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:15.024683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:15.031787 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72ea2ae8-68dd-4eef-885b-510c46a4c6b4 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1357 microversion: 2.47 time: 0.312282 Oct 19 07:06:15.034461 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1938/4004] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:14 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1357 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:15.066053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:15.070920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:15.071805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Searching by: {'deleted': False, 'project_id': '01818e11c082485688fe7fc640e7613e'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:06:15.088823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:15.089319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:15.089767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:15.090507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:15.090964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:15.098068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:15.383792 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6085ceed-8fe2-4d30-aced-b578271e1683 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90/action" status: 202 len: 0 microversion: 2.1 time: 0.428122 Oct 19 07:06:15.385030 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2067/4005] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:14 2022] POST /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:06:15.399482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:15.405087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:15.441359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:15.443546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:15.444043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:15.450671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:15.451175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:15.453881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:15.477294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:06:15.706605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:15.727474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:15.728185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:15.728968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:15.757015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:15.784013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:16.062340 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0ebd822-5cd0-4572-802b-2ef50a96d491 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 1.000281 Oct 19 07:06:16.063818 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1939/4006] 10.222.0.39 () {60 vars in 1187 bytes} [Wed Oct 19 07:06:15 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:06:16.070580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8ab72b0-26e6-437e-afa4-e57f928ce30b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:16.071416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8ab72b0-26e6-437e-afa4-e57f928ce30b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:16.275933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8ab72b0-26e6-437e-afa4-e57f928ce30b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:16.285896 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8ab72b0-26e6-437e-afa4-e57f928ce30b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1214 microversion: 2.1 time: 0.219000 Oct 19 07:06:16.288238 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1940/4007] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:16 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:16.294663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:16.295693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:16.309364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:16.310060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:16.310677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:16.311971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:16.312774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:16.313380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:16.348228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:06:16.768548 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-081b3041-aca3-459e-97d2-f6c694a528b3 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 204 len: 0 microversion: 2.47 time: 0.478144 Oct 19 07:06:16.774768 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1941/4008] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:06:16 2022] DELETE /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:06:16.779420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:16.780376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:16.810024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:16.814625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:16.818554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:16.822744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:16.823237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:16.826531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:16.937710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:16.953042 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3396b0e-6da6-4ba9-a3ec-750347740d30 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1507 microversion: 2.1 time: 1.563206 Oct 19 07:06:16.954881 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2068/4009] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:15 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1507 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:17.034378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:17.048192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:17.055653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:17.066483 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-970d5e88-90e8-4c7e-b6dc-7e727a6292a7 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1363 microversion: 2.47 time: 0.291785 Oct 19 07:06:17.068142 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1942/4010] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:16 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:17.347600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:17.347600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:17.347600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:17.347600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:17.347600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:17.347600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:17.347600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:17.347600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:17.614919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:17.628852 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f4d3c77-b198-453c-b496-c23122429ba6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1210 microversion: 2.1 time: 0.316445 Oct 19 07:06:17.633604 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2069/4011] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:17 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1210 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:17.978558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:17.979836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:17.990571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:17.991313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:17.993477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:18.002459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:18.003294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:18.003958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:18.098889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:18.098889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:18.105728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:18.106522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:18.107787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:18.108828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:18.109474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:18.110158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:18.266671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:18.281013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:18.295298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:18.302752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:18.302752 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e518ce1b-1160-4dd4-88dd-33bd60e82bee tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1363 microversion: 2.47 time: 0.208998 Oct 19 07:06:18.302752 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2070/4012] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:18 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:06:18.303115 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb1bd7e1-26b0-4223-9dee-0a834c1d2136 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1487 microversion: 2.1 time: 0.319198 Oct 19 07:06:18.320075 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1943/4013] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:17 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1487 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:18.341865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:18.360209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:18.382126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:18.388620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:18.388620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:18.388620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:18.388620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:18.388620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:18.391815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:18.468114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:06:18.658452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:18.659546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:18.676546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:18.688433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:18.689384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:18.691783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:18.693575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:18.700054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:18.895893 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f57d3a85-10f6-425d-922a-5690599c838e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 204 len: 0 microversion: 2.1 time: 0.561292 Oct 19 07:06:18.899797 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2071/4014] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:06:18 2022] DELETE /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:06:18.909777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:18.917319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:18.936501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:18.943136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:18.944762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:18.945798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:18.949037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:18.949687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:19.175419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:19.185714 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8c7535a-a3c5-42d6-a8e2-eb2dd23429cf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1274 microversion: 2.1 time: 0.532405 Oct 19 07:06:19.186316 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1944/4015] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:18 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1274 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:19.328779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:19.333584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:19.343578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:19.344234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:19.344526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:19.345229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:19.345689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:19.346666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:19.602225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:19.614433 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f1564be-9396-4f94-9481-debe885e4d6a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1493 microversion: 2.1 time: 0.710300 Oct 19 07:06:19.620511 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2072/4016] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:18 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1493 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:19.933993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:19.959535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:19.959535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:19.962000 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d604d616-8e07-4810-93a4-c81a847ecade tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 200 len: 1363 microversion: 2.47 time: 0.636985 Oct 19 07:06:19.962611 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1945/4017] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:19 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 1363 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:20.223017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:20.223792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:20.237506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:20.238005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:20.238615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:20.239522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:20.239987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:20.240621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:20.355797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4304252c-ddf6-491d-a10e-17c9d3d57adf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Action: 'create', calling method: .version_select at 0x7f6d5f977790>, body: {"keypair": {"name": "tempest-keypair-1191074714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYuDBQgwpiAAs97+DJS1hI+3du3+Us4f0fqMD3vnBrcsqHgaUVXbUKPgQPXyd8QO79JjsGt8wi3RIC8rSagYbf5RKoeW9/jvoEwp+ixngEumI0CeM5WvT+FbWCE/+xHiQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:20.430049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4304252c-ddf6-491d-a10e-17c9d3d57adf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Getting quotas for project dc00fa11f6d5486481b4900e70be3705. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:20.464167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4304252c-ddf6-491d-a10e-17c9d3d57adf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Getting quotas for user 271263f7a46e48218d4417a01c56832b and project dc00fa11f6d5486481b4900e70be3705. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:20.637371 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4304252c-ddf6-491d-a10e-17c9d3d57adf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.675637 Oct 19 07:06:20.637991 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2073/4018] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:06:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:20.642923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:20.646702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:20.684855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:20.687975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:20.695605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:20.696031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:20.698200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:20.701234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:20.851452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:20.875779 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-766d888d-430b-4ba4-9803-b2c72023637b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1284 microversion: 2.1 time: 0.662107 Oct 19 07:06:20.876432 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1946/4019] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:20 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1284 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:20.991544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:20.992737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: e2f33ffa-27ac-4a6f-a082-f17fbab8fa57] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:21.005411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:21.006776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:21.009043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:21.010099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:21.016200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:21.016200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:21.050148 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] HTTP exception thrown: Instance e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 could not be found. Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Request method failure captured: Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 HTTP/1.1 Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6G5bdYA_xob6KyE_EUP9QTrD_hSYi5zp6qNTH_Vyg_4DIiwAHAGVhJzf13YBVMvQvjnQYgnx2FLxhMo2bYp2PVvYSa-OHKUUh7wgAl6m95NcWZcixtMb0QHtiUpwShVol-Im04mx33laIJmry1nGMDo5UgmRSaHNiB4HgyrjNE5ID8 Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.47 Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 01818e11c082485688fe7fc640e7613e Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerShowV247Test-1534461355 Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/01818e11c082485688fe7fc640e7613e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01818e11c082485688fe7fc640e7613e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01818e11c082485688fe7fc640e7613e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_01818e11c082485688fe7fc640e7613e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerShowV247Test-1534461355 Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 01818e11c082485688fe7fc640e7613e Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerShowV247Test-1534461355 Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerShowV247Test-1534461355-project Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 271f5c8219c9454385c3bf42fe2979dd Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerShowV247Test-1534461355-project Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 could not be found. Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'e2f33ffa-27ac-4a6f-a082-f17fbab8fa57'} Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 could not be found. Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 could not be found. Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:21.054224 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:21.059668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:21.059668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:21.059668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:21.059668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:06:21.059668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:06:21.059668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 could not be found. Oct 19 07:06:21.059668 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:21.059668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Returning 404 to user: Instance e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:06:21.059668 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39d56de2-7a73-4ca1-9c32-faf2549ebb9a tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57" status: 404 len: 111 microversion: 2.47 time: 0.069123 Oct 19 07:06:21.061593 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1947/4020] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:20 2022] GET /compute/v2.1/servers/e2f33ffa-27ac-4a6f-a082-f17fbab8fa57 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:06:21.076169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:21.077127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: cd9719f5-7d78-412f-a59a-931b8ce9c735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:21.098250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:21.098906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:21.099269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:21.100446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:21.101077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:21.102706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:21.166024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: cd9719f5-7d78-412f-a59a-931b8ce9c735] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:06:21.247997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:21.264023 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13ce5b68-b7e0-4e96-841e-6ca608251c99 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1493 microversion: 2.1 time: 0.624260 Oct 19 07:06:21.265250 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2074/4021] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:20 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1493 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:21.603745 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-239dbec8-2102-4cbb-ba6f-b07ad0e3ae88 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735" status: 204 len: 0 microversion: 2.47 time: 0.535986 Oct 19 07:06:21.607347 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1948/4022] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:06:21 2022] DELETE /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:06:21.614040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:21.614810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: cd9719f5-7d78-412f-a59a-931b8ce9c735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:21.628216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:21.629956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:21.632089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:21.633506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:21.635847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:21.637903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:21.858376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:21.873251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:21.878350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:21.883956 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-850bb543-36e6-4125-9830-ad72e273a9a6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735" status: 200 len: 1363 microversion: 2.47 time: 0.270708 Oct 19 07:06:21.886106 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2075/4023] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:21 2022] GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:21.902675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:21.903377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:21.919270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:21.919873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:21.920370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:21.923583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:21.924082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:21.924592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:22.289290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:22.291432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:22.307149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:22.319537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:22.319537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:22.319537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:22.319537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:22.319537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:22.433383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:22.445190 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb9284f4-1f89-4f6b-b71d-b2b52cd5ddbc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.545619 Oct 19 07:06:22.447515 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1949/4024] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:21 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:22.713279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:22.726405 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68d284bb-fb9f-4eb1-8265-372c62d1ae17 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1493 microversion: 2.1 time: 0.440480 Oct 19 07:06:22.737470 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2076/4025] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:22 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1493 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:22.911620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:22.914233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: cd9719f5-7d78-412f-a59a-931b8ce9c735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:22.921804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:22.922216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:22.922681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:22.923412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:22.928532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:22.929178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:23.120770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:23.136437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:23.143552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:23.145641 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d21d051-dc99-4463-9ee3-07bdc0cf6914 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735" status: 200 len: 1363 microversion: 2.47 time: 0.238244 Oct 19 07:06:23.146739 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1950/4026] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:22 2022] GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:23.371378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-89f6c6ed-064c-41a3-8b5a-6d50661affaa req-77ec4dab-7e78-469d-a6f2-bf6d71a0d3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa9ebb5-481e-4e20-b395-95dd86979b90", "name": "network-vif-deleted", "tag": "902a3221-c227-445b-9d53-b87b2ae8e877"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:23.383957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:23.386827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89f6c6ed-064c-41a3-8b5a-6d50661affaa req-77ec4dab-7e78-469d-a6f2-bf6d71a0d3b1 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:23.387772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89f6c6ed-064c-41a3-8b5a-6d50661affaa req-77ec4dab-7e78-469d-a6f2-bf6d71a0d3b1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:23.391674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89f6c6ed-064c-41a3-8b5a-6d50661affaa req-77ec4dab-7e78-469d-a6f2-bf6d71a0d3b1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:23.408173 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-89f6c6ed-064c-41a3-8b5a-6d50661affaa req-77ec4dab-7e78-469d-a6f2-bf6d71a0d3b1 service nova] Creating event network-vif-deleted:902a3221-c227-445b-9d53-b87b2ae8e877 for instance ffa9ebb5-481e-4e20-b395-95dd86979b90 on n-h2-861333-10 Oct 19 07:06:23.417090 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-89f6c6ed-064c-41a3-8b5a-6d50661affaa req-77ec4dab-7e78-469d-a6f2-bf6d71a0d3b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051124 Oct 19 07:06:23.419985 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2077/4027] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:23.476407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:23.479185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:23.500507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:23.502004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:23.508220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:23.509931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:23.511414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:23.514326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:23.576151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:23.763686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:23.764623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:23.767799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:23.779229 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d23ddc8-6d41-4ae9-bb26-72a2ad067c91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.313114 Oct 19 07:06:23.782982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:23.783952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:23.784737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:23.786895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:23.787644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:23.790483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:23.797058 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1951/4028] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:23 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:23.864972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:23.865479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:23.866326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:23.866892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lazy-loading 'fault' on Instance uuid ffa9ebb5-481e-4e20-b395-95dd86979b90 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:06:23.945031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:23.965994 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ddaa23fe-1826-4ac5-af04-68f012b5fe21 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 200 len: 1304 microversion: 2.1 time: 0.209577 Oct 19 07:06:23.967109 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2078/4029] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:23 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:24.175498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:24.176134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: cd9719f5-7d78-412f-a59a-931b8ce9c735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:24.183242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:24.183739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:24.184211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:24.184930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:24.185388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:24.185816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:24.385190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:24.421973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:24.424227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:24.427834 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4cdb4135-7123-4a84-bbe7-89edd479b3da tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735" status: 200 len: 1363 microversion: 2.47 time: 0.254750 Oct 19 07:06:24.448233 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1952/4030] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:24 2022] GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:24.808837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:24.809561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:24.824782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:24.829520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:24.830064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:24.835858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:24.836933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:24.837412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:24.996769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:24.997970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:25.016436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:25.016874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:25.017377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:25.018357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:25.018826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:25.019688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:25.069783 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 HTTP/1.1 Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'ffa9ebb5-481e-4e20-b395-95dd86979b90'} Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:25.073080 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e9a7a96b-2af5-4356-b3bc-b7a8e93529bf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 404 len: 111 microversion: 2.1 time: 0.083692 Oct 19 07:06:25.079844 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1953/4031] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:24 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:06:25.242826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:25.263249 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d618e21-a442-46f0-8f0e-47e1ff940a8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.452057 Oct 19 07:06:25.264420 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2079/4032] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:24 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:25.344585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1793150917", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "737f0953-92be-4377-a7d8-73cd2ce52ac7"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:25.371019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:25.456519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:25.457148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: cd9719f5-7d78-412f-a59a-931b8ce9c735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:25.467790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] validate_networks() for [('737f0953-92be-4377-a7d8-73cd2ce52ac7', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:06:25.485469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:25.485980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:25.501341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:25.502637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:25.505266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:25.507517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:25.615952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:25.616488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:25.616926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:25.620911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lazy-loading 'fault' on Instance uuid cd9719f5-7d78-412f-a59a-931b8ce9c735 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:06:26.008014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:26.018866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:26.024965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '271f5c8219c9454385c3bf42fe2979dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01818e11c082485688fe7fc640e7613e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:26.028534 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a4e0355-9693-4542-95e8-72776a385a31 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735" status: 200 len: 1368 microversion: 2.47 time: 0.577606 Oct 19 07:06:26.033976 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2080/4033] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:25 2022] GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735 => generated 1368 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:06:26.052459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0bdd794c-b065-472e-b45e-9cbcda4ce745 req-debd9608-bf88-437a-bb88-0d9cbbca140f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa65439-7731-4ef3-ab8e-fb7a53d8f643", "tag": "b1f7f645-a1e6-4fb3-ad53-45444f6ceedc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:26.078162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0bdd794c-b065-472e-b45e-9cbcda4ce745 req-debd9608-bf88-437a-bb88-0d9cbbca140f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:26.079162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0bdd794c-b065-472e-b45e-9cbcda4ce745 req-debd9608-bf88-437a-bb88-0d9cbbca140f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:26.079851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0bdd794c-b065-472e-b45e-9cbcda4ce745 req-debd9608-bf88-437a-bb88-0d9cbbca140f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:26.100576 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0bdd794c-b065-472e-b45e-9cbcda4ce745 req-debd9608-bf88-437a-bb88-0d9cbbca140f service nova] Creating event network-changed:b1f7f645-a1e6-4fb3-ad53-45444f6ceedc for instance 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 on n-h2-861333-10 Oct 19 07:06:26.109025 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0bdd794c-b065-472e-b45e-9cbcda4ce745 req-debd9608-bf88-437a-bb88-0d9cbbca140f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073225 Oct 19 07:06:26.115557 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2081/4034] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:26.283643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:26.290652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:26.292013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:26.298743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:26.299873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:26.300505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:26.301362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:26.301854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:26.302364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:26.792581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:26.803157 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8030dbd-0974-49f7-9443-f9c9a3162e3d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.516827 Oct 19 07:06:26.805867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2082/4035] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:26 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:27.062549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:27.063210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] [instance: cd9719f5-7d78-412f-a59a-931b8ce9c735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:27.075927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:27.076923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:27.077851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:27.081046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:27.084025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:27.084025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:27.117712 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] HTTP exception thrown: Instance cd9719f5-7d78-412f-a59a-931b8ce9c735 could not be found. Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Request method failure captured: Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735 HTTP/1.1 Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6G5bdYA_xob6KyE_EUP9QTrD_hSYi5zp6qNTH_Vyg_4DIiwAHAGVhJzf13YBVMvQvjnQYgnx2FLxhMo2bYp2PVvYSa-OHKUUh7wgAl6m95NcWZcixtMb0QHtiUpwShVol-Im04mx33laIJmry1nGMDo5UgmRSaHNiB4HgyrjNE5ID8 Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.47 Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 01818e11c082485688fe7fc640e7613e Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerShowV247Test-1534461355 Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/01818e11c082485688fe7fc640e7613e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01818e11c082485688fe7fc640e7613e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01818e11c082485688fe7fc640e7613e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_01818e11c082485688fe7fc640e7613e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerShowV247Test-1534461355 Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 01818e11c082485688fe7fc640e7613e Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerShowV247Test-1534461355 Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerShowV247Test-1534461355-project Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 271f5c8219c9454385c3bf42fe2979dd Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerShowV247Test-1534461355-project Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance cd9719f5-7d78-412f-a59a-931b8ce9c735 could not be found. Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'cd9719f5-7d78-412f-a59a-931b8ce9c735'} Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd9719f5-7d78-412f-a59a-931b8ce9c735 could not be found. Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd9719f5-7d78-412f-a59a-931b8ce9c735 could not be found. Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:27.121670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:27.126372 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:27.126372 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:27.126372 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:27.126372 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:06:27.126372 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:06:27.126372 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd9719f5-7d78-412f-a59a-931b8ce9c735 could not be found. Oct 19 07:06:27.126372 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:27.126372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] Returning 404 to user: Instance cd9719f5-7d78-412f-a59a-931b8ce9c735 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:06:27.126964 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0efea08-8ceb-4a41-8a6a-4ff0c07ab8b6 tempest-ServerShowV247Test-1534461355 tempest-ServerShowV247Test-1534461355-project] 10.222.0.39 "GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735" status: 404 len: 111 microversion: 2.47 time: 0.069363 Oct 19 07:06:27.131370 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2083/4036] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:06:27 2022] GET /compute/v2.1/servers/cd9719f5-7d78-412f-a59a-931b8ce9c735 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:06:27.342409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:06:27.342955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:06:27.345688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:06:27.346129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:06:27.346549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:06:27.367932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:27.369794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:27.370752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:27.376393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:27.381073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:27.381073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:27.403335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:27.411467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for user 44114105ac6d4e1daf262bbd4b212f5e and project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:27.425808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:06:27.428217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:06:27.593630 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46c4f307-856c-4a7b-8b60-cdaa414071d9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.254963 Oct 19 07:06:27.607193 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1954/4037] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:06:27.608225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32825ffa-3d9c-4809-9afe-f2667512874a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:27.608854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32825ffa-3d9c-4809-9afe-f2667512874a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:27.711982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32825ffa-3d9c-4809-9afe-f2667512874a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:27.722001 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32825ffa-3d9c-4809-9afe-f2667512874a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1215 microversion: 2.1 time: 0.118079 Oct 19 07:06:27.723428 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2084/4038] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:27 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:27.831676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:27.832325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:27.845999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:27.848317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:27.849223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:27.851680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:27.853277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:27.853600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:28.351102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:28.359382 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4315b443-5540-4e1c-9805-5803ffda1540 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.532494 Oct 19 07:06:28.376283 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1955/4039] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:27 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:28.746467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93b0222c-45d8-491f-a72d-ec408752f92b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:28.747169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93b0222c-45d8-491f-a72d-ec408752f92b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:28.840403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93b0222c-45d8-491f-a72d-ec408752f92b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:28.850443 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93b0222c-45d8-491f-a72d-ec408752f92b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1215 microversion: 2.1 time: 0.108157 Oct 19 07:06:28.851272 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2085/4040] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:28 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:29.389203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:29.390985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:29.419278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:29.419788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:29.420258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:29.422957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:29.427079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:29.431868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:29.665598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:29.676469 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.291609 Oct 19 07:06:29.677297 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1956/4041] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:29 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:29.874306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:29.875663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:29.900336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:29.901127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:29.901785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:29.903273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:29.903990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:29.904626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:30.014859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:30.039382 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-388ef8ab-74f0-4a77-9306-52b407b3e96c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1267 microversion: 2.1 time: 0.168960 Oct 19 07:06:30.061431 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2086/4042] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:29 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:30.673963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:30.675176 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c631d86e-aa3d-46ec-96b0-830f0403ddb4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001509 Oct 19 07:06:30.683983 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1957/4043] 10.222.0.39 () {56 vars in 886 bytes} [Wed Oct 19 07:06:30 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 07:06:30.704242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:30.710358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:30.730707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:30.731315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:30.731832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:30.738492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:30.739918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:30.741461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:31.069784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:31.071982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:31.148591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:31.149267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:31.156518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:31.157804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:31.158291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:31.165509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:31.189704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:31.210143 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-569689db-502e-4abb-92ce-c24e59b40e5b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.512772 Oct 19 07:06:31.226319 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2087/4044] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:30 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:31.354238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:31.372158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-033340ce-29a3-4980-ad66-a39a6dd1b4fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1273 microversion: 2.1 time: 0.307653 Oct 19 07:06:31.379298 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1958/4045] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:31 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1273 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:32.237922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:32.238608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:32.258699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:32.273659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:32.274364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:32.275172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:32.275669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:32.276141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:32.405954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:32.405954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:32.421011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:32.423978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:32.425527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:32.426518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:32.437649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:32.438642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:33.018793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:33.039927 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-865ee9cb-4db3-46e2-a2d9-ef4460ec840b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1273 microversion: 2.1 time: 0.640641 Oct 19 07:06:33.057593 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1959/4046] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:32 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1273 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:33.167506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:33.185025 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a27488c9-92aa-4582-bcd1-89a2cf252d53 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.951026 Oct 19 07:06:33.191748 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2088/4047] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:32 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:34.065866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:34.066533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:34.084368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:34.090058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:34.097164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:34.098403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:34.100666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:34.101330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:34.214759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:34.218439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:34.229826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:34.240681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:34.241260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:34.242046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:34.242540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:34.242984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:34.473749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:34.484738 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e01b534-6688-46f2-8738-04d9481683c0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.273767 Oct 19 07:06:34.485963 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2089/4048] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:34 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:34.491012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0c360040-bce1-412a-bd9e-301b1c7bf56b req-b5e965e2-f85e-4206-a35c-0fe42469eddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa65439-7731-4ef3-ab8e-fb7a53d8f643", "name": "network-vif-plugged", "status": "completed", "tag": "b1f7f645-a1e6-4fb3-ad53-45444f6ceedc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:34.502200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c360040-bce1-412a-bd9e-301b1c7bf56b req-b5e965e2-f85e-4206-a35c-0fe42469eddf service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:34.506924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c360040-bce1-412a-bd9e-301b1c7bf56b req-b5e965e2-f85e-4206-a35c-0fe42469eddf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:34.508078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c360040-bce1-412a-bd9e-301b1c7bf56b req-b5e965e2-f85e-4206-a35c-0fe42469eddf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:34.532298 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0c360040-bce1-412a-bd9e-301b1c7bf56b req-b5e965e2-f85e-4206-a35c-0fe42469eddf service nova] Creating event network-vif-plugged:b1f7f645-a1e6-4fb3-ad53-45444f6ceedc for instance 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 on n-h2-861333-10 Oct 19 07:06:34.542530 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0c360040-bce1-412a-bd9e-301b1c7bf56b req-b5e965e2-f85e-4206-a35c-0fe42469eddf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054987 Oct 19 07:06:34.546833 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2090/4049] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:34.620042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:34.637239 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d1a3ddf-d526-4a19-bca0-0379619d8914 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1315 microversion: 2.1 time: 0.575561 Oct 19 07:06:34.638106 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1960/4050] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:34 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:35.514506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:35.515942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:35.530707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:35.532703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:35.535324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:35.537849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:35.539118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:35.540351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:35.549104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:35.665047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:35.668979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:35.677715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:35.680922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:35.681991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:35.693494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:35.694098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:35.694567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:36.323528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:36.340928 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b58ac2f-9936-4875-afd4-5e7bb82ebc71 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1315 microversion: 2.1 time: 0.680376 Oct 19 07:06:36.342839 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1961/4051] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:35 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:36.399383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:36.412523 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8689df31-1568-487b-8034-3ebc5f64ccb3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1314 microversion: 2.1 time: 0.901078 Oct 19 07:06:36.414273 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2091/4052] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:35 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:37.028293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-07690846-7e66-443b-85d1-74bd09b55f10 req-8ba9acbe-6b02-4b9e-8027-4920e038137f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ad9c08-f496-42f8-8d06-6009bd9ec758", "tag": "27ace315-328c-4c38-8778-46df3acdaf37"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:37.048233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-07690846-7e66-443b-85d1-74bd09b55f10 req-8ba9acbe-6b02-4b9e-8027-4920e038137f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:37.048733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-07690846-7e66-443b-85d1-74bd09b55f10 req-8ba9acbe-6b02-4b9e-8027-4920e038137f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:37.066264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-07690846-7e66-443b-85d1-74bd09b55f10 req-8ba9acbe-6b02-4b9e-8027-4920e038137f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:37.131770 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-07690846-7e66-443b-85d1-74bd09b55f10 req-8ba9acbe-6b02-4b9e-8027-4920e038137f service nova] Creating event network-changed:27ace315-328c-4c38-8778-46df3acdaf37 for instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 on n-h1-861333-10 Oct 19 07:06:37.131770 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-07690846-7e66-443b-85d1-74bd09b55f10 req-8ba9acbe-6b02-4b9e-8027-4920e038137f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107755 Oct 19 07:06:37.133154 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1962/4053] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:37.365156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:37.365788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:37.379875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:37.380414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:37.380867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:37.381609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:37.382082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:37.382532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:37.442257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:37.443609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:37.450614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:37.451763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:37.453939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:37.456263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:37.457255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:37.461909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:37.461909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:37.461909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:38.069421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:38.077146 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9fb86b28-d590-42c5-a5df-1ebc4ae99734 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1315 microversion: 2.1 time: 0.716222 Oct 19 07:06:38.077736 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2092/4054] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:37 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:38.254318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:38.275655 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9254179c-8ba3-492f-a9ca-e83e393ce1bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1501 microversion: 2.1 time: 0.836960 Oct 19 07:06:38.279334 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1963/4055] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:37 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1501 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:38.308079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b21fb77c-abf2-42d5-a34b-2f9256328aaf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:38.311132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b21fb77c-abf2-42d5-a34b-2f9256328aaf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:38.331982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21fb77c-abf2-42d5-a34b-2f9256328aaf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:38.332517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21fb77c-abf2-42d5-a34b-2f9256328aaf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:38.332971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21fb77c-abf2-42d5-a34b-2f9256328aaf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:38.340154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21fb77c-abf2-42d5-a34b-2f9256328aaf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:38.345369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21fb77c-abf2-42d5-a34b-2f9256328aaf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:38.346333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21fb77c-abf2-42d5-a34b-2f9256328aaf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:38.439043 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b21fb77c-abf2-42d5-a34b-2f9256328aaf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 14 microversion: 2.1 time: 0.134979 Oct 19 07:06:38.440688 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2093/4056] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:38 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:06:39.173198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:39.173198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:39.173198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:39.173198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:39.173198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:39.173198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:39.173198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:39.173198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:39.454862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d61ae44-b7bf-4e9a-b695-85220b0974ce tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:39.474165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d61ae44-b7bf-4e9a-b695-85220b0974ce tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:39.481719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:39.494359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d61ae44-b7bf-4e9a-b695-85220b0974ce tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:39.503833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d61ae44-b7bf-4e9a-b695-85220b0974ce tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:39.504408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d61ae44-b7bf-4e9a-b695-85220b0974ce tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:39.505441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d61ae44-b7bf-4e9a-b695-85220b0974ce tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:39.506009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d61ae44-b7bf-4e9a-b695-85220b0974ce tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:39.506433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d61ae44-b7bf-4e9a-b695-85220b0974ce tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:39.553825 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d61ae44-b7bf-4e9a-b695-85220b0974ce tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 14 microversion: 2.1 time: 0.103030 Oct 19 07:06:39.554820 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2094/4057] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:39 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:06:40.023519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:40.032832 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0db1b530-e972-4917-9a13-ef9b22f231f5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1315 microversion: 2.1 time: 0.932619 Oct 19 07:06:40.047548 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1964/4058] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:39 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1315 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:40.567439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80b061a5-a3c9-4645-867e-742f50b09765 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:40.569810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80b061a5-a3c9-4645-867e-742f50b09765 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:40.581580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80b061a5-a3c9-4645-867e-742f50b09765 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:40.583348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80b061a5-a3c9-4645-867e-742f50b09765 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:40.588541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80b061a5-a3c9-4645-867e-742f50b09765 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:40.592227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80b061a5-a3c9-4645-867e-742f50b09765 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:40.593006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80b061a5-a3c9-4645-867e-742f50b09765 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:40.593611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80b061a5-a3c9-4645-867e-742f50b09765 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:40.639860 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80b061a5-a3c9-4645-867e-742f50b09765 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 14 microversion: 2.1 time: 0.077947 Oct 19 07:06:40.641216 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2095/4059] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:40 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:06:41.070756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:41.076649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:41.084135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:41.086970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:41.087481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:41.092559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:41.095237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:41.095697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:41.520830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:41.529067 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6f4efa6-573e-446d-9a8d-74358b46073c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1315 microversion: 2.1 time: 0.463223 Oct 19 07:06:41.545846 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1965/4060] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:41 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:41.654689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b470a75-1fce-4eea-a975-b3a5b94684ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:41.658091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b470a75-1fce-4eea-a975-b3a5b94684ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:41.669464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b470a75-1fce-4eea-a975-b3a5b94684ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:41.669464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b470a75-1fce-4eea-a975-b3a5b94684ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:41.669464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b470a75-1fce-4eea-a975-b3a5b94684ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:41.670326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b470a75-1fce-4eea-a975-b3a5b94684ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:41.670818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b470a75-1fce-4eea-a975-b3a5b94684ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:41.671544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b470a75-1fce-4eea-a975-b3a5b94684ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:41.735994 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b470a75-1fce-4eea-a975-b3a5b94684ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 14 microversion: 2.1 time: 0.086173 Oct 19 07:06:41.736931 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2096/4061] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:41 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:06:42.287399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa39d257-6f48-4b5c-90d9-ac59e8fe8c75 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Action: 'create', calling method: .version_select at 0x7f6d5f954040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-208581388", "policies": ["affinity"]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:42.310663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:42.329761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fa39d257-6f48-4b5c-90d9-ac59e8fe8c75 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:42.345764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fa39d257-6f48-4b5c-90d9-ac59e8fe8c75 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:42.474955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fa39d257-6f48-4b5c-90d9-ac59e8fe8c75 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:42.498802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fa39d257-6f48-4b5c-90d9-ac59e8fe8c75 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:42.527512 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa39d257-6f48-4b5c-90d9-ac59e8fe8c75 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.631006 Oct 19 07:06:42.528194 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1966/4062] 10.222.0.39 () {60 vars in 1174 bytes} [Wed Oct 19 07:06:41 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:42.544040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68502ba9-ea23-4753-ba31-00d3f1706822 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Action: 'create', calling method: .version_select at 0x7f6d5f8825e0>, body: {"server_group": {"name": "tempest-server-group-983833243", "policies": ["affinity"]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:42.556013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:42.556671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:42.572305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:42.572305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:42.576810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:42.577624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:42.578110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:42.578560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:42.582542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-68502ba9-ea23-4753-ba31-00d3f1706822 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:42.606711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-68502ba9-ea23-4753-ba31-00d3f1706822 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:42.846655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-68502ba9-ea23-4753-ba31-00d3f1706822 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:42.872170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-68502ba9-ea23-4753-ba31-00d3f1706822 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:42.903544 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68502ba9-ea23-4753-ba31-00d3f1706822 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.360606 Oct 19 07:06:42.905070 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2097/4063] 10.222.0.39 () {60 vars in 1173 bytes} [Wed Oct 19 07:06:42 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:42.910517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f72c6404-94ef-424e-b68f-43f17ab79470 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:42.913542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f72c6404-94ef-424e-b68f-43f17ab79470 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:42.921864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f72c6404-94ef-424e-b68f-43f17ab79470 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:42.925188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f72c6404-94ef-424e-b68f-43f17ab79470 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:42.929063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f72c6404-94ef-424e-b68f-43f17ab79470 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:42.929063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f72c6404-94ef-424e-b68f-43f17ab79470 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:42.929650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f72c6404-94ef-424e-b68f-43f17ab79470 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:42.930333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f72c6404-94ef-424e-b68f-43f17ab79470 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:42.987747 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f72c6404-94ef-424e-b68f-43f17ab79470 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 14 microversion: 2.1 time: 0.080362 Oct 19 07:06:42.994169 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2098/4064] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:42 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:06:43.006329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a05e9253-4619-4140-bc63-57d5780481f1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Action: 'create', calling method: .version_select at 0x7f6d5f9d6040>, body: {"server_group": {"name": "tempest-server-group-983833243", "policies": ["affinity"]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:43.040538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a05e9253-4619-4140-bc63-57d5780481f1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:43.049170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a05e9253-4619-4140-bc63-57d5780481f1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:43.174944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a05e9253-4619-4140-bc63-57d5780481f1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:43.198058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a05e9253-4619-4140-bc63-57d5780481f1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:43.209789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:43.218144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:43.229044 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a56e9ffe-6057-4d77-9e8e-f7ce555e1012 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1315 microversion: 2.1 time: 0.676775 Oct 19 07:06:43.238301 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1967/4065] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:42 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:43.259065 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a05e9253-4619-4140-bc63-57d5780481f1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.263364 Oct 19 07:06:43.259693 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2099/4066] 10.222.0.39 () {60 vars in 1173 bytes} [Wed Oct 19 07:06:42 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:43.273878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-586383b9-668e-410b-b8c9-da154c74c316 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:43.415134 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-586383b9-668e-410b-b8c9-da154c74c316 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/4b544248-040d-45e3-90ea-8dd75f8ffe38" status: 204 len: 0 microversion: 2.1 time: 0.148270 Oct 19 07:06:43.415943 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1968/4067] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:06:43 2022] DELETE /compute/v2.1/os-server-groups/4b544248-040d-45e3-90ea-8dd75f8ffe38 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:06:43.425405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-755f5984-af89-45b3-8df5-ccc122b1627a tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:43.464736 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-755f5984-af89-45b3-8df5-ccc122b1627a tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.041713 Oct 19 07:06:43.472745 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2100/4068] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 07:06:43 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:43.478953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e55cbba7-5134-4469-81f6-b1c4764763f7 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:43.627464 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e55cbba7-5134-4469-81f6-b1c4764763f7 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb" status: 204 len: 0 microversion: 2.1 time: 0.152359 Oct 19 07:06:43.628067 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1969/4069] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:06:43 2022] DELETE /compute/v2.1/os-server-groups/d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:06:43.636526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3998d264-78a0-4fde-b713-0b5c84b47b2e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:43.667476 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3998d264-78a0-4fde-b713-0b5c84b47b2e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034245 Oct 19 07:06:43.684926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b60a4114-9edc-49f9-a594-425c524b713b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Action: 'create', calling method: .version_select at 0x7f6d5f807670>, body: {"server_group": {"name": "tempest-server-group-1648273096", "policies": ["affinity"]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:43.693334 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2101/4070] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 07:06:43 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:43.742627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b60a4114-9edc-49f9-a594-425c524b713b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:43.788530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b60a4114-9edc-49f9-a594-425c524b713b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:43.981876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b60a4114-9edc-49f9-a594-425c524b713b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:43.999602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b60a4114-9edc-49f9-a594-425c524b713b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:44.001263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78fc4885-e138-4a89-a77e-ae7822398fe5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:44.005065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78fc4885-e138-4a89-a77e-ae7822398fe5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:44.034708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc4885-e138-4a89-a77e-ae7822398fe5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:44.038686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc4885-e138-4a89-a77e-ae7822398fe5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:44.043564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc4885-e138-4a89-a77e-ae7822398fe5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:44.045173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc4885-e138-4a89-a77e-ae7822398fe5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:44.046980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc4885-e138-4a89-a77e-ae7822398fe5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:44.049294 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b60a4114-9edc-49f9-a594-425c524b713b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.360742 Oct 19 07:06:44.049973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc4885-e138-4a89-a77e-ae7822398fe5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:44.055819 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1970/4071] 10.222.0.39 () {60 vars in 1173 bytes} [Wed Oct 19 07:06:43 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:44.089015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81290333-cec0-421f-8a73-6fec260f9776 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:44.148512 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78fc4885-e138-4a89-a77e-ae7822398fe5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 14 microversion: 2.1 time: 0.151005 Oct 19 07:06:44.149207 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2102/4072] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:43 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 07:06:44.264979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:44.266405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:44.276093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:44.277116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:44.277753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:44.278679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:44.279327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:44.279954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:44.290040 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81290333-cec0-421f-8a73-6fec260f9776 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/2cb790d7-a937-498f-b407-c07b8aa8b7ec" status: 204 len: 0 microversion: 2.1 time: 0.222322 Oct 19 07:06:44.292015 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1971/4073] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:06:44 2022] DELETE /compute/v2.1/os-server-groups/2cb790d7-a937-498f-b407-c07b8aa8b7ec => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:06:44.298929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0826d379-32c4-4f78-a99c-29d16dd120fd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:44.334743 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0826d379-32c4-4f78-a99c-29d16dd120fd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.039214 Oct 19 07:06:44.349863 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1972/4074] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 07:06:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:44.381959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ece2e6f-a4e6-4419-8905-18ccb4c8bcdf tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Action: 'create', calling method: .version_select at 0x7f6d5f8074c0>, body: {"server_group": {"name": "tempest-server-group-431159596", "policies": ["anti-affinity"]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:44.460452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4ece2e6f-a4e6-4419-8905-18ccb4c8bcdf tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:44.471236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4ece2e6f-a4e6-4419-8905-18ccb4c8bcdf tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:44.590856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:44.607785 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f7b4984-8528-476e-8bad-5ffc52f307ec tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1315 microversion: 2.1 time: 0.347071 Oct 19 07:06:44.628143 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2103/4075] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:44 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:44.645491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4ece2e6f-a4e6-4419-8905-18ccb4c8bcdf tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:44.673788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4ece2e6f-a4e6-4419-8905-18ccb4c8bcdf tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:44.700286 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ece2e6f-a4e6-4419-8905-18ccb4c8bcdf tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.341180 Oct 19 07:06:44.701418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1973/4076] 10.222.0.39 () {60 vars in 1173 bytes} [Wed Oct 19 07:06:44 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:44.716199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ca87ec7-b30a-4495-b3cf-edb7d6ea50e0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:44.850516 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ca87ec7-b30a-4495-b3cf-edb7d6ea50e0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/14c2d965-db80-4ea0-a8a1-73ed8cd83af2" status: 204 len: 0 microversion: 2.1 time: 0.139107 Oct 19 07:06:44.853171 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2104/4077] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:06:44 2022] DELETE /compute/v2.1/os-server-groups/14c2d965-db80-4ea0-a8a1-73ed8cd83af2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:06:44.861212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd8afcd3-d8da-45f4-b796-b1778feceae7 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:44.910866 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd8afcd3-d8da-45f4-b796-b1778feceae7 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.053597 Oct 19 07:06:44.911981 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1974/4078] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 07:06:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:45.161497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-656bcb7f-a522-4b97-bfbb-864d3a893d1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:45.165878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-656bcb7f-a522-4b97-bfbb-864d3a893d1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:45.174041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-656bcb7f-a522-4b97-bfbb-864d3a893d1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:45.175931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-656bcb7f-a522-4b97-bfbb-864d3a893d1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:45.189926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-656bcb7f-a522-4b97-bfbb-864d3a893d1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:45.191743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-656bcb7f-a522-4b97-bfbb-864d3a893d1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:45.192482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-656bcb7f-a522-4b97-bfbb-864d3a893d1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:45.193276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-656bcb7f-a522-4b97-bfbb-864d3a893d1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:45.272487 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-656bcb7f-a522-4b97-bfbb-864d3a893d1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 14 microversion: 2.1 time: 0.116041 Oct 19 07:06:45.273145 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2105/4079] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:45 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:06:45.587931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:45.593758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1152811823", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "ecfdc0de-3008-406a-8baf-f34871629b8e"}]}, "os:scheduler_hints": {"group": "a85788fb-8d54-48d7-a53d-d66d9b950914"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:45.631976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:45.632923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:45.654533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:45.656413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:45.657495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:45.658507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:45.659721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:45.660351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:45.741458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] validate_networks() for [('ecfdc0de-3008-406a-8baf-f34871629b8e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:06:46.340250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:46.359622 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb8f0177-8b82-4e15-9ed4-1f8f0d529e83 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1315 microversion: 2.1 time: 0.729992 Oct 19 07:06:46.362113 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2106/4080] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:45 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:46.378309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75680d3f-81f6-4352-b93f-9a6b9ea5e40b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:46.392138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75680d3f-81f6-4352-b93f-9a6b9ea5e40b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:46.415643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75680d3f-81f6-4352-b93f-9a6b9ea5e40b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:46.418960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75680d3f-81f6-4352-b93f-9a6b9ea5e40b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:46.419645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75680d3f-81f6-4352-b93f-9a6b9ea5e40b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:46.420965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75680d3f-81f6-4352-b93f-9a6b9ea5e40b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:46.421733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75680d3f-81f6-4352-b93f-9a6b9ea5e40b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:46.422347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75680d3f-81f6-4352-b93f-9a6b9ea5e40b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:46.496760 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75680d3f-81f6-4352-b93f-9a6b9ea5e40b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 14 microversion: 2.1 time: 0.130805 Oct 19 07:06:46.506918 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2107/4081] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:46 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:06:46.884783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:06:46.885262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:06:46.885892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:06:46.886522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:06:46.887033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:06:46.905020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:46.906118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:46.906675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:46.907503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:46.908049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:46.908818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:46.939207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:46.955052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:46.981059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:06:46.984449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:06:47.162028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127568) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 19 07:06:47.226375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_group_members'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:47.243314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_group_members'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:47.267669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1c0f731b-bd25-4a6b-af1a-99da972b3319 req-e6eb708f-27d9-45fd-9e51-dd7e4574a87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ad9c08-f496-42f8-8d06-6009bd9ec758", "name": "network-vif-plugged", "status": "completed", "tag": "27ace315-328c-4c38-8778-46df3acdaf37"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:47.301448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c0f731b-bd25-4a6b-af1a-99da972b3319 req-e6eb708f-27d9-45fd-9e51-dd7e4574a87c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:47.304376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c0f731b-bd25-4a6b-af1a-99da972b3319 req-e6eb708f-27d9-45fd-9e51-dd7e4574a87c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:47.305584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c0f731b-bd25-4a6b-af1a-99da972b3319 req-e6eb708f-27d9-45fd-9e51-dd7e4574a87c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:47.333963 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1c0f731b-bd25-4a6b-af1a-99da972b3319 req-e6eb708f-27d9-45fd-9e51-dd7e4574a87c service nova] Creating event network-vif-plugged:27ace315-328c-4c38-8778-46df3acdaf37 for instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 on n-h1-861333-10 Oct 19 07:06:47.340466 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1c0f731b-bd25-4a6b-af1a-99da972b3319 req-e6eb708f-27d9-45fd-9e51-dd7e4574a87c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079237 Oct 19 07:06:47.342388 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2108/4082] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:47.387424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:47.388436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:47.411418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:47.411418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:47.411418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:47.416082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:47.416621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:47.417109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_group_members'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:06:47.417662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:47.435965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Getting quotas for user dc8be1ca00d64432af40619b12193ebc and project 91f972f7bf7e410e85e4980ed5ee27b6. Resources: {'server_group_members'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:06:47.531933 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef07e241-bb8e-46ad-a599-95a0c364958c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944369 Oct 19 07:06:47.535644 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1975/4083] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:06:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:06:47.541731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d655abd7-38f0-4d99-b462-0d9ade8ac19b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:47.549793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d655abd7-38f0-4d99-b462-0d9ade8ac19b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:47.573349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d655abd7-38f0-4d99-b462-0d9ade8ac19b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:47.579640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d655abd7-38f0-4d99-b462-0d9ade8ac19b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:47.580320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d655abd7-38f0-4d99-b462-0d9ade8ac19b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:47.581791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d655abd7-38f0-4d99-b462-0d9ade8ac19b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:47.587220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d655abd7-38f0-4d99-b462-0d9ade8ac19b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:47.590500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d655abd7-38f0-4d99-b462-0d9ade8ac19b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:47.715683 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d655abd7-38f0-4d99-b462-0d9ade8ac19b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 14 microversion: 2.1 time: 0.178534 Oct 19 07:06:47.718497 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1976/4084] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:47 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:06:47.736418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d527499-d18b-4cc0-addd-62b9561dcd2e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:47.740473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d527499-d18b-4cc0-addd-62b9561dcd2e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:47.963850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d527499-d18b-4cc0-addd-62b9561dcd2e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:47.974202 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d527499-d18b-4cc0-addd-62b9561dcd2e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1213 microversion: 2.1 time: 0.254408 Oct 19 07:06:47.977324 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1977/4085] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:47 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1213 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:48.029335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:48.054926 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-645181f6-5545-4a6d-942a-446396c1afc9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1315 microversion: 2.1 time: 0.671907 Oct 19 07:06:48.076039 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2109/4086] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:47 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:48.735835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afa3f5e9-4a05-4844-ab2d-1c8bae5e4553 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:48.740637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afa3f5e9-4a05-4844-ab2d-1c8bae5e4553 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:48.753431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa3f5e9-4a05-4844-ab2d-1c8bae5e4553 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:48.755454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa3f5e9-4a05-4844-ab2d-1c8bae5e4553 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:48.760637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa3f5e9-4a05-4844-ab2d-1c8bae5e4553 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:48.761458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa3f5e9-4a05-4844-ab2d-1c8bae5e4553 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:48.761993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa3f5e9-4a05-4844-ab2d-1c8bae5e4553 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:48.763666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa3f5e9-4a05-4844-ab2d-1c8bae5e4553 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:48.832095 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afa3f5e9-4a05-4844-ab2d-1c8bae5e4553 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action" status: 200 len: 8208 microversion: 2.1 time: 0.106882 Oct 19 07:06:48.836588 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1978/4087] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:48 2022] POST /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643/action => generated 8208 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:48.848229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:48.849231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:48.891055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:48.893727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:48.894794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:48.897396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:48.898476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:48.899416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:49.001144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3df5cc1e-4fcb-4e12-b8f2-133b2e4b74c5 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:49.008763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3df5cc1e-4fcb-4e12-b8f2-133b2e4b74c5 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:49.173951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:49.190728 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-699be5dc-cbd5-4475-bbc1-9159f0ff0266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.344045 Oct 19 07:06:49.191847 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2110/4088] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:48 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:49.197041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:49.198429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:49.208229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:49.209029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:49.209688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:49.215808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3df5cc1e-4fcb-4e12-b8f2-133b2e4b74c5 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:49.219624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:49.222831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:49.224463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:49.227103 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3df5cc1e-4fcb-4e12-b8f2-133b2e4b74c5 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1213 microversion: 2.1 time: 0.230774 Oct 19 07:06:49.238488 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1979/4089] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:48 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1213 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:49.244460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:49.251069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:49.269028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:49.269644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:49.270169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:49.273097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:49.274150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:49.274681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:49.556328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:49.567673 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90840495-646b-4ca3-ba7a-a97a441403f1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1503 microversion: 2.1 time: 0.373868 Oct 19 07:06:49.586470 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2111/4090] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:49 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:49.595376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:49.596240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:49.604253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:49.605030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:49.605727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:49.606437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:49.606910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:49.607354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:49.635536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lazy-loading 'flavor' on Instance uuid c5ad9c08-f496-42f8-8d06-6009bd9ec758 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:06:49.648207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:49.656681 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30856f15-0d4d-496c-af5d-56cb7333555b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.416666 Oct 19 07:06:49.665303 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1980/4091] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:49 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:49.689260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:49.690250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:49.699482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:49.700232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:49.703559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:49.703559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:49.704218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:49.705123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:50.198581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:50.212990 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2fb8e454-c8f7-4403-ab8e-cc8bbb813774 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.529494 Oct 19 07:06:50.213587 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1981/4092] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:49 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:50.243884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:50.246563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:50.255635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:50.261710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:50.261710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:50.261710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:50.264152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:50.264911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:50.278197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:50.611460 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-035586b4-0afe-40b3-88e2-c2ef73174b38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758/action" status: 202 len: 0 microversion: 2.1 time: 1.021597 Oct 19 07:06:50.626355 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2112/4093] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:49 2022] POST /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758/action => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:06:50.653681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:50.654444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:50.678251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:50.682588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:50.684209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:50.685202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:50.688142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:50.689039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:50.812485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:50.833126 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa7ec91c-1d55-45f4-ac2e-6192baea1ed7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.594722 Oct 19 07:06:50.841188 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1982/4094] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:50 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:50.847777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:50.853220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:50.864637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:50.865466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:50.870677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:50.870677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:50.870677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:50.870677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:50.892008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:50.905259 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb7e8dca-de45-424f-8a8b-e4bf92c0ede4 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1265 microversion: 2.1 time: 0.274997 Oct 19 07:06:50.905793 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2113/4095] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:50 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:50.911967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:50.912588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:50.921333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:50.922142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:50.922819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:50.923861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:50.924600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:50.925257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:50.964817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:51.201150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Locking {{(pid=127567) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 19 07:06:51.315996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:51.333280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59ffa693-ceda-442b-b4b5-54d3dced858f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.490769 Oct 19 07:06:51.352383 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1983/4096] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:50 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:51.494936 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4aa31e35-3998-47ec-bc44-09457389dd44 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.587948 Oct 19 07:06:51.495892 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2114/4097] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:50 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:06:51.517691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:51.518340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:51.529772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:51.530551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:51.534409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:51.534409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:51.534409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:51.534409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:51.839773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:51.855598 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f231e7f3-8e54-4ff8-bddf-8b4564174cc1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.342131 Oct 19 07:06:51.856517 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1984/4098] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:51 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:51.879369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62efb4cf-3e64-42a8-9c2c-ec96cc864960 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:51.888750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62efb4cf-3e64-42a8-9c2c-ec96cc864960 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:51.889751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62efb4cf-3e64-42a8-9c2c-ec96cc864960 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:51.890399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62efb4cf-3e64-42a8-9c2c-ec96cc864960 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:51.934252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:51.935166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:51.941619 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-62efb4cf-3e64-42a8-9c2c-ec96cc864960 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] HTTP exception thrown: Instance 3e06e92a-b261-47bc-8963-f42b50716743 is locked Oct 19 07:06:51.944353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62efb4cf-3e64-42a8-9c2c-ec96cc864960 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Request method failure captured: Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action HTTP/1.1 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 15 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6DmX-pQ_4OnfuRUxh8rZSYDxjA0X84x3jYkADkvnJhDXg00PWP_QY3Xa-1vVKKQiCwPtOHOUWT_jfFKZg3ocIvk_QkW2-ZefnF6mQ0XawPMe--AMUWBI3jMmufugk0Ll2vtD8y9ScW4pTC2z439SwsP67b_cVZJF5JCwtBUgMpip78 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05016de78e0b4491a53cfa3885193ca8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-816942685 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2543970e80c84e109961fc84bfaaedd1 Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: {"os-stop": {}} Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3e06e92a-b261-47bc-8963-f42b50716743 is locked Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3e06e92a-b261-47bc-8963-f42b50716743', 'body': {'os-stop': {}}} Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1458, in _stop_server Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance, Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 3e06e92a-b261-47bc-8963-f42b50716743 is locked Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1461, in _stop_server Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 3e06e92a-b261-47bc-8963-f42b50716743 is locked Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e06e92a-b261-47bc-8963-f42b50716743 is locked Oct 19 07:06:51.946037 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:06:51.951238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:51.956226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62efb4cf-3e64-42a8-9c2c-ec96cc864960 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Returning 409 to user: Instance 3e06e92a-b261-47bc-8963-f42b50716743 is locked {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:06:51.956226 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62efb4cf-3e64-42a8-9c2c-ec96cc864960 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 409 len: 107 microversion: 2.1 time: 0.077473 Oct 19 07:06:51.957623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:51.958492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:51.959488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:51.959703 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2115/4099] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:51 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 107 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:06:51.962063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:51.970530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:51.973554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:51.991890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:51.992610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:51.994657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:51.995872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:51.996904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:51.998452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:52.120732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:52.138486 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a46b195-63b8-4aef-907a-d6331757a76e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1271 microversion: 2.1 time: 0.204271 Oct 19 07:06:52.141118 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1985/4100] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:51 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:52.184859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Unlocking {{(pid=127567) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 19 07:06:52.364161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:52.364801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:52.375862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:52.376405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:52.376856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:52.378195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:52.381712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:52.498660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:52.616026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:52.630258 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a7bc41db-a0ff-438d-bafa-1b5d4d0bab8a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.270578 Oct 19 07:06:52.633416 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1986/4101] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:52 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:53.036360 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4434e4d9-2b72-461a-8f74-e51f6602cd0d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 1.074093 Oct 19 07:06:53.040041 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2116/4102] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:51 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 1079 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:06:53.047386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d061243-6dbc-4396-b664-582f1f2f6d62 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:53.065389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d061243-6dbc-4396-b664-582f1f2f6d62 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:53.065909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d061243-6dbc-4396-b664-582f1f2f6d62 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:53.066353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d061243-6dbc-4396-b664-582f1f2f6d62 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:53.136400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d061243-6dbc-4396-b664-582f1f2f6d62 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 07:06:53.165661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:53.166604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:53.186511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:53.188820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:53.189475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:53.191765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:53.196539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:53.197555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:53.261203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=16 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:53.378039 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d061243-6dbc-4396-b664-582f1f2f6d62 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.334562 Oct 19 07:06:53.380283 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1987/4103] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:06:53 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:06:53.407567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:53.412857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:53.424834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:53.426123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:53.426792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:53.427740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:53.428596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:53.437191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:53.505202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:53.524644 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e96ca85-acb6-4029-8eb5-83eb01727918 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1313 microversion: 2.1 time: 0.357338 Oct 19 07:06:53.526656 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2117/4104] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:53 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:53.654806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:53.655426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:53.664025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:53.664610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:53.666373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:53.667105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:53.676033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:53.676605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:53.850920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:53.869607 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1200333-8d02-434b-8e6d-dfd77299ef4d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.478234 Oct 19 07:06:53.872487 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1988/4105] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:53 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:54.020522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:54.034160 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af0acb6e-98fe-4c77-971b-147154745c34 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.383000 Oct 19 07:06:54.052351 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2118/4106] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:53 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:54.556407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:54.558728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:54.569390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:54.577448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:54.577448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:54.580792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:54.582520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:54.583950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:54.816258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:54.825124 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b40ee901-13ba-434e-a884-04cdad77c04c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1313 microversion: 2.1 time: 0.274344 Oct 19 07:06:54.845896 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1989/4107] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:54 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:54.901610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:54.907473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:54.925490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:54.926485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:54.927922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:54.948227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:54.951977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:54.969417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:55.058619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:55.059666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:55.067631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:55.069608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:55.070792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:55.072836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:55.074995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:55.075532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:55.245651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:55.258162 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e2fd075-7626-4f42-80b1-5c01f89df0ee tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.360991 Oct 19 07:06:55.259251 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2119/4108] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:54 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:55.506559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:55.520552 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c7841b7-b8b8-4db7-975d-b8284d9651ce tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.465580 Oct 19 07:06:55.524544 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1990/4109] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:55 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:55.858139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:55.863648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:55.873948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:55.874800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:55.875378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:55.882361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:55.883354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:55.887248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:56.247926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8afe7a06-d41b-4c85-aa77-9e7601e4f1e3 req-99ca1df3-d856-435b-955d-d5884dcd34f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de4b086b-2080-42b4-947f-209f28b1e073", "tag": "822e8e29-4512-460b-9bfc-edd1ec70a865"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:06:56.282674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8afe7a06-d41b-4c85-aa77-9e7601e4f1e3 req-99ca1df3-d856-435b-955d-d5884dcd34f5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:56.283183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8afe7a06-d41b-4c85-aa77-9e7601e4f1e3 req-99ca1df3-d856-435b-955d-d5884dcd34f5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:56.283636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8afe7a06-d41b-4c85-aa77-9e7601e4f1e3 req-99ca1df3-d856-435b-955d-d5884dcd34f5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:56.321336 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8afe7a06-d41b-4c85-aa77-9e7601e4f1e3 req-99ca1df3-d856-435b-955d-d5884dcd34f5 service nova] Creating event network-changed:822e8e29-4512-460b-9bfc-edd1ec70a865 for instance de4b086b-2080-42b4-947f-209f28b1e073 on n-h2-861333-10 Oct 19 07:06:56.330288 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8afe7a06-d41b-4c85-aa77-9e7601e4f1e3 req-99ca1df3-d856-435b-955d-d5884dcd34f5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097526 Oct 19 07:06:56.334936 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1991/4110] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:06:56.352141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:56.352903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:56.367657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:56.372523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:56.373275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:56.373818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:56.375230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:56.375778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:56.376422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:56.391126 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37f1328d-7896-43e1-9a4e-d5f61425de8b tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1313 microversion: 2.1 time: 0.541045 Oct 19 07:06:56.392658 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2120/4111] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:55 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:56.547057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:56.547827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:56.559505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:56.560144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:56.568834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:56.570169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:56.570783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:56.571323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:56.927431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:56.958799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:56.970903 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97ec88d9-5069-41f9-a5d7-bb4a2186d1c5 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.427895 Oct 19 07:06:56.972430 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2121/4112] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:56 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:57.086527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:57.100859 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f4f4e25-d23f-4031-858d-908b908b32de tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.763230 Oct 19 07:06:57.112877 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1992/4113] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:56 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:57.429325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:57.429957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:57.441498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:57.446980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:57.446980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:57.446980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:57.446980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:57.446980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:58.007646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:58.010517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:58.040138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:58.041338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:58.044149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:58.046379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:58.048476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:58.049089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:58.077039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:58.100725 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4728c795-623a-42cf-aad5-e8cec3ce1c3d tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1313 microversion: 2.1 time: 0.685291 Oct 19 07:06:58.104549 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2122/4114] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:57 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:58.130216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:58.131101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:58.137697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:58.138732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:58.139322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:58.140208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:58.140818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:58.141389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:58.426870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:58.434944 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-454dd120-140d-4e47-bc72-c4a53de28c88 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.441799 Oct 19 07:06:58.435510 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1993/4115] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:57 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:58.453917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:58.462020 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6de8f27c-af1d-4f5f-8586-11b4a4745dca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.336916 Oct 19 07:06:58.476151 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2123/4116] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:58 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:06:59.125550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:59.128291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:59.157629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:59.158135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:59.158585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:59.162416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:59.162416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:59.162416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:59.252298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=42 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:06:59.459405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:59.460145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:59.486174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:59.488662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:59.492395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:59.496990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:59.497573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:59.499929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:59.801557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:06:59.815664 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd48fe53-43d7-497d-867b-5ae82dd5a0dd tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1313 microversion: 2.1 time: 0.693536 Oct 19 07:06:59.828130 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1994/4117] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:59 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:06:59.832445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:06:59.833726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:06:59.844671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:59.852250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:59.853229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:06:59.857372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:06:59.858278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:06:59.858948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:00.119991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:00.130590 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5790add9-c90e-4c06-a478-3b521a71f529 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.674867 Oct 19 07:07:00.145291 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2124/4118] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:59 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:00.682630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:00.703381 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a25841fc-1778-41fb-84ae-34b1be950069 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.881483 Oct 19 07:07:00.704422 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1995/4119] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:06:59 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:00.842054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:00.843283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:00.853226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:00.853743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:00.856331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:00.869830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:00.869830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:00.869830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:01.153879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:01.165275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:01.166433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:01.178580 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-124d6be7-8151-4ec1-8537-a931e6570a16 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1313 microversion: 2.1 time: 0.341911 Oct 19 07:07:01.181309 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2125/4120] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:00 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:01.184215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:01.184998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:01.185656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:01.186729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:01.188586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:01.189794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:01.466234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:01.474903 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc9fa811-e435-4ddb-96a1-66dd5c154640 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.319232 Oct 19 07:07:01.475505 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1996/4121] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:01 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:01.737675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:01.738554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:01.745328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:01.746016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:01.747769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:01.747769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:01.747769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:01.748128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:01.755371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:02.014941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:02.026456 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0cee3510-d542-42d3-b2f3-077738722840 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.300426 Oct 19 07:07:02.031981 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2126/4122] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:01 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:02.226070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:02.226707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:02.230646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:02.253319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:02.256902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:02.258349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:02.259275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:02.260073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:02.260694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:02.440875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:02.448598 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-833f616b-48b2-46bb-a8d2-0040e65d6346 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1313 microversion: 2.1 time: 0.245566 Oct 19 07:07:02.449195 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1997/4123] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:02 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:02.500619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:02.501265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:02.507951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:02.508527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:02.509026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:02.509774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:02.510243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:02.510693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:02.676337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:02.685871 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b4490b1-626f-46cd-b0bb-1565cb78d799 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.189127 Oct 19 07:07:02.701633 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2127/4124] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:02 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:03.058077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:03.059048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:03.066289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:03.067132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:03.069247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:03.069889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:03.070360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:03.074165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:03.094850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:03.177966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-aa5903b8-139f-4859-a028-45ba1bcaaba7 req-307771bc-257f-4766-af75-a02ce022092c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4b086b-2080-42b4-947f-209f28b1e073", "name": "network-vif-plugged", "status": "completed", "tag": "822e8e29-4512-460b-9bfc-edd1ec70a865"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:03.251028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aa5903b8-139f-4859-a028-45ba1bcaaba7 req-307771bc-257f-4766-af75-a02ce022092c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:03.251682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aa5903b8-139f-4859-a028-45ba1bcaaba7 req-307771bc-257f-4766-af75-a02ce022092c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:03.252684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aa5903b8-139f-4859-a028-45ba1bcaaba7 req-307771bc-257f-4766-af75-a02ce022092c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:03.269522 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-aa5903b8-139f-4859-a028-45ba1bcaaba7 req-307771bc-257f-4766-af75-a02ce022092c service nova] Creating event network-vif-plugged:822e8e29-4512-460b-9bfc-edd1ec70a865 for instance de4b086b-2080-42b4-947f-209f28b1e073 on n-h2-861333-10 Oct 19 07:07:03.275054 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-aa5903b8-139f-4859-a028-45ba1bcaaba7 req-307771bc-257f-4766-af75-a02ce022092c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101676 Oct 19 07:07:03.278687 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2128/4125] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:07:03.308706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:03.327005 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e81e6e87-7c13-44ed-a201-b25d46b5b0bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.270117 Oct 19 07:07:03.327005 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1998/4126] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:03 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:03.472832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:03.473683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:03.486418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:03.488735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:03.490448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:03.494854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:03.496830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:03.497424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:03.714082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:03.714878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:03.734471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:03.740221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:03.740776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:03.741244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:03.744126 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f410a6a-126b-47b9-99b4-5217b901b2e1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1313 microversion: 2.1 time: 0.276857 Oct 19 07:07:03.745350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:03.745882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:03.746351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:03.748718 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2129/4127] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:03 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:04.006064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:04.015153 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de9ce69f-a77a-4a30-8da8-a34b73924083 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.309102 Oct 19 07:07:04.015784 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1999/4128] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:03 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:04.352175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:04.352897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:04.368262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:04.368839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:04.369371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:04.374794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:04.375402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:04.375925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:04.575881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:04.586846 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac0ddbba-8b60-4ae7-81e2-42961dfaa912 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1657 microversion: 2.1 time: 0.238400 Oct 19 07:07:04.588890 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2130/4129] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:04 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1657 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:04.612547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8fe15242-4e4c-4997-a541-37461bdb7992 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:04.651173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fe15242-4e4c-4997-a541-37461bdb7992 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:04.654335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fe15242-4e4c-4997-a541-37461bdb7992 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:04.654335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fe15242-4e4c-4997-a541-37461bdb7992 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:04.698863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8fe15242-4e4c-4997-a541-37461bdb7992 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Going to try to start instance {{(pid=127568) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 07:07:04.771768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:04.772460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:04.782438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:04.788807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:04.789666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:04.790556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:04.791293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:04.791869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:04.950098 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8fe15242-4e4c-4997-a541-37461bdb7992 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.342293 Oct 19 07:07:04.950712 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2000/4130] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:07:04 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:07:04.979448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:04.980510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:04.997439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:04.997972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:04.998465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:04.999146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:04.999835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:05.000985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:05.012861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:05.024650 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05550d9d-a46b-4ca8-90fc-9854ca7ee833 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1313 microversion: 2.1 time: 0.257465 Oct 19 07:07:05.030012 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2131/4131] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:04 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:05.046643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:05.047701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:05.061761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:05.062264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:05.062905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:05.063778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:05.064418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:05.065539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:05.307957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:05.323847 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e57192e1-3f58-477d-a612-832cf8d7dc84 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.281946 Oct 19 07:07:05.325184 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2132/4132] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:05 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:05.561620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:05.574748 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-511924c9-7697-447c-9cd9-5d73457e4530 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1666 microversion: 2.1 time: 0.619046 Oct 19 07:07:05.575780 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2001/4133] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:04 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1666 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:06.058414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:06.059640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:06.069251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.069948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.070959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.072229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.073116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.073715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.349594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:06.352386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:06.369657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.370937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.371447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.372498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.373016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.374230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.383892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:06.397243 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06495e94-2ae5-4b2f-96e8-9857e1734c68 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1498 microversion: 2.1 time: 0.345314 Oct 19 07:07:06.398779 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2133/4134] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:06 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1498 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:06.428190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f3f9c41-97ef-40f0-b6e0-d54ccbd9a925 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:06.458892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.server_groups [None req-1f3f9c41-97ef-40f0-b6e0-d54ccbd9a925 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Querying cell 2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) for 1 instances {{(pid=127567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 07:07:06.459585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f3f9c41-97ef-40f0-b6e0-d54ccbd9a925 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.460084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f3f9c41-97ef-40f0-b6e0-d54ccbd9a925 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.460557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f3f9c41-97ef-40f0-b6e0-d54ccbd9a925 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.493282 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f3f9c41-97ef-40f0-b6e0-d54ccbd9a925 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/a85788fb-8d54-48d7-a53d-d66d9b950914" status: 200 len: 221 microversion: 2.1 time: 0.069015 Oct 19 07:07:06.504290 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2134/4135] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 07:07:06 2022] GET /compute/v2.1/os-server-groups/a85788fb-8d54-48d7-a53d-d66d9b950914 => generated 221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:07:06.512525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:06.514604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:06.525290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.526190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.526822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.527732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.531390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.531390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.566548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:07:06.632809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:06.645431 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fccda9d8-bc77-4447-81fe-961c32a0821c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.300782 Oct 19 07:07:06.650874 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2002/4136] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:06 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:06.660281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:06.661117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:06.676963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.677847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.678459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.679344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.682859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.682859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.922832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:06.932097 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6752b76-e373-45f4-9c7b-d06c393bb02b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1666 microversion: 2.1 time: 0.280079 Oct 19 07:07:06.933955 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2003/4137] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:06 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1666 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:06.969297 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2bf02b74-c3e6-4ceb-93f3-c19fee3397a1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 204 len: 0 microversion: 2.1 time: 0.461716 Oct 19 07:07:06.970611 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2135/4138] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:07:06 2022] DELETE /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:07:06.980234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:06.981117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:06.990932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.991749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.992455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:06.993400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:06.994066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:06.994702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:07.179631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:07.196705 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91823b87-20d1-457a-8bbb-07989ec33570 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1504 microversion: 2.1 time: 0.213166 Oct 19 07:07:07.199209 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2004/4139] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:06 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:07.669954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:07.670710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:07.679708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:07.686202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:07.686756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:07.687560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:07.689166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:07.691284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:07.904272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:07.921499 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab395bce-d501-44ca-9485-dcc9b2e70d03 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.254758 Oct 19 07:07:07.925270 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2136/4140] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:07 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:07.961365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:07.962662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:07.971173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:07.971894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:07.972542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:07.973453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:07.974114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:07.974744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:08.161818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:08.171483 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7e46b21-6b2b-460a-bb86-918c5eb446ad tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.215710 Oct 19 07:07:08.184876 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2005/4141] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:07 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:08.197589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:08.198198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:08.205549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:08.207250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:08.207704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:08.208514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:08.230874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:08.232797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:08.236505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:08.237336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:08.256589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:08.257317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:08.257946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:08.259303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:08.261847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:08.262455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:08.521093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:08.530444 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e2feaf6-954e-428c-9ab1-67faf6d1d92c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.336824 Oct 19 07:07:08.531394 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2137/4142] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:08 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:08.568336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:08.573188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:08.586043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:08.586719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:08.590726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:08.592483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:08.593605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:08.594274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:08.678750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:08.692362 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b7d7b44-dc05-4c86-a5d3-2ba193b5a60e tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1504 microversion: 2.1 time: 0.463593 Oct 19 07:07:08.708513 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2006/4143] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:08 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1504 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:08.949890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:08.950762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:08.957902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:08.958699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:08.959362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:08.960410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:08.961093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:08.961746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:09.019627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Unlocking {{(pid=127567) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 19 07:07:09.320420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:09.340421 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-623f189f-b8b5-4cb7-85e1-0f37c65fe6b8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.395265 Oct 19 07:07:09.354552 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2007/4144] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:08 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:09.471063 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-732be537-aa71-4e6a-b7e0-5b6c074d56d2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.917665 Oct 19 07:07:09.486134 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2138/4145] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:07:08 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:07:09.496227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:09.497257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:09.507338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:09.508176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:09.508835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:09.510731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:09.511585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:09.512313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:09.641364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-669f0f5c-b77e-4c22-88b9-d81aab22a6d2 req-ef2ade02-b4c3-4ad2-81e7-e4d1b71eabc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4b086b-2080-42b4-947f-209f28b1e073", "name": "network-vif-deleted", "tag": "822e8e29-4512-460b-9bfc-edd1ec70a865"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:09.666291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-669f0f5c-b77e-4c22-88b9-d81aab22a6d2 req-ef2ade02-b4c3-4ad2-81e7-e4d1b71eabc4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:09.667256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-669f0f5c-b77e-4c22-88b9-d81aab22a6d2 req-ef2ade02-b4c3-4ad2-81e7-e4d1b71eabc4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:09.667773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-669f0f5c-b77e-4c22-88b9-d81aab22a6d2 req-ef2ade02-b4c3-4ad2-81e7-e4d1b71eabc4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:09.682043 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-669f0f5c-b77e-4c22-88b9-d81aab22a6d2 req-ef2ade02-b4c3-4ad2-81e7-e4d1b71eabc4 service nova] Creating event network-vif-deleted:822e8e29-4512-460b-9bfc-edd1ec70a865 for instance de4b086b-2080-42b4-947f-209f28b1e073 on n-h2-861333-10 Oct 19 07:07:09.688089 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-669f0f5c-b77e-4c22-88b9-d81aab22a6d2 req-ef2ade02-b4c3-4ad2-81e7-e4d1b71eabc4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050865 Oct 19 07:07:09.689007 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2139/4146] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:07:09.721896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:09.722993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:09.742514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:09.743340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:09.743800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:09.744727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:09.745188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:09.745623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:09.784732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:09.786153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:09.801952 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c2e0bbe-0bcd-478a-bcde-aeb1ed769561 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.321374 Oct 19 07:07:09.803394 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2008/4147] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:09 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:09.833624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:09.834269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:09.842228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:09.844188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:09.845230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:09.846259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:09.846884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:09.849926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:09.885096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:09.899224 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38e8feb2-b59e-4f29-8ac5-3b2a8a553de9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1462 microversion: 2.1 time: 0.183413 Oct 19 07:07:09.903078 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2140/4148] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:09 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1462 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:10.080907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:10.090231 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-98d730e5-7659-469a-8143-9c7969d644b7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.267401 Oct 19 07:07:10.092132 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2009/4149] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:09 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:10.114871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:10.115639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:10.121583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:10.134373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.148218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.148944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:10.149945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.150620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.151248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:10.365849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:10.366554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:10.375873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.396724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.396724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:10.396724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.396724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.396724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:10.499719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:10.517433 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff0a7371-26e2-4477-9855-7e4a3eade7a2 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.406973 Oct 19 07:07:10.530177 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2141/4150] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:10 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:10.555792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f61433d0-b316-4552-8152-0e37ded7d4e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:10.557058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f61433d0-b316-4552-8152-0e37ded7d4e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:10.574505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61433d0-b316-4552-8152-0e37ded7d4e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.575703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61433d0-b316-4552-8152-0e37ded7d4e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.592266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61433d0-b316-4552-8152-0e37ded7d4e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:10.596409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61433d0-b316-4552-8152-0e37ded7d4e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.598110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61433d0-b316-4552-8152-0e37ded7d4e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.599095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61433d0-b316-4552-8152-0e37ded7d4e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:10.731800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:10.743405 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e17559b1-a9bc-4be8-8c9c-ad3cd4eda332 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.383619 Oct 19 07:07:10.744008 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2010/4151] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:10 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:10.929490 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f61433d0-b316-4552-8152-0e37ded7d4e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.384700 Oct 19 07:07:10.933612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:10.934289 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2142/4152] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:07:10 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:07:10.934441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:10.945086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:10.946649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:10.948081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.950676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.954607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:10.958115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.961050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.963390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:10.964329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.965584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.966641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:10.967408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:10.967872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:10.968546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:11.020189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:11.020912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:11.021504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:11.022180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lazy-loading 'fault' on Instance uuid de4b086b-2080-42b4-947f-209f28b1e073 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:07:11.147402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8be1ca00d64432af40619b12193ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f972f7bf7e410e85e4980ed5ee27b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:11.158595 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbe1352f-715f-4739-8175-319e81f501c0 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 200 len: 1303 microversion: 2.1 time: 0.229668 Oct 19 07:07:11.160954 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2011/4153] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:10 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:11.614141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:11.624586 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27c1ee84-ed1f-4b98-ae14-7b70c39e4578 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1675 microversion: 2.1 time: 0.688699 Oct 19 07:07:11.628500 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2143/4154] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:10 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1675 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:11.777207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:11.779368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:11.797763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:11.798251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:11.798691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:11.800026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:11.800519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:11.805474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.011133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:12.024606 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c53a0948-bd8c-4a41-8aae-946fe3084dbc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.259783 Oct 19 07:07:12.041836 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2012/4155] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:11 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:12.186608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.188030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:12.202470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.203183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.205397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.222487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.223761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.224487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.261571 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] HTTP exception thrown: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Request method failure captured: Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 HTTP/1.1 Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6IBIopwflyCUL4X7Ans1IUOdgdVJ0Cl0PDSQUDVetdBzG-gezRobbkN9spcNlYLwmccN2kviYncP2xdFAZ82_HA63D6y82_HQajMG5MDAqIivp7URtiDSQTZnaWdjqJOfILx0jRSmTTk9W-LEK4Q4-iNCwX8FU-owPPGtgvn2Z10vo Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "tempest-type-206735895", "name": "tempest-service-1579355126", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "tempest-type-1039970366", "name": "tempest-service-424248695", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91f972f7bf7e410e85e4980ed5ee27b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: dc8be1ca00d64432af40619b12193ebc Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'de4b086b-2080-42b4-947f-209f28b1e073'} Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.266291 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Returning 404 to user: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b25cba4-fa1f-4d65-a462-f0bd89ee4a02 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 404 len: 111 microversion: 2.1 time: 0.091742 Oct 19 07:07:12.281234 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2144/4156] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:12 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:07:12.294230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f63e10a-babf-4f76-97de-c8022077f35c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.318602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.server_groups [None req-7f63e10a-babf-4f76-97de-c8022077f35c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Querying cell 2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) for 1 instances {{(pid=127568) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 07:07:12.319509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f63e10a-babf-4f76-97de-c8022077f35c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.320071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f63e10a-babf-4f76-97de-c8022077f35c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.327891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f63e10a-babf-4f76-97de-c8022077f35c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.339602 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f63e10a-babf-4f76-97de-c8022077f35c tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.055972 Oct 19 07:07:12.340386 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2013/4157] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 07:07:12 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:07:12.356647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33756aa8-4b8c-46d1-b509-6e814431f220 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.391475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.server_groups [None req-33756aa8-4b8c-46d1-b509-6e814431f220 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Querying cell 2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) for 1 instances {{(pid=127567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 07:07:12.392993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33756aa8-4b8c-46d1-b509-6e814431f220 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.394386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33756aa8-4b8c-46d1-b509-6e814431f220 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.396192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33756aa8-4b8c-46d1-b509-6e814431f220 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.408813 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33756aa8-4b8c-46d1-b509-6e814431f220 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/a85788fb-8d54-48d7-a53d-d66d9b950914" status: 200 len: 183 microversion: 2.1 time: 0.058028 Oct 19 07:07:12.416313 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2145/4158] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 07:07:12 2022] GET /compute/v2.1/os-server-groups/a85788fb-8d54-48d7-a53d-d66d9b950914 => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:07:12.427409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.428496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:12.438138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.439027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.439782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.442112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.461146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.461146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.464836 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] HTTP exception thrown: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Request method failure captured: Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 HTTP/1.1 Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6IBIopwflyCUL4X7Ans1IUOdgdVJ0Cl0PDSQUDVetdBzG-gezRobbkN9spcNlYLwmccN2kviYncP2xdFAZ82_HA63D6y82_HQajMG5MDAqIivp7URtiDSQTZnaWdjqJOfILx0jRSmTTk9W-LEK4Q4-iNCwX8FU-owPPGtgvn2Z10vo Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "tempest-type-206735895", "name": "tempest-service-1579355126", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "tempest-type-1039970366", "name": "tempest-service-424248695", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91f972f7bf7e410e85e4980ed5ee27b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: dc8be1ca00d64432af40619b12193ebc Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'de4b086b-2080-42b4-947f-209f28b1e073'} Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:07:12.467073 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.470439 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.474305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Returning 404 to user: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:07:12.475608 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61596f2d-1581-4121-9f85-af1b7742c0d9 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 404 len: 111 microversion: 2.1 time: 0.053896 Oct 19 07:07:12.477238 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2014/4159] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:07:12 2022] DELETE /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:07:12.486490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.487142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] [instance: de4b086b-2080-42b4-947f-209f28b1e073] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:12.493659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.494161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.494606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.495314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.496000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.496456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.511704 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] HTTP exception thrown: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Request method failure captured: Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 HTTP/1.1 Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6IBIopwflyCUL4X7Ans1IUOdgdVJ0Cl0PDSQUDVetdBzG-gezRobbkN9spcNlYLwmccN2kviYncP2xdFAZ82_HA63D6y82_HQajMG5MDAqIivp7URtiDSQTZnaWdjqJOfILx0jRSmTTk9W-LEK4Q4-iNCwX8FU-owPPGtgvn2Z10vo Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "tempest-type-206735895", "name": "tempest-service-1579355126", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "tempest-type-1039970366", "name": "tempest-service-424248695", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91f972f7bf7e410e85e4980ed5ee27b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: dc8be1ca00d64432af40619b12193ebc Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'de4b086b-2080-42b4-947f-209f28b1e073'} Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.513468 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Returning 404 to user: Instance de4b086b-2080-42b4-947f-209f28b1e073 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:07:12.516823 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe21ff04-0da8-4b95-9390-3a1407a7ec61 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073" status: 404 len: 111 microversion: 2.1 time: 0.033342 Oct 19 07:07:12.519739 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2146/4160] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:12 2022] GET /compute/v2.1/servers/de4b086b-2080-42b4-947f-209f28b1e073 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:07:12.525111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a37097e2-8c61-4b63-9186-9798c12c5b38 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.531720 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a37097e2-8c61-4b63-9186-9798c12c5b38 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] HTTP exception thrown: Instance group 14c2d965-db80-4ea0-a8a1-73ed8cd83af2 could not be found. Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a37097e2-8c61-4b63-9186-9798c12c5b38 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Request method failure captured: Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-server-groups/14c2d965-db80-4ea0-a8a1-73ed8cd83af2 HTTP/1.1 Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6IBIopwflyCUL4X7Ans1IUOdgdVJ0Cl0PDSQUDVetdBzG-gezRobbkN9spcNlYLwmccN2kviYncP2xdFAZ82_HA63D6y82_HQajMG5MDAqIivp7URtiDSQTZnaWdjqJOfILx0jRSmTTk9W-LEK4Q4-iNCwX8FU-owPPGtgvn2Z10vo Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "tempest-type-206735895", "name": "tempest-service-1579355126", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "tempest-type-1039970366", "name": "tempest-service-424248695", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91f972f7bf7e410e85e4980ed5ee27b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: dc8be1ca00d64432af40619b12193ebc Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance group 14c2d965-db80-4ea0-a8a1-73ed8cd83af2 could not be found. Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '14c2d965-db80-4ea0-a8a1-73ed8cd83af2'} Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 14c2d965-db80-4ea0-a8a1-73ed8cd83af2 could not be found. Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 14c2d965-db80-4ea0-a8a1-73ed8cd83af2 could not be found. Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.533363 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 14c2d965-db80-4ea0-a8a1-73ed8cd83af2 could not be found. Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a37097e2-8c61-4b63-9186-9798c12c5b38 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Returning 404 to user: Instance group 14c2d965-db80-4ea0-a8a1-73ed8cd83af2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a37097e2-8c61-4b63-9186-9798c12c5b38 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/14c2d965-db80-4ea0-a8a1-73ed8cd83af2" status: 404 len: 117 microversion: 2.1 time: 0.013965 Oct 19 07:07:12.537743 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2015/4161] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:07:12 2022] DELETE /compute/v2.1/os-server-groups/14c2d965-db80-4ea0-a8a1-73ed8cd83af2 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:07:12.544140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c82a103b-40be-4485-a7e9-4405e4ec69eb tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.550912 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c82a103b-40be-4485-a7e9-4405e4ec69eb tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] HTTP exception thrown: Instance group 2cb790d7-a937-498f-b407-c07b8aa8b7ec could not be found. Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c82a103b-40be-4485-a7e9-4405e4ec69eb tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Request method failure captured: Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-server-groups/2cb790d7-a937-498f-b407-c07b8aa8b7ec HTTP/1.1 Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6IBIopwflyCUL4X7Ans1IUOdgdVJ0Cl0PDSQUDVetdBzG-gezRobbkN9spcNlYLwmccN2kviYncP2xdFAZ82_HA63D6y82_HQajMG5MDAqIivp7URtiDSQTZnaWdjqJOfILx0jRSmTTk9W-LEK4Q4-iNCwX8FU-owPPGtgvn2Z10vo Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "tempest-type-206735895", "name": "tempest-service-1579355126", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "tempest-type-1039970366", "name": "tempest-service-424248695", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91f972f7bf7e410e85e4980ed5ee27b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: dc8be1ca00d64432af40619b12193ebc Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance group 2cb790d7-a937-498f-b407-c07b8aa8b7ec could not be found. Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '2cb790d7-a937-498f-b407-c07b8aa8b7ec'} Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2cb790d7-a937-498f-b407-c07b8aa8b7ec could not be found. Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2cb790d7-a937-498f-b407-c07b8aa8b7ec could not be found. Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.553152 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2cb790d7-a937-498f-b407-c07b8aa8b7ec could not be found. Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c82a103b-40be-4485-a7e9-4405e4ec69eb tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Returning 404 to user: Instance group 2cb790d7-a937-498f-b407-c07b8aa8b7ec could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:07:12.557054 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c82a103b-40be-4485-a7e9-4405e4ec69eb tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/2cb790d7-a937-498f-b407-c07b8aa8b7ec" status: 404 len: 117 microversion: 2.1 time: 0.014609 Oct 19 07:07:12.558603 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2147/4162] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:07:12 2022] DELETE /compute/v2.1/os-server-groups/2cb790d7-a937-498f-b407-c07b8aa8b7ec => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:07:12.565809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e374e30-23cb-4a82-b64e-e44b532217b1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.573568 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3e374e30-23cb-4a82-b64e-e44b532217b1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] HTTP exception thrown: Instance group d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb could not be found. Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e374e30-23cb-4a82-b64e-e44b532217b1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Request method failure captured: Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-server-groups/d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb HTTP/1.1 Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6IBIopwflyCUL4X7Ans1IUOdgdVJ0Cl0PDSQUDVetdBzG-gezRobbkN9spcNlYLwmccN2kviYncP2xdFAZ82_HA63D6y82_HQajMG5MDAqIivp7URtiDSQTZnaWdjqJOfILx0jRSmTTk9W-LEK4Q4-iNCwX8FU-owPPGtgvn2Z10vo Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "tempest-type-206735895", "name": "tempest-service-1579355126", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "tempest-type-1039970366", "name": "tempest-service-424248695", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91f972f7bf7e410e85e4980ed5ee27b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: dc8be1ca00d64432af40619b12193ebc Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance group d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb could not be found. Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'd4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb'} Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb could not be found. Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb could not be found. Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.575440 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.579427 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.579427 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.579427 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.579427 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.579427 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:07:12.579427 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:07:12.579427 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb could not be found. Oct 19 07:07:12.579427 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.579427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e374e30-23cb-4a82-b64e-e44b532217b1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Returning 404 to user: Instance group d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:07:12.581574 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e374e30-23cb-4a82-b64e-e44b532217b1 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb" status: 404 len: 117 microversion: 2.1 time: 0.020661 Oct 19 07:07:12.585201 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2016/4163] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:07:12 2022] DELETE /compute/v2.1/os-server-groups/d4cc5fa2-0ebc-45d2-94bf-590d53f8a1fb => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78672488-83ca-410c-9fad-9a2876c4af98 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-78672488-83ca-410c-9fad-9a2876c4af98 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] HTTP exception thrown: Instance group 4b544248-040d-45e3-90ea-8dd75f8ffe38 could not be found. Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78672488-83ca-410c-9fad-9a2876c4af98 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Request method failure captured: Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-server-groups/4b544248-040d-45e3-90ea-8dd75f8ffe38 HTTP/1.1 Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6IBIopwflyCUL4X7Ans1IUOdgdVJ0Cl0PDSQUDVetdBzG-gezRobbkN9spcNlYLwmccN2kviYncP2xdFAZ82_HA63D6y82_HQajMG5MDAqIivp7URtiDSQTZnaWdjqJOfILx0jRSmTTk9W-LEK4Q4-iNCwX8FU-owPPGtgvn2Z10vo Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "tempest-type-206735895", "name": "tempest-service-1579355126", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "tempest-type-1039970366", "name": "tempest-service-424248695", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91f972f7bf7e410e85e4980ed5ee27b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91f972f7bf7e410e85e4980ed5ee27b6", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 91f972f7bf7e410e85e4980ed5ee27b6 Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1349812248 Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: dc8be1ca00d64432af40619b12193ebc Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerGroupTestJSON-1349812248-project Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance group 4b544248-040d-45e3-90ea-8dd75f8ffe38 could not be found. Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '4b544248-040d-45e3-90ea-8dd75f8ffe38'} Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4b544248-040d-45e3-90ea-8dd75f8ffe38 could not be found. Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.604705 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4b544248-040d-45e3-90ea-8dd75f8ffe38 could not be found. Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4b544248-040d-45e3-90ea-8dd75f8ffe38 could not be found. Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78672488-83ca-410c-9fad-9a2876c4af98 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Returning 404 to user: Instance group 4b544248-040d-45e3-90ea-8dd75f8ffe38 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78672488-83ca-410c-9fad-9a2876c4af98 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/4b544248-040d-45e3-90ea-8dd75f8ffe38" status: 404 len: 117 microversion: 2.1 time: 0.014720 Oct 19 07:07:12.607409 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2148/4164] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:07:12 2022] DELETE /compute/v2.1/os-server-groups/4b544248-040d-45e3-90ea-8dd75f8ffe38 => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:07:12.611582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5d349e0-7707-4e5a-b17d-fada76602e19 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.653196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:12.655038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:12.664356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.665128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.665810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.666669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.667302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.667932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.761546 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5d349e0-7707-4e5a-b17d-fada76602e19 tempest-ServerGroupTestJSON-1349812248 tempest-ServerGroupTestJSON-1349812248-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/a85788fb-8d54-48d7-a53d-d66d9b950914" status: 204 len: 0 microversion: 2.1 time: 0.153827 Oct 19 07:07:12.763481 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2017/4165] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:07:12 2022] DELETE /compute/v2.1/os-server-groups/a85788fb-8d54-48d7-a53d-d66d9b950914 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:07:12.906746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:12.922939 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6294fc4a-ce71-41b1-990d-bf7f6528dd99 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1655 microversion: 2.1 time: 0.275024 Oct 19 07:07:12.924062 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2149/4166] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:12 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1655 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:12.954884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-503de0b6-d3da-4428-96b8-40d03da1f4c1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:12.955403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-503de0b6-d3da-4428-96b8-40d03da1f4c1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:12.974544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503de0b6-d3da-4428-96b8-40d03da1f4c1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.974544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503de0b6-d3da-4428-96b8-40d03da1f4c1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.974544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503de0b6-d3da-4428-96b8-40d03da1f4c1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.975900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503de0b6-d3da-4428-96b8-40d03da1f4c1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:12.978268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503de0b6-d3da-4428-96b8-40d03da1f4c1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:12.979531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503de0b6-d3da-4428-96b8-40d03da1f4c1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:12.994622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:13.053822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:13.054671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:13.065991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:13.067492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:13.070233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:13.072395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:13.073080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:13.076337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:13.355969 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-503de0b6-d3da-4428-96b8-40d03da1f4c1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.405708 Oct 19 07:07:13.357753 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2018/4167] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:07:12 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:07:13.371814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:13.373713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:13.382765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:13.383781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:13.392069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:13.393259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:13.393964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:13.394652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:13.457248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:13.472845 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d999d15-09b6-4add-87d3-f957f150a2ed tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.423917 Oct 19 07:07:13.474160 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2150/4168] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:13 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:13.712144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1227347596", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8c9ce40e-8245-4546-88db-76f6a3db0eb6"}], "security_groups": [{"name": "tempest-securitygroup--328250917"}], "key_name": "tempest-keypair-1191074714", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b102fc19-6765-4fa4-bc32-4704d85b3e81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:13.923991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] validate_networks() for [('8c9ce40e-8245-4546-88db-76f6a3db0eb6', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:07:13.990110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:14.006114 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c040c87-c61b-4877-bb73-2a0b7393e663 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1662 microversion: 2.1 time: 0.639873 Oct 19 07:07:14.010003 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2019/4169] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:13 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1662 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:14.502127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:14.503303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:14.517582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:14.518327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:14.521618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:14.522660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:14.523893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:14.524964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:14.974942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:14.988186 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1b644e3-236d-4e3a-a134-83eab62e56e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.488226 Oct 19 07:07:14.989830 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2020/4170] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:14 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:15.030874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:15.031536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:15.056024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:15.058700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:15.060399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:15.061380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:15.063024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:15.063901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:15.237486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Getting quotas for project dc00fa11f6d5486481b4900e70be3705. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:07:15.243684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Getting quotas for user 271263f7a46e48218d4417a01c56832b and project dc00fa11f6d5486481b4900e70be3705. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:07:15.270111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:07:15.270691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:07:15.271662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:07:15.272291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:07:15.273007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:07:15.290152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:15.291090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:15.298873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:15.329949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:15.329949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:15.329949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:15.345580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Getting quotas for project dc00fa11f6d5486481b4900e70be3705. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:07:15.363698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Getting quotas for user 271263f7a46e48218d4417a01c56832b and project dc00fa11f6d5486481b4900e70be3705. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:07:15.474188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:15.482344 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99b9f1b3-9ca7-4214-aa62-24d2b0cd3fd8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.455989 Oct 19 07:07:15.482929 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2021/4171] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:15 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:15.514460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:15.514460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:15.520458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:15.522990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:15.526033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:15.527654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:15.528413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:15.529082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:15.554862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:07:15.557695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b102fc19-6765-4fa4-bc32-4704d85b3e81',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:07:16.194955 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac7b2b77-2526-4418-bd08-d32a299710ff tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.487623 Oct 19 07:07:16.197203 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2151/4172] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:07:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 2491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 07:07:16.213422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:16.213422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:16.230808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:16.239648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:16.243013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:16.248225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:16.249538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:16.252639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:16.291224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:16.302748 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-987c0009-73e8-4d49-b9fa-202309d2f2bc tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.799031 Oct 19 07:07:16.309021 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2022/4173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:15 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:16.319221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0a91c38-901f-49e9-889e-32b2ecc2a1b2 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:16.320367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0a91c38-901f-49e9-889e-32b2ecc2a1b2 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:16.488947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0a91c38-901f-49e9-889e-32b2ecc2a1b2 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:16.504371 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0a91c38-901f-49e9-889e-32b2ecc2a1b2 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1122 microversion: 2.1 time: 0.192117 Oct 19 07:07:16.516818 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2023/4174] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:16 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1122 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:16.526196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:16.527936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:16.546301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:16.547645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:16.548837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:16.550884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:16.551553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:16.552252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:16.941974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:16.954653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:16.957971 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78f45849-442b-43c0-8761-faecbd83cf26 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1509 microversion: 2.1 time: 0.759314 Oct 19 07:07:16.959551 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2152/4175] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:16 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1509 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:16.966573 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1795b9d-565e-4f08-a942-23f623a9a351 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.453026 Oct 19 07:07:16.969036 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2024/4176] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:16 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:16.998647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:17.002017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:17.017832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:17.019955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:17.020661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:17.022255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:17.025547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:17.026424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:17.420421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:17.430362 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b32baee6-f986-4348-a3e3-be6fb3151bb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.435910 Oct 19 07:07:17.434560 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2153/4177] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:16 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:17.459096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:17.459781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:17.488321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:17.489111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:17.495851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:17.497873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:17.499988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:17.500663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:17.532681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-059ccdb4-ff10-4c62-aef8-ef67acb09a92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:17.536634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-059ccdb4-ff10-4c62-aef8-ef67acb09a92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:17.967435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-059ccdb4-ff10-4c62-aef8-ef67acb09a92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:17.985984 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-059ccdb4-ff10-4c62-aef8-ef67acb09a92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1122 microversion: 2.1 time: 0.459904 Oct 19 07:07:18.000360 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2154/4178] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:17 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1122 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:18.015635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:18.017280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:18.061040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:18.061567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:18.071053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:18.074704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:18.077964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:18.081168 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3900e20-704e-4084-9237-06b1ceda2266 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.625647 Oct 19 07:07:18.081903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:18.083144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:18.108022 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2025/4179] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:17 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:18.119749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:18.120914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:18.140770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:18.142230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:18.142230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:18.142578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:18.143048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:18.144019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:18.797803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:18.809459 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abbf5dcf-4328-4358-ae58-c2a7a3bc7648 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.699561 Oct 19 07:07:18.810338 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2026/4180] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:18 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:19.021246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:19.022022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:19.052258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:19.052712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:19.053342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:19.079538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:19.080224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:19.080524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:19.345331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:19.355772 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22bfffef-5eb9-411c-b99e-29f6926943c8 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 1.354082 Oct 19 07:07:19.366856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:19.375121 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d95c49b2-881d-4e04-a161-ab36a23f5428 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1220 microversion: 2.1 time: 0.364379 Oct 19 07:07:19.395204 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2155/4181] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:18 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:19.395410 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2027/4182] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:19 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1220 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:20.416494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:20.422497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:20.422742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:20.422742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:20.475019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:20.475629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:20.476402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:20.479325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:20.480247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:20.483883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:20.485664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:20.493319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:20.497220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:20.498029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:20.498566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:20.503122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:21.000487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:21.014624 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6866520-65b4-4f60-804a-d2eeb99a44c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.610716 Oct 19 07:07:21.044497 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2156/4183] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:20 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:21.177897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:21.189503 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4adf1589-312a-414b-903b-74fbd02f07cb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1238 microversion: 2.1 time: 0.782164 Oct 19 07:07:21.220158 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2028/4184] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:20 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1238 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:22.037971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:22.038758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:22.060477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:22.061115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:22.061675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:22.062541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:22.063639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:22.064724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:22.230548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:22.231387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:22.248245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:22.249054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:22.249721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:22.250674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:22.252756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:22.253462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:22.533627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:22.545692 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1aa44d4-a944-49e7-bbf3-1cac5e5679f9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.511889 Oct 19 07:07:22.549025 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2157/4185] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:22 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:23.160066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:23.171425 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ddfb0055-9806-40ce-85fa-b9befa6f97a3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1238 microversion: 2.1 time: 0.946771 Oct 19 07:07:23.172382 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2029/4186] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:22 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1238 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:23.578577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:23.579348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:23.595121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:23.597675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:23.598303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:23.600278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:23.604636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:23.605335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:24.140878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:24.151052 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b6b90c0-36f6-4145-b9da-1bf35df40ffb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.576539 Oct 19 07:07:24.165996 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2158/4187] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:23 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:24.195884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:24.196651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:24.210591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:24.212010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:24.214143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:24.215155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:24.216592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:24.219949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:24.390719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-55aa07c7-0fdf-4bf5-9b84-b804d9a0f1cf req-8217cfb5-c03e-42e5-812a-3e324b10a12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ad9c08-f496-42f8-8d06-6009bd9ec758", "name": "network-vif-plugged", "status": "completed", "tag": "27ace315-328c-4c38-8778-46df3acdaf37"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:24.420741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55aa07c7-0fdf-4bf5-9b84-b804d9a0f1cf req-8217cfb5-c03e-42e5-812a-3e324b10a12b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:24.421248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55aa07c7-0fdf-4bf5-9b84-b804d9a0f1cf req-8217cfb5-c03e-42e5-812a-3e324b10a12b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:24.425805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55aa07c7-0fdf-4bf5-9b84-b804d9a0f1cf req-8217cfb5-c03e-42e5-812a-3e324b10a12b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:24.437603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:24.454560 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e425fcb3-9841-4e35-bc7a-3ffaca397d28 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1238 microversion: 2.1 time: 0.262399 Oct 19 07:07:24.458838 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2030/4188] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:24 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1238 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:24.479116 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-55aa07c7-0fdf-4bf5-9b84-b804d9a0f1cf req-8217cfb5-c03e-42e5-812a-3e324b10a12b service nova] Creating event network-vif-plugged:27ace315-328c-4c38-8778-46df3acdaf37 for instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 on n-h1-861333-10 Oct 19 07:07:24.512450 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-55aa07c7-0fdf-4bf5-9b84-b804d9a0f1cf req-8217cfb5-c03e-42e5-812a-3e324b10a12b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122951 Oct 19 07:07:24.519158 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2159/4189] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:07:25.193142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:25.193971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:25.220381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:25.221023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:25.240844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:25.245399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:25.246790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:25.247263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:25.484810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:25.490252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:25.491204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:25.503165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:25.507518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:25.516526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:25.516526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:25.516526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:25.516526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:26.101403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:26.101403 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e44c3242-4934-4780-a84f-98e522ed5dc6 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1305 microversion: 2.1 time: 0.434674 Oct 19 07:07:26.101403 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2160/4190] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:25 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1305 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:26.102848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:26.102848 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61decc32-b068-422a-870c-074f47488cdf tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.820668 Oct 19 07:07:26.102848 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2031/4191] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:25 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:26.746286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b2529821-7604-4060-9935-c6724423681a req-538afd4c-a4c3-45d3-8c4c-afce301c4277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8166ede1-9eae-4ddd-ba55-3b767c235fc3", "tag": "77292d2c-4227-43f8-9b2d-c555fbf8c91a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:26.775142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b2529821-7604-4060-9935-c6724423681a req-538afd4c-a4c3-45d3-8c4c-afce301c4277 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:26.782522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b2529821-7604-4060-9935-c6724423681a req-538afd4c-a4c3-45d3-8c4c-afce301c4277 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:26.782522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b2529821-7604-4060-9935-c6724423681a req-538afd4c-a4c3-45d3-8c4c-afce301c4277 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:26.832523 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b2529821-7604-4060-9935-c6724423681a req-538afd4c-a4c3-45d3-8c4c-afce301c4277 service nova] Creating event network-changed:77292d2c-4227-43f8-9b2d-c555fbf8c91a for instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 on n-h2-861333-10 Oct 19 07:07:26.844139 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b2529821-7604-4060-9935-c6724423681a req-538afd4c-a4c3-45d3-8c4c-afce301c4277 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101903 Oct 19 07:07:26.851923 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2161/4192] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:07:27.031308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:27.031929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:27.033791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:27.034571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:27.044846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:27.046776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:27.047270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:27.047715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:27.048456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:27.048914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:27.049343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:27.063447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:27.064189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:27.064660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:27.068762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:27.077047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:27.080503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:27.351024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:27.361694 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97d5ac41-cac4-4a5a-8696-b3f5d7e1b45c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1305 microversion: 2.1 time: 0.334444 Oct 19 07:07:27.369121 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2032/4193] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:27 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1305 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:27.983763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:28.139175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:28.143868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:28.154775 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88928f79-9689-4743-8535-817877847385 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 1.125492 Oct 19 07:07:28.162067 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2162/4194] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:27 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:28.395961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:28.396619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:28.420062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:28.420551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:28.423859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:28.424772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:28.428708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:28.433828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:29.186593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:29.187221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:29.198099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:29.202109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:29.202109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:29.202109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:29.202109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:29.202109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:29.253944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:29.264373 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-095d2a1c-f644-45a1-ba2d-4ef0eae8a826 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1305 microversion: 2.1 time: 0.872810 Oct 19 07:07:29.266022 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2033/4195] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:28 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1305 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:29.812521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:29.826358 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50a26c8b-5137-4b1d-b8d6-c14158368754 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.641019 Oct 19 07:07:29.840420 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2163/4196] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:29 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:30.292850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:30.293691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:30.308480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:30.320360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:30.322158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:30.325742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:30.327835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:30.331264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:30.854323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:30.855533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:30.868057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:30.874001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:30.874660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:30.875713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:30.879014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:30.879644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:31.010427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:31.013359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:31.030985 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1188d235-fb0c-4d26-9e07-4633d16e0dcf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1305 microversion: 2.1 time: 0.742922 Oct 19 07:07:31.031835 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2034/4197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:30 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1305 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:31.240839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:31.263762 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bccc87fe-488e-4c0d-94b9-fc58c076f0ca tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.407303 Oct 19 07:07:31.278408 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2164/4198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:30 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:32.067204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:32.068880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:32.159225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:32.168526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:32.172009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:32.176902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:32.183434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:32.189730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:32.308411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:32.312379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:32.368021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:32.373537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:32.378755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:32.384485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:32.384485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:32.384485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:32.845607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:32.881769 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-638abb61-5b5e-484e-9227-2b6a8b4e5b1b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1305 microversion: 2.1 time: 0.831420 Oct 19 07:07:32.904447 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2035/4199] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:32 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1305 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:32.985954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:32.998721 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-901afbf0-97cd-4ba7-b30b-0b8786ecb971 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.708013 Oct 19 07:07:33.013616 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2165/4200] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:32 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:33.930046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:33.930685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:33.945563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:33.946101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:33.946557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:33.947266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:33.947737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:33.948223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:34.027143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:34.027770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:34.042155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:34.042679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:34.043127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:34.050799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:34.052881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:34.053555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:34.738969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:34.747396 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-426d60d2-b2d0-4101-bc2a-0b5e8f0920fc tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.724273 Oct 19 07:07:34.766400 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2166/4201] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:34 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:34.876041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:34.897839 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-786e594b-f620-4772-9dc3-31350e61af43 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1293 microversion: 2.1 time: 0.984073 Oct 19 07:07:34.913571 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2036/4202] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:33 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1293 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:35.777783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:35.778981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:35.831664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:35.832757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:35.843803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:35.845090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:35.846880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:35.847550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:35.935730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:35.937011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:35.961674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:35.968888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:35.973150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:35.973810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:35.979165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:35.982229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:35.990532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:36.665846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:36.678040 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e64a5a07-436b-49b6-b2a1-8497d8e69343 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.906476 Oct 19 07:07:36.696057 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2167/4203] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:35 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:37.010688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:37.028706 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a60d78c-feba-495b-9a24-729d97bd2feb tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1293 microversion: 2.1 time: 1.091728 Oct 19 07:07:37.029674 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2037/4204] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:35 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1293 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:37.703701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:37.704873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:37.716356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:37.716861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:37.717313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:37.718029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:37.729081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:37.729801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:38.051716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:38.054750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:38.075575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:38.076488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:38.077169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:38.079836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:38.081952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:38.083448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:38.373938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:38.385089 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec0efb5a-df0f-4639-8c1b-4dd814f3cb14 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1293 microversion: 2.1 time: 0.337554 Oct 19 07:07:38.387620 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2038/4205] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:38 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1293 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:39.417983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:39.419838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:39.439472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:39.439865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:39.441482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:39.443301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:39.444276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:39.447025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:39.903956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:39.916079 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29851099-1574-4f31-b11b-67b048c6d633 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1293 microversion: 2.1 time: 0.503352 Oct 19 07:07:39.917335 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2039/4206] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:39 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1293 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:39.932032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:39.940842 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb795137-270c-43e8-aa14-15c86c13ad3e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 2.240966 Oct 19 07:07:39.960301 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2168/4207] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:37 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:40.945603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:40.946219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:40.963899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:40.964570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:40.968252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:40.968946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:40.969818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:40.971516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:40.972220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:40.975449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:40.981546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:40.982054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:40.989159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:40.990052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:40.990553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:40.998071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:41.488604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:41.499980 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba19f69f-cb0b-4887-b00c-970546e087cf tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1293 microversion: 2.1 time: 0.557969 Oct 19 07:07:41.501104 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2040/4208] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:40 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1293 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:41.750457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:41.763396 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8894f75a-04e9-4e72-970b-3c0d0cbd6f0e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.802653 Oct 19 07:07:41.766012 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2169/4209] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:40 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:42.527030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:42.527729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:42.547120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:42.547750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:42.548317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:42.549087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:42.555169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:42.555885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:42.794756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:42.796040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:42.820669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:42.824884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:42.826752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:42.827768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:42.831748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:42.834907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:43.205129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:43.227018 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f634b9c-a10d-406f-8608-15befd187396 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1293 microversion: 2.1 time: 0.701830 Oct 19 07:07:43.227952 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2041/4210] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:42 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1293 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:43.463394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:43.473440 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23c7d323-1eea-4d65-a3bf-fa3243db8652 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.682668 Oct 19 07:07:43.479052 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2170/4211] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:42 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:44.254208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:44.255520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:44.282986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:44.292854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:44.294425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:44.296524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:44.298608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:44.302050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:44.773319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:44.786925 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc22d1ec-b229-48c4-84b6-7bcad81ed332 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1293 microversion: 2.1 time: 0.534003 Oct 19 07:07:44.789743 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2042/4212] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:44 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1293 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:44.807381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:44.814377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:44.843833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:44.847043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:44.847043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:44.850945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:44.854521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:44.858457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:45.319808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2658ab45-5454-47b6-a39e-b28ef44019a7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'create', calling method: .version_select at 0x7f6d68a46670>, body: {"keypair": {"name": "tempest-keypair-2000869835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH5DQUVQ69gIvMOYeUZ3h6taOtRSYypyQJNoS4yz06WyX1TQ924xNoViUgM7G2SP3FFtmMszgYBGm1DnhbNQOf2dNLeqU9EZgqmmlRkGm97BxlSwAgyb/lfaXtAtZqouw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:45.334395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:45.353958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2658ab45-5454-47b6-a39e-b28ef44019a7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Getting quotas for project 1c7336f5e48c4c2ea36b25acaffdca60. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:07:45.374588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2658ab45-5454-47b6-a39e-b28ef44019a7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Getting quotas for user 9eadfbc09389478d9bbf2c3f90033135 and project 1c7336f5e48c4c2ea36b25acaffdca60. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:07:45.525603 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2658ab45-5454-47b6-a39e-b28ef44019a7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.094773 Oct 19 07:07:45.526462 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2171/4213] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 07:07:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1096 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 19 07:07:45.819074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:45.819074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:45.849463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:45.853788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:45.854572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:45.858844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:45.859598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:45.860301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:45.944749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:45.963659 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b30fea6e-9636-4134-a0db-e7b0464342c7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 1.172633 Oct 19 07:07:45.972324 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2043/4214] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:44 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:46.107970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-53e0dc18-6b04-4f36-88ba-377cf9164382 req-8d0c0e24-b29b-455a-bf06-47080c3b20d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8166ede1-9eae-4ddd-ba55-3b767c235fc3", "name": "network-vif-plugged", "status": "completed", "tag": "77292d2c-4227-43f8-9b2d-c555fbf8c91a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:46.126816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53e0dc18-6b04-4f36-88ba-377cf9164382 req-8d0c0e24-b29b-455a-bf06-47080c3b20d4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:46.130261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53e0dc18-6b04-4f36-88ba-377cf9164382 req-8d0c0e24-b29b-455a-bf06-47080c3b20d4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:46.131869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53e0dc18-6b04-4f36-88ba-377cf9164382 req-8d0c0e24-b29b-455a-bf06-47080c3b20d4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:46.168684 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-53e0dc18-6b04-4f36-88ba-377cf9164382 req-8d0c0e24-b29b-455a-bf06-47080c3b20d4 service nova] Creating event network-vif-plugged:77292d2c-4227-43f8-9b2d-c555fbf8c91a for instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 on n-h2-861333-10 Oct 19 07:07:46.183873 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-53e0dc18-6b04-4f36-88ba-377cf9164382 req-8d0c0e24-b29b-455a-bf06-47080c3b20d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077346 Oct 19 07:07:46.184803 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2044/4215] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:07:46.674169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:46.682685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-516fffd7-8b1a-411b-ba70-071484944222 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1293 microversion: 2.1 time: 0.871326 Oct 19 07:07:46.695363 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2172/4216] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:45 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1293 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:46.994504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:46.995352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:47.010079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:47.011442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:47.020357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:47.021554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:47.022249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:47.023194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:47.498218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:47.510722 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb365c4f-9f33-4d25-a741-2ed65f73a105 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1525 microversion: 2.1 time: 0.521591 Oct 19 07:07:47.511652 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2045/4217] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:46 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1525 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:47.724946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:47.726300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:47.756461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:47.757274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:47.762163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:47.762613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:47.763479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:47.766239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:48.220486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:48.229253 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5f53681-28b1-4110-9e26-be677260e395 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1293 microversion: 2.1 time: 0.510205 Oct 19 07:07:48.229864 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2173/4218] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:47 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1293 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:48.537437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:48.538068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:48.553330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:48.554103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:48.554723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:48.560833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:48.561574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:48.562215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:49.254288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:49.256857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:49.264609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:49.265630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:49.266221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:49.267080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:49.270254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:49.270927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:49.600566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:49.609077 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-982c19d5-6c43-41cf-ae8b-2292e7c0a883 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1507 microversion: 2.1 time: 1.076095 Oct 19 07:07:49.614629 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2046/4219] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:48 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1507 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:49.760830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:49.772185 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6fbf846-cad8-4095-b490-692c9a12b37b tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1485 microversion: 2.1 time: 0.522200 Oct 19 07:07:49.773353 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2174/4220] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:49 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1485 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:49.796532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8c44c2c-a22d-4c81-9d6a-e90668d028e3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:49.797491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8c44c2c-a22d-4c81-9d6a-e90668d028e3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:49.809632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c44c2c-a22d-4c81-9d6a-e90668d028e3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:49.810566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c44c2c-a22d-4c81-9d6a-e90668d028e3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:49.811209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c44c2c-a22d-4c81-9d6a-e90668d028e3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:49.812127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c44c2c-a22d-4c81-9d6a-e90668d028e3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:49.812761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c44c2c-a22d-4c81-9d6a-e90668d028e3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:49.813948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8c44c2c-a22d-4c81-9d6a-e90668d028e3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:50.550706 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8c44c2c-a22d-4c81-9d6a-e90668d028e3 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.759251 Oct 19 07:07:50.551532 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2047/4221] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:07:49 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3/os-interface => generated 285 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:07:50.641691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:50.643078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:50.657156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:50.658348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:50.661607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:50.664145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:50.664851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:50.665317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:51.271389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99d8260b-f056-4406-af0f-c57d11e34a6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:51.274219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99d8260b-f056-4406-af0f-c57d11e34a6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:51.288322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d8260b-f056-4406-af0f-c57d11e34a6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:51.290201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d8260b-f056-4406-af0f-c57d11e34a6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:51.290944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d8260b-f056-4406-af0f-c57d11e34a6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:51.292711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d8260b-f056-4406-af0f-c57d11e34a6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:51.293626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d8260b-f056-4406-af0f-c57d11e34a6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:51.294641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d8260b-f056-4406-af0f-c57d11e34a6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:51.334427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:51.349770 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5860949a-ea4c-4c4e-b8c6-b6493ecdc8ea tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1507 microversion: 2.1 time: 0.712713 Oct 19 07:07:51.368606 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2175/4222] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:50 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1507 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:51.700225 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99d8260b-f056-4406-af0f-c57d11e34a6b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.429904 Oct 19 07:07:51.700225 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2048/4223] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:07:51 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:07:51.706152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:51.707321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:51.714909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:51.715663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:51.716317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:51.717410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:51.718068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:51.718696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:52.068295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:52.083498 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ade60447-343a-4bef-9eec-4114b111a7dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1672 microversion: 2.1 time: 0.381134 Oct 19 07:07:52.085270 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2176/4224] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:51 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1672 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:52.384472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:52.384472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:52.388376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:52.389193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:52.390054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:52.391046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:52.391509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:52.391940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:52.795652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:52.822721 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-922c1940-4d08-4a2c-827b-cb2678e65046 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1507 microversion: 2.1 time: 0.447935 Oct 19 07:07:52.824634 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2049/4225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:52 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1507 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:07:53.136851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:53.139267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:53.167919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:53.167919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:53.167919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:53.171751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:53.172543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:53.175149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:53.181609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1361042591", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4b02963-15b9-49b5-82cd-ae709303ad6c"}], "security_groups": [{"name": "tempest-securitygroup--420586037"}], "key_name": "tempest-keypair-2000869835", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:53.525634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:53.537825 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c8fa938-7307-48ab-bc0a-79a9e78122f3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1672 microversion: 2.1 time: 0.430598 Oct 19 07:07:53.539179 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2177/4226] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:53 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1672 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:53.681723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] validate_networks() for [('a4b02963-15b9-49b5-82cd-ae709303ad6c', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:07:53.846104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:53.847269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:53.866132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:53.866540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:53.866994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:53.878508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:53.880311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:53.880908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:54.258567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:54.266929 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ebe99cc-f1e0-4968-a495-c1ea3c2de7fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1507 microversion: 2.1 time: 0.424807 Oct 19 07:07:54.267523 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2178/4227] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:53 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:54.276585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7e0f1263-f553-4b55-8a3e-d55369d84c27 req-b311c66f-adf2-4650-be0d-1ba12b164d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ad9c08-f496-42f8-8d06-6009bd9ec758", "name": "network-vif-unplugged", "status": "completed", "tag": "27ace315-328c-4c38-8778-46df3acdaf37"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:54.310129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7e0f1263-f553-4b55-8a3e-d55369d84c27 req-b311c66f-adf2-4650-be0d-1ba12b164d70 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:54.310946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7e0f1263-f553-4b55-8a3e-d55369d84c27 req-b311c66f-adf2-4650-be0d-1ba12b164d70 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:54.311538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7e0f1263-f553-4b55-8a3e-d55369d84c27 req-b311c66f-adf2-4650-be0d-1ba12b164d70 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:54.348462 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7e0f1263-f553-4b55-8a3e-d55369d84c27 req-b311c66f-adf2-4650-be0d-1ba12b164d70 service nova] Creating event network-vif-unplugged:27ace315-328c-4c38-8778-46df3acdaf37 for instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 on n-h1-861333-10 Oct 19 07:07:54.362939 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7e0f1263-f553-4b55-8a3e-d55369d84c27 req-b311c66f-adf2-4650-be0d-1ba12b164d70 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087831 Oct 19 07:07:54.365464 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2179/4228] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:07:54.564372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:54.565781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:54.584485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:54.584485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:54.584485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:54.584485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:54.584828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:54.585184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:54.912992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:54.928161 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af0dfbd2-5907-44b8-a303-8914bf6ace87 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1485 microversion: 2.1 time: 0.368174 Oct 19 07:07:54.930941 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2180/4229] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:54 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1485 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:54.950870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:54.953034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:54.965824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:54.966542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:54.967338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:54.969599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:54.970263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:54.974378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:54.983597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:55.317900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:55.332613 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5a9544d-9a4f-4bfb-9ca3-71cb66412b52 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1672 microversion: 2.1 time: 0.400371 Oct 19 07:07:55.333275 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2181/4230] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:54 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1672 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:55.351050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-33cc8205-d747-4214-96a4-928a0f15678f req-3f4e6693-f9e9-4532-8ad5-6e3694b491a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8166ede1-9eae-4ddd-ba55-3b767c235fc3", "tag": "77292d2c-4227-43f8-9b2d-c555fbf8c91a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:07:55.368905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-33cc8205-d747-4214-96a4-928a0f15678f req-3f4e6693-f9e9-4532-8ad5-6e3694b491a0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:55.369639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-33cc8205-d747-4214-96a4-928a0f15678f req-3f4e6693-f9e9-4532-8ad5-6e3694b491a0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:55.370234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-33cc8205-d747-4214-96a4-928a0f15678f req-3f4e6693-f9e9-4532-8ad5-6e3694b491a0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:55.391769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:55.399103 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-33cc8205-d747-4214-96a4-928a0f15678f req-3f4e6693-f9e9-4532-8ad5-6e3694b491a0 service nova] Creating event network-changed:77292d2c-4227-43f8-9b2d-c555fbf8c91a for instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 on n-h2-861333-10 Oct 19 07:07:55.418758 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-33cc8205-d747-4214-96a4-928a0f15678f req-3f4e6693-f9e9-4532-8ad5-6e3694b491a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078329 Oct 19 07:07:55.421252 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2182/4231] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:07:55.430890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:55.438954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:55.468821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:55.469383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:55.469831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:55.477254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:55.477943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:55.478406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:56.003458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:07:56.003993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:07:56.004466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:07:56.009226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:07:56.009226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:07:56.026975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:56.028839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:56.029890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:56.032496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:56.033137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:56.035540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:56.093889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Getting quotas for project 1c7336f5e48c4c2ea36b25acaffdca60. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:07:56.112944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Getting quotas for user 9eadfbc09389478d9bbf2c3f90033135 and project 1c7336f5e48c4c2ea36b25acaffdca60. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:07:56.141056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:07:56.145355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:07:56.295498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:56.298448 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5d4c21f-e4be-4930-aa7a-8f14c45353e9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.121286 Oct 19 07:07:56.303060 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2050/4232] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 07:07:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 3126 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 07:07:56.311628 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8b7d4f2-353b-4c22-9a28-ac0d905b0255 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 200 len: 1510 microversion: 2.1 time: 0.888991 Oct 19 07:07:56.312232 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2183/4233] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:55 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 1510 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:56.316238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8075455d-c2c6-4de8-b68c-873166560d0c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:56.320969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8075455d-c2c6-4de8-b68c-873166560d0c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:56.356405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:56.371929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:56.392411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:56.393245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:56.393906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:56.394848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:56.396913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:56.398841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:56.458676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:07:56.478270 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.compute.api [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Working on deleting snapshot 658483c0-8199-440a-8dbe-6d0d0efb87b1 from shelved instance... Oct 19 07:07:56.535524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8075455d-c2c6-4de8-b68c-873166560d0c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:56.547663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8075455d-c2c6-4de8-b68c-873166560d0c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:56.548530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8075455d-c2c6-4de8-b68c-873166560d0c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:56.549993 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8075455d-c2c6-4de8-b68c-873166560d0c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1282 microversion: 2.20 time: 0.239498 Oct 19 07:07:56.550612 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2051/4234] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:07:56 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1282 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:07:56.579815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:56.580432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:56.617520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:56.618150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:56.620225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:56.621136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:56.621540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:56.621987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:57.174993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:57.199972 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3885de5f-bef0-4508-97f2-92049f2d184a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1672 microversion: 2.1 time: 0.639807 Oct 19 07:07:57.231708 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2052/4235] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:56 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1672 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:57.579199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2934246-dd5b-4a99-8bdb-e5ebb752a594 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:57.579985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2934246-dd5b-4a99-8bdb-e5ebb752a594 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:57.695149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c2934246-dd5b-4a99-8bdb-e5ebb752a594 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:57.728830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c2934246-dd5b-4a99-8bdb-e5ebb752a594 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:57.738920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c2934246-dd5b-4a99-8bdb-e5ebb752a594 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:57.740491 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2934246-dd5b-4a99-8bdb-e5ebb752a594 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1282 microversion: 2.20 time: 0.165550 Oct 19 07:07:57.741238 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2053/4236] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:07:57 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:07:58.277654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:58.311155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:58.359919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:58.360760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:58.361365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:58.362285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:58.362907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:58.363512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:58.405781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:07:58.580332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:58.605823 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38eda598-a69c-4dab-9953-f037d9176b5d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1677 microversion: 2.1 time: 0.351188 Oct 19 07:07:58.613686 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2054/4237] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:58 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1677 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:07:58.771708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:58.772552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:58.796820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Doing local delete in cell 2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) {{(pid=127567) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 19 07:07:58.799607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:58.801363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:58.803804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:58.804416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:58.805110 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.compute.api [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 19 07:07:58.805877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:58.807384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:58.814331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:58.814890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:58.815399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:58.824845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] deallocate_for_instance() {{(pid=127567) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 19 07:07:58.917832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:58.927405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:58.929976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:07:58.932378 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e36a8abf-0720-49ea-a0fa-f174fe6ae405 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1286 microversion: 2.20 time: 0.165118 Oct 19 07:07:58.933432 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2055/4238] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:07:58 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:07:59.630714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:07:59.632422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:07:59.653999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:59.655322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:59.655786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:07:59.656577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:07:59.662400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:07:59.665107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:00.640823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:00.653335 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7b59a30-e4fc-4bcf-8e99-955178f8349d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 1.027483 Oct 19 07:08:00.655083 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2056/4239] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:07:59 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:08:00.660910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:00.661812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:00.678199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:00.678531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:00.679015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:00.679763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:00.680245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:00.680877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:00.780535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:00.793823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:00.797023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:00.798498 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-80689041-02a9-4177-896f-6c0a92ce5b53 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1340 microversion: 2.20 time: 0.142142 Oct 19 07:08:00.804747 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2057/4240] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:00 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1340 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:08:01.459174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Updating instance_info_cache with network_info: [] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 07:08:01.536075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ce63a7ac-efec-4efe-a604-d79946e04840 req-cfd7949d-f7d4-491b-8a63-7c538786be1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ad9c08-f496-42f8-8d06-6009bd9ec758", "name": "network-vif-deleted", "tag": "27ace315-328c-4c38-8778-46df3acdaf37"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:01.546248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ce63a7ac-efec-4efe-a604-d79946e04840 req-cfd7949d-f7d4-491b-8a63-7c538786be1f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:01.547093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ce63a7ac-efec-4efe-a604-d79946e04840 req-cfd7949d-f7d4-491b-8a63-7c538786be1f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:01.547691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ce63a7ac-efec-4efe-a604-d79946e04840 req-cfd7949d-f7d4-491b-8a63-7c538786be1f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:01.561480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.server_external_events [req-ce63a7ac-efec-4efe-a604-d79946e04840 req-cfd7949d-f7d4-491b-8a63-7c538786be1f service nova] Unable to find a host for instance c5ad9c08-f496-42f8-8d06-6009bd9ec758. Dropping event network-vif-deleted {{(pid=127568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 07:08:01.562694 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ce63a7ac-efec-4efe-a604-d79946e04840 req-cfd7949d-f7d4-491b-8a63-7c538786be1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.192123 Oct 19 07:08:01.563462 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2058/4241] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 193 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 19 07:08:01.833088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:01.833945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:01.843708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:01.844272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:01.847298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:01.849949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:01.851434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:01.851884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:02.449219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:02.461702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:02.470175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:02.483086 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d50fb75a-f820-4489-8f83-19e645e8333c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1407 microversion: 2.20 time: 0.640103 Oct 19 07:08:02.484631 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2059/4242] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:01 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1407 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:08:02.500517 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29c6d755-00d5-4b22-afcf-ad47fbc3ad35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 204 len: 0 microversion: 2.1 time: 6.158405 Oct 19 07:08:02.501293 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2184/4243] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:07:56 2022] DELETE /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 0 bytes in 6160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:08:02.509814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:02.510440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:02.518801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:02.519530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:02.520142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:02.521039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:02.521674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:02.522260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:02.539071 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 HTTP/1.1 Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'c5ad9c08-f496-42f8-8d06-6009bd9ec758'} Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:08:02.541175 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:08:02.547217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:08:02.547217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:08:02.547217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:08:02.547217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:08:02.547217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:08:02.547217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:08:02.547217 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:08:02.547217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:08:02.547217 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4901a19a-f0c5-46aa-84d0-4e5e16409e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 404 len: 111 microversion: 2.1 time: 0.036883 Oct 19 07:08:02.548075 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2060/4244] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:02 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:08:02.750350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-586810942", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "737f0953-92be-4377-a7d8-73cd2ce52ac7"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:02.876209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] validate_networks() for [('737f0953-92be-4377-a7d8-73cd2ce52ac7', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:08:03.519779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:03.520435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:03.535199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:03.537358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:03.537845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:03.538584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:03.539054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:03.540371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:04.013019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:08:04.013019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:08:04.013482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:08:04.014452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:08:04.014452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:08:04.027112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:04.027866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:04.028493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:04.029371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:04.030042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:04.030626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:04.051744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:08:04.059654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for user 44114105ac6d4e1daf262bbd4b212f5e and project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:08:04.078399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:08:04.081661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:08:04.234006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:04.241168 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d128bd24-0387-44a5-a465-bea97a98e9aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.494784 Oct 19 07:08:04.246436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:04.254936 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2185/4245] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:08:04.260440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:04.262841 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35f3b778-375c-49c0-a647-731330cff93c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1407 microversion: 2.20 time: 0.755871 Oct 19 07:08:04.264759 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2061/4246] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:03 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1407 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:08:04.267602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f69b7b61-1459-43be-9f1c-0e52172637d6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:04.268998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f69b7b61-1459-43be-9f1c-0e52172637d6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:04.417777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f69b7b61-1459-43be-9f1c-0e52172637d6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:04.430786 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f69b7b61-1459-43be-9f1c-0e52172637d6 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1214 microversion: 2.1 time: 0.173197 Oct 19 07:08:04.444819 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2186/4247] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:04 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:05.048648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-151f3717-984a-42a7-bd4c-e0ddda162b2e req-f1c60a5b-c59b-4f81-bf5d-9a266beddca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf", "tag": "d36dab0c-9d83-4aa8-b6bb-531eafbf58f6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:05.062922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-151f3717-984a-42a7-bd4c-e0ddda162b2e req-f1c60a5b-c59b-4f81-bf5d-9a266beddca4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:05.070294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-151f3717-984a-42a7-bd4c-e0ddda162b2e req-f1c60a5b-c59b-4f81-bf5d-9a266beddca4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:05.071078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-151f3717-984a-42a7-bd4c-e0ddda162b2e req-f1c60a5b-c59b-4f81-bf5d-9a266beddca4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:05.094249 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-151f3717-984a-42a7-bd4c-e0ddda162b2e req-f1c60a5b-c59b-4f81-bf5d-9a266beddca4 service nova] Creating event network-changed:d36dab0c-9d83-4aa8-b6bb-531eafbf58f6 for instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf on n-h1-861333-10 Oct 19 07:08:05.099179 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-151f3717-984a-42a7-bd4c-e0ddda162b2e req-f1c60a5b-c59b-4f81-bf5d-9a266beddca4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054110 Oct 19 07:08:05.100455 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2062/4248] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:08:05.292153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:05.293321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:05.307558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:05.308721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:05.309317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:05.320857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:05.321380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:05.321844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:05.461390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd477175-e844-4203-bf65-4345acea4c59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:05.464402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd477175-e844-4203-bf65-4345acea4c59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:05.700371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd477175-e844-4203-bf65-4345acea4c59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:05.713305 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd477175-e844-4203-bf65-4345acea4c59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1214 microversion: 2.1 time: 0.258889 Oct 19 07:08:05.717094 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2063/4249] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:05 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1214 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:05.816008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:05.847978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:05.850614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:05.869269 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8701176d-d88f-4dd2-a761-6e41bb0717d0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1407 microversion: 2.20 time: 0.580856 Oct 19 07:08:05.875704 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2187/4250] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:05 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1407 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:08:06.754652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:06.755577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:06.770143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:06.772879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:06.777899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:06.779165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:06.781614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:06.782249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:06.782855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:06.902199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:06.902199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:06.911893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:06.913600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:06.914286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:06.915242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:06.924261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:06.925477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:07.071214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:07.085723 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e55699bb-1657-45ba-be98-bed9622c7153 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1266 microversion: 2.1 time: 0.345181 Oct 19 07:08:07.089641 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2064/4251] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:06 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:07.323523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:07.335937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:07.340888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:07.343163 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3071331a-c340-45da-a19e-2dcac77a6e35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1407 microversion: 2.20 time: 0.446048 Oct 19 07:08:07.354487 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2188/4252] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:06 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:08:08.118040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:08.118673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:08.131145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:08.133367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:08.134865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:08.135743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:08.136873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:08.137687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:08.138409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:08.377904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:08.387923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:08.403437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:08.405280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:08.408857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:08.410776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:08.411416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:08.412015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:08.575851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:08.591778 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce5016cb-c20f-41d3-9a22-bba788517fb4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1272 microversion: 2.1 time: 0.479577 Oct 19 07:08:08.593029 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2065/4253] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:08 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1272 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:08.883101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:08.895463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:08.898924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:08.900147 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-592c0602-536e-4709-bddf-59eae06f261d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1407 microversion: 2.20 time: 0.526459 Oct 19 07:08:08.904191 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2189/4254] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:08 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:08:09.617113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:09.617802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:09.625853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:09.630824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:09.631513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:09.632856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:09.633599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:09.634910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:09.931512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:09.932179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:09.960129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:09.962770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:09.962770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:09.962770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:09.962770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:09.963227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:10.225895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:10.240170 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e93023a-b1fd-4339-98d8-853421e82d4a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1314 microversion: 2.1 time: 0.627012 Oct 19 07:08:10.241559 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2066/4255] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:09 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:10.396654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:10.415788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:10.419570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:10.421679 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab19ea28-7fca-4cea-9c15-8254c23a05f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1407 microversion: 2.20 time: 0.494411 Oct 19 07:08:10.441412 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2190/4256] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:09 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:08:10.618534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-31bc9880-f6e5-495b-8c2b-62a2e4863dd3 req-91a57197-566b-470f-adff-414ab28896e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c24e3e8-564b-442b-bc22-8bba1eb12244", "tag": "9e661941-b69e-4b58-b3be-1b2269092116"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:10.634243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-31bc9880-f6e5-495b-8c2b-62a2e4863dd3 req-91a57197-566b-470f-adff-414ab28896e5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:10.636346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-31bc9880-f6e5-495b-8c2b-62a2e4863dd3 req-91a57197-566b-470f-adff-414ab28896e5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:10.636346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-31bc9880-f6e5-495b-8c2b-62a2e4863dd3 req-91a57197-566b-470f-adff-414ab28896e5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:10.650601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-31bc9880-f6e5-495b-8c2b-62a2e4863dd3 req-91a57197-566b-470f-adff-414ab28896e5 service nova] Creating event network-changed:9e661941-b69e-4b58-b3be-1b2269092116 for instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 on n-h2-861333-10 Oct 19 07:08:10.656515 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-31bc9880-f6e5-495b-8c2b-62a2e4863dd3 req-91a57197-566b-470f-adff-414ab28896e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041686 Oct 19 07:08:10.658059 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2067/4257] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:08:11.274114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:11.275216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:11.286640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:11.287368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:11.288016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:11.288991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:11.289605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:11.290193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:11.452886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:11.453839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:11.461360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:11.462020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:11.462681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:11.463547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:11.464027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:11.464650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:11.626552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:11.637684 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2be763de-e165-458d-9392-3c3ecb999426 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1314 microversion: 2.1 time: 0.375909 Oct 19 07:08:11.638454 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2191/4258] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:11 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:12.168654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:12.182751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:12.203763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:12.203763 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb6935b7-d2ff-4a1b-8d58-696ebc620a94 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1407 microversion: 2.20 time: 0.750190 Oct 19 07:08:12.203763 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2068/4259] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:11 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1407 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:08:12.661534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:12.662874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:12.680842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:12.681993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:12.682754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:12.684355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:12.685434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:12.686394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:12.994737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:13.004477 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ef52e7b-b431-433c-bd84-8986a8d1b31a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1314 microversion: 2.1 time: 0.347305 Oct 19 07:08:13.005086 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2192/4260] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:12 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:13.238877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:13.239594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:13.252558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:13.252558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:13.252558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:13.253606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:13.253606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:13.254027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:13.727867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:13.742188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:13.743704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:13.744984 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22192eea-1573-4f38-acbc-74826ec5fe08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1407 microversion: 2.20 time: 0.517676 Oct 19 07:08:13.746312 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2069/4261] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:13 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:08:14.028552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:14.029184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:14.036437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:14.037263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:14.038463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:14.039372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:14.040059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:14.042010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:14.042010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:14.224697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d6cc6ebe-d522-4ae6-aa63-8978d54a862c req-861ed204-486a-4966-acff-b963b85bad76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf", "name": "network-vif-plugged", "status": "completed", "tag": "d36dab0c-9d83-4aa8-b6bb-531eafbf58f6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:14.246078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d6cc6ebe-d522-4ae6-aa63-8978d54a862c req-861ed204-486a-4966-acff-b963b85bad76 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:14.246729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d6cc6ebe-d522-4ae6-aa63-8978d54a862c req-861ed204-486a-4966-acff-b963b85bad76 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:14.246979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d6cc6ebe-d522-4ae6-aa63-8978d54a862c req-861ed204-486a-4966-acff-b963b85bad76 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:14.279199 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d6cc6ebe-d522-4ae6-aa63-8978d54a862c req-861ed204-486a-4966-acff-b963b85bad76 service nova] Creating event network-vif-plugged:d36dab0c-9d83-4aa8-b6bb-531eafbf58f6 for instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf on n-h1-861333-10 Oct 19 07:08:14.290945 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d6cc6ebe-d522-4ae6-aa63-8978d54a862c req-861ed204-486a-4966-acff-b963b85bad76 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070243 Oct 19 07:08:14.292610 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2070/4262] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:08:14.317840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:14.323004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:14.362318 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8644aaeb-0323-4337-93a8-adfdb11d235c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1314 microversion: 2.1 time: 0.308373 Oct 19 07:08:14.370878 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2193/4263] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:14 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:14.777521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:14.778415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:14.796485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:14.796989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:14.797439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:14.798160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:14.798625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:14.799059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:15.395497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:15.396280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:15.400287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:15.406105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:15.407292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:15.407292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:15.407787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:15.408287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:15.408915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:15.523590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:15.535979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:15.539537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:15.541985 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e251e3c7-ff63-497f-9259-6fc949659e6d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1407 microversion: 2.20 time: 0.770047 Oct 19 07:08:15.543209 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2071/4264] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:14 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1407 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:08:15.677764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:15.691980 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae5ef183-98a5-4b17-9d8f-879184d8fb8d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1314 microversion: 2.1 time: 0.300835 Oct 19 07:08:15.692614 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2194/4265] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:15 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:08:16.567754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:16.568395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:16.573915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:16.576771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:16.577171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:16.577612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:16.578327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:16.578979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:16.579294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:16.717251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:16.717950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:16.733842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:16.735401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:16.736126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:16.736649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:16.737978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:16.738509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:16.739008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:16.953104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:16.961894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:16.963764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:16.965277 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-997f4233-dadb-4f0e-89dc-df24ef883534 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1599 microversion: 2.20 time: 0.402154 Oct 19 07:08:16.966429 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2072/4266] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:08:16 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1599 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:08:16.999862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c77cfbe4-0f70-432f-a780-cfc257001869 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:17.000245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:17.003898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c77cfbe4-0f70-432f-a780-cfc257001869 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:17.014150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c77cfbe4-0f70-432f-a780-cfc257001869 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:17.015323 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d09e8365-de20-4fb3-94e8-96a064dd1dfb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1314 microversion: 2.1 time: 0.302274 Oct 19 07:08:17.035688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c77cfbe4-0f70-432f-a780-cfc257001869 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:17.035688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c77cfbe4-0f70-432f-a780-cfc257001869 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:17.035688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c77cfbe4-0f70-432f-a780-cfc257001869 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:17.035688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c77cfbe4-0f70-432f-a780-cfc257001869 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:17.035688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c77cfbe4-0f70-432f-a780-cfc257001869 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:17.036594 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2195/4267] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:16 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:08:17.211907 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c77cfbe4-0f70-432f-a780-cfc257001869 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.215573 Oct 19 07:08:17.223654 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2073/4268] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Oct 19 07:08:16 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-interface => generated 285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:08:17.518087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-08c1845b-17d2-4ef6-957c-7644d598f30d req-4e5c92c9-d70a-498c-94d8-789f2db1db3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c24e3e8-564b-442b-bc22-8bba1eb12244", "name": "network-vif-plugged", "status": "completed", "tag": "9e661941-b69e-4b58-b3be-1b2269092116"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:17.538886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08c1845b-17d2-4ef6-957c-7644d598f30d req-4e5c92c9-d70a-498c-94d8-789f2db1db3e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:17.538886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08c1845b-17d2-4ef6-957c-7644d598f30d req-4e5c92c9-d70a-498c-94d8-789f2db1db3e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:17.538886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08c1845b-17d2-4ef6-957c-7644d598f30d req-4e5c92c9-d70a-498c-94d8-789f2db1db3e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:17.557084 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-08c1845b-17d2-4ef6-957c-7644d598f30d req-4e5c92c9-d70a-498c-94d8-789f2db1db3e service nova] Creating event network-vif-plugged:9e661941-b69e-4b58-b3be-1b2269092116 for instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 on n-h2-861333-10 Oct 19 07:08:17.572706 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-08c1845b-17d2-4ef6-957c-7644d598f30d req-4e5c92c9-d70a-498c-94d8-789f2db1db3e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058737 Oct 19 07:08:17.573749 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2196/4269] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:08:18.044838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:18.046118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:18.054051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:18.054919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:18.055555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:18.056414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:18.057089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:18.057754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:18.803648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:18.815362 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31940f45-00fd-41c5-a90d-33b5eda0259f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1314 microversion: 2.1 time: 0.775604 Oct 19 07:08:18.816713 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2074/4270] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:18 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1314 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:19.844444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:19.846202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:19.855008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:19.855500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:19.855941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:19.856675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:19.857131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:19.857561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:20.566069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:20.576444 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89dec1cb-8554-4c18-87d1-8246afece6a4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1502 microversion: 2.1 time: 0.737701 Oct 19 07:08:20.580599 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2197/4271] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:19 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1502 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:20.599013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b34ab4d0-c85e-4dc7-8899-7731f4c79804 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:20.605961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b34ab4d0-c85e-4dc7-8899-7731f4c79804 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:20.606469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b34ab4d0-c85e-4dc7-8899-7731f4c79804 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:20.607077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b34ab4d0-c85e-4dc7-8899-7731f4c79804 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:20.621717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:20.632494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b34ab4d0-c85e-4dc7-8899-7731f4c79804 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 07:08:20.852571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1cea4dbb-f94c-45ae-bcc1-b88d60bc97ad req-84f01100-7108-40b3-b02f-6e10db8bc7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf", "tag": "d36dab0c-9d83-4aa8-b6bb-531eafbf58f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:20.873309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1cea4dbb-f94c-45ae-bcc1-b88d60bc97ad req-84f01100-7108-40b3-b02f-6e10db8bc7f3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:20.874675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1cea4dbb-f94c-45ae-bcc1-b88d60bc97ad req-84f01100-7108-40b3-b02f-6e10db8bc7f3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:20.876154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1cea4dbb-f94c-45ae-bcc1-b88d60bc97ad req-84f01100-7108-40b3-b02f-6e10db8bc7f3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:20.888170 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b34ab4d0-c85e-4dc7-8899-7731f4c79804 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244/action" status: 202 len: 0 microversion: 2.1 time: 0.292671 Oct 19 07:08:20.888945 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2075/4272] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:08:20 2022] POST /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:08:20.911093 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1cea4dbb-f94c-45ae-bcc1-b88d60bc97ad req-84f01100-7108-40b3-b02f-6e10db8bc7f3 service nova] Creating event network-changed:d36dab0c-9d83-4aa8-b6bb-531eafbf58f6 for instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf on n-h1-861333-10 Oct 19 07:08:20.916382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:20.923625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:20.926408 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1cea4dbb-f94c-45ae-bcc1-b88d60bc97ad req-84f01100-7108-40b3-b02f-6e10db8bc7f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077976 Oct 19 07:08:20.929422 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2198/4273] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:08:20.950564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:20.951063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:20.951580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:20.952300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:20.953406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:20.953918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:21.486136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:21.502530 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73439386-dfb6-4c5c-861d-1ce5fb650a32 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.596038 Oct 19 07:08:21.504002 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2076/4274] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:20 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:22.531077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:22.532434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:22.546534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:22.547308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:22.548163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:22.549068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:22.550418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:22.551124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:22.949507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:22.963104 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37eb35b7-f556-47e0-971b-0825834a77df tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.439713 Oct 19 07:08:22.964028 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2199/4275] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:22 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:23.988669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:23.989437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:23.997995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:23.998495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:23.998943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:23.999655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:24.000189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:24.000586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:24.327950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:24.341581 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fcc2c3f0-cf18-44f4-8aef-691f61b28c95 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.357006 Oct 19 07:08:24.342291 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2077/4276] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:23 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:25.365034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:25.366251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:25.373988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:25.374784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:25.375448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:25.376541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:25.377085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:25.378372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:26.024801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:26.037618 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a968567-d418-4d27-bf77-32d9be56d9fd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.676368 Oct 19 07:08:26.052523 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2200/4277] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:25 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:27.066446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:27.068285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:27.085922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:27.087487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:27.093293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:27.093293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:27.093293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:27.093293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:27.762278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:27.770984 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70abb60e-6603-478f-8b80-762ac28b1e1b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.709335 Oct 19 07:08:27.785446 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2078/4278] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:27 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:28.796215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:28.796831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:28.803846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:28.804388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:28.804828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:28.805529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:28.806156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:28.806587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:29.134397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:29.143949 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc87aaa7-b712-4c39-bf27-4f5bb152c833 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.351573 Oct 19 07:08:29.156284 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2201/4279] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:28 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:30.181572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:30.182198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:30.193712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:30.194216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:30.199601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:30.200997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:30.201502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:30.201957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:30.492885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:30.501935 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf823129-6a6b-4d93-b1f8-333188fca621 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.325077 Oct 19 07:08:30.506416 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2079/4280] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:30 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:31.526759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:31.527727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:31.542421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:31.546198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:31.546198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:31.546198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:31.547065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:31.549558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:31.871773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:31.881305 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b55f7e8-f94b-46e8-aaa4-67ec869fda38 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.358918 Oct 19 07:08:31.886169 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2202/4281] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:31 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:32.750296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:32.751358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:32.760036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:32.769304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:32.770068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:32.771223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:32.771903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:32.772363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:32.912667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:32.914027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:32.925653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:32.926519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:32.927817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:32.931723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:32.931723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:32.931723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:33.149410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:33.164344 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7537fe8b-c898-40cc-be9d-fdfb36c1c8dd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.415347 Oct 19 07:08:33.181086 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2080/4282] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:32 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:33.210850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:33.225101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:33.253119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:33.256887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:33.257648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:33.260890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:33.261717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:33.262047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:33.263542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:33.272497 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2f20596-bd80-4ccb-a148-001b62e11817 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.362366 Oct 19 07:08:33.273773 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2203/4283] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:32 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:08:33.566824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:33.576825 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0374f85d-21b2-44bd-9fb7-e661be4af7a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.373646 Oct 19 07:08:33.578887 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2081/4284] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:33 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:33.600301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:33.604884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:33.610646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:33.611403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:33.612134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:33.613093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:33.615093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:33.616024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:33.759330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:33.768044 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a003072-18ba-439f-b492-8fb8ad1c038b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.171557 Oct 19 07:08:33.769226 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2204/4285] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:33 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:33.795863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:33.796776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:33.809068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:33.809613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:33.810080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:33.810779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:33.811247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:33.813755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:34.093266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:34.110617 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28d79718-0af9-4219-a745-98d6538f51c3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.316338 Oct 19 07:08:34.111911 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2082/4286] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:33 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:34.297149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:34.298372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:34.311004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:34.316536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:34.316536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:34.316536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:34.316536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:34.318868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:34.335082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2118204477", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "6982a92b-3116-4178-8c1d-06fbcd358c52"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:34.427904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] validate_networks() for [('6982a92b-3116-4178-8c1d-06fbcd358c52', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:08:34.552778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:34.561189 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b720ce04-7949-4bb3-b552-52ca4f031d05 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.268519 Oct 19 07:08:34.561832 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2205/4287] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:34 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:35.321689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:08:35.328611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:08:35.330749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:08:35.332583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:08:35.335282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:08:35.369805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:35.373267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:35.373760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:35.374541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:35.375031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:35.375451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:35.430229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:08:35.437008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for user 2543970e80c84e109961fc84bfaaedd1 and project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:08:35.453186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:08:35.460585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:08:35.586249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:35.587096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:35.594256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:35.594863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:35.595382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:35.596204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:35.597340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:35.597779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:35.704313 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a6a375d-9014-4ac1-95fb-eb525cb7a103 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364541 Oct 19 07:08:35.704313 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2083/4288] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:08:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 07:08:35.721880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87b35559-3538-453f-978c-295e944b7d07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:35.722145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87b35559-3538-453f-978c-295e944b7d07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:35.966491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:35.996132 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-feb38836-e18a-4e49-9917-69ed0802d192 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.399682 Oct 19 07:08:35.996132 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2206/4289] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:35 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:08:36.183317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87b35559-3538-453f-978c-295e944b7d07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:36.195068 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87b35559-3538-453f-978c-295e944b7d07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1215 microversion: 2.1 time: 0.490131 Oct 19 07:08:36.209530 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2084/4290] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:35 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1215 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:37.009375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:37.010115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:37.022819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:37.024758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:37.026254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:37.027706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:37.028731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:37.033231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:37.222500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:37.223137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:37.231102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:37.231826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:37.232465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:37.233419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:37.234042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:37.234770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:37.301322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:37.310890 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84718d29-a75a-4654-a64b-f5ea750dcf94 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1219 microversion: 2.1 time: 0.095467 Oct 19 07:08:37.322120 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2085/4291] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:37 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:37.408536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:37.417412 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a3d6299-f646-417e-a2d1-0ff2ccf47d35 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.412684 Oct 19 07:08:37.429774 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2207/4292] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:37 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:38.340044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:38.341488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:38.350596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:38.351749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:38.352367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:38.353743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:38.354651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:38.355235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:38.442932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:38.443695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:38.451757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:38.452289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:38.453587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:38.455205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:38.456455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:38.457060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:38.487227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:38.500060 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5cecbfdf-7ae8-4473-970d-753c4ab5c996 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1267 microversion: 2.1 time: 0.164611 Oct 19 07:08:38.506101 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2086/4293] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:38 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:38.734555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:38.740516 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9f25299-ce84-4120-8b8f-5532de2cce4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.302961 Oct 19 07:08:38.741571 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2208/4294] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:38 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:39.530642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:39.531294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:39.542920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:39.543647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:39.545125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:39.546165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:39.550506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:39.550506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:39.650471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:39.667648 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-173cf971-396f-46e8-b3d8-e3ff0d07a94d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1273 microversion: 2.1 time: 0.133560 Oct 19 07:08:39.671894 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2087/4295] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:39 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:08:39.765474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:39.766069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:39.787473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:39.788518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:39.789114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:39.790404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:39.791223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:39.791804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:40.035399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:40.061354 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca2fec7f-212b-405f-b9d1-9a757809829b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.299672 Oct 19 07:08:40.061958 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2209/4296] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:39 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:40.713468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:40.718871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:40.741934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:40.758084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:40.758084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:40.758084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:40.758084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:40.758084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:40.758441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:41.085198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:41.088086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:41.098000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:41.098744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:41.099376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:41.100320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:41.100787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:41.101394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:41.257199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:41.265317 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44a223b1-f15e-47d6-84de-42b4f908abe8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1315 microversion: 2.1 time: 0.565207 Oct 19 07:08:41.281312 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2088/4297] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:40 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:41.445667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:41.456831 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-053b5bec-07a5-4fda-9786-0cbbccdb8177 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.375337 Oct 19 07:08:41.458010 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2210/4298] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:41 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:08:42.292130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:42.293035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:42.300954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:42.307508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:42.307508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:42.307508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:42.307508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:42.307508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:42.485887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:42.487179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:42.495570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:42.496024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:42.496531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:42.497258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:42.497759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:42.498194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:42.678323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:42.684960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:42.687573 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd1604cf-128a-47d0-ac4e-206d092dab8c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.210328 Oct 19 07:08:42.688175 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2211/4299] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:42 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:08:42.900791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:42.916945 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6448a29-3c27-4819-8062-ec534373a1cd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1315 microversion: 2.1 time: 0.628786 Oct 19 07:08:42.919571 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2089/4300] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:42 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:43.111390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dc6e4baa-57cc-446e-a42b-eafd64c91e46 req-c4788f6a-7272-46ff-a5fb-224910bca04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b1cb95-b1fe-4552-a70b-b49170840ce5", "tag": "189accec-c091-4229-be96-21e82b542537"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:43.134185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dc6e4baa-57cc-446e-a42b-eafd64c91e46 req-c4788f6a-7272-46ff-a5fb-224910bca04a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:43.134692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dc6e4baa-57cc-446e-a42b-eafd64c91e46 req-c4788f6a-7272-46ff-a5fb-224910bca04a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:43.137681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dc6e4baa-57cc-446e-a42b-eafd64c91e46 req-c4788f6a-7272-46ff-a5fb-224910bca04a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:43.166303 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dc6e4baa-57cc-446e-a42b-eafd64c91e46 req-c4788f6a-7272-46ff-a5fb-224910bca04a service nova] Creating event network-changed:189accec-c091-4229-be96-21e82b542537 for instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 on n-h1-861333-10 Oct 19 07:08:43.173474 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dc6e4baa-57cc-446e-a42b-eafd64c91e46 req-c4788f6a-7272-46ff-a5fb-224910bca04a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066405 Oct 19 07:08:43.175565 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2212/4301] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:08:43.712822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:43.714103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:43.729006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:43.729523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:43.729960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:43.730747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:43.731158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:43.731598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:43.946433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:43.947287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:43.961203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:43.962500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:43.963183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:43.964153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:43.964837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:43.965694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:44.183052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:44.207401 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2fc6f3e6-b174-4d57-bb1f-c18df4769ea3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.498540 Oct 19 07:08:44.208008 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2090/4302] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:43 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:44.405878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:44.411873 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14bd2683-7de3-4264-a335-e2d868b7794f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1315 microversion: 2.1 time: 0.468070 Oct 19 07:08:44.421483 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2213/4303] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:43 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:45.237647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:45.238282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:45.245732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:45.246228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:45.246681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:45.247403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:45.247874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:45.248360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:45.390629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:45.408534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:45.421872 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17ec0944-33fe-40e4-ba1d-bfde73d56aee tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.193871 Oct 19 07:08:45.422813 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2091/4304] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:45 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:45.438068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:45.439400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:45.457014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:45.457815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:45.458272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:45.459012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:45.459453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:45.459913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:45.670634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:45.683640 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5a48071-f072-48b5-ba09-31513c8865ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1315 microversion: 2.1 time: 0.245606 Oct 19 07:08:45.683640 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2214/4305] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:45 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:46.451370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:46.452081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:46.454779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:46.462242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:46.462869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:46.463382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:46.464862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:46.465162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:46.465801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:46.713465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:46.714733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:46.744348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:46.747419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:46.752552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:46.761987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:46.764461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:46.765002 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-423a9f08-3019-4796-b093-17d7bfba40b3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1512 microversion: 2.1 time: 0.318925 Oct 19 07:08:46.767756 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2092/4306] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:46 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:46.769552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:46.773715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:46.777571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:47.166914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:47.180955 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1722e8f4-073f-4bbe-9b4f-eb4d33e1b38e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1315 microversion: 2.1 time: 0.481922 Oct 19 07:08:47.183609 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2215/4307] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:46 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:47.792707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:47.793334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:47.813373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:47.813962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:47.814422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:47.815177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:47.816221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:47.816883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:48.210652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:48.211322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:48.225244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:48.225759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:48.226209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:48.230022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:48.230852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:48.234673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:48.247704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:48.247813 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5043bce3-8f57-42e6-89c1-b97680e4b46b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1489 microversion: 2.1 time: 0.457088 Oct 19 07:08:48.248750 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2093/4308] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:47 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1489 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:48.276296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:48.276296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:48.290322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:48.290833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:48.291276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:48.299044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:48.299044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:48.299044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:48.361250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:08:48.604024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:48.611940 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-715eca8b-772a-40fa-89b3-78ae671ed84c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1315 microversion: 2.1 time: 0.405720 Oct 19 07:08:48.613146 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2216/4309] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:48 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:48.794833 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abd004a0-881a-4cdd-ae9c-432bdcfc38b1 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 204 len: 0 microversion: 2.1 time: 0.524710 Oct 19 07:08:48.800928 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2094/4310] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:08:48 2022] DELETE /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:08:48.809048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:48.809677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:48.818294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:48.819193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:48.824544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:48.824544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:48.824544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:48.824544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:49.521688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:49.539232 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8268c6aa-8424-4bb5-8403-6395d0efdd59 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1495 microversion: 2.1 time: 0.733317 Oct 19 07:08:49.540449 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2217/4311] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:48 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1495 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:49.637853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:49.639060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:49.655101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:49.656009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:49.656650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:49.657359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:49.657815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:49.658248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:50.009532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:50.021129 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-822d88f7-75ca-4a39-95c2-4b1939d9fcd7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1315 microversion: 2.1 time: 0.388052 Oct 19 07:08:50.038752 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2095/4312] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:49 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:50.580665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:50.582858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:50.610996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:50.611505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:50.612493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:50.613620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:50.614260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:50.615104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:50.858427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:50.894818 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-406eb21e-a540-4248-9d1a-a163e8f2d6ba tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1495 microversion: 2.1 time: 0.335557 Oct 19 07:08:50.896655 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2218/4313] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:50 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1495 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:50.926456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-03a395bc-d850-4dc6-8819-9cbc862f6231 req-4bf019bd-bbbd-4262-bd19-f75a8c0203b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b1cb95-b1fe-4552-a70b-b49170840ce5", "name": "network-vif-plugged", "status": "completed", "tag": "189accec-c091-4229-be96-21e82b542537"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:50.965720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03a395bc-d850-4dc6-8819-9cbc862f6231 req-4bf019bd-bbbd-4262-bd19-f75a8c0203b1 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:50.966217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03a395bc-d850-4dc6-8819-9cbc862f6231 req-4bf019bd-bbbd-4262-bd19-f75a8c0203b1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:50.972306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03a395bc-d850-4dc6-8819-9cbc862f6231 req-4bf019bd-bbbd-4262-bd19-f75a8c0203b1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:50.983822 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-03a395bc-d850-4dc6-8819-9cbc862f6231 req-4bf019bd-bbbd-4262-bd19-f75a8c0203b1 service nova] Creating event network-vif-plugged:189accec-c091-4229-be96-21e82b542537 for instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 on n-h1-861333-10 Oct 19 07:08:50.991048 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-03a395bc-d850-4dc6-8819-9cbc862f6231 req-4bf019bd-bbbd-4262-bd19-f75a8c0203b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073554 Oct 19 07:08:50.992007 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2096/4314] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:08:51.045312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:51.046044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:51.058539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:51.059216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:51.059488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:51.060243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:51.060886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:51.061682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:51.287269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:51.299227 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-987452b6-68b6-470b-a147-9d9c56c95b0a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1315 microversion: 2.1 time: 0.257793 Oct 19 07:08:51.310045 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2219/4315] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:51 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:51.686788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-692768a4-c711-4b18-8e4c-fb7e38066480 req-4d6a49e5-1c63-42ad-b290-1b5b32f4dd8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c24e3e8-564b-442b-bc22-8bba1eb12244", "name": "network-vif-deleted", "tag": "9e661941-b69e-4b58-b3be-1b2269092116"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:51.703075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-692768a4-c711-4b18-8e4c-fb7e38066480 req-4d6a49e5-1c63-42ad-b290-1b5b32f4dd8b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:51.704335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-692768a4-c711-4b18-8e4c-fb7e38066480 req-4d6a49e5-1c63-42ad-b290-1b5b32f4dd8b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:51.704932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-692768a4-c711-4b18-8e4c-fb7e38066480 req-4d6a49e5-1c63-42ad-b290-1b5b32f4dd8b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:51.733802 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-692768a4-c711-4b18-8e4c-fb7e38066480 req-4d6a49e5-1c63-42ad-b290-1b5b32f4dd8b service nova] Creating event network-vif-deleted:9e661941-b69e-4b58-b3be-1b2269092116 for instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 on n-h2-861333-10 Oct 19 07:08:51.733802 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-692768a4-c711-4b18-8e4c-fb7e38066480 req-4d6a49e5-1c63-42ad-b290-1b5b32f4dd8b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048373 Oct 19 07:08:51.733802 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2097/4316] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:08:51.921220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:51.922203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:51.938385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:51.938964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:51.944136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:51.944136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:51.944136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:51.944136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:52.095334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:52.105873 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da4853ab-35fa-44d3-8cd5-3355ce28743a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 200 len: 1286 microversion: 2.1 time: 0.189028 Oct 19 07:08:52.106467 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2220/4317] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:51 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 1286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:52.332296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:52.332633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:52.347173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:52.347662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:52.348153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:52.351514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:52.353541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:52.353989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:52.667986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:52.680634 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1fcda265-981c-4162-99f2-727e2e8bd155 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1315 microversion: 2.1 time: 0.359957 Oct 19 07:08:52.696133 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2098/4318] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:52 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:53.132960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:53.133862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:53.136569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=52 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:08:53.141790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:53.142353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:53.143059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:53.144560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:53.145081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:53.145695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 HTTP/1.1 Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '7c24e3e8-564b-442b-bc22-8bba1eb12244'} Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:08:53.166023 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81f84189-b06c-4af0-89b4-61aeb6336712 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 404 len: 111 microversion: 2.1 time: 0.037080 Oct 19 07:08:53.171000 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2221/4319] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:53 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:08:53.288771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1755491990", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "737f0953-92be-4377-a7d8-73cd2ce52ac7"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:53.357254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] validate_networks() for [('737f0953-92be-4377-a7d8-73cd2ce52ac7', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:08:53.707113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:53.710255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:53.729781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:53.730561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:53.734433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:53.734433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:53.734433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:53.736467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:53.939456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:53.949985 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cded850-8353-4974-b2ca-e5fa71d5455a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1503 microversion: 2.1 time: 0.247466 Oct 19 07:08:53.966589 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2222/4320] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:53 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:53.978792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:53.979494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:54.001720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:54.002349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:54.003537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:54.004372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:54.005044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:54.005587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:54.181774 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.network.security_group_api [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Removing security group 6c1d6146-dfd5-4b25-ac83-f87f61a20d98 from port 189accec-c091-4229-be96-21e82b542537 Oct 19 07:08:55.065806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:08:55.066392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:08:55.067140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:08:55.067949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:08:55.072095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:08:55.074513 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba6027ec-8ddf-45ad-8539-bc627a130f43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5/action" status: 202 len: 0 microversion: 2.1 time: 1.102874 Oct 19 07:08:55.075687 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2223/4321] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:08:53 2022] POST /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5/action => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:08:55.085398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:55.086018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:55.098505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:55.099251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:55.099854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:55.100778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:55.101771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:55.102363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:55.106165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:55.106522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:55.110010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:55.111495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:55.111989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:55.112992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:55.194141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:08:55.219352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Getting quotas for user 44114105ac6d4e1daf262bbd4b212f5e and project e77512d0f6f04753b1d86fd2884cf39c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:08:55.257020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:08:55.265980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:08:55.430386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:55.450557 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a252bf6-a5e6-4e73-818a-af4fb7fa4b6e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1461 microversion: 2.1 time: 0.369306 Oct 19 07:08:55.451697 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2224/4322] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:55 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1461 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:55.458326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-220c3516-71d7-4ca8-96f2-64ad7c2b7a81 req-0bffaf5a-9dd2-49e8-8ed2-f6fedd8e54ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b1cb95-b1fe-4552-a70b-b49170840ce5", "tag": "189accec-c091-4229-be96-21e82b542537"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:55.469369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-220c3516-71d7-4ca8-96f2-64ad7c2b7a81 req-0bffaf5a-9dd2-49e8-8ed2-f6fedd8e54ca service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:55.469857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-220c3516-71d7-4ca8-96f2-64ad7c2b7a81 req-0bffaf5a-9dd2-49e8-8ed2-f6fedd8e54ca service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:55.470419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-220c3516-71d7-4ca8-96f2-64ad7c2b7a81 req-0bffaf5a-9dd2-49e8-8ed2-f6fedd8e54ca service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:55.477664 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5674943d-73eb-426d-a8f3-f25a9ea8ea18 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.192621 Oct 19 07:08:55.479452 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2099/4323] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:08:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:08:55.495002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:55.496681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:55.509670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:55.510273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:55.510724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:55.516339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:55.516854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:55.517311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:55.531900 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-220c3516-71d7-4ca8-96f2-64ad7c2b7a81 req-0bffaf5a-9dd2-49e8-8ed2-f6fedd8e54ca service nova] Creating event network-changed:189accec-c091-4229-be96-21e82b542537 for instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 on n-h1-861333-10 Oct 19 07:08:55.542016 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-220c3516-71d7-4ca8-96f2-64ad7c2b7a81 req-0bffaf5a-9dd2-49e8-8ed2-f6fedd8e54ca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088172 Oct 19 07:08:55.542643 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2225/4324] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:08:55.560774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b9a7e0d-94d7-49ba-889a-4f0bb3587cd4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:55.561502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b9a7e0d-94d7-49ba-889a-4f0bb3587cd4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:55.671844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b9a7e0d-94d7-49ba-889a-4f0bb3587cd4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:55.687802 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b9a7e0d-94d7-49ba-889a-4f0bb3587cd4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1215 microversion: 2.1 time: 0.143098 Oct 19 07:08:55.694814 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2226/4325] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:55 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:55.722499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed49aff5-d26a-4208-a654-ad7224bb0247 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:55.725202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed49aff5-d26a-4208-a654-ad7224bb0247 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:55.740546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed49aff5-d26a-4208-a654-ad7224bb0247 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:55.741081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed49aff5-d26a-4208-a654-ad7224bb0247 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:55.741519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed49aff5-d26a-4208-a654-ad7224bb0247 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:55.742843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed49aff5-d26a-4208-a654-ad7224bb0247 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:55.743994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed49aff5-d26a-4208-a654-ad7224bb0247 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:55.744497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed49aff5-d26a-4208-a654-ad7224bb0247 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:55.804312 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed49aff5-d26a-4208-a654-ad7224bb0247 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/ips" status: 200 len: 152 microversion: 2.20 time: 0.093191 Oct 19 07:08:55.810420 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2227/4326] 10.222.0.39 () {60 vars in 1289 bytes} [Wed Oct 19 07:08:55 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/ips => generated 152 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:08:56.228828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:56.246913 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23c3b02e-9e58-4021-b4e7-623d46b2bb1d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.762193 Oct 19 07:08:56.247747 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2100/4327] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:55 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:56.278976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:56.279942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:56.295485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:56.297298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:56.298027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:56.300027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:56.302536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:56.302536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:56.717338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1799d475-5587-48b4-8842-a6448e9fd413 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:56.718361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1799d475-5587-48b4-8842-a6448e9fd413 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:56.726421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:56.741242 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7665c7ac-36ea-4fad-add3-2d538ee5799b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.466672 Oct 19 07:08:56.745347 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2228/4328] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:56 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:56.765880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:56.766809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:56.779277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:56.780010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:56.780795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:56.786805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:56.786805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:56.786805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:56.864359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1799d475-5587-48b4-8842-a6448e9fd413 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:56.876305 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1799d475-5587-48b4-8842-a6448e9fd413 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1215 microversion: 2.1 time: 0.166022 Oct 19 07:08:56.892385 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2101/4329] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:56 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:08:57.381388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:57.391667 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3c397e7-d334-4ed3-a610-73203cd7a847 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.629193 Oct 19 07:08:57.393198 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2229/4330] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:56 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:57.414819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:57.415975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:57.430346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:57.430346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:57.430346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:57.430346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:57.430346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:57.430346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:57.751328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:57.763620 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46a04240-3442-4e14-9baa-478f6ef93b47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.352742 Oct 19 07:08:57.764577 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2102/4331] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:57 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:57.905661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:57.907461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:57.919248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:57.921111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:57.923145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:57.924973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:57.926761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:57.928084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:58.090802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1185629125", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "6982a92b-3116-4178-8c1d-06fbcd358c52"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:08:58.125902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:58.135592 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67ba62cc-7621-4b13-9674-ec40b4de1356 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1267 microversion: 2.1 time: 0.234288 Oct 19 07:08:58.136978 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2230/4332] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:57 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:08:58.226307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] validate_networks() for [('6982a92b-3116-4178-8c1d-06fbcd358c52', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:08:59.167850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:08:59.167850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:08:59.176709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:59.177540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:59.178166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:59.179334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:08:59.180379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:08:59.180925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:08:59.296884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:08:59.305274 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-669e7c79-5881-486f-8093-772402ff9237 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1267 microversion: 2.1 time: 0.147100 Oct 19 07:08:59.308093 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2231/4333] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:08:59 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:00.129515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:09:00.130109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:09:00.130859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:09:00.131472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:09:00.131973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:09:00.163220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:00.163947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:00.164535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:00.165626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:00.166172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:00.166707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:00.192912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:09:00.199456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Getting quotas for user 2543970e80c84e109961fc84bfaaedd1 and project 05016de78e0b4491a53cfa3885193ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:09:00.215325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:09:00.217803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:09:00.330441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:00.331181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:00.340266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:00.340777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:00.341229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:00.341963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:00.348201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:00.358310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:00.358310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:00.412816 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6315b5f-dcdb-464c-b801-f7120c34bdf1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.318601 Oct 19 07:09:00.419809 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2103/4334] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:09:00.426645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a68720d7-6b56-4133-80bc-0d3a555edc07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:00.428384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a68720d7-6b56-4133-80bc-0d3a555edc07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:00.594547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a68720d7-6b56-4133-80bc-0d3a555edc07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:00.603344 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a68720d7-6b56-4133-80bc-0d3a555edc07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1215 microversion: 2.1 time: 0.182306 Oct 19 07:09:00.603881 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2104/4335] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:00 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:00.723012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:00.723764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:00.734732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:00.736362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:00.738690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:00.740090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:00.740796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:00.741770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:00.776700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lazy-loading 'flavor' on Instance uuid 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:09:00.900991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:00.917991 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0a4c9a7-9c6b-4418-9d34-08fcc07238d0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1273 microversion: 2.1 time: 0.591116 Oct 19 07:09:00.933989 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2232/4336] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:00 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1273 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:01.436074 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecfee474-e472-480a-826c-5dd58e5ad0a1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/action" status: 202 len: 0 microversion: 2.20 time: 0.717661 Oct 19 07:09:01.438301 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2105/4337] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 07:09:00 2022] POST /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:09:01.448343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:01.450192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:01.459254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:01.460282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:01.464862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:01.464862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:01.464862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:01.464862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:01.636996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:01.637729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:01.645093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:01.645900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:01.646579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:01.647516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:01.648578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:01.649232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:01.692930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:01.701584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:01.703200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:01.704355 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4f5a4b0-bedb-466f-963b-009499d70685 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.261272 Oct 19 07:09:01.704934 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2233/4338] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:01 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:01.840854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:01.871428 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-895ef424-3178-47fa-b056-b74325df3531 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1219 microversion: 2.1 time: 0.236876 Oct 19 07:09:01.882384 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2106/4339] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:01 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1219 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:01.946560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:01.954475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:01.961556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:01.962114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:01.962723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:01.963484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:01.963935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:01.976624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:02.582451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:02.591630 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7666bcaa-a4f3-4b76-9fa8-5c7973bbc43a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.650042 Oct 19 07:09:02.594479 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2234/4340] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:01 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:02.733365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:02.734257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:02.742708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:02.743415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:02.743862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:02.744652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:02.745122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:02.745546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:02.896920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:02.911566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:02.931385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:02.932199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:02.932853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:02.933778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:02.934714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:02.935152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:03.030100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:03.043964 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-468ac6a3-4fb7-4180-9764-c316e47f0d92 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1267 microversion: 2.1 time: 0.149715 Oct 19 07:09:03.043964 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2235/4341] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:02 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:03.099587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:03.111572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:03.114072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:03.115511 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ca1ed8f-19cb-4338-9d33-cb5f2cf8d479 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.386365 Oct 19 07:09:03.120619 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2107/4342] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:02 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:03.624536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:03.626688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:03.639116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:03.640136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:03.640836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:03.641637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:03.642108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:03.643134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:03.926445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:03.935361 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7432813-8e41-4eb9-be7e-d8e286bf651d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.318089 Oct 19 07:09:03.935950 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2236/4343] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:03 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:04.070899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:04.072133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:04.080443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:04.081416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:04.082579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:04.083344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:04.083832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:04.084481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:04.145961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:04.147176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:04.153741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:04.158614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:04.158614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:04.158614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:04.158614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:04.158614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:04.217088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:04.234676 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a20c3059-246e-42d9-b321-1d512b488ff3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1273 microversion: 2.1 time: 0.167424 Oct 19 07:09:04.255561 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2108/4344] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:04 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:04.489507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:04.500060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:04.502674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:04.504032 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-926e8c51-7079-4f27-8e15-5dad7c95ea75 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.362693 Oct 19 07:09:04.505720 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2237/4345] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:04 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:04.887432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2a008053-0682-4e2f-a4d7-2a7db725b2fd req-c41bae2d-187c-484a-b028-7851c81d6fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37390f79-bc12-43de-8da6-c7fab445d1be", "tag": "21c2bea9-3f16-4c72-b058-b0f0ca256479"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:04.906223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2a008053-0682-4e2f-a4d7-2a7db725b2fd req-c41bae2d-187c-484a-b028-7851c81d6fa3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:04.907542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2a008053-0682-4e2f-a4d7-2a7db725b2fd req-c41bae2d-187c-484a-b028-7851c81d6fa3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:04.908518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2a008053-0682-4e2f-a4d7-2a7db725b2fd req-c41bae2d-187c-484a-b028-7851c81d6fa3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:04.929880 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2a008053-0682-4e2f-a4d7-2a7db725b2fd req-c41bae2d-187c-484a-b028-7851c81d6fa3 service nova] Creating event network-changed:21c2bea9-3f16-4c72-b058-b0f0ca256479 for instance 37390f79-bc12-43de-8da6-c7fab445d1be on n-h2-861333-10 Oct 19 07:09:04.946776 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2a008053-0682-4e2f-a4d7-2a7db725b2fd req-c41bae2d-187c-484a-b028-7851c81d6fa3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064451 Oct 19 07:09:04.959686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:04.960862 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2109/4346] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:04.961352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:04.976238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:04.977050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:04.977832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:04.978788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:04.979501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:04.980183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:05.225576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:05.254273 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48297a7e-2086-4858-bfc0-055fb17ad4aa tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.297996 Oct 19 07:09:05.255228 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2238/4347] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:04 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:05.261154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:05.262460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:05.275044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:05.279896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:05.279896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:05.279896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:05.284868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:05.285458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:05.538953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:05.542682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:05.558000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:05.564264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:05.565325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:05.566747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:05.567244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:05.568199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:05.678731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:06.248606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:06.265020 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5e9b60d-b3b1-4082-83c3-4cc278f2afd4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 1.004691 Oct 19 07:09:06.280272 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2110/4348] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:05 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:06.280272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:06.280272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:06.293362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:06.293362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:06.293362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:06.293776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:06.294312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:06.294752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:06.309650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:06.407573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:06.425817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:06.427582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:06.444076 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e28e01a-4e00-4089-8ab7-a34355048adf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.915121 Oct 19 07:09:06.456723 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2239/4349] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:05 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:09:06.942903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:06.956565 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c09e034b-37aa-48a3-a236-0facbf198845 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.676829 Oct 19 07:09:06.957328 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2111/4350] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:06 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:07.289975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:07.291344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:07.305002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:07.309052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:07.309678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:07.310757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:07.312818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:07.314975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:07.474060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:07.474761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:07.486686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:07.487221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:07.487655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:07.488415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:07.488996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:07.493550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:07.714884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:07.726296 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0bdfe2f5-5c18-486d-a4bd-dd7eb670919a tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.439296 Oct 19 07:09:07.727283 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2240/4351] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:07 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:07.941352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:07.954993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:07.961846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:07.963171 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65548c87-dba0-4ae6-b386-1c739ec69259 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.494008 Oct 19 07:09:07.968975 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2112/4352] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:07 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:07.984122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:07.984755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:07.992315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:07.992817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:07.993258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:07.994273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:07.994867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:07.995306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:08.148577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-48191162-1950-4b89-96ea-8d1a1bb18f89 req-b4c38beb-9616-440b-bf95-492ad43598d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45a1749-93d8-4842-9251-95117b90a309", "tag": "4d508603-62c3-4929-988f-c99746ed6182"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:08.169215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-48191162-1950-4b89-96ea-8d1a1bb18f89 req-b4c38beb-9616-440b-bf95-492ad43598d6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:08.169961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-48191162-1950-4b89-96ea-8d1a1bb18f89 req-b4c38beb-9616-440b-bf95-492ad43598d6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:08.170593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-48191162-1950-4b89-96ea-8d1a1bb18f89 req-b4c38beb-9616-440b-bf95-492ad43598d6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:08.204489 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-48191162-1950-4b89-96ea-8d1a1bb18f89 req-b4c38beb-9616-440b-bf95-492ad43598d6 service nova] Creating event network-changed:4d508603-62c3-4929-988f-c99746ed6182 for instance c45a1749-93d8-4842-9251-95117b90a309 on n-h1-861333-10 Oct 19 07:09:08.211514 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-48191162-1950-4b89-96ea-8d1a1bb18f89 req-b4c38beb-9616-440b-bf95-492ad43598d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066478 Oct 19 07:09:08.212453 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2113/4353] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:08.761527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:08.763475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:08.780570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:08.781079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:08.782271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:08.783637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:08.786956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:08.787484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:08.791728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:08.814757 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-323da1fb-2a96-4198-a9a9-3f4e5336649e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.835549 Oct 19 07:09:08.815536 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2241/4354] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:07 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:08.998166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:08.998857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:09.008830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:09.009343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:09.009792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:09.012670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:09.013170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:09.013671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:09.385289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:09.399033 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a60be69-243a-482c-9857-804153f258ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.649438 Oct 19 07:09:09.403436 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2114/4355] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:08 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:09.417785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:09.429863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:09.435782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:09.437821 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c08ec33e-fc69-470d-8096-0cf1c3dc7ea3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.443441 Oct 19 07:09:09.452422 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2242/4356] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:08 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:09:09.842741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:09.842741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:09.850832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:09.851600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:09.852296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:09.853207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:09.853865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:09.854501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:10.181121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:10.427438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:10.428750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:10.429511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:10.437647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:10.440423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:10.440423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:10.440423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:10.441374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:10.442046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:10.442158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d7da694-7ad1-4f1e-831a-94a5ad549865 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.605054 Oct 19 07:09:10.456142 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2115/4357] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:09 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:10.476062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:10.476808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:10.495444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:10.497567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:10.498996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:10.501107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:10.501669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:10.502123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:10.602408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:10.648958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:10.651155 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b832d823-c57a-4fcd-988d-e38fd50c49fb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.227823 Oct 19 07:09:10.652672 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2243/4358] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:10 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:10.927041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:10.940190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:10.942292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:10.943612 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2aeab634-be4b-4ae2-b7f6-4d6e9d41dd0b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.478755 Oct 19 07:09:10.951164 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2116/4359] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:10 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:11.466948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:11.467562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:11.486321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:11.493333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:11.493333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:11.493333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:11.493333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:11.493333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:11.680749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:11.681828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:11.689182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:11.689922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:11.691317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:11.692556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:11.693258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:11.693930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:11.961492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:11.977019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:11.979482 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5222789-f1e9-402f-99f8-1d83785e7bcb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.513367 Oct 19 07:09:11.980404 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2244/4360] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:11 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:11.989458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:11.990894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:11.998194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:11.999030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:11.999869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:12.000852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:12.001464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:12.002531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:12.006034 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc581424-fb5b-43f4-8d31-106d51c2173c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.328777 Oct 19 07:09:12.011782 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2117/4361] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:11 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:12.017583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:12.037431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:12.038028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Searching by: {'deleted': False, 'project_id': 'dc00fa11f6d5486481b4900e70be3705'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:09:12.051731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:12.052852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:12.053537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:12.054961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:12.055726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:12.056362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:12.098049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:09:12.146684 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5436c4f3-4af4-4bea-8670-90e9cf37c835 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.133594 Oct 19 07:09:12.147332 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2118/4362] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 07:09:12 2022] GET /compute/v2.1/servers => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:12.162196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:12.169656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:12.170332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Searching by: {'deleted': False, 'project_id': 'dc00fa11f6d5486481b4900e70be3705'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:09:12.178853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:12.182280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:12.184579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:12.186592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:12.191622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:12.192481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:12.193508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:12.241866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:09:12.342093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:12.350719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:12.352134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:12.353190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:12.354890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:12.361339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:12.363719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:12.365129 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-691c8b34-705d-43dd-b343-3d07f34b8610 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.382993 Oct 19 07:09:12.369125 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2245/4363] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:11 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:12.616597 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23951036-5c68-4990-9596-adfbde147772 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.459978 Oct 19 07:09:12.617377 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2119/4364] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 07:09:12 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:12.644900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0429d093-e166-4e1a-9195-9070b67f9a30 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:12.656214 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0429d093-e166-4e1a-9195-9070b67f9a30 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017355 Oct 19 07:09:12.658018 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2246/4365] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 07:09:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:13.009280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:13.010470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:13.019226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:13.020223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:13.020827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:13.021527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:13.022157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:13.022748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:13.054794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:13.055471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:13.081867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:13.082664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:13.083469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:13.084784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:13.086124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:13.086732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:13.488051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:13.500950 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2cafd5dc-bfe0-419e-8f63-8fb900c7a8a0 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.498206 Oct 19 07:09:13.501571 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2120/4366] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:13 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:13.522188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:13.525850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:13.537577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:13.538342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:13.538949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:13.539835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:13.540510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:13.541685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:13.594436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:09:14.005031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:14.027140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-658e576c-1149-4718-b5f3-a58327766d9f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.980156 Oct 19 07:09:14.038973 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2247/4367] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:13 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:14.053261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:14.054164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:14.063855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:14.064663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:14.065760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:14.072714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:14.073397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:14.074985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:14.101284 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06400c29-a6b8-4441-9769-bb323d87c274 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 204 len: 0 microversion: 2.1 time: 0.596202 Oct 19 07:09:14.101284 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2121/4368] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:09:13 2022] DELETE /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:09:14.123998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:14.126427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:14.145364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:14.147243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:14.148056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:14.151545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:14.154236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:14.154917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:14.389015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:14.417855 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75b93f7b-5510-417e-b5c2-30b88724c540 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1610 microversion: 2.1 time: 0.311039 Oct 19 07:09:14.418622 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2122/4369] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:14 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1610 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:14.423796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-00453270-3722-4e99-bca3-11d2612891f0 req-10ae74eb-327b-46d8-8570-11c6ea7341f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37390f79-bc12-43de-8da6-c7fab445d1be", "name": "network-vif-plugged", "status": "completed", "tag": "21c2bea9-3f16-4c72-b058-b0f0ca256479"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:14.458388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-00453270-3722-4e99-bca3-11d2612891f0 req-10ae74eb-327b-46d8-8570-11c6ea7341f9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:14.461430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-00453270-3722-4e99-bca3-11d2612891f0 req-10ae74eb-327b-46d8-8570-11c6ea7341f9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:14.464213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-00453270-3722-4e99-bca3-11d2612891f0 req-10ae74eb-327b-46d8-8570-11c6ea7341f9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:14.506112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:14.509692 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-00453270-3722-4e99-bca3-11d2612891f0 req-10ae74eb-327b-46d8-8570-11c6ea7341f9 service nova] Creating event network-vif-plugged:21c2bea9-3f16-4c72-b058-b0f0ca256479 for instance 37390f79-bc12-43de-8da6-c7fab445d1be on n-h2-861333-10 Oct 19 07:09:14.522234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:14.523008 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-00453270-3722-4e99-bca3-11d2612891f0 req-10ae74eb-327b-46d8-8570-11c6ea7341f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103097 Oct 19 07:09:14.523872 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2123/4370] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:14.524321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:14.525625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6206ddd-a4d5-4dd5-9c00-209351436c8f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1745 microversion: 2.20 time: 0.485279 Oct 19 07:09:14.526627 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2248/4371] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:14 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1745 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:14.554344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:14.555483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:14.563554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:14.564310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:14.565857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:14.566751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:14.567546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:14.568480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:14.868244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:14.878791 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5f5a3d6-a598-4390-86f2-650df6cf5e7f tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.351818 Oct 19 07:09:14.896184 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2124/4372] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:14 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:15.053507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:15.059324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:15.067476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:15.067882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:15.068386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:15.069115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:15.069580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:15.070042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:15.438356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:15.441857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:15.451315 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6bccbeb-61ef-449e-842c-6c3e1dcde62e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.402531 Oct 19 07:09:15.453603 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2249/4373] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:15 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:15.479704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:15.480531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:15.488566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:15.489409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:15.490853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:15.491765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:15.495462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:15.495462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:15.568546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:15.568546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:15.573927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:15.574404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:15.575179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:15.576059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:15.576762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:15.577359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:15.723738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:15.735953 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07ff0e03-f531-4db4-b877-3be0164688d9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1610 microversion: 2.1 time: 0.287271 Oct 19 07:09:15.736982 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2125/4374] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:15 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1610 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:15.904642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:15.906972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:15.907595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:15.913673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:15.915128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:15.918665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:15.922813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:15.923060 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8cf31758-32d6-4fd1-84bf-a31c777322b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.362443 Oct 19 07:09:15.924413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:15.926595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:15.926712 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2250/4375] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:15 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:09:15.929699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:15.932808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:15.975773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:16.479193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:16.480525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:16.496080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:16.497007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:16.497617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:16.498504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:16.499129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:16.499800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:16.742168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:16.761378 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60f31df4-0b6a-4f9d-8fb5-90d4e5ad1122 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.856587 Oct 19 07:09:16.762833 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2126/4376] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:15 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:16.787080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:16.787080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:16.795014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:16.795906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:16.796615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:16.798393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:16.799135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:16.800359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:16.940360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:16.949830 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51a50af8-dc0e-486f-b65a-a9d35dd11477 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.474897 Oct 19 07:09:16.956321 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2251/4377] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:16 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:16.967195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:16.972362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:17.014941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:17.018078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:17.018964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:17.023062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:17.023062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:17.023884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:17.189239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:17.199051 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3dffbb97-fa98-4192-9314-840ff7342564 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1610 microversion: 2.1 time: 0.434894 Oct 19 07:09:17.200910 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2127/4378] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:16 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1610 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:17.544745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:17.584902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:17.589069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:17.595767 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b1c6e50-6141-4a6a-bf4e-bdea15ab34f4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.635097 Oct 19 07:09:17.603353 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2252/4379] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:16 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:17.792743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:17.793419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:17.816225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:17.822832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:17.823904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:17.833633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:17.836759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:17.836759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:17.984666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:17.985484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:17.993297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:17.994158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:17.994770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:17.995646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:17.996411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:17.997131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:18.251890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:18.280826 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b33be487-50af-46c3-9604-4b3b47989da5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.293225 Oct 19 07:09:18.285649 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2253/4380] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:17 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:18.305775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:18.306580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:18.335348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:18.335853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:18.336330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:18.337053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:18.337514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:18.337960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:18.407896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:18.429442 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-601e0884-4579-46fb-a081-d9109c9a6a73 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1315 microversion: 2.1 time: 0.635669 Oct 19 07:09:18.444132 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2128/4381] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:17 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:18.548566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:18.560308 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a1ae508-03de-4ba4-8c2b-f3980f6b0592 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1543 microversion: 2.1 time: 0.272907 Oct 19 07:09:18.560826 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2254/4382] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:18 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1543 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:18.632497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:18.633409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:18.651188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:18.652142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:18.652818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:18.655954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:18.666121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:18.667049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:18.881349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bdfdec36-b8df-44d8-95d3-c4b3e6efd54e req-20e41f07-ecdb-4d74-8fff-e3c27fac2f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45a1749-93d8-4842-9251-95117b90a309", "name": "network-vif-plugged", "status": "completed", "tag": "4d508603-62c3-4929-988f-c99746ed6182"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:18.915881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bdfdec36-b8df-44d8-95d3-c4b3e6efd54e req-20e41f07-ecdb-4d74-8fff-e3c27fac2f4d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:18.930763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bdfdec36-b8df-44d8-95d3-c4b3e6efd54e req-20e41f07-ecdb-4d74-8fff-e3c27fac2f4d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:18.932814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bdfdec36-b8df-44d8-95d3-c4b3e6efd54e req-20e41f07-ecdb-4d74-8fff-e3c27fac2f4d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:18.985622 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bdfdec36-b8df-44d8-95d3-c4b3e6efd54e req-20e41f07-ecdb-4d74-8fff-e3c27fac2f4d service nova] Creating event network-vif-plugged:4d508603-62c3-4929-988f-c99746ed6182 for instance c45a1749-93d8-4842-9251-95117b90a309 on n-h1-861333-10 Oct 19 07:09:19.011465 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bdfdec36-b8df-44d8-95d3-c4b3e6efd54e req-20e41f07-ecdb-4d74-8fff-e3c27fac2f4d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135023 Oct 19 07:09:19.028040 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2255/4383] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:19.304440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:19.305208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:19.317182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:19.318318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:19.318923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:19.322104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:19.323234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:19.323912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:19.324690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:19.331526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:19.338097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:19.339401 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f45d0cc-cbfc-4817-b411-21568286a739 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.712880 Oct 19 07:09:19.346220 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2129/4384] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:18 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:19.459370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:19.460217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:19.473340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:19.475040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:19.475880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:19.476735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:19.478191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:19.479822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:19.682597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:19.698463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e99ba3e-8f11-43e1-a709-6463a11e8866 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.399005 Oct 19 07:09:19.699068 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2256/4385] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:19 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:19.705064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c2267bbb-9389-4489-a9fe-f8ef18bcebea req-bdd82e41-55e5-4d9a-a6bf-2e3aef5694ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8166ede1-9eae-4ddd-ba55-3b767c235fc3", "name": "network-vif-deleted", "tag": "77292d2c-4227-43f8-9b2d-c555fbf8c91a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:19.732462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c2267bbb-9389-4489-a9fe-f8ef18bcebea req-bdd82e41-55e5-4d9a-a6bf-2e3aef5694ac service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:19.733411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c2267bbb-9389-4489-a9fe-f8ef18bcebea req-bdd82e41-55e5-4d9a-a6bf-2e3aef5694ac service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:19.734035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c2267bbb-9389-4489-a9fe-f8ef18bcebea req-bdd82e41-55e5-4d9a-a6bf-2e3aef5694ac service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:19.749605 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c2267bbb-9389-4489-a9fe-f8ef18bcebea req-bdd82e41-55e5-4d9a-a6bf-2e3aef5694ac service nova] Creating event network-vif-deleted:77292d2c-4227-43f8-9b2d-c555fbf8c91a for instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 on n-h2-861333-10 Oct 19 07:09:19.755303 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c2267bbb-9389-4489-a9fe-f8ef18bcebea req-bdd82e41-55e5-4d9a-a6bf-2e3aef5694ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054781 Oct 19 07:09:19.757115 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2257/4386] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:19.762994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:19.764951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:19.772512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:19.773730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:19.774333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:19.775232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:19.775906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:19.776520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:19.915198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:19.926748 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9fbff7a2-0b37-4b0e-a9d0-79e12187986d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1503 microversion: 2.1 time: 0.469833 Oct 19 07:09:19.931990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:19.941481 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2130/4387] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:19 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1503 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:19.945924 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12505637-5f73-49e7-bce0-fb05e3237a49 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1253 microversion: 2.1 time: 0.187710 Oct 19 07:09:19.948540 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2258/4388] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:19 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1253 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:19.954891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:19.955791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:19.963032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:19.964060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:19.964538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:19.965453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:19.966067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:19.968255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:20.039078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lazy-loading 'flavor' on Instance uuid 37390f79-bc12-43de-8da6-c7fab445d1be {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:09:20.371466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:20.372637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:20.387965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:20.390078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:20.390724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:20.392987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:20.395159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:20.397680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:20.442000 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be9f3638-fa7d-40b5-a2f4-4500a3a5c6c2 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "POST /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be/action" status: 202 len: 0 microversion: 2.1 time: 0.493703 Oct 19 07:09:20.446759 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2131/4389] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:09:19 2022] POST /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:09:20.453730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:20.462602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:20.496378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:20.497266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:20.500447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:20.503600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:20.506968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:20.508662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:20.802856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:20.813560 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0fc8bab-d3d5-4555-b57d-1c519986bb92 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1511 microversion: 2.1 time: 0.364282 Oct 19 07:09:20.814164 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2132/4390] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:20 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:20.843011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:20.843799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:20.857177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:20.857980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:20.858725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:20.859884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:20.860519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:20.861093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:21.221170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:21.235898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:21.237046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:21.249717 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1197342f-23ca-43b2-9227-1a61713e2651 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.883800 Oct 19 07:09:21.254070 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2259/4391] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:20 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:21.262213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:21.265190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:21.281778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:21.282496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:21.283535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:21.284532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:21.296908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:21.297670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:21.600829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:21.610148 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8bc1365-b0eb-48b5-b9fb-489c1170906c tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1253 microversion: 2.1 time: 0.354794 Oct 19 07:09:21.613385 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2260/4392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:21 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1253 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:21.708368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:21.727149 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-928186f9-6abe-4abd-ba41-2434fd8eccbd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1315 microversion: 2.1 time: 0.909914 Oct 19 07:09:21.728758 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2133/4393] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:20 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:21.817703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d89fcf54-8863-4056-ac2d-82cd22d695af req-e974ae03-3b67-40b6-aa1c-aa5833bb877b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf", "name": "network-vif-plugged", "status": "completed", "tag": "d36dab0c-9d83-4aa8-b6bb-531eafbf58f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:21.833187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d89fcf54-8863-4056-ac2d-82cd22d695af req-e974ae03-3b67-40b6-aa1c-aa5833bb877b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:21.840361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:21.841245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:21.849205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d89fcf54-8863-4056-ac2d-82cd22d695af req-e974ae03-3b67-40b6-aa1c-aa5833bb877b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:21.851545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:21.852971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d89fcf54-8863-4056-ac2d-82cd22d695af req-e974ae03-3b67-40b6-aa1c-aa5833bb877b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:21.854588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:21.859385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:21.861051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:21.861540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:21.863718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:21.885606 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d89fcf54-8863-4056-ac2d-82cd22d695af req-e974ae03-3b67-40b6-aa1c-aa5833bb877b service nova] Creating event network-vif-plugged:d36dab0c-9d83-4aa8-b6bb-531eafbf58f6 for instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf on n-h1-861333-10 Oct 19 07:09:21.905923 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d89fcf54-8863-4056-ac2d-82cd22d695af req-e974ae03-3b67-40b6-aa1c-aa5833bb877b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091871 Oct 19 07:09:21.912195 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2261/4394] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:22.218315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:22.280096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:22.281026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:22.301088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:22.302959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:22.303630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:22.304888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:22.306062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:22.306804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:22.307972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:22.321109 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79b500ec-f0de-408e-a2e0-81d9bc219811 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1494 microversion: 2.1 time: 0.484910 Oct 19 07:09:22.325780 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2134/4395] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:21 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1494 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:22.352264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:22.353027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:22.362526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:22.366484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:22.370897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:22.370897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:22.370897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:22.374618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:22.375282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:22.455875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:09:22.724645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:22.740341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:22.746513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:22.748029 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f32adfe6-3ddf-401e-847d-d8a1f1f2dd25 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.473516 Oct 19 07:09:22.753630 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2262/4396] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:22 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:09:22.772647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:22.773651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:22.786118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:22.789181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:22.789811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:22.791345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:22.793422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:22.794034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:22.834092 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b1497f1-8a85-4ae5-8a8c-92778b75a2a9 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 204 len: 0 microversion: 2.1 time: 0.485527 Oct 19 07:09:22.835282 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2135/4397] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:09:22 2022] DELETE /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:09:22.843425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:22.844336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:22.857977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:22.859347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:22.861547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:22.863054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:22.866332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:22.867499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:23.140958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:23.155485 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39d948ec-7ffe-42d9-8c00-356ee8577356 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1253 microversion: 2.1 time: 0.400496 Oct 19 07:09:23.159771 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2263/4398] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:22 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1253 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:23.174304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:23.174304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:23.191227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:23.191749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:23.192212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:23.192939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:23.193394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:23.196219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:23.519340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:23.531092 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d89d5d1-1420-40f7-b080-c4c3ea47685c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1502 microversion: 2.1 time: 0.694835 Oct 19 07:09:23.556435 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2136/4399] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:22 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1502 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:23.578642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2dc98ce6-0572-4a4e-8dd3-47371fa4da47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:23.579672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2dc98ce6-0572-4a4e-8dd3-47371fa4da47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:23.606401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2dc98ce6-0572-4a4e-8dd3-47371fa4da47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:23.615140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2dc98ce6-0572-4a4e-8dd3-47371fa4da47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:23.616492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2dc98ce6-0572-4a4e-8dd3-47371fa4da47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:23.620056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2dc98ce6-0572-4a4e-8dd3-47371fa4da47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:23.622859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2dc98ce6-0572-4a4e-8dd3-47371fa4da47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:23.639836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2dc98ce6-0572-4a4e-8dd3-47371fa4da47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:24.012143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:24.024617 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b30ce5b3-02ae-4aba-8c57-53bb2c821773 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1500 microversion: 2.1 time: 0.862727 Oct 19 07:09:24.027066 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2264/4400] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:23 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1500 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:24.041180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:24.042538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:24.057780 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2dc98ce6-0572-4a4e-8dd3-47371fa4da47 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309/action" status: 202 len: 0 microversion: 2.1 time: 0.495919 Oct 19 07:09:24.059906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=90 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:24.060425 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2137/4401] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:09:23 2022] POST /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:09:24.066009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:24.069430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:24.070204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:24.071261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:24.071956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:24.075658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:24.079866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:24.082083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:24.095759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:24.096777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:24.097656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:24.098716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:24.099518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:24.100191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:24.602022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:24.615165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:24.621587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:24.630662 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9159778-8b5c-48e2-876d-c8e1e7a8821d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.602255 Oct 19 07:09:24.631710 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2265/4402] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:24 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:24.636636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:24.640053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:24.655133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:24.660444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:24.661133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:24.662287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:24.670881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:24.671644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:24.874033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:24.874033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:24.874033 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d405243-1c16-497e-8e35-8dd4bef8fdaa tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1507 microversion: 2.1 time: 0.767878 Oct 19 07:09:24.874033 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2138/4403] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:24 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1507 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:25.057207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:25.058226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:25.104089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:25.105117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:25.105613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:25.106504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:25.107061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:25.111205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:25.191613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:25.199758 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-912a26f6-ef85-42c6-951f-47482e7b0cb9 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1253 microversion: 2.1 time: 0.566738 Oct 19 07:09:25.219543 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2266/4404] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:24 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1253 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:25.663447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:25.671012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:25.678184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:25.679644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:25.681483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:25.684359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:25.685110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:25.685784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:26.334562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:26.349647 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a04f7e7-2d75-4ad0-8291-250d3ce9b7d3 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1500 microversion: 2.1 time: 1.294192 Oct 19 07:09:26.364657 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2139/4405] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:25 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1500 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:26.375600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:26.380487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:26.391230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:26.391739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:26.392205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:26.392925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:26.393388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:26.401245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:26.769959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:26.779947 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a594feca-bd8a-47fb-af02-fb81ee3667e9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1487 microversion: 2.1 time: 0.414043 Oct 19 07:09:26.789174 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2140/4406] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:26 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1487 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:26.805173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:26.811714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:26.846840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:26.847128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:26.848175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:26.849655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:26.853114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:26.857186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:27.072484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:27.083468 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0de91982-b68d-4608-a32a-271a9b7d9580 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1253 microversion: 2.1 time: 0.293043 Oct 19 07:09:27.089747 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2141/4407] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:26 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1253 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:27.108931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:27.109776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:27.127616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:27.129866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:27.129866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:27.129866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:27.130312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:27.130742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:27.200549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lazy-loading 'flavor' on Instance uuid c45a1749-93d8-4842-9251-95117b90a309 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:09:27.924364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:27.945130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:27.954192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:27.961053 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efb602cd-58df-4e65-8ec7-800f0d437373 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 2.300917 Oct 19 07:09:27.963470 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2267/4408] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:25 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:27.974943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-08cc4a75-1a09-46e9-91bc-acad1bb156bf req-5d3fd531-0f92-4be1-a44b-9519546037a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37390f79-bc12-43de-8da6-c7fab445d1be", "name": "network-vif-deleted", "tag": "21c2bea9-3f16-4c72-b058-b0f0ca256479"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:27.990495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08cc4a75-1a09-46e9-91bc-acad1bb156bf req-5d3fd531-0f92-4be1-a44b-9519546037a7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:27.993416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08cc4a75-1a09-46e9-91bc-acad1bb156bf req-5d3fd531-0f92-4be1-a44b-9519546037a7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:27.993416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08cc4a75-1a09-46e9-91bc-acad1bb156bf req-5d3fd531-0f92-4be1-a44b-9519546037a7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:28.009874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-08cc4a75-1a09-46e9-91bc-acad1bb156bf req-5d3fd531-0f92-4be1-a44b-9519546037a7 service nova] Creating event network-vif-deleted:21c2bea9-3f16-4c72-b058-b0f0ca256479 for instance 37390f79-bc12-43de-8da6-c7fab445d1be on n-h2-861333-10 Oct 19 07:09:28.017034 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-08cc4a75-1a09-46e9-91bc-acad1bb156bf req-5d3fd531-0f92-4be1-a44b-9519546037a7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051555 Oct 19 07:09:28.022319 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2268/4409] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:28.026696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:28.028277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:28.037587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:28.038864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:28.040441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:28.043260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:28.044057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:28.044928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:28.051836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:28.169346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:28.170481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:28.172998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:28.179068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lazy-loading 'fault' on Instance uuid 37390f79-bc12-43de-8da6-c7fab445d1be {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:09:28.203487 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8634b8be-8b40-45dd-83bd-1330f53a3901 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309/action" status: 202 len: 0 microversion: 2.1 time: 1.114030 Oct 19 07:09:28.207901 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2142/4410] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:09:27 2022] POST /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309/action => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:09:28.222191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:28.223458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:28.232384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:28.233406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:28.234226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:28.235460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:28.236208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:28.237152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:28.418872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44114105ac6d4e1daf262bbd4b212f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77512d0f6f04753b1d86fd2884cf39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:28.427296 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22f1c36e-9642-4320-a2f6-bc0641a1859c tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 200 len: 1305 microversion: 2.1 time: 0.406314 Oct 19 07:09:28.427885 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2269/4411] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:28 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 1305 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:28.475780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:28.476834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:28.494873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:28.496710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:28.501260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:28.502117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:28.503696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:28.505560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:28.506675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:28.519354 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9120804-777f-44f0-89f5-62723b59e840 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1253 microversion: 2.1 time: 0.300222 Oct 19 07:09:28.544583 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2143/4412] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:28 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1253 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:28.994046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:28.994873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:29.014157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.014664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.025183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.029219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.029219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.029219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.321750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:29.341605 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6cb9a690-8f96-4104-8f0a-40bcead657d6 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1493 microversion: 2.1 time: 0.889034 Oct 19 07:09:29.345392 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2270/4413] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:28 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1493 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:29.451100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:29.451645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:29.464732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.465293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.467990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.468837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.469321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.469769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.529499 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be HTTP/1.1 Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '37390f79-bc12-43de-8da6-c7fab445d1be'} Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:29.547263 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.552693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:29.552693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:29.552693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:29.552693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:29.552693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:29.552693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.552693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.557013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:29.560720 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b883126e-29ec-44ee-a9b9-06c5ead49f0b tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 404 len: 111 microversion: 2.1 time: 0.113724 Oct 19 07:09:29.573498 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2271/4414] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:29 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:09:29.588772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:29.589409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:29.614964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:29.619077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.624184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.626737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.631694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.634936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.636196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:29.637947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:29.638430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.647934 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3adc6051-5a6f-486d-87cd-4df84c780890 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.662345 Oct 19 07:09:29.653517 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2144/4415] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:28 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:29.672341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:29.676745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:29.690987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.698005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.698005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.698005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.698714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.704142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.742534 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be HTTP/1.1 Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '37390f79-bc12-43de-8da6-c7fab445d1be'} Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:29.746125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.750236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.762552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:29.766941 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b272959-cd3e-4b0e-aae2-2efd460adf3a tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 404 len: 111 microversion: 2.1 time: 0.109222 Oct 19 07:09:29.766941 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2145/4416] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:09:29 2022] DELETE /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:29.781545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:29.784036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 37390f79-bc12-43de-8da6-c7fab445d1be] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:29.814910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.822494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.823017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.823800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.824310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.824860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.901761 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be HTTP/1.1 Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '37390f79-bc12-43de-8da6-c7fab445d1be'} Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:29.903384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.907560 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:29.907560 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:29.907560 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:29.907560 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:29.907560 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:29.907560 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. Oct 19 07:09:29.907560 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:29.915607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 37390f79-bc12-43de-8da6-c7fab445d1be could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:29.916597 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2c9f179-e360-4101-a1be-9253ccbd17bb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be" status: 404 len: 111 microversion: 2.1 time: 0.146520 Oct 19 07:09:29.917181 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2146/4417] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:29 2022] GET /compute/v2.1/servers/37390f79-bc12-43de-8da6-c7fab445d1be => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:29.959767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:29.960387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:29.985571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.986096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:29.986553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:29.997019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:29.999373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:30.001088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.003742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.010214 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8df1c0ae-4ffb-4592-b876-e1c561f3bc92 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1253 microversion: 2.1 time: 0.435506 Oct 19 07:09:30.013464 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2272/4418] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:29 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1253 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:30.108266 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 HTTP/1.1 Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '7c24e3e8-564b-442b-bc22-8bba1eb12244'} Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:30.118855 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:30.124158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c3ea244-d3a2-4d4a-9f38-58f579da5422 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 404 len: 111 microversion: 2.1 time: 0.189098 Oct 19 07:09:30.131777 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2147/4419] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:09:29 2022] DELETE /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:30.137553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:30.138278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 7c24e3e8-564b-442b-bc22-8bba1eb12244] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:30.147988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.153170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.157888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.159084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.161276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.168730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.207627 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 HTTP/1.1 Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '7c24e3e8-564b-442b-bc22-8bba1eb12244'} Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.237928 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.241625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.241625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.241625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.241625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:30.241625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:30.241625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. Oct 19 07:09:30.241625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.241625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 7c24e3e8-564b-442b-bc22-8bba1eb12244 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:30.241625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf675b28-545c-4067-9e04-c98d81974395 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244" status: 404 len: 111 microversion: 2.1 time: 0.105821 Oct 19 07:09:30.244326 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2273/4420] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:30 2022] GET /compute/v2.1/servers/7c24e3e8-564b-442b-bc22-8bba1eb12244 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:30.250847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:30.251436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:30.272232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.272232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.272232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.281967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.282752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.283460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.312789 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 HTTP/1.1 Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'c5ad9c08-f496-42f8-8d06-6009bd9ec758'} Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:30.316918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.320736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.324921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:30.330544 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51237a71-ca3d-4f4e-8ce4-bdf8f60bbf4d tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 404 len: 111 microversion: 2.1 time: 0.086142 Oct 19 07:09:30.332018 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2148/4421] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:09:30 2022] DELETE /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:30.344950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:30.345809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: c5ad9c08-f496-42f8-8d06-6009bd9ec758] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:30.358704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.359211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.359651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.367880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:30.368760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:30.373345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.377026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.377685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.378304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.379058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.380755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.381644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.392818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.392818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.437596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 HTTP/1.1 Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c5ad9c08-f496-42f8-8d06-6009bd9ec758'} Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.440253 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.446091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.446091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.446091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.446091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:30.446091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:30.446091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. Oct 19 07:09:30.446091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.457092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance c5ad9c08-f496-42f8-8d06-6009bd9ec758 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:30.459778 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4e523d2-175a-47d5-be39-d8011a00d1e7 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758" status: 404 len: 111 microversion: 2.1 time: 0.118129 Oct 19 07:09:30.460923 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2274/4422] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:30 2022] GET /compute/v2.1/servers/c5ad9c08-f496-42f8-8d06-6009bd9ec758 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:09:30.474518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:30.475325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:30.502009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.508421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.509188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.511750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.512476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.513152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.550294 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 HTTP/1.1 Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'ffa9ebb5-481e-4e20-b395-95dd86979b90'} Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:30.553091 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.557294 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.558812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:30.559873 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b50de597-1933-4d52-8504-c42176ecd0ab tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 404 len: 111 microversion: 2.1 time: 0.094760 Oct 19 07:09:30.564880 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2275/4423] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:09:30 2022] DELETE /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:30.571072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:30.575996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: ffa9ebb5-481e-4e20-b395-95dd86979b90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:30.581772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.582735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.583402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.585153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.586075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.586730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.606341 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 HTTP/1.1 Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'ffa9ebb5-481e-4e20-b395-95dd86979b90'} Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.610077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.613887 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.613887 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.613887 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.613887 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:30.613887 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:30.613887 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. Oct 19 07:09:30.613887 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.617533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance ffa9ebb5-481e-4e20-b395-95dd86979b90 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:30.618764 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7222d1b9-f122-44db-9cfb-871992183535 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90" status: 404 len: 111 microversion: 2.1 time: 0.051957 Oct 19 07:09:30.623131 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2276/4424] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:30 2022] GET /compute/v2.1/servers/ffa9ebb5-481e-4e20-b395-95dd86979b90 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:30.632319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6dd326a0-b2e2-45b5-b193-c8b15cf3666e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:30.633357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6dd326a0-b2e2-45b5-b193-c8b15cf3666e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 95c278e5-bc7e-415e-b746-5d1d6b423ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:30.640929 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6dd326a0-b2e2-45b5-b193-c8b15cf3666e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6dd326a0-b2e2-45b5-b193-c8b15cf3666e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7 HTTP/1.1 Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '95c278e5-bc7e-415e-b746-5d1d6b423ea7'} Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.643132 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.650425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.650425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.650425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.650425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:30.650425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:30.650425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.650425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.653793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6dd326a0-b2e2-45b5-b193-c8b15cf3666e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:30.656904 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6dd326a0-b2e2-45b5-b193-c8b15cf3666e tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7" status: 404 len: 111 microversion: 2.1 time: 0.029018 Oct 19 07:09:30.656904 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2277/4425] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:09:30 2022] DELETE /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:30.663786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a2f2ca5-231b-4940-8ee7-8a037f95c483 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:30.664451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a2f2ca5-231b-4940-8ee7-8a037f95c483 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 95c278e5-bc7e-415e-b746-5d1d6b423ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:30.673243 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5a2f2ca5-231b-4940-8ee7-8a037f95c483 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a2f2ca5-231b-4940-8ee7-8a037f95c483 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7 HTTP/1.1 Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '95c278e5-bc7e-415e-b746-5d1d6b423ea7'} Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:30.674921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:30.678947 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:30.678947 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:30.678947 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:30.678947 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. Oct 19 07:09:30.678947 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:30.678947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a2f2ca5-231b-4940-8ee7-8a037f95c483 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 95c278e5-bc7e-415e-b746-5d1d6b423ea7 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:30.678947 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a2f2ca5-231b-4940-8ee7-8a037f95c483 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7" status: 404 len: 111 microversion: 2.1 time: 0.016932 Oct 19 07:09:30.678947 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2278/4426] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:30 2022] GET /compute/v2.1/servers/95c278e5-bc7e-415e-b746-5d1d6b423ea7 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:30.695132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:30.696140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:30.711654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.716228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.716965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:30.718457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:30.719107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:30.720680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:31.190043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:31.203247 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b56cf731-8633-4f5b-8ba7-42a2717792f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1514 microversion: 2.1 time: 0.839876 Oct 19 07:09:31.207144 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2149/4427] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:30 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1514 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:31.239145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:31.244262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:31.257456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:31.267734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:31.268277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:31.268757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:31.277419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:31.280388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:31.281129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:31.283133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:31.290375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:31.296592 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3c45807-bf41-4d83-b396-87f41844e1f7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.617876 Oct 19 07:09:31.298921 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2279/4428] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:30 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:31.506650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271263f7a46e48218d4417a01c56832b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00fa11f6d5486481b4900e70be3705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:31.516945 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e4983c4-18f9-4af5-816f-612a8187f500 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 200 len: 1253 microversion: 2.1 time: 0.308615 Oct 19 07:09:31.521421 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2150/4429] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:31 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 1253 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:32.248325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:32.252683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:32.277413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:32.277916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:32.278359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:32.279076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:32.279535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:32.279964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:32.332177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:32.332865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:32.359285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:32.359830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:32.365306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:32.368586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:32.370102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:32.371162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:32.993055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:33.004500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:33.009064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:33.013089 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae1d7a75-4bfa-40c9-8447-d318675f61b8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 0.783829 Oct 19 07:09:33.017250 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2280/4430] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:32 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:33.020913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:33.026402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:33.029013 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c39e7d84-cc62-46d5-bd3a-029e4cfbbf08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.702227 Oct 19 07:09:33.030681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] [instance: 8166ede1-9eae-4ddd-ba55-3b767c235fc3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:33.047020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:33.047887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:33.048308 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2151/4431] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:32 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:33.049705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:33.052249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:33.054269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:33.054918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:33.087298 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] HTTP exception thrown: Instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 could not be found. Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Request method failure captured: Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 HTTP/1.1 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6Hr6Wpot82j4zBeqSuMrZf1tosFgEGPVi2YLQyrV0JxfZLNsKKfZ4pUsIG1kDY3bWOJwyYgciTZrffNfxjYQogyTSP-5lKeTkVP39PGLPhi8bhwpyDOGlpZ3nd6dKHf4ung9Gn5oMAKJH-_BPB1DkE1_n7hZ_-kTR-TKu8pzJKq1K4 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: dc00fa11f6d5486481b4900e70be3705 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestBootFromVolume-911684312 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dc00fa11f6d5486481b4900e70be3705"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc00fa11f6d5486481b4900e70be3705"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc00fa11f6d5486481b4900e70be3705"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dc00fa11f6d5486481b4900e70be3705", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestBootFromVolume-911684312 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: dc00fa11f6d5486481b4900e70be3705 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestBootFromVolume-911684312 Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestBootFromVolume-911684312-project Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 271263f7a46e48218d4417a01c56832b Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestBootFromVolume-911684312-project Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 could not be found. Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '8166ede1-9eae-4ddd-ba55-3b767c235fc3'} Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 could not be found. Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 could not be found. Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:33.089413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:33.095670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:33.095670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:33.095670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:33.095670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:33.095670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:33.095670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 could not be found. Oct 19 07:09:33.095670 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:09:33.095670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Returning 404 to user: Instance 8166ede1-9eae-4ddd-ba55-3b767c235fc3 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:33.097380 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc0e5251-57b4-4d43-81d8-3e8d69d5d959 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3" status: 404 len: 111 microversion: 2.1 time: 0.073339 Oct 19 07:09:33.098442 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2281/4432] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:33 2022] GET /compute/v2.1/servers/8166ede1-9eae-4ddd-ba55-3b767c235fc3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:33.106788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c2788fe-de6c-4baa-b30a-7cc42b8f5f20 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] Calling method '.version_select at 0x7f6d64fe9f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:33.237221 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c2788fe-de6c-4baa-b30a-7cc42b8f5f20 tempest-ServersTestBootFromVolume-911684312 tempest-ServersTestBootFromVolume-911684312-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1191074714" status: 202 len: 0 microversion: 2.1 time: 0.131370 Oct 19 07:09:33.243713 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2152/4433] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1191074714 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:09:34.046362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:34.047057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:34.066037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:34.067331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:34.091827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:34.093761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:34.097954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:34.098860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:34.103123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:34.106538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:34.107834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:34.108838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:34.110628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:34.117234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:34.121502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:34.125495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:34.728734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:34.743640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:34.748006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:34.755515 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4850747b-a5cd-4857-a840-6d9b878e41c4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.696962 Oct 19 07:09:34.760416 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2153/4434] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:34 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:35.107514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:35.127402 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9ce2ca3-d1ad-4995-b89c-2c067275cb07 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 1.084600 Oct 19 07:09:35.132440 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2282/4435] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:34 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:35.792025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:35.792680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:35.803688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:35.820140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:35.820859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:35.821824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:35.824095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:35.830743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:36.155507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:36.156190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:36.201744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:36.226046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:36.243804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:36.250521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:36.251373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:36.254782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:36.644520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:36.662598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:36.675889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:36.704366 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f638f391-c3b2-4611-bd3c-9b72b45e0205 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.907541 Oct 19 07:09:36.704366 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2154/4436] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:35 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:37.724370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:37.725722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:37.751186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:37.756407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:37.757345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:37.758312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:37.767862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:37.771861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:38.220802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:38.242587 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02269cc1-68e7-46d5-964e-50f7ba481ce5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 2.092109 Oct 19 07:09:38.244699 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2283/4437] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:36 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:38.265047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-cb8b1c38-c0a3-4aae-87fd-fda472700ba7 req-493f4e3e-2cc6-4ccd-987f-50eb42f44d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45a1749-93d8-4842-9251-95117b90a309", "name": "network-vif-plugged", "status": "completed", "tag": "4d508603-62c3-4929-988f-c99746ed6182"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:38.292894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cb8b1c38-c0a3-4aae-87fd-fda472700ba7 req-493f4e3e-2cc6-4ccd-987f-50eb42f44d01 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:38.297066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cb8b1c38-c0a3-4aae-87fd-fda472700ba7 req-493f4e3e-2cc6-4ccd-987f-50eb42f44d01 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:38.297797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cb8b1c38-c0a3-4aae-87fd-fda472700ba7 req-493f4e3e-2cc6-4ccd-987f-50eb42f44d01 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:38.326154 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-cb8b1c38-c0a3-4aae-87fd-fda472700ba7 req-493f4e3e-2cc6-4ccd-987f-50eb42f44d01 service nova] Creating event network-vif-plugged:4d508603-62c3-4929-988f-c99746ed6182 for instance c45a1749-93d8-4842-9251-95117b90a309 on n-h1-861333-10 Oct 19 07:09:38.351928 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-cb8b1c38-c0a3-4aae-87fd-fda472700ba7 req-493f4e3e-2cc6-4ccd-987f-50eb42f44d01 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096275 Oct 19 07:09:38.351928 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2284/4438] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:38.444668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:38.456392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:38.468668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:38.472180 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5faad9eb-c888-48ab-9aec-f6ba259d0cde tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.750826 Oct 19 07:09:38.472812 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2155/4439] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:37 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:09:39.276505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:39.278000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:39.293624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:39.296359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:39.297075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:39.298571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:39.300475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:39.303563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:39.512592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:39.515274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:39.545975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:39.548624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:39.551733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:39.555962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:39.565915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:39.569299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:40.146846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:40.164893 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75d937ea-4a78-46ee-ab2e-d3d843d18322 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 0.895260 Oct 19 07:09:40.180138 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2285/4440] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:39 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:41.184472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:41.197401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:41.199338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:41.200588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:41.215537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:41.220884 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-121bd89c-25ce-4a10-a1c4-b85e050ccf78 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 1.720192 Oct 19 07:09:41.225750 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2156/4441] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:39 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:09:41.231211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.233410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.235536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:41.251259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.254126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.255040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:41.434697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:41.434697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:41.446945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.460911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.462121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:41.471188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.472072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.477092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:41.478117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:41.503638 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 HTTP/1.1 Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9'} Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:41.523139 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.527131 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.530457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:41.538999 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9b3e825-cdd1-4698-9bbc-cb964672f7fb tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 404 len: 111 microversion: 2.1 time: 0.113928 Oct 19 07:09:41.541850 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2157/4442] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:09:41 2022] DELETE /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:09:41.564756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:41.566217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:41.597104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.604827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.609440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:41.610372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.616762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.617365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:41.687068 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 HTTP/1.1 Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9'} Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:41.707388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.712218 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:41.712218 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:41.712218 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:41.712218 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:41.712218 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:41.712218 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. Oct 19 07:09:41.712218 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.720471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:41.722280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a123aa63-02b3-4937-92f9-57fa763a2dfd tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9" status: 404 len: 111 microversion: 2.1 time: 0.172391 Oct 19 07:09:41.728247 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2158/4443] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:41 2022] GET /compute/v2.1/servers/a524e9c2-7f8c-4f28-a6d6-24ee6c6738a9 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:41.745222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:41.762026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:41.783341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.787450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.791951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:41.801098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.801746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.805196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:41.855608 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b HTTP/1.1 Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4c15c629-a490-4e4a-82bb-0b6f166b451b'} Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:41.866770 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:41.870513 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:41.874444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:41.875568 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-757eb849-e247-4fd2-bfa1-eb763fb9cb27 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 404 len: 111 microversion: 2.1 time: 0.143543 Oct 19 07:09:41.878987 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2159/4444] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:09:41 2022] DELETE /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:41.891886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:41.899564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] [instance: 4c15c629-a490-4e4a-82bb-0b6f166b451b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:41.926324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.952463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.953440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:41.954454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:41.955173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:41.955838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:42.007156 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] HTTP exception thrown: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Request method failure captured: Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b HTTP/1.1 Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6FnyjLhYTiOuRFbjClSAI_3cVjQZXgGs-lHAFRJq3oP_1VJifk18MR3wvy7B7LHjphW3MyJdT3eZAYGA2fvcFxqi9PCD5dsMYG7GGu0TrIMtSWa-tvjRxTPAQdIqUZoTAMw7E5HJ37llDBu__NMjMSjcohc1ATcm1okWglAW-uAqWE Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e77512d0f6f04753b1d86fd2884cf39c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e77512d0f6f04753b1d86fd2884cf39c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: e77512d0f6f04753b1d86fd2884cf39c Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-113841651 Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 44114105ac6d4e1daf262bbd4b212f5e Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-113841651-project Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4c15c629-a490-4e4a-82bb-0b6f166b451b'} Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:09:42.018495 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:42.025481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:09:42.025481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:09:42.025481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:09:42.025481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:09:42.025481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:09:42.025481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. Oct 19 07:09:42.025481 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:09:42.025481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] Returning 404 to user: Instance 4c15c629-a490-4e4a-82bb-0b6f166b451b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:09:42.025481 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e82bc4d-8e8e-464f-b99a-35efbc3ce4c4 tempest-DeleteServersTestJSON-113841651 tempest-DeleteServersTestJSON-113841651-project] 10.222.0.39 "GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b" status: 404 len: 111 microversion: 2.1 time: 0.139004 Oct 19 07:09:42.027961 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2160/4445] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:41 2022] GET /compute/v2.1/servers/4c15c629-a490-4e4a-82bb-0b6f166b451b => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:09:42.068662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:42.083707 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9afbca6-5778-4fb2-a247-9711ca4726c4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 0.889401 Oct 19 07:09:42.100432 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2286/4446] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:41 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:42.253750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:42.254377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:42.262405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:42.263872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:42.264403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:42.264845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:42.265566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:42.266025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:42.268197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:43.112157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:43.113960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:43.135161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:43.162327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:43.162327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:43.162327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:43.162327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:43.162327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:44.236301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:44.248399 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54fe4d81-0644-4be8-be73-96fcde00dc51 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 1.142420 Oct 19 07:09:44.249160 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2287/4447] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:43 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:09:44.323382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:44.335455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:44.355659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:44.378111 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b073a0e4-aa94-4acb-ba8f-9cce81eeb488 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 2.109203 Oct 19 07:09:44.382707 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2161/4448] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:42 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:45.276082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:45.276713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:45.285752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:45.302894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:45.303645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:45.305446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:45.306090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:45.306695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:45.389669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:45.390282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:45.408868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:45.415254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:45.415254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:45.415254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:45.415254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:45.415254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:46.457318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:46.476028 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aaae3085-d11e-41ef-a8bf-2c7c8671d5ca tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 1.203643 Oct 19 07:09:46.477071 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2288/4449] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:45 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:47.335128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:47.377568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:47.381104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:47.386934 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-145917f4-46e4-49ee-a01a-4051ed98b7d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 1.998331 Oct 19 07:09:47.405198 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2162/4450] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:45 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:47.505213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:47.505818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:47.533959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:47.542308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:47.547149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:47.549231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:47.550139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:47.552257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:48.424301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:48.425665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:48.455632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:48.460535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:48.461487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:48.462552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:48.466452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:48.472945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:49.138493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:49.172016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:49.174300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:49.184847 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e3d7dde-9286-4dfe-a01c-bd4c2dd77553 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1740 microversion: 2.20 time: 0.761403 Oct 19 07:09:49.201322 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2163/4451] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:48 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1740 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:09:49.452625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:49.464256 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b7e3150-9552-4b0b-97c6-25c859d1d6f7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 1.964772 Oct 19 07:09:49.477689 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2289/4452] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:47 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:50.218461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:50.219082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:50.229184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:50.230004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:50.230664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:50.231603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:50.232255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:50.232849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:50.495049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:50.496680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:50.515140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:50.518211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:50.519874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:50.522111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:50.522991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:50.526676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:51.111323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:51.120926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:51.125260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:51.137278 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dfc89c69-4ef3-4078-a862-d276189a9cda tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1722 microversion: 2.20 time: 0.922699 Oct 19 07:09:51.164570 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2164/4453] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:50 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1722 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:51.358089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:51.387608 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8bd70bb-047d-4c6c-a78a-6a75c43f18a9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 0.900275 Oct 19 07:09:51.410236 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2290/4454] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:50 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:52.173151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:52.175672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:52.184445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:52.189246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:52.189246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:52.189246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:52.189246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:52.189246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:52.418801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:52.419767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:52.443478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:52.445885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:52.447282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:52.448067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:52.454712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:52.455398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:53.139845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:53.155618 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9026df9-c1ee-403d-92e9-d9bf86f82736 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 0.743517 Oct 19 07:09:53.158470 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2291/4455] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:52 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:53.731049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:53.747562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:53.749089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:53.758119 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-973c7d2b-3324-4f7b-a3c5-f822dfbb43b4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1722 microversion: 2.20 time: 1.589376 Oct 19 07:09:53.764231 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2165/4456] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:52 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1722 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:53.980888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ec4a8463-1318-4da8-83e2-60380a9c5663 req-1554b961-d18b-4b5d-b551-cefe9ab67c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf", "name": "network-vif-unplugged", "status": "completed", "tag": "d36dab0c-9d83-4aa8-b6bb-531eafbf58f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:09:54.011455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec4a8463-1318-4da8-83e2-60380a9c5663 req-1554b961-d18b-4b5d-b551-cefe9ab67c26 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:54.011672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec4a8463-1318-4da8-83e2-60380a9c5663 req-1554b961-d18b-4b5d-b551-cefe9ab67c26 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:54.012326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec4a8463-1318-4da8-83e2-60380a9c5663 req-1554b961-d18b-4b5d-b551-cefe9ab67c26 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:54.025901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:54.046648 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ec4a8463-1318-4da8-83e2-60380a9c5663 req-1554b961-d18b-4b5d-b551-cefe9ab67c26 service nova] Creating event network-vif-unplugged:d36dab0c-9d83-4aa8-b6bb-531eafbf58f6 for instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf on n-h1-861333-10 Oct 19 07:09:54.067248 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ec4a8463-1318-4da8-83e2-60380a9c5663 req-1554b961-d18b-4b5d-b551-cefe9ab67c26 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091519 Oct 19 07:09:54.068049 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2292/4457] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:09:54.187020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:54.188923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:54.213073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:54.213564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:54.214126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:54.216240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:54.218971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:54.220068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:54.788588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:54.789713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:54.797698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=58 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:09:54.812792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:54.813724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:54.817573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:54.818526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:54.820201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:54.821452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:55.415023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:55.429550 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7578c0f7-4b8e-4325-af5c-6b2167b30d7c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 1.246476 Oct 19 07:09:55.433761 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2166/4458] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:54 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:56.182327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:56.202339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:56.219839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:56.225424 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97055b1b-5fb9-45de-bccc-9fb5a114293a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1722 microversion: 2.20 time: 1.442245 Oct 19 07:09:56.228509 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2293/4459] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:54 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1722 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:56.462542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:56.464343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:56.494221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:56.498208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:56.498990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:56.501885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:56.502631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:56.503691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:56.978915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:57.018504 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b90de1c2-ea95-46d2-bfb9-c05ce91dc7cb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 0.566800 Oct 19 07:09:57.021903 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2167/4460] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:56 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:57.268707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:57.271301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:57.292796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:57.301331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:57.301331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:57.301331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:57.306879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:57.307278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:58.047232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:58.048647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:58.059237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:58.059745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:58.060283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:58.065319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:58.066214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:58.066665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:58.899095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:58.918176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:58.928657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:58.937121 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db0a3d3d-d7ef-4430-bee0-c14c05eb1a27 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1722 microversion: 2.20 time: 1.676090 Oct 19 07:09:58.942218 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2294/4461] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:57 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1722 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:09:59.090832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:09:59.108791 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a169586-5830-41d5-8947-7df07f9f768c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 1.065954 Oct 19 07:09:59.109383 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2168/4462] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:09:58 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:09:59.971013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:09:59.972437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:09:59.985806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:59.986460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:59.990104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:09:59.997916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:09:59.997916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:09:59.997916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:00.136853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:00.137590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:00.148829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:00.149501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:00.152638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:00.153512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:00.154096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:00.154839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:00.656165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:00.666728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:00.668336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:00.669779 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b020ff8-1abd-4900-8530-a1908d415cf6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1665 microversion: 2.20 time: 0.702783 Oct 19 07:10:00.674401 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2295/4463] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:09:59 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1665 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:00.700268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6cbe8b57-4f41-4071-b7ea-55b19f539ecf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df783e7c-0a02-4c6a-9855-14d8b118b826"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:00.702944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6cbe8b57-4f41-4071-b7ea-55b19f539ecf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:00.719337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbe8b57-4f41-4071-b7ea-55b19f539ecf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:00.720287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbe8b57-4f41-4071-b7ea-55b19f539ecf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:00.724509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbe8b57-4f41-4071-b7ea-55b19f539ecf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:00.725496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbe8b57-4f41-4071-b7ea-55b19f539ecf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:00.726821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbe8b57-4f41-4071-b7ea-55b19f539ecf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:00.727728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbe8b57-4f41-4071-b7ea-55b19f539ecf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:01.565020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:01.575783 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-332a03db-d632-42c3-99f2-681bf205d211 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 1.443022 Oct 19 07:10:01.581035 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2169/4464] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:00 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:10:02.445945 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6cbe8b57-4f41-4071-b7ea-55b19f539ecf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.750604 Oct 19 07:10:02.447807 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2296/4465] 10.222.0.39 () {62 vars in 1364 bytes} [Wed Oct 19 07:10:00 2022] POST /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments => generated 188 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 07:10:02.607172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:02.607777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:02.616213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:02.616728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:02.617195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:02.618402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:02.618402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:02.618755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:02.781557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:02.781557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:02.818007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:02.822290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:02.823109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:02.827331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:02.835214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:02.836245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:02.971670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 07:10:03.085550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:03.106068 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48ec72ae-50ac-4167-8395-b024ed44b29b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 0.503595 Oct 19 07:10:03.122342 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2170/4466] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:02 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:03.313054 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a723ffc-1847-46a0-832d-d6df0fcc5f2a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/action" status: 202 len: 0 microversion: 2.20 time: 0.544684 Oct 19 07:10:03.314893 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2297/4467] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 07:10:02 2022] POST /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:10:03.323275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:03.324916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:03.335625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:03.336171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:03.336737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:03.337340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:03.337811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:03.338242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:03.891655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:03.905628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:03.907616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:03.908866 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3aebd76-20e7-4aef-9fcd-eecd24490fcc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1751 microversion: 2.20 time: 0.590191 Oct 19 07:10:03.931463 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2171/4468] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:03 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1751 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:04.147477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:04.148124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:04.166526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:04.167421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:04.168038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:04.172040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:04.172040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:04.172040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:04.424554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:04.461371 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6de5be62-cb10-4be9-933e-cffb2e1860a5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1509 microversion: 2.1 time: 0.313259 Oct 19 07:10:04.476165 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2298/4469] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:04 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:10:04.938753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:04.939523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:04.947852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:04.948437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:04.949137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:04.950114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:04.950789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:04.951488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:05.398456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:05.420363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:05.422028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:05.423246 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-83121562-0967-44ce-9894-aec320ca69be tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1751 microversion: 2.20 time: 0.488395 Oct 19 07:10:05.423814 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2172/4470] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:04 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1751 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:05.486294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:05.487834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:05.495418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:05.496286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:05.497176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:05.498246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:05.498927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:05.499996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:06.449042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:06.449752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:06.457005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:06.457181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:06.457536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:06.458241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:06.458691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:06.459117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:06.757079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:06.795599 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d57612e-814d-461d-8215-4b7011da4097 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1506 microversion: 2.1 time: 1.311770 Oct 19 07:10:06.798836 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2299/4471] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:05 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1506 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:06.962105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:06.979143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:06.981314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:06.982612 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b693a8e0-1484-4301-8497-fbc6e893c28b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1753 microversion: 2.20 time: 0.537759 Oct 19 07:10:06.986461 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2173/4472] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:06 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1753 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:10:07.732682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8590a226-61d2-4bc3-a087-72a729d39d91 req-fd94d464-a792-4e37-bc91-4deba4b6e41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45a1749-93d8-4842-9251-95117b90a309", "name": "network-vif-unplugged", "status": "completed", "tag": "4d508603-62c3-4929-988f-c99746ed6182"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:07.752953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8590a226-61d2-4bc3-a087-72a729d39d91 req-fd94d464-a792-4e37-bc91-4deba4b6e41d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:07.758160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8590a226-61d2-4bc3-a087-72a729d39d91 req-fd94d464-a792-4e37-bc91-4deba4b6e41d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:07.758738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8590a226-61d2-4bc3-a087-72a729d39d91 req-fd94d464-a792-4e37-bc91-4deba4b6e41d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:07.798252 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8590a226-61d2-4bc3-a087-72a729d39d91 req-fd94d464-a792-4e37-bc91-4deba4b6e41d service nova] Creating event network-vif-unplugged:4d508603-62c3-4929-988f-c99746ed6182 for instance c45a1749-93d8-4842-9251-95117b90a309 on n-h1-861333-10 Oct 19 07:10:07.812934 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8590a226-61d2-4bc3-a087-72a729d39d91 req-fd94d464-a792-4e37-bc91-4deba4b6e41d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079125 Oct 19 07:10:07.812934 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2300/4473] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:10:07.822726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:07.823362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:07.843277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:07.843809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:07.844313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:07.845045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:07.845514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:07.845949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:08.016783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:08.017840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:08.030565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:08.032606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:08.038478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:08.038478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:08.038478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:08.038478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:08.144540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:08.181881 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecb65965-6f43-47ba-b164-c7ce63507ae8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1506 microversion: 2.1 time: 0.344825 Oct 19 07:10:08.201757 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2174/4474] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:07 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:08.487087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:08.498657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:08.503009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:08.512672 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f361cb9-5dfc-4d33-98ce-0e4f416b88f3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1753 microversion: 2.20 time: 0.494364 Oct 19 07:10:08.513630 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2301/4475] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:08 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1753 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:10:09.208430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:09.209872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:09.222958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:09.228037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:09.228797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:09.231978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:09.232754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:09.233356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:09.549304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:09.551017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:09.565891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:09.566628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:09.567787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:09.571900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:09.572707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:09.573413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:10.130478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:10.145987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:10.147822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:10.151707 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-475c6028-b0f9-4c88-8fa5-06e03c03b145 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1753 microversion: 2.20 time: 0.606512 Oct 19 07:10:10.152533 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2302/4476] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:09 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1753 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:10.363688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:10.374702 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-50362945-a508-49e3-b206-6a84ba49aa43 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 200 len: 1449 microversion: 2.1 time: 1.170487 Oct 19 07:10:10.375458 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2175/4477] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:09 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 1449 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:10.411082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:10.412161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:10.426117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:10.429102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:10.429777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:10.432284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:10.433170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:10.433966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:11.026397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:11.048909 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ecf41160-107c-40f2-aab8-14b625fabcfd tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.649408 Oct 19 07:10:11.049532 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2303/4478] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:10 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:11.097731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:11.099099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:11.113641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:11.113641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:11.113641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:11.116091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:11.116916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:11.117604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:11.156818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:11.191814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:11.192488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:11.202636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:11.203148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:11.203602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:11.207909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:11.208728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:11.210791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:12.491185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:12.501932 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c23a0aca-b140-42fd-99b2-3ad0545b0356 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 1.413491 Oct 19 07:10:12.510445 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2176/4479] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:11 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:12.535225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:12.535846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:12.573020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:12.573530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:12.573974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:12.584594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:12.585842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:12.586996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:12.741320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:12.773577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:12.777126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:12.779006 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-207a5c9b-f734-48c9-9ed5-4739cf069932 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1753 microversion: 2.20 time: 1.594589 Oct 19 07:10:12.780799 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2304/4480] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:11 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1753 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:13.095260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:13.108554 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-569466f9-a148-4c72-b9a3-6dfa3dea1a45 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.580209 Oct 19 07:10:13.112995 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2177/4481] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:12 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:13.135930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:13.136861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:13.144966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:13.145819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:13.146275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:13.147034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:13.147496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:13.147935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:13.796076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:13.812266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:13.814132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:13.817264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=34 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:13.819993 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d5777a6-8519-4d92-b500-5d03812a50e0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.688684 Oct 19 07:10:13.829456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:13.845195 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2305/4482] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:13 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:13.846189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:13.850850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:13.857038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:13.858231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e56c41de-3a53-447e-ac12-e8e236907604 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:13.858923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:13.861339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:13.870852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e56c41de-3a53-447e-ac12-e8e236907604 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:13.875087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e56c41de-3a53-447e-ac12-e8e236907604 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:13.875722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e56c41de-3a53-447e-ac12-e8e236907604 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:13.925589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:13.929786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e56c41de-3a53-447e-ac12-e8e236907604 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Going to try to stop instance {{(pid=127567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 07:10:14.177189 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e56c41de-3a53-447e-ac12-e8e236907604 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.323909 Oct 19 07:10:14.177818 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2306/4483] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:10:13 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:10:14.188392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:14.202388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:14.216942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:14.219096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:14.219671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:14.222597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:14.223343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:14.230528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:14.501063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:14.519297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:14.524432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:14.529727 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-120a0211-9a04-445e-8fc2-5cf755cd04a8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1753 microversion: 2.20 time: 0.720031 Oct 19 07:10:14.533707 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2178/4484] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:13 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1753 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:14.806799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:14.815627 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74fe4bc7-f16a-445e-a3e4-a78b43b2bce8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.632505 Oct 19 07:10:14.817536 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2307/4485] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:14 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:15.562078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:15.562610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:15.578744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:15.583000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:15.583000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:15.584709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:15.585328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:15.587554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:15.840406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:15.841880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:15.858616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:15.860594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:15.861633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:15.865814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:15.866863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:15.868353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:16.276808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:16.301728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:16.301728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:16.301728 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0dd8ad02-c1e1-41ca-a43c-cfa7f2549817 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.742661 Oct 19 07:10:16.303332 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2179/4486] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:15 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:16.853530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:16.870454 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca2a5a7b-d68f-403e-847f-cbb146d7ebd0 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 1.034245 Oct 19 07:10:16.890427 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2308/4487] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:15 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:17.333511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:17.334131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:17.348518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:17.349283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:17.349904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:17.356985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:17.357725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:17.358339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:17.902230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:17.903037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:17.934582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:17.937835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:17.939648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:17.944339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:17.946101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:17.950146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:18.103351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:18.111336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:18.120785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:18.122571 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6e910d0-6526-4567-b8a7-503f4223ea08 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.793657 Oct 19 07:10:18.126856 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2180/4488] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:17 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:18.795349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:18.804946 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1d096d4-dc84-4694-9d72-d7d2862ae576 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.909295 Oct 19 07:10:18.805667 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2309/4489] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:17 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:19.158134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:19.158913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:19.166654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:19.167386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:19.168089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:19.171279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:19.171966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:19.172672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:19.505762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:19.523550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:19.527121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:19.527121 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed189f1f-d7b4-42bd-bd64-a7b5fd837136 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.371980 Oct 19 07:10:19.527121 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2181/4490] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:19 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:19.830078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:19.830695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:19.847726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:19.848247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:19.848700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:19.850050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:19.850523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:19.850959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:19.951275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8d05a13c-056f-4a18-b7ec-0b1a847db804 req-13ed25e7-50d6-44e2-8bb3-b07b644d747d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf", "tag": "d36dab0c-9d83-4aa8-b6bb-531eafbf58f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:19.964947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8d05a13c-056f-4a18-b7ec-0b1a847db804 req-13ed25e7-50d6-44e2-8bb3-b07b644d747d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:19.964947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8d05a13c-056f-4a18-b7ec-0b1a847db804 req-13ed25e7-50d6-44e2-8bb3-b07b644d747d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:19.964947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8d05a13c-056f-4a18-b7ec-0b1a847db804 req-13ed25e7-50d6-44e2-8bb3-b07b644d747d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:20.008272 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8d05a13c-056f-4a18-b7ec-0b1a847db804 req-13ed25e7-50d6-44e2-8bb3-b07b644d747d service nova] Creating event network-changed:d36dab0c-9d83-4aa8-b6bb-531eafbf58f6 for instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf on n-h2-861333-10 Oct 19 07:10:20.026967 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8d05a13c-056f-4a18-b7ec-0b1a847db804 req-13ed25e7-50d6-44e2-8bb3-b07b644d747d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377878 Oct 19 07:10:20.028141 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2310/4491] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:10:20.343096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:20.353909 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8650b206-039c-49ad-b322-cf2107906122 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 0.527711 Oct 19 07:10:20.355493 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2182/4492] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:19 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:20.557728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:20.558432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:20.570281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:20.571975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:20.576168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:20.576168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:20.576168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:20.576168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:21.290932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1108498936", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "964ba4bb-d6a4-4452-9c66-5250667e57d2"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:21.438130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] validate_networks() for [('964ba4bb-d6a4-4452-9c66-5250667e57d2', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:10:22.140719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:22.170007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:22.184741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:22.196602 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5b2163f-7059-4044-ac5c-1f41a695eb46 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 1.640342 Oct 19 07:10:22.199362 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2311/4493] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:20 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:22.231709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:22.249919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:22.289425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:22.291506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:22.299461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:22.299461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:22.299461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:22.299461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:22.994945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:10:22.995440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:10:22.995847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:10:22.999355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:10:22.999911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:10:23.025454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:23.026070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:23.030844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:23.037315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:23.039146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:23.039624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:23.116973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Getting quotas for project c481a0b055cc4683ac688f94398122cb. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:10:23.138751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Getting quotas for user 613a6cdb6b7146079687a249c75eb22d and project c481a0b055cc4683ac688f94398122cb. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:10:23.202312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Going to run 3 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:10:23.205998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:10:23.415329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=08870b64-b146-4c26-a37a-b9539dbe2bf1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:10:23.627533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=228a31d6-e376-44d4-9300-ce6437e626c9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:10:23.639457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:23.649917 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27456b86-076a-4650-acce-65dbaeac909f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1680 microversion: 2.1 time: 1.430740 Oct 19 07:10:23.654636 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2312/4494] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:22 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1680 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:23.684376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:23.684376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:23.703152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:23.703686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:23.704233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:23.708971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:23.710209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:23.710689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:23.885475 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef3b57df-f0ef-4e4c-b47d-c04ef2c0dbe9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.844507 Oct 19 07:10:23.886151 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2183/4495] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:10:23.908679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:23.923558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:23.924418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Searching by: {'deleted': False, 'project_id': 'c481a0b055cc4683ac688f94398122cb'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:10:23.992986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:23.993491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:23.994021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:23.994776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:24.003885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:24.004667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:24.052246 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f2032fa-3701-4ede-94a1-a6f0817dae82 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.156291 Oct 19 07:10:24.054107 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2184/4496] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 07:10:23 2022] GET /compute/v2.1/servers => generated 1018 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:24.065463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57e729f0-2ae4-4eeb-b5b0-312be7d62cd3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:24.066674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57e729f0-2ae4-4eeb-b5b0-312be7d62cd3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:24.980452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:24.996924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:25.000626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:25.003523 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e5bfbe3-08ce-4f22-90f5-cfbb3b1f394c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 1.346268 Oct 19 07:10:25.004335 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2313/4497] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:23 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:25.017127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:25.018218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:25.033528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:25.035717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:25.039802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:25.041108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:25.042065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:25.047374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:25.289981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57e729f0-2ae4-4eeb-b5b0-312be7d62cd3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:25.303658 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57e729f0-2ae4-4eeb-b5b0-312be7d62cd3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1223 microversion: 2.1 time: 1.242803 Oct 19 07:10:25.326041 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2185/4498] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:24 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1223 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:10:25.896674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:25.909543 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33fff5c9-d14f-4ed3-a3af-2760d5e9ab9d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1657 microversion: 2.1 time: 0.903336 Oct 19 07:10:25.910410 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2314/4499] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:25 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1657 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:25.943625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4db80c2f-7c21-4255-b1d3-a5c53f79e90d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:25.975467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4db80c2f-7c21-4255-b1d3-a5c53f79e90d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:25.975981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4db80c2f-7c21-4255-b1d3-a5c53f79e90d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:25.978819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4db80c2f-7c21-4255-b1d3-a5c53f79e90d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:26.035935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:26.037057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:26.046955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:26.047164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4db80c2f-7c21-4255-b1d3-a5c53f79e90d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Going to try to start instance {{(pid=127568) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 07:10:26.057611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:26.058131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:26.058590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:26.069337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:26.070035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:26.073735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:26.279830 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4db80c2f-7c21-4255-b1d3-a5c53f79e90d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.342041 Oct 19 07:10:26.281005 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2186/4500] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:10:25 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:10:26.316462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:26.317430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:26.349758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:26.354881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:26.355374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:26.362815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:26.363398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:26.365237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:26.962416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:26.971621 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3413ab7-2e4c-4a01-ab2e-8745ee2c1398 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1666 microversion: 2.1 time: 0.677820 Oct 19 07:10:26.974745 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2187/4501] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:26 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1666 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:26.982388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aedc1a2a-0f61-4459-b6a1-0e7142942c14 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:26.983332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aedc1a2a-0f61-4459-b6a1-0e7142942c14 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:27.185554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aedc1a2a-0f61-4459-b6a1-0e7142942c14 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:27.196733 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aedc1a2a-0f61-4459-b6a1-0e7142942c14 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1223 microversion: 2.1 time: 0.217853 Oct 19 07:10:27.197362 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2188/4502] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:26 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1223 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:27.510675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:27.523130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:27.532646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:27.534195 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad10ef81-4ead-4bc3-aabc-424209d42412 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 1.503158 Oct 19 07:10:27.539703 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2315/4503] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:26 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:27.998088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:27.999831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:28.020631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:28.021625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:28.025740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:28.025740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:28.025740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:28.025740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:28.225497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f631d079-d05b-4d2d-898c-173ec864d384 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:28.228149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f631d079-d05b-4d2d-898c-173ec864d384 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:28.478392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f631d079-d05b-4d2d-898c-173ec864d384 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:28.501724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:28.502547 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f631d079-d05b-4d2d-898c-173ec864d384 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1223 microversion: 2.1 time: 0.283252 Oct 19 07:10:28.503243 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2316/4504] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:28 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1223 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:10:28.545947 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41918de2-1231-4fed-8e2f-85d09d59c249 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1666 microversion: 2.1 time: 0.547432 Oct 19 07:10:28.561958 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2189/4505] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:27 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1666 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:28.571510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:28.574188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:28.586718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:28.587283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:28.587733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:28.588742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:28.589832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:28.590276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:29.526906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:29.527543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:29.535518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:29.536380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:29.537124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:29.546188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:29.548561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:29.549617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:29.771300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:29.791607 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ebdd761-c785-45b5-a814-afefa64f0592 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1227 microversion: 2.1 time: 0.268782 Oct 19 07:10:29.800930 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2190/4506] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:29 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1227 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:29.817039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:29.818083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:29.826064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:29.830916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:29.832699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:29.834094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:29.834782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:29.835391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:30.296429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:30.315239 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08d2c739-75a4-43fe-a833-29187b1a9e64 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.502142 Oct 19 07:10:30.317093 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2191/4507] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:29 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:30.353356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:30.354582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:30.362665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:30.363168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:30.363750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:30.364479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:30.365109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:30.367388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:30.763798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:30.783679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:30.790287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:30.791879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-391c0bc8-2049-4e85-a92d-f79fe34b2317 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 2.225338 Oct 19 07:10:30.795814 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2317/4508] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:28 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:30.823085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:30.824140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:30.853467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:30.854531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:30.855392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:30.856635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:30.861824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:30.861824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:31.065432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:31.090158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd913ada-9381-4b53-acd8-85459df503ef tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.744646 Oct 19 07:10:31.093091 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2192/4509] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:30 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:31.121824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:31.122819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:31.148060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:31.148060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:31.148060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:31.150838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:31.151592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:31.154416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:31.299201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:31.318923 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3594facd-63fb-49b7-8f4d-c960c20426c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1275 microversion: 2.1 time: 0.500491 Oct 19 07:10:31.321606 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2318/4510] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:30 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1275 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:10:31.833501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:31.838938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:31.863702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:31.867832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:31.869154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:31.871752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:31.872465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:31.873097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:31.874717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:31.880665 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99930d9d-f2bd-416b-b589-49317ede7efb tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.764434 Oct 19 07:10:31.898178 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2193/4511] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:31 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:10:31.917893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:31.918705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:31.932717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:31.933233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:31.934207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:31.935120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:31.938375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:31.941169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:32.505377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:32.521697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:32.540917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:32.543040 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5405507-e4a4-40b4-b759-3594db2546ee tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.718404 Oct 19 07:10:32.544005 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2319/4512] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:31 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:10:32.552765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:32.562434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:32.574280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:32.574774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:32.575300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:32.575990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:32.579312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:32.579758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:32.677171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:32.686082 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-546b9d49-9881-4faa-ba71-bc898ecd83d0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1281 microversion: 2.1 time: 0.138377 Oct 19 07:10:32.686743 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2320/4513] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:32 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:33.574748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:33.575596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:33.585137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:33.586128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:33.587032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:33.588171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:33.588877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:33.589607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:33.977794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:34.001063 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9a587f5-1702-484c-a137-44945f4e69d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 2.088809 Oct 19 07:10:34.002337 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2194/4514] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:31 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:34.011766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:34.012458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:34.022026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:34.024834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:34.026396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:34.029164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:34.034876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:34.045355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:34.053444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:34.122805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:34.317883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:34.320532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:34.338198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:34.345551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:34.348262 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cc65128-f770-4ee8-bb49-61abd816a44d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.777460 Oct 19 07:10:34.353101 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96fa06f1-384d-405c-8c0d-8cd30aab94e1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1281 microversion: 2.1 time: 0.348512 Oct 19 07:10:34.353775 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2195/4515] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:34 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1281 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:34.368959 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2321/4516] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:33 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:34.375337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:34.376245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:34.382991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:34.383810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:34.384521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:34.385476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:34.386097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:34.386744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:34.670963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:34.681280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-010054c0-8d56-44be-b2fc-43e34292da7e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.311724 Oct 19 07:10:34.697548 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2196/4517] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:34 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:34.713675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:34.717116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:34.726012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:34.726787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:34.727403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:34.729615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:34.730265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:34.731921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:34.775188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lazy-loading 'flavor' on Instance uuid 3e06e92a-b261-47bc-8963-f42b50716743 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:10:34.963848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:35.241543 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee0d5320-2da0-45ed-9b11-b3fea7cc4971 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.533130 Oct 19 07:10:35.242780 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2322/4518] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:10:34 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:10:35.251491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:35.252179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:35.293078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:35.296181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:35.300270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:35.308919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:35.308919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:35.308919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:35.383139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:35.388848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:35.399088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:35.401005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:35.403273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:35.404434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:35.407312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:35.412826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:35.597817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:35.611818 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a95cf3ba-1c71-4df2-9b44-485c75fb4cd6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1281 microversion: 2.1 time: 0.234018 Oct 19 07:10:35.620302 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2323/4519] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:35 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1281 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:35.633690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:35.634305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:35.652973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:35.653492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:35.653986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:35.661195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:35.666382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:35.666382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:36.351579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:36.381214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:36.386093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:36.394883 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93476c1f-239a-4960-9e57-70154786619e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.780122 Oct 19 07:10:36.398364 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2324/4520] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:35 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:36.557206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:36.566700 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ebe2ecef-f622-4071-9fa2-13bf879fa150 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1678 microversion: 2.1 time: 1.319310 Oct 19 07:10:36.573265 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2197/4521] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:35 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1678 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:36.637904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:36.638658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:36.654400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:36.661140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:36.663884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:36.664850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:36.666163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:36.669753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:36.901530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:36.927365 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ebd0a57a-c503-40d8-9c3f-058dfc46feb2 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1281 microversion: 2.1 time: 0.293349 Oct 19 07:10:36.949769 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2325/4522] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:36 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1281 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:37.436313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:37.437369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:37.443908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:37.486122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:37.488561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:37.491992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:37.496248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:37.497186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:37.502388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:37.593630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:37.594051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:37.605261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:37.605856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:37.606366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:37.607125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:37.619867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:37.620708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:38.030639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:38.044978 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c87020fa-9681-4ee2-9f82-d2ad7164ea91 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1661 microversion: 2.1 time: 0.455549 Oct 19 07:10:38.045986 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2326/4523] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:37 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1661 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:10:38.056937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:38.056937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:38.074953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:38.075476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:38.075934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:38.076780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:38.078608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:38.080340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:38.257133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:38.257133 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cae33f35-8624-48f8-b8c5-ce9bb883f178 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1281 microversion: 2.1 time: 0.191893 Oct 19 07:10:38.257133 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2327/4524] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:38 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1281 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:38.257133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bb234df-7f26-4811-8bac-22137ce740f1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:38.257133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bb234df-7f26-4811-8bac-22137ce740f1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:38.261742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb234df-7f26-4811-8bac-22137ce740f1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:38.262586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb234df-7f26-4811-8bac-22137ce740f1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:38.264893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb234df-7f26-4811-8bac-22137ce740f1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:38.270763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb234df-7f26-4811-8bac-22137ce740f1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:38.272498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb234df-7f26-4811-8bac-22137ce740f1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:38.273130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bb234df-7f26-4811-8bac-22137ce740f1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:38.496207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:38.698976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:38.709765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:38.711635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:38.713242 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b1122e8-f9ed-4a03-bd75-54c22470c94e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 1.283030 Oct 19 07:10:38.714420 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2198/4525] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:37 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:39.007600 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bb234df-7f26-4811-8bac-22137ce740f1 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action" status: 202 len: 0 microversion: 2.1 time: 0.766240 Oct 19 07:10:39.008303 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2328/4526] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:10:38 2022] POST /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743/action => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:10:39.016341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:39.017207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:39.028442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:39.034678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:39.034678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:39.034678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:39.034678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:39.034678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:39.293908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:39.294639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:39.327298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:39.327298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:39.327298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:39.327298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:39.327298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:39.327298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:39.897013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:39.906237 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98b9a381-4d04-40f8-a0bd-a9145c75b21f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 0.631476 Oct 19 07:10:39.908877 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2329/4527] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:39 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:39.916240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:39.917054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:39.925446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:39.926306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:39.926759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:39.927479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:39.928198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:39.928797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:39.940265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:39.952916 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-487c760e-23f2-44b8-a641-d4d5c64250bf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1667 microversion: 2.1 time: 0.937624 Oct 19 07:10:39.953541 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2199/4528] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:39 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1667 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:40.848455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:40.876906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:40.883586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:40.885140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb3398bc-e345-4e0e-915a-e4691e75aba7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.974366 Oct 19 07:10:40.885891 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2330/4529] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:39 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:40.933610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:40.934502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:40.968085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:40.969775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:40.973285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:40.977822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:40.980680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:40.985846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:40.990262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:40.990422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:41.006850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:41.008272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:41.008997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:41.013357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:41.014093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:41.024881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:43.086252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:43.094312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:43.109948 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c53f817-827d-4d68-90ec-f7185b1cc1c6 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 2.176819 Oct 19 07:10:43.111014 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2200/4530] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:40 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:43.121853 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ed1cdf3-66d4-476b-a7d4-7c1469004f39 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1667 microversion: 2.1 time: 2.141154 Oct 19 07:10:43.132432 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2331/4531] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:40 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1667 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:43.134317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:43.140066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2c1d53e2-3f1a-4206-872c-66f00bd6a04a req-11aacc90-650f-4533-a9ab-348446838473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08870b64-b146-4c26-a37a-b9539dbe2bf1", "tag": "9f1c27a0-4fb7-41d3-a3e1-c70e31016b26"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:43.146693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:43.167887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:43.168882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:43.169563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:43.172365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:43.175870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:43.176298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c1d53e2-3f1a-4206-872c-66f00bd6a04a req-11aacc90-650f-4533-a9ab-348446838473 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:43.176869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c1d53e2-3f1a-4206-872c-66f00bd6a04a req-11aacc90-650f-4533-a9ab-348446838473 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:43.177331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c1d53e2-3f1a-4206-872c-66f00bd6a04a req-11aacc90-650f-4533-a9ab-348446838473 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:43.178609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:43.219600 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2c1d53e2-3f1a-4206-872c-66f00bd6a04a req-11aacc90-650f-4533-a9ab-348446838473 service nova] Creating event network-changed:9f1c27a0-4fb7-41d3-a3e1-c70e31016b26 for instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 on n-h1-861333-10 Oct 19 07:10:43.242141 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2c1d53e2-3f1a-4206-872c-66f00bd6a04a req-11aacc90-650f-4533-a9ab-348446838473 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109725 Oct 19 07:10:43.243176 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2332/4532] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:10:44.082252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:44.104871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:44.112841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:44.115422 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac13cc19-73c0-4a46-8327-deb639fd7154 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 1.002659 Oct 19 07:10:44.118407 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2201/4533] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:43 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:44.150718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:44.152156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:44.159899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:44.160870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:44.161373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:44.161605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:44.162319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:44.163170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:44.163753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:44.164335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:44.181217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:44.181734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:44.182430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:44.182887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:44.183343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:44.192927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:44.512388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:44.522912 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f64efd7-1e2a-4d24-ae09-6b99ce4b8d56 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 0.377815 Oct 19 07:10:44.527082 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2333/4534] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:44 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:45.147765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:45.149010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:45.163345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:45.174583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:45.174583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:45.174583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:45.174583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:45.174583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:45.364737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:45.374328 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32e4f568-fa2a-4e4f-b19a-4a250e21aeb9 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 1.220597 Oct 19 07:10:45.381162 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2202/4535] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:44 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:45.405472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:45.412263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:45.420950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=9 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:45.422642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:45.427602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:45.428432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:45.430189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:45.447679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:45.447679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:45.652506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:45.668587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:45.670259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:45.676028 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5fd7073-f974-4735-80da-5be100eb8423 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.533082 Oct 19 07:10:45.676775 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2334/4536] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:45 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:10:45.686253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:45.687691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:45.694989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:45.696144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:45.696829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:45.697541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:45.697996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:45.698585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:45.905936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:45.919303 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2e6ac40-b95c-4882-941e-59471cde6aa9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 0.236943 Oct 19 07:10:45.921101 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2335/4537] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:45 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:46.365488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:46.379138 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-acaa811f-17ee-4975-aa3f-21fe99cfde66 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1670 microversion: 2.1 time: 0.976485 Oct 19 07:10:46.379756 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2203/4538] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:45 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1670 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:46.406831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:46.408012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:46.418163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:46.428695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:46.430373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:46.431523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:46.439584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:46.440368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:46.530220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:10:46.555844 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.compute.api [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Working on deleting snapshot cd1378da-5e48-4016-97c8-bbd7a776a91a from shelved instance... Oct 19 07:10:46.574424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-fe077736-00a9-4e01-ba05-bc00151e5fce req-ee839131-8c8f-4643-a3b3-a744954836de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228a31d6-e376-44d4-9300-ce6437e626c9", "tag": "9a0bc543-6808-4c3b-8733-bdae615e0c16"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:46.608182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fe077736-00a9-4e01-ba05-bc00151e5fce req-ee839131-8c8f-4643-a3b3-a744954836de service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:46.608962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fe077736-00a9-4e01-ba05-bc00151e5fce req-ee839131-8c8f-4643-a3b3-a744954836de service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:46.609711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fe077736-00a9-4e01-ba05-bc00151e5fce req-ee839131-8c8f-4643-a3b3-a744954836de service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:46.654931 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-fe077736-00a9-4e01-ba05-bc00151e5fce req-ee839131-8c8f-4643-a3b3-a744954836de service nova] Creating event network-changed:9a0bc543-6808-4c3b-8733-bdae615e0c16 for instance 228a31d6-e376-44d4-9300-ce6437e626c9 on n-h2-861333-10 Oct 19 07:10:46.678503 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-fe077736-00a9-4e01-ba05-bc00151e5fce req-ee839131-8c8f-4643-a3b3-a744954836de service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111526 Oct 19 07:10:46.688057 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2204/4539] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:10:46.705392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:46.716255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:46.730649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:46.733414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:46.734225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:46.735334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:46.737224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:46.740771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:48.199077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:48.230595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:48.232439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:48.234728 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45cee043-7c9b-453c-aeec-91a4112a4e77 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 1.536054 Oct 19 07:10:48.238692 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2205/4540] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:46 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:10:48.247778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:48.248757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:48.261547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:48.264683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:48.265412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:48.268628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:48.282607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:48.284063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:48.620266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Doing local delete in cell 2095ce14-8217-4a0f-91a3-f188d1d5cb77(cell1) {{(pid=127567) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 19 07:10:48.621072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:48.636619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:48.637270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:48.637925 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.compute.api [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 19 07:10:48.641560 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [69b71267-9614-4467-b3a0-65d6007dcfbf] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 07:10:49.024468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:49.036979 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e107f71d-e0bd-4c77-8652-c88b935722e3 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 0.793378 Oct 19 07:10:49.039541 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2206/4541] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:48 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:49.265844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:49.267881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:49.284681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:49.289834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:49.290382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:49.291157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:49.291639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:49.292069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:49.654341 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [69b71267-9614-4467-b3a0-65d6007dcfbf] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35976. Oct 19 07:10:49.660914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] deallocate_for_instance() {{(pid=127567) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 19 07:10:50.183942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:50.201713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:50.208568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:50.212185 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-502690e9-7010-4f11-b0f2-243be3c9d1ef tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.950982 Oct 19 07:10:50.248994 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2207/4542] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:49 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:50.261467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:50.264654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:50.282694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:50.297032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:50.297993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:50.307017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:50.307017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:50.307017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:50.698318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:50.711625 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00618580-bef6-4744-918d-f5f485d2d538 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 0.460736 Oct 19 07:10:50.712964 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2208/4543] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:50 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:50.733463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3f63b65c-4aed-43b4-9044-cd2e9963dd2e req-f784096e-6e93-4fea-a2ea-df63614722c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93f0caa-a42d-4d64-87e7-f04c2218c1d0", "tag": "35389a45-3a24-4569-bc92-3e160c78d4ea"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:50.744513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3f63b65c-4aed-43b4-9044-cd2e9963dd2e req-f784096e-6e93-4fea-a2ea-df63614722c5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:50.757881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3f63b65c-4aed-43b4-9044-cd2e9963dd2e req-f784096e-6e93-4fea-a2ea-df63614722c5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:50.757881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3f63b65c-4aed-43b4-9044-cd2e9963dd2e req-f784096e-6e93-4fea-a2ea-df63614722c5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:50.759499 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3f63b65c-4aed-43b4-9044-cd2e9963dd2e req-f784096e-6e93-4fea-a2ea-df63614722c5 service nova] Creating event network-changed:35389a45-3a24-4569-bc92-3e160c78d4ea for instance d93f0caa-a42d-4d64-87e7-f04c2218c1d0 on n-h1-861333-10 Oct 19 07:10:50.765526 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3f63b65c-4aed-43b4-9044-cd2e9963dd2e req-f784096e-6e93-4fea-a2ea-df63614722c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051049 Oct 19 07:10:50.766687 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2209/4544] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:10:51.245591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:51.247187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:51.260626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:51.265338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:51.266166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:51.267642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:51.268352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:51.269893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:52.030291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Updating instance_info_cache with network_info: [] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 07:10:52.042972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:52.339696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:52.357142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:52.386184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:52.387557 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4b8003f-af1a-4e54-9850-992f1ddadad2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 1.148181 Oct 19 07:10:52.400189 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2210/4545] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:51 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:52.728954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cd5884b1-0ee6-47a6-85e4-46d37a5de8b0 req-6ef7fc08-405b-46e9-ab42-85876fb1e954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf", "name": "network-vif-plugged", "status": "completed", "tag": "d36dab0c-9d83-4aa8-b6bb-531eafbf58f6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:52.749518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cd5884b1-0ee6-47a6-85e4-46d37a5de8b0 req-6ef7fc08-405b-46e9-ab42-85876fb1e954 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:52.750220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cd5884b1-0ee6-47a6-85e4-46d37a5de8b0 req-6ef7fc08-405b-46e9-ab42-85876fb1e954 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:52.751409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cd5884b1-0ee6-47a6-85e4-46d37a5de8b0 req-6ef7fc08-405b-46e9-ab42-85876fb1e954 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:52.788127 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cd5884b1-0ee6-47a6-85e4-46d37a5de8b0 req-6ef7fc08-405b-46e9-ab42-85876fb1e954 service nova] Creating event network-vif-plugged:d36dab0c-9d83-4aa8-b6bb-531eafbf58f6 for instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf on n-h2-861333-10 Oct 19 07:10:52.817014 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cd5884b1-0ee6-47a6-85e4-46d37a5de8b0 req-6ef7fc08-405b-46e9-ab42-85876fb1e954 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.422410 Oct 19 07:10:52.818549 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2211/4546] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:10:52.838825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:52.842071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:52.862208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:52.863262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:52.863706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:52.874683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:52.875227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:52.875677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:52.946157 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69eef0e3-4caa-432d-a0ea-ec6007d1b886 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 204 len: 0 microversion: 2.1 time: 6.541815 Oct 19 07:10:52.946157 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2336/4547] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:10:46 2022] DELETE /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 0 bytes in 6544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:10:52.968554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-37371b7f-6872-4898-a8f9-41ea78c10bd3 req-bb892c54-d290-4011-9379-1ec99cbdf6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45a1749-93d8-4842-9251-95117b90a309", "name": "network-vif-deleted", "tag": "4d508603-62c3-4929-988f-c99746ed6182"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:53.008002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-37371b7f-6872-4898-a8f9-41ea78c10bd3 req-bb892c54-d290-4011-9379-1ec99cbdf6f6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:53.012740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-37371b7f-6872-4898-a8f9-41ea78c10bd3 req-bb892c54-d290-4011-9379-1ec99cbdf6f6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:53.013338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-37371b7f-6872-4898-a8f9-41ea78c10bd3 req-bb892c54-d290-4011-9379-1ec99cbdf6f6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:53.042536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.server_external_events [req-37371b7f-6872-4898-a8f9-41ea78c10bd3 req-bb892c54-d290-4011-9379-1ec99cbdf6f6 service nova] Unable to find a host for instance c45a1749-93d8-4842-9251-95117b90a309. Dropping event network-vif-deleted {{(pid=127567) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 07:10:53.046310 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-37371b7f-6872-4898-a8f9-41ea78c10bd3 req-bb892c54-d290-4011-9379-1ec99cbdf6f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.091729 Oct 19 07:10:53.052261 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2337/4548] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 105 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 07:10:53.066437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:53.069064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: c45a1749-93d8-4842-9251-95117b90a309] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:53.078945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:53.078945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:53.080928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:53.082919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:53.084425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:53.085055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:53.133793 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] HTTP exception thrown: Instance c45a1749-93d8-4842-9251-95117b90a309 could not be found. Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Request method failure captured: Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 HTTP/1.1 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6DmX-pQ_4OnfuRUxh8rZSYDxjA0X84x3jYkADkvnJhDXg00PWP_QY3Xa-1vVKKQiCwPtOHOUWT_jfFKZg3ocIvk_QkW2-ZefnF6mQ0XawPMe--AMUWBI3jMmufugk0Ll2vtD8y9ScW4pTC2z439SwsP67b_cVZJF5JCwtBUgMpip78 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05016de78e0b4491a53cfa3885193ca8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-816942685 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2543970e80c84e109961fc84bfaaedd1 Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance c45a1749-93d8-4842-9251-95117b90a309 could not be found. Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c45a1749-93d8-4842-9251-95117b90a309'} Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45a1749-93d8-4842-9251-95117b90a309 could not be found. Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45a1749-93d8-4842-9251-95117b90a309 could not be found. Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:10:53.139382 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:10:53.144559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:10:53.144559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:10:53.144559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:10:53.144559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:10:53.144559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:10:53.144559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45a1749-93d8-4842-9251-95117b90a309 could not be found. Oct 19 07:10:53.144559 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:10:53.149674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Returning 404 to user: Instance c45a1749-93d8-4842-9251-95117b90a309 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:10:53.151342 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ab3a550-bf04-4b42-b6c8-76ecb6fd1dbf tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309" status: 404 len: 111 microversion: 2.1 time: 0.096486 Oct 19 07:10:53.156145 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2338/4549] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:53 2022] GET /compute/v2.1/servers/c45a1749-93d8-4842-9251-95117b90a309 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:10:53.180231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:53.181484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:53.192843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:53.194758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:53.195222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:53.195970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:53.196479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:53.197173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:53.255168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:10:53.813874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6415ea6-7ec9-467f-a330-5118283d2e8c tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "DELETE /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 204 len: 0 microversion: 2.1 time: 0.639174 Oct 19 07:10:53.816166 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2339/4550] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:10:53 2022] DELETE /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:10:53.827335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:53.828609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:53.847772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:53.848361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:53.852021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:53.855102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:53.855102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:53.855102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:54.117561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:54.130466 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1383ae6-cde4-46d8-a18d-677b6556e53c tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 1.309803 Oct 19 07:10:54.133346 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2212/4551] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:52 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:54.144809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:54.149035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:54.166131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:54.172158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:54.172158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:54.172158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:54.172158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:54.172158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:54.404168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:54.425866 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df865538-95c4-4fe6-9a6c-64a102006845 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1467 microversion: 2.1 time: 0.288587 Oct 19 07:10:54.427961 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2213/4552] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:54 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1467 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:54.440329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:54.450332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:54.454564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:54.456171 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ba9f456-f34d-4601-909c-0a74deeeaae8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.637022 Oct 19 07:10:54.472845 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2340/4553] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:53 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:54.963221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-75fc7d9c-3060-4adb-b8ac-6e9296f3ece6 req-d2f21094-2630-42ce-a3b8-f92e14004d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08870b64-b146-4c26-a37a-b9539dbe2bf1", "name": "network-vif-plugged", "status": "completed", "tag": "9f1c27a0-4fb7-41d3-a3e1-c70e31016b26"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:54.974529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-75fc7d9c-3060-4adb-b8ac-6e9296f3ece6 req-d2f21094-2630-42ce-a3b8-f92e14004d99 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:54.985231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-75fc7d9c-3060-4adb-b8ac-6e9296f3ece6 req-d2f21094-2630-42ce-a3b8-f92e14004d99 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:54.985231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-75fc7d9c-3060-4adb-b8ac-6e9296f3ece6 req-d2f21094-2630-42ce-a3b8-f92e14004d99 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:55.004020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:55.007912 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-75fc7d9c-3060-4adb-b8ac-6e9296f3ece6 req-d2f21094-2630-42ce-a3b8-f92e14004d99 service nova] Creating event network-vif-plugged:9f1c27a0-4fb7-41d3-a3e1-c70e31016b26 for instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 on n-h1-861333-10 Oct 19 07:10:55.020495 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-75fc7d9c-3060-4adb-b8ac-6e9296f3ece6 req-d2f21094-2630-42ce-a3b8-f92e14004d99 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069596 Oct 19 07:10:55.021607 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2214/4554] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:10:55.157010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:55.163693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:55.183342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:55.185448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:55.187932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:55.191360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:55.195535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:55.195535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:55.451642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:55.453524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:55.463297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:55.464903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:55.465549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:55.475192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:55.475192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:55.475192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:55.937979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:55.955994 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ec21a01-b4b0-420b-8b76-1685c7dab417 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1467 microversion: 2.1 time: 0.509805 Oct 19 07:10:55.958993 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2215/4555] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:55 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1467 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:10:55.966372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:55.976800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:55.988675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:55.989692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:55.990952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:55.992546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:55.993010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:55.993442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:56.110047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:56.130456 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-864060a2-cb65-4240-a01b-8317f778f016 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 0.974550 Oct 19 07:10:56.132504 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2341/4556] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:55 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:56.862814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:56.922048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:56.923616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:56.937016 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-763bb279-54e4-4cbf-83a8-7d83aa334a8e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.974591 Oct 19 07:10:56.947328 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2216/4557] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:55 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:56.984835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:56.985751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:57.001012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:57.001516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:57.006613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:57.006613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:57.006613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:57.006613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:57.071887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e47a8252-7ed4-499d-8ea0-d02ecefd17ac req-6edc55ab-22c6-44d4-b628-ede565eac330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228a31d6-e376-44d4-9300-ce6437e626c9", "name": "network-vif-plugged", "status": "completed", "tag": "9a0bc543-6808-4c3b-8733-bdae615e0c16"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:57.099025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e47a8252-7ed4-499d-8ea0-d02ecefd17ac req-6edc55ab-22c6-44d4-b628-ede565eac330 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:57.099545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e47a8252-7ed4-499d-8ea0-d02ecefd17ac req-6edc55ab-22c6-44d4-b628-ede565eac330 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:57.102423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e47a8252-7ed4-499d-8ea0-d02ecefd17ac req-6edc55ab-22c6-44d4-b628-ede565eac330 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:57.113380 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e47a8252-7ed4-499d-8ea0-d02ecefd17ac req-6edc55ab-22c6-44d4-b628-ede565eac330 service nova] Creating event network-vif-plugged:9a0bc543-6808-4c3b-8733-bdae615e0c16 for instance 228a31d6-e376-44d4-9300-ce6437e626c9 on n-h2-861333-10 Oct 19 07:10:57.119187 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e47a8252-7ed4-499d-8ea0-d02ecefd17ac req-6edc55ab-22c6-44d4-b628-ede565eac330 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051307 Oct 19 07:10:57.125935 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2217/4558] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:10:57.156588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:57.157276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:57.173000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:57.180289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:57.180289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:57.180289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:57.180289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:57.180289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:58.052439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:58.062917 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eae02162-d08b-4dc3-9f8a-e5e34a47dd71 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1467 microversion: 2.1 time: 1.083240 Oct 19 07:10:58.065101 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2342/4559] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:56 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1467 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:58.092500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:58.092500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:58.099589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:10:58.101951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:58.120274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:58.120274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:58.120274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:58.120274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:58.120274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:58.515097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:58.531622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:58.533081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:58.534260 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43e1a05c-0e3c-4c79-a75f-c4e61b83eac8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1809 microversion: 2.20 time: 0.451822 Oct 19 07:10:58.535389 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2343/4560] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:58 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1809 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:10:58.560033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7a0a2ee5-7159-4950-add0-915250082524 req-7da8e06f-f923-414e-8990-159bff71b409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b1cb95-b1fe-4552-a70b-b49170840ce5", "name": "network-vif-deleted", "tag": "189accec-c091-4229-be96-21e82b542537"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:58.579820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a0a2ee5-7159-4950-add0-915250082524 req-7da8e06f-f923-414e-8990-159bff71b409 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:58.580727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a0a2ee5-7159-4950-add0-915250082524 req-7da8e06f-f923-414e-8990-159bff71b409 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:58.582292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a0a2ee5-7159-4950-add0-915250082524 req-7da8e06f-f923-414e-8990-159bff71b409 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:58.601244 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7a0a2ee5-7159-4950-add0-915250082524 req-7da8e06f-f923-414e-8990-159bff71b409 service nova] Creating event network-vif-deleted:189accec-c091-4229-be96-21e82b542537 for instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 on n-h1-861333-10 Oct 19 07:10:58.609923 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7a0a2ee5-7159-4950-add0-915250082524 req-7da8e06f-f923-414e-8990-159bff71b409 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060323 Oct 19 07:10:58.612210 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2344/4561] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:10:58.650707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:58.661485 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0027b23-88a2-4999-9044-906dccce6920 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 1.509891 Oct 19 07:10:58.662085 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2218/4562] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:57 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:10:59.098034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:59.099339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:59.118821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:59.122450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:59.122450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:59.122450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:59.122450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:59.123512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:59.218758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b3d67908-8c19-4886-8593-6878827e1780 req-11cfe770-3f27-4a70-baed-d718769ce7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93f0caa-a42d-4d64-87e7-f04c2218c1d0", "name": "network-vif-plugged", "status": "completed", "tag": "35389a45-3a24-4569-bc92-3e160c78d4ea"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:10:59.248805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:59.253672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:59.257260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:59.260344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lazy-loading 'fault' on Instance uuid 10b1cb95-b1fe-4552-a70b-b49170840ce5 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:10:59.262580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3d67908-8c19-4886-8593-6878827e1780 req-11cfe770-3f27-4a70-baed-d718769ce7b2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:59.263474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3d67908-8c19-4886-8593-6878827e1780 req-11cfe770-3f27-4a70-baed-d718769ce7b2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:59.265058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3d67908-8c19-4886-8593-6878827e1780 req-11cfe770-3f27-4a70-baed-d718769ce7b2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:59.311043 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b3d67908-8c19-4886-8593-6878827e1780 req-11cfe770-3f27-4a70-baed-d718769ce7b2 service nova] Creating event network-vif-plugged:35389a45-3a24-4569-bc92-3e160c78d4ea for instance d93f0caa-a42d-4d64-87e7-f04c2218c1d0 on n-h1-861333-10 Oct 19 07:10:59.320734 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b3d67908-8c19-4886-8593-6878827e1780 req-11cfe770-3f27-4a70-baed-d718769ce7b2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112277 Oct 19 07:10:59.325430 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2219/4563] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:10:59.377517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:10:59.392913 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e946ecf-9914-4313-a64a-9e26004e40d4 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 200 len: 1305 microversion: 2.1 time: 0.303706 Oct 19 07:10:59.405004 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2345/4564] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:59 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 1305 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:10:59.570399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:59.572472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:59.592455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:59.597710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:59.607126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:59.611112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:59.611618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:59.613459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:59.687772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:10:59.688446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:10:59.704499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:59.705366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:59.706013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:10:59.707718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:10:59.709080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:10:59.710035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:00.260467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:00.282638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:00.291332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:00.294340 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e82a34dd-2a93-4548-b621-27f9cea21a5b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1796 microversion: 2.20 time: 0.729803 Oct 19 07:11:00.296969 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2220/4565] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:10:59 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1796 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:11:00.428899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:00.430009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 10b1cb95-b1fe-4552-a70b-b49170840ce5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:00.438842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:00.443643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:00.443643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:00.443643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:00.443643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:00.443643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:00.471685 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] HTTP exception thrown: Instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 could not be found. Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Request method failure captured: Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 HTTP/1.1 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DmX-pQ_4OnfuRUxh8rZSYDxjA0X84x3jYkADkvnJhDXg00PWP_QY3Xa-1vVKKQiCwPtOHOUWT_jfFKZg3ocIvk_QkW2-ZefnF6mQ0XawPMe--AMUWBI3jMmufugk0Ll2vtD8y9ScW4pTC2z439SwsP67b_cVZJF5JCwtBUgMpip78 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05016de78e0b4491a53cfa3885193ca8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 2543970e80c84e109961fc84bfaaedd1 Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 could not be found. Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '10b1cb95-b1fe-4552-a70b-b49170840ce5'} Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 could not be found. Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 could not be found. Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:00.473675 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:00.479568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:00.479568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:00.479568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:00.479568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:00.479568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:00.479568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 could not be found. Oct 19 07:11:00.479568 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:00.479568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Returning 404 to user: Instance 10b1cb95-b1fe-4552-a70b-b49170840ce5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:00.480985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:00.487292 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbe2115f-36b7-4f67-98a6-1a31e27699ea tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5" status: 404 len: 111 microversion: 2.1 time: 0.050426 Oct 19 07:11:00.488310 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c936c086-4780-4085-a6e0-8c8ee0ba5884 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 0.808000 Oct 19 07:11:00.491765 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2346/4566] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:10:59 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:00.492245 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2221/4567] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:00 2022] GET /compute/v2.1/servers/10b1cb95-b1fe-4552-a70b-b49170840ce5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:11:00.496522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:00.497018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:00.525311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:00.529159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:00.531944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:00.531944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:00.534842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:00.535297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:00.591268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:11:00.646532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=16,nova_cell1:RELEASE=1,nova_cell1:SELECT=79,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:00.962586 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ab12e41-463b-410f-98c5-d81bd20f8075 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 204 len: 0 microversion: 2.1 time: 0.469300 Oct 19 07:11:00.963393 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2347/4568] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:11:00 2022] DELETE /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:11:00.972055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:00.973150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:00.988411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:00.989744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:00.991497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:00.992933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:00.995639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:00.996268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:01.296543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:01.310846 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fffebd85-4285-456b-a69a-91c2de978629 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1507 microversion: 2.1 time: 0.343255 Oct 19 07:11:01.311430 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2222/4569] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:00 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:11:01.513673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:01.514382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:01.530707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:01.531386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:01.532015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:01.535831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:01.536658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:01.537111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:01.962068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:01.972682 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38fbcffd-413d-4fcf-bd33-e3af5a8f2587 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1323 microversion: 2.1 time: 0.463045 Oct 19 07:11:01.974749 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2348/4570] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:01 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:02.334607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:02.335176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:02.346355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:02.346355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:02.346355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:02.346355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:02.346355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:02.346355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:02.637181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:02.658805 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-baec153f-f8ce-4651-8ca6-b656a0de7cc3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1507 microversion: 2.1 time: 0.327742 Oct 19 07:11:02.676851 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2223/4571] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:02 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1507 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:02.998944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:03.001957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:03.021246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.024494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.025132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.027865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.028565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.029161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.316036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a838e36e-abfb-4148-b873-f30e0ec2db3e req-b857df1d-04b9-4c96-ad88-a8a1935a2fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa65439-7731-4ef3-ab8e-fb7a53d8f643", "name": "network-vif-deleted", "tag": "b1f7f645-a1e6-4fb3-ad53-45444f6ceedc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:03.326773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a838e36e-abfb-4148-b873-f30e0ec2db3e req-b857df1d-04b9-4c96-ad88-a8a1935a2fea service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.327505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a838e36e-abfb-4148-b873-f30e0ec2db3e req-b857df1d-04b9-4c96-ad88-a8a1935a2fea service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.328227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a838e36e-abfb-4148-b873-f30e0ec2db3e req-b857df1d-04b9-4c96-ad88-a8a1935a2fea service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.345504 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a838e36e-abfb-4148-b873-f30e0ec2db3e req-b857df1d-04b9-4c96-ad88-a8a1935a2fea service nova] Creating event network-vif-deleted:b1f7f645-a1e6-4fb3-ad53-45444f6ceedc for instance 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 on n-h2-861333-10 Oct 19 07:11:03.351990 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a838e36e-abfb-4148-b873-f30e0ec2db3e req-b857df1d-04b9-4c96-ad88-a8a1935a2fea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039698 Oct 19 07:11:03.358128 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2224/4572] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:11:03.407089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:03.422339 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02530731-e1d0-4b6a-b52a-b797d3a1d19a tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 200 len: 1517 microversion: 2.1 time: 0.426252 Oct 19 07:11:03.422951 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2349/4573] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:02 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 1517 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:03.455396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:03.455396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:03.469376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.469875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.470526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.471423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.472076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.472906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.686477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:03.695492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:03.703441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.704463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.705090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.710845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.711560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.719682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.801432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.802289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.803715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.804424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lazy-loading 'fault' on Instance uuid 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:11:03.841494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:03.858625 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d58ad94-e3a6-4bdb-8ee7-5f7f31811686 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9" status: 200 len: 1516 microversion: 2.1 time: 0.412231 Oct 19 07:11:03.876785 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2225/4574] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:03 2022] GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9 => generated 1516 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:03.886745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:03.887686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:03.898796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.900478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.900478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.901313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:03.901943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:03.902706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:03.931100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:03.947169 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08630f69-9154-425c-9724-8f22d8bf6480 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 200 len: 1304 microversion: 2.1 time: 0.264446 Oct 19 07:11:03.948793 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2350/4575] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:03 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 1304 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:04.183698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:04.198447 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4711771c-725b-4487-886a-4dea52ff4492 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1" status: 200 len: 1517 microversion: 2.1 time: 0.316595 Oct 19 07:11:04.211653 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2226/4576] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:03 2022] GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 => generated 1517 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:04.221543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:04.222834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:04.237278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:04.238886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:04.239507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:04.240437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:04.241156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:04.242064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:04.278038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:11:04.677842 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e550010c-22a4-4f67-a36d-544cc2b88ecc tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "DELETE /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1" status: 204 len: 0 microversion: 2.1 time: 0.459768 Oct 19 07:11:04.678960 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2351/4577] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:11:04 2022] DELETE /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:11:04.687299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:04.687927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:04.702994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:04.703516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:04.703970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:04.717258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:04.717697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:04.718157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:04.983086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:04.984257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 9aa65439-7731-4ef3-ab8e-fb7a53d8f643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:04.998087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:04.998787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:05.000260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:05.003093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:05.006598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:05.007171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:05.044217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:05.045149 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] HTTP exception thrown: Instance 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 could not be found. Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Request method failure captured: Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 HTTP/1.1 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6DmX-pQ_4OnfuRUxh8rZSYDxjA0X84x3jYkADkvnJhDXg00PWP_QY3Xa-1vVKKQiCwPtOHOUWT_jfFKZg3ocIvk_QkW2-ZefnF6mQ0XawPMe--AMUWBI3jMmufugk0Ll2vtD8y9ScW4pTC2z439SwsP67b_cVZJF5JCwtBUgMpip78 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05016de78e0b4491a53cfa3885193ca8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2543970e80c84e109961fc84bfaaedd1 Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 could not be found. Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '9aa65439-7731-4ef3-ab8e-fb7a53d8f643'} Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 could not be found. Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 could not be found. Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:05.047828 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 could not be found. Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Returning 404 to user: Instance 9aa65439-7731-4ef3-ab8e-fb7a53d8f643 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aaf2e715-4209-4e86-bca7-70a826e83f87 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643" status: 404 len: 111 microversion: 2.1 time: 0.072743 Oct 19 07:11:05.061350 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2352/4578] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:04 2022] GET /compute/v2.1/servers/9aa65439-7731-4ef3-ab8e-fb7a53d8f643 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:11:05.070023 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79ce19b0-54fb-470b-afb4-1d26e7919b41 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1" status: 200 len: 1523 microversion: 2.1 time: 0.386595 Oct 19 07:11:05.073895 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2227/4579] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:04 2022] GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:05.091278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:05.093543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:05.115836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:05.118105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:05.118569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:05.121366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:05.122648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:05.127021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:05.218618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:11:05.597160 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e00388b-a94d-4fb7-9cf5-a5d9d207d0b5 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 204 len: 0 microversion: 2.1 time: 0.532662 Oct 19 07:11:05.598057 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2353/4580] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:11:05 2022] DELETE /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:11:05.607422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:05.608153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:05.616859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:05.617579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:05.618291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:05.619214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:05.619672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:05.620097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:05.857107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:05.866121 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bdf2e3e-b016-4e16-baea-1a9c4160d8d3 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1495 microversion: 2.1 time: 0.263097 Oct 19 07:11:05.867282 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2228/4581] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:05 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1495 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:06.095824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:06.097857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:06.106911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:06.107902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:06.112197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:06.112197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:06.112197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:06.112197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:06.641758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:06.651387 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-455b5364-91d5-477d-8bd1-2ea1b2d117ff tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1" status: 200 len: 1523 microversion: 2.1 time: 0.560138 Oct 19 07:11:06.664891 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2354/4582] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:06 2022] GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 => generated 1523 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:11:06.893221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:06.896573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:06.917074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:06.917892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:06.918590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:06.924348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:06.924348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:06.924348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:06.981671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c6ca77c2-c3c9-44f8-909d-5db3258a4684 req-9dee69e9-f1bc-43c5-8425-dbc0bb7e74b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed028ead-fa3b-491a-80fa-4fe766097ef2", "name": "network-vif-deleted", "tag": "0fbb0704-c6b4-4768-be40-7a4928fdda40"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:06.995796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c6ca77c2-c3c9-44f8-909d-5db3258a4684 req-9dee69e9-f1bc-43c5-8425-dbc0bb7e74b3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:06.996573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c6ca77c2-c3c9-44f8-909d-5db3258a4684 req-9dee69e9-f1bc-43c5-8425-dbc0bb7e74b3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:06.999059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c6ca77c2-c3c9-44f8-909d-5db3258a4684 req-9dee69e9-f1bc-43c5-8425-dbc0bb7e74b3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:07.022954 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c6ca77c2-c3c9-44f8-909d-5db3258a4684 req-9dee69e9-f1bc-43c5-8425-dbc0bb7e74b3 service nova] Creating event network-vif-deleted:0fbb0704-c6b4-4768-be40-7a4928fdda40 for instance ed028ead-fa3b-491a-80fa-4fe766097ef2 on n-h2-861333-10 Oct 19 07:11:07.051095 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c6ca77c2-c3c9-44f8-909d-5db3258a4684 req-9dee69e9-f1bc-43c5-8425-dbc0bb7e74b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074678 Oct 19 07:11:07.052535 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2355/4583] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:11:07.132399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:07.148688 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e2de1a0-df57-4d73-ba6e-d3ef67f976f8 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1453 microversion: 2.1 time: 0.256156 Oct 19 07:11:07.149555 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2229/4584] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:06 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1453 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:07.687422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:07.688156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:07.696137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:07.697001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:07.697675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:07.698690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:07.699366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:07.700015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:07.951693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:07.965653 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c34af093-9f7b-4f43-b4aa-9c9067a1788b tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1" status: 200 len: 1481 microversion: 2.1 time: 0.280445 Oct 19 07:11:07.985383 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2356/4585] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:07 2022] GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 => generated 1481 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:08.084838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-20b5180f-37e6-48cd-815c-93dd9e40c14e req-34f2c645-21f6-43a9-a3d4-5d7ef79cb3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08870b64-b146-4c26-a37a-b9539dbe2bf1", "name": "network-vif-deleted", "tag": "9f1c27a0-4fb7-41d3-a3e1-c70e31016b26"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:08.084838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-20b5180f-37e6-48cd-815c-93dd9e40c14e req-34f2c645-21f6-43a9-a3d4-5d7ef79cb3d9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:08.084838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-20b5180f-37e6-48cd-815c-93dd9e40c14e req-34f2c645-21f6-43a9-a3d4-5d7ef79cb3d9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:08.084838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-20b5180f-37e6-48cd-815c-93dd9e40c14e req-34f2c645-21f6-43a9-a3d4-5d7ef79cb3d9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:08.106262 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-20b5180f-37e6-48cd-815c-93dd9e40c14e req-34f2c645-21f6-43a9-a3d4-5d7ef79cb3d9 service nova] Creating event network-vif-deleted:9f1c27a0-4fb7-41d3-a3e1-c70e31016b26 for instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 on n-h1-861333-10 Oct 19 07:11:08.118856 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-20b5180f-37e6-48cd-815c-93dd9e40c14e req-34f2c645-21f6-43a9-a3d4-5d7ef79cb3d9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063056 Oct 19 07:11:08.118984 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2230/4586] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:11:08.173128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:08.173756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:08.183899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:08.186229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:08.186933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:08.187903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:08.192072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:08.193101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:08.247952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:08.248788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:08.249313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:08.250047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lazy-loading 'fault' on Instance uuid ed028ead-fa3b-491a-80fa-4fe766097ef2 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:11:08.695318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:08.725993 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3d21add-336d-48ca-a7ca-8b677c7d13d7 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 200 len: 1304 microversion: 2.1 time: 0.557054 Oct 19 07:11:08.727978 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2357/4587] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:08 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 1304 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:08.992818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:08.994144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:09.001468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:09.002243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:09.003267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:09.004674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:09.005254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:09.006035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:09.049825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:09.051116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:09.051756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:09.052470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lazy-loading 'fault' on Instance uuid 08870b64-b146-4c26-a37a-b9539dbe2bf1 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:11:09.112677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:09.121728 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f01dfb0-a6cd-4ec2-a695-7cb6005ebf09 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1" status: 200 len: 1313 microversion: 2.1 time: 0.135406 Oct 19 07:11:09.124074 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2231/4588] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:08 2022] GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:09.762843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:09.764869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: ed028ead-fa3b-491a-80fa-4fe766097ef2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:09.791823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:09.792711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:09.793480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:09.795088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:09.795825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:09.796721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:09.821036 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] HTTP exception thrown: Instance ed028ead-fa3b-491a-80fa-4fe766097ef2 could not be found. Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Request method failure captured: Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 HTTP/1.1 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6DmX-pQ_4OnfuRUxh8rZSYDxjA0X84x3jYkADkvnJhDXg00PWP_QY3Xa-1vVKKQiCwPtOHOUWT_jfFKZg3ocIvk_QkW2-ZefnF6mQ0XawPMe--AMUWBI3jMmufugk0Ll2vtD8y9ScW4pTC2z439SwsP67b_cVZJF5JCwtBUgMpip78 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05016de78e0b4491a53cfa3885193ca8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 2543970e80c84e109961fc84bfaaedd1 Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance ed028ead-fa3b-491a-80fa-4fe766097ef2 could not be found. Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'ed028ead-fa3b-491a-80fa-4fe766097ef2'} Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed028ead-fa3b-491a-80fa-4fe766097ef2 could not be found. Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed028ead-fa3b-491a-80fa-4fe766097ef2 could not be found. Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:09.823572 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:09.829919 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:09.829919 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:09.829919 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:09.829919 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:09.829919 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:09.829919 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed028ead-fa3b-491a-80fa-4fe766097ef2 could not be found. Oct 19 07:11:09.829919 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:09.829919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Returning 404 to user: Instance ed028ead-fa3b-491a-80fa-4fe766097ef2 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:09.832337 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28dd5d6b-1a17-4a5e-9bac-b7782fdb28ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2" status: 404 len: 111 microversion: 2.1 time: 0.074160 Oct 19 07:11:09.835028 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2358/4589] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:09 2022] GET /compute/v2.1/servers/ed028ead-fa3b-491a-80fa-4fe766097ef2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:11:09.846294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:09.846294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:09.850235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:09.850862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:09.851312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:09.852095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:09.852652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:09.853446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:09.901569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:11:10.118490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:10.151164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.152521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:10.163110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.163803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.164477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.165661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.166703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.167387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.211956 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] HTTP exception thrown: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Request method failure captured: Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 HTTP/1.1 Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6LccjE8uFKreqt_4E1dMwz1kW7nUQ55l_XfSjeRta1IpFCNFoJD8TiJXgVniMjl6Dq8ZeieMqya7LtMIINECEg21_3nBQ8nELBmJqGMFNjte6wI8AATSlx2knLcWe0eonref6cwfwD8l9_6EwODfwKtc7Z8pXu81Ch2zM3LY5OzwMA Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c481a0b055cc4683ac688f94398122cb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 613a6cdb6b7146079687a249c75eb22d Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '08870b64-b146-4c26-a37a-b9539dbe2bf1'} Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.212868 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Returning 404 to user: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:10.217618 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf9d4ca3-f1fc-4a0e-9516-7460a9145edb tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1" status: 404 len: 111 microversion: 2.1 time: 0.069568 Oct 19 07:11:10.219727 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2359/4590] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:11:10.233333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.263923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:10.265347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c481a0b055cc4683ac688f94398122cb'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:11:10.271953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.273011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.273623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.274523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.276367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.277007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.337905 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-844327e2-ab94-4cb2-b695-80590938ab1e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 204 len: 0 microversion: 2.1 time: 0.498748 Oct 19 07:11:10.339318 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2232/4591] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:11:09 2022] DELETE /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:11:10.349147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.349857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:10.374492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.377671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.378134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.378923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.379394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.379829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.452933 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a1bb8b8-fb78-4982-a720-ddea3bdf4f9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.231720 Oct 19 07:11:10.453590 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2360/4592] 10.222.0.39 () {58 vars in 1230 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:11:10.485321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-486d8ddd-04d6-4b2a-96c1-4ead56e3107f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-486d8ddd-04d6-4b2a-96c1-4ead56e3107f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Request method failure captured: Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6LccjE8uFKreqt_4E1dMwz1kW7nUQ55l_XfSjeRta1IpFCNFoJD8TiJXgVniMjl6Dq8ZeieMqya7LtMIINECEg21_3nBQ8nELBmJqGMFNjte6wI8AATSlx2knLcWe0eonref6cwfwD8l9_6EwODfwKtc7Z8pXu81Ch2zM3LY5OzwMA Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c481a0b055cc4683ac688f94398122cb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 613a6cdb6b7146079687a249c75eb22d Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: action_args: {} Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 19 07:11:10.490131 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-486d8ddd-04d6-4b2a-96c1-4ead56e3107f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-486d8ddd-04d6-4b2a-96c1-4ead56e3107f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.023921 Oct 19 07:11:10.503455 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2361/4593] 10.222.0.39 () {58 vars in 1182 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:11:10.506952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.512232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:10.512894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Searching by: {'deleted': False, 'project_id': 'c481a0b055cc4683ac688f94398122cb'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:11:10.519416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.519956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.520737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.525439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.525439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.525439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.558785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:11:10.589698 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5b52eb5-40d7-4dcc-ab69-89b23b4dd8aa tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.090200 Oct 19 07:11:10.590528 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2362/4594] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers => generated 683 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:11:10.614757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.624225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:10.634031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.servers [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Removing options 'limit' from query {{(pid=127567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1500}} Oct 19 07:11:10.634031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Searching by: {'deleted': False, 'project_id': 'c481a0b055cc4683ac688f94398122cb'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:11:10.637195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.637858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.638430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.639983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.640673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.641669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.649976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:10.660365 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a099c62d-1491-4120-b77f-594b44816b3b tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1676 microversion: 2.1 time: 0.315246 Oct 19 07:11:10.661492 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2233/4595] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1676 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:11:10.681644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:11:10.698506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:10.714917 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6e930f7-62ea-4c66-8135-1040d15babf1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.115911 Oct 19 07:11:10.715517 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2363/4596] 10.222.0.39 () {58 vars in 1144 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:11:10.738411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5167c5c-26ec-4d50-a652-b773c90d7c87 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5167c5c-26ec-4d50-a652-b773c90d7c87 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Request method failure captured: Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6LccjE8uFKreqt_4E1dMwz1kW7nUQ55l_XfSjeRta1IpFCNFoJD8TiJXgVniMjl6Dq8ZeieMqya7LtMIINECEg21_3nBQ8nELBmJqGMFNjte6wI8AATSlx2knLcWe0eonref6cwfwD8l9_6EwODfwKtc7Z8pXu81Ch2zM3LY5OzwMA Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c481a0b055cc4683ac688f94398122cb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 613a6cdb6b7146079687a249c75eb22d Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: action_args: {} Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '-1' Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 19 07:11:10.742880 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.747257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5167c5c-26ec-4d50-a652-b773c90d7c87 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:10.754346 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5167c5c-26ec-4d50-a652-b773c90d7c87 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.014840 Oct 19 07:11:10.754346 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2234/4597] 10.222.0.39 () {58 vars in 1142 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:11:10.762119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-964af3e8-c2c9-42ad-a281-61c20bdecb27 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-964af3e8-c2c9-42ad-a281-61c20bdecb27 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Request method failure captured: Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6LccjE8uFKreqt_4E1dMwz1kW7nUQ55l_XfSjeRta1IpFCNFoJD8TiJXgVniMjl6Dq8ZeieMqya7LtMIINECEg21_3nBQ8nELBmJqGMFNjte6wI8AATSlx2knLcWe0eonref6cwfwD8l9_6EwODfwKtc7Z8pXu81Ch2zM3LY5OzwMA Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c481a0b055cc4683ac688f94398122cb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 613a6cdb6b7146079687a249c75eb22d Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: action_args: {} Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'testing' Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 19 07:11:10.764533 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-964af3e8-c2c9-42ad-a281-61c20bdecb27 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:10.769817 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-964af3e8-c2c9-42ad-a281-61c20bdecb27 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.010446 Oct 19 07:11:10.770852 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2364/4598] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:11:10.778807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1bff7d7d-6197-4999-827f-ab06057e7f62 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.785517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1bff7d7d-6197-4999-827f-ab06057e7f62 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:10.786365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1bff7d7d-6197-4999-827f-ab06057e7f62 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c481a0b055cc4683ac688f94398122cb'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:11:10.794680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.servers [None req-1bff7d7d-6197-4999-827f-ab06057e7f62 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Flavor 'non_existing_flavor' could not be found {{(pid=127568) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 19 07:11:10.804747 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1bff7d7d-6197-4999-827f-ab06057e7f62 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.021676 Oct 19 07:11:10.804747 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2235/4599] 10.222.0.39 () {58 vars in 1178 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:11:10.810471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.816580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:10.817489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c481a0b055cc4683ac688f94398122cb'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:11:10.825450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.826139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.826862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.827764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.828619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.829414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.924230 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e789dd00-c883-4435-b128-6077f24eb621 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.117064 Oct 19 07:11:10.947077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:10.951975 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2365/4600] 10.222.0.39 () {58 vars in 1174 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:11:10.953754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:10.954773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c481a0b055cc4683ac688f94398122cb'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:11:10.963458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.964855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.965534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:10.966637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:10.967568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:10.968227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:11.073941 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0116b664-48ff-491f-8a56-733ef11ab2ab tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.131190 Oct 19 07:11:11.087400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:11.094926 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2236/4601] 10.222.0.39 () {58 vars in 1184 bytes} [Wed Oct 19 07:11:10 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:11:11.100915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:11.110018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Searching by: {'deleted': False, 'project_id': 'c481a0b055cc4683ac688f94398122cb'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:11:11.110018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:11.110018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:11.110018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:11.110018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:11.110018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:11.110916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:11.142936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:11:11.191552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:11.199789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:11.201331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:11.202050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:11.653951 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f19b0d92-51c7-4976-8d44-0cdb0060feb0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.568315 Oct 19 07:11:11.653951 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2366/4602] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 07:11:11 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:11.679870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18e0aeb2-1683-4f2f-9e9a-fc4e6788401d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:11.696508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:11.696508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:11.711097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18e0aeb2-1683-4f2f-9e9a-fc4e6788401d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:11.714345 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18e0aeb2-1683-4f2f-9e9a-fc4e6788401d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.038493 Oct 19 07:11:11.716241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:11.732418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2237/4603] 10.222.0.39 () {58 vars in 1178 bytes} [Wed Oct 19 07:11:11 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:11:11.739902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:11.741781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:11.741781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:11.741781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:11.742164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:11.747811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:11.758468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:11.759227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Searching by: {'deleted': False, 'project_id': 'c481a0b055cc4683ac688f94398122cb'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 07:11:11.776012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:11.776603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:11.782701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:11.783509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:11.791754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:11.794779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:11.845076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 07:11:11.936303 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-603ce475-27c1-4c94-85c7-5ad867ae3138 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.198121 Oct 19 07:11:11.937288 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2238/4604] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 07:11:11 2022] GET /compute/v2.1/servers => generated 683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:11:11.951800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:11.952336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:11.964392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:11.965240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:11.967107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:11.969222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:11.969703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:11.979666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:12.006583 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] HTTP exception thrown: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Request method failure captured: Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 HTTP/1.1 Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6LccjE8uFKreqt_4E1dMwz1kW7nUQ55l_XfSjeRta1IpFCNFoJD8TiJXgVniMjl6Dq8ZeieMqya7LtMIINECEg21_3nBQ8nELBmJqGMFNjte6wI8AATSlx2knLcWe0eonref6cwfwD8l9_6EwODfwKtc7Z8pXu81Ch2zM3LY5OzwMA Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c481a0b055cc4683ac688f94398122cb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 613a6cdb6b7146079687a249c75eb22d Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '08870b64-b146-4c26-a37a-b9539dbe2bf1'} Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:12.008285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Returning 404 to user: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:12.012125 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-107453eb-56b4-4f49-a1e3-d33c32eca7ef tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "DELETE /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1" status: 404 len: 111 microversion: 2.1 time: 0.063502 Oct 19 07:11:12.023884 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2239/4605] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:11:11 2022] DELETE /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:11:12.029467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:12.029967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:12.042733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:12.043232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:12.043677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:12.044439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:12.044904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:12.045339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:12.089689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:11:12.403833 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6a05041-88de-47ca-919d-5beaac9bf6f5 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "DELETE /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9" status: 204 len: 0 microversion: 2.1 time: 0.377306 Oct 19 07:11:12.404541 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2240/4606] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:11:12 2022] DELETE /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:11:12.415122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:12.415793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:12.436810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:12.438627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:12.439076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:12.439813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:12.440306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:12.441456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:12.559487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:11:12.807323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:12.816332 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9629fb15-5150-490c-a9d4-da2fcbc2884d tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1676 microversion: 2.1 time: 1.129156 Oct 19 07:11:12.826545 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2367/4607] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:11 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1676 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:11:12.973835 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-532d5b84-e32b-43af-9923-d01a3d7edbc0 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 204 len: 0 microversion: 2.1 time: 0.563347 Oct 19 07:11:12.975033 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2241/4608] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:11:12 2022] DELETE /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:11:12.985738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:12.985738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 08870b64-b146-4c26-a37a-b9539dbe2bf1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:12.996245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:13.004979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:13.005434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:13.006188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:13.006647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:13.007075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:13.039831 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] HTTP exception thrown: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Request method failure captured: Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 HTTP/1.1 Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6LccjE8uFKreqt_4E1dMwz1kW7nUQ55l_XfSjeRta1IpFCNFoJD8TiJXgVniMjl6Dq8ZeieMqya7LtMIINECEg21_3nBQ8nELBmJqGMFNjte6wI8AATSlx2knLcWe0eonref6cwfwD8l9_6EwODfwKtc7Z8pXu81Ch2zM3LY5OzwMA Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c481a0b055cc4683ac688f94398122cb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 613a6cdb6b7146079687a249c75eb22d Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '08870b64-b146-4c26-a37a-b9539dbe2bf1'} Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:13.044986 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Returning 404 to user: Instance 08870b64-b146-4c26-a37a-b9539dbe2bf1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:13.048910 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ddc9571e-e60a-4343-941f-5b26a51eee7d tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1" status: 404 len: 111 microversion: 2.1 time: 0.067403 Oct 19 07:11:13.053019 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2368/4609] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:12 2022] GET /compute/v2.1/servers/08870b64-b146-4c26-a37a-b9539dbe2bf1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:11:13.062962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:13.063786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:13.072063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:13.073277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:13.073885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:13.075004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:13.075572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:13.076316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:13.380643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:13.392055 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3359899-9c8e-4a95-8fba-4661e4e9ce9f tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9" status: 200 len: 1522 microversion: 2.1 time: 0.334220 Oct 19 07:11:13.394835 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2242/4610] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:13 2022] GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:11:13.842327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:13.842948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:13.855683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:13.856471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:13.857846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:13.859585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:13.860295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:13.872128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:14.045674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:14.059505 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ddce4614-aa1f-45f7-b033-04566ae185ba tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1609 microversion: 2.1 time: 0.216616 Oct 19 07:11:14.072972 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2369/4611] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:13 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1609 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:14.438777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:14.446747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:14.448589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:14.470146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:14.474122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:14.475660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:14.476410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:14.477117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:15.093424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:15.094064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:15.111614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:15.112168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:15.112660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:15.113407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:15.113866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:15.120311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:15.181511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:15.193201 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37205174-b142-49e3-9607-7c48eee5aff1 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9" status: 200 len: 1522 microversion: 2.1 time: 0.760476 Oct 19 07:11:15.193991 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2243/4612] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:14 2022] GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9 => generated 1522 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:15.198558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a3de4fec-9d64-45b7-b0d7-2a5b748e684f req-656425b2-ab58-4479-bc18-c8ba763fafdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e06e92a-b261-47bc-8963-f42b50716743", "name": "network-vif-deleted", "tag": "66267486-2e59-4106-9cf9-f8b5ba5ef492"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:15.230828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a3de4fec-9d64-45b7-b0d7-2a5b748e684f req-656425b2-ab58-4479-bc18-c8ba763fafdf service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:15.231318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a3de4fec-9d64-45b7-b0d7-2a5b748e684f req-656425b2-ab58-4479-bc18-c8ba763fafdf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:15.231737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a3de4fec-9d64-45b7-b0d7-2a5b748e684f req-656425b2-ab58-4479-bc18-c8ba763fafdf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:15.289866 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a3de4fec-9d64-45b7-b0d7-2a5b748e684f req-656425b2-ab58-4479-bc18-c8ba763fafdf service nova] Creating event network-vif-deleted:66267486-2e59-4106-9cf9-f8b5ba5ef492 for instance 3e06e92a-b261-47bc-8963-f42b50716743 on n-h1-861333-10 Oct 19 07:11:15.297903 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a3de4fec-9d64-45b7-b0d7-2a5b748e684f req-656425b2-ab58-4479-bc18-c8ba763fafdf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102531 Oct 19 07:11:15.300484 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2244/4613] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:11:15.349979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:15.366480 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19f17717-6e79-48fa-9579-1e4aeb4e5072 tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1609 microversion: 2.1 time: 0.282128 Oct 19 07:11:15.407863 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2370/4614] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:15 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1609 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:16.222968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:16.223666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:16.227649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:16.245112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:16.245608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:16.246051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:16.246760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:16.247655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:16.248742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:16.390303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:16.390828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:16.401725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:16.402218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:16.406340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:16.412652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:16.413581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:16.414194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:16.488091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:16.488611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:16.494338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:16.497078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lazy-loading 'fault' on Instance uuid 3e06e92a-b261-47bc-8963-f42b50716743 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:11:16.745104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2543970e80c84e109961fc84bfaaedd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05016de78e0b4491a53cfa3885193ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:16.764003 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d0c9edb-24c5-4a69-be54-c80d19ee499f tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 200 len: 1328 microversion: 2.1 time: 0.372355 Oct 19 07:11:16.765221 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2371/4615] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:16 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 1328 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:16.788947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:16.798009 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3bc411f-63c4-4334-b887-d3a8dfaff8e8 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9" status: 200 len: 1522 microversion: 2.1 time: 0.580817 Oct 19 07:11:16.799309 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2245/4616] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:16 2022] GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9 => generated 1522 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:17.368127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-88a920d4-a8a9-4140-8b6f-229cf032ebdc req-a5b33e7e-4cb8-4832-b9f8-f4d475e81a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228a31d6-e376-44d4-9300-ce6437e626c9", "name": "network-vif-deleted", "tag": "9a0bc543-6808-4c3b-8733-bdae615e0c16"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:17.385966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88a920d4-a8a9-4140-8b6f-229cf032ebdc req-a5b33e7e-4cb8-4832-b9f8-f4d475e81a87 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:17.386718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88a920d4-a8a9-4140-8b6f-229cf032ebdc req-a5b33e7e-4cb8-4832-b9f8-f4d475e81a87 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:17.389119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88a920d4-a8a9-4140-8b6f-229cf032ebdc req-a5b33e7e-4cb8-4832-b9f8-f4d475e81a87 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:17.428501 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-88a920d4-a8a9-4140-8b6f-229cf032ebdc req-a5b33e7e-4cb8-4832-b9f8-f4d475e81a87 service nova] Creating event network-vif-deleted:9a0bc543-6808-4c3b-8733-bdae615e0c16 for instance 228a31d6-e376-44d4-9300-ce6437e626c9 on n-h2-861333-10 Oct 19 07:11:17.440531 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-88a920d4-a8a9-4140-8b6f-229cf032ebdc req-a5b33e7e-4cb8-4832-b9f8-f4d475e81a87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076399 Oct 19 07:11:17.441782 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2372/4617] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:11:17.792699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:17.796723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] [instance: 3e06e92a-b261-47bc-8963-f42b50716743] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:17.803171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:17.803938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:17.804394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:17.805279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:17.805741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:17.806174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:17.823485 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] HTTP exception thrown: Instance 3e06e92a-b261-47bc-8963-f42b50716743 could not be found. Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Request method failure captured: Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 HTTP/1.1 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6DmX-pQ_4OnfuRUxh8rZSYDxjA0X84x3jYkADkvnJhDXg00PWP_QY3Xa-1vVKKQiCwPtOHOUWT_jfFKZg3ocIvk_QkW2-ZefnF6mQ0XawPMe--AMUWBI3jMmufugk0Ll2vtD8y9ScW4pTC2z439SwsP67b_cVZJF5JCwtBUgMpip78 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05016de78e0b4491a53cfa3885193ca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05016de78e0b4491a53cfa3885193ca8", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 05016de78e0b4491a53cfa3885193ca8 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-816942685 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 2543970e80c84e109961fc84bfaaedd1 Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-816942685-project Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 3e06e92a-b261-47bc-8963-f42b50716743 could not be found. Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '3e06e92a-b261-47bc-8963-f42b50716743'} Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e06e92a-b261-47bc-8963-f42b50716743 could not be found. Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e06e92a-b261-47bc-8963-f42b50716743 could not be found. Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:17.830252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e06e92a-b261-47bc-8963-f42b50716743 could not be found. Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Returning 404 to user: Instance 3e06e92a-b261-47bc-8963-f42b50716743 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3460cb93-d24e-4de4-8ebe-490be4d8060e tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743" status: 404 len: 111 microversion: 2.1 time: 0.044573 Oct 19 07:11:17.839664 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2246/4618] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:17 2022] GET /compute/v2.1/servers/3e06e92a-b261-47bc-8963-f42b50716743 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:11:17.850408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:17.852016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:17.854483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0b94ca1-3360-415e-bb18-3222caeab7ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] Calling method '.version_select at 0x7f6d64103820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:17.865237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:17.865905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:17.866491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:17.867335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:17.868136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:17.868748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:18.149195 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0b94ca1-3360-415e-bb18-3222caeab7ed tempest-ServerActionsTestJSON-816942685 tempest-ServerActionsTestJSON-816942685-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-901693878" status: 202 len: 0 microversion: 2.1 time: 0.305302 Oct 19 07:11:18.150803 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2247/4619] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 07:11:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-901693878 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:11:18.192186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:18.204561 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47cbcaa5-be07-4da3-88a2-ddce4f0ee8e9 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9" status: 200 len: 1308 microversion: 2.1 time: 0.380470 Oct 19 07:11:18.204561 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2373/4620] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:17 2022] GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:19.238857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:19.241090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:19.266436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:19.267340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:19.267960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:19.270256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:19.271061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:19.277034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:19.374451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:19.375134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:19.379131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:19.379131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lazy-loading 'fault' on Instance uuid 228a31d6-e376-44d4-9300-ce6437e626c9 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:11:19.480018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613a6cdb6b7146079687a249c75eb22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c481a0b055cc4683ac688f94398122cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:19.488009 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-233b12c5-e293-48bd-90bb-f7824e7f936e tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9" status: 200 len: 1313 microversion: 2.1 time: 0.265738 Oct 19 07:11:19.491505 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2248/4621] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:19 2022] GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:19.512416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-41981d9d-b811-4ff4-a054-b859abd13ce7 req-6805fe85-f677-4d3c-9f7e-67bbe5ed399a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93f0caa-a42d-4d64-87e7-f04c2218c1d0", "name": "network-vif-deleted", "tag": "35389a45-3a24-4569-bc92-3e160c78d4ea"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:19.525403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-41981d9d-b811-4ff4-a054-b859abd13ce7 req-6805fe85-f677-4d3c-9f7e-67bbe5ed399a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:19.526173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-41981d9d-b811-4ff4-a054-b859abd13ce7 req-6805fe85-f677-4d3c-9f7e-67bbe5ed399a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:19.526799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-41981d9d-b811-4ff4-a054-b859abd13ce7 req-6805fe85-f677-4d3c-9f7e-67bbe5ed399a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:19.542226 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-41981d9d-b811-4ff4-a054-b859abd13ce7 req-6805fe85-f677-4d3c-9f7e-67bbe5ed399a service nova] Creating event network-vif-deleted:35389a45-3a24-4569-bc92-3e160c78d4ea for instance d93f0caa-a42d-4d64-87e7-f04c2218c1d0 on n-h1-861333-10 Oct 19 07:11:19.547743 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-41981d9d-b811-4ff4-a054-b859abd13ce7 req-6805fe85-f677-4d3c-9f7e-67bbe5ed399a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039251 Oct 19 07:11:19.549051 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2374/4622] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:11:20.513937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:20.515169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: 228a31d6-e376-44d4-9300-ce6437e626c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:20.522345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:20.523084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:20.524787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:20.524787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:20.524787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:20.525078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:20.541460 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] HTTP exception thrown: Instance 228a31d6-e376-44d4-9300-ce6437e626c9 could not be found. Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Request method failure captured: Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9 HTTP/1.1 Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6LccjE8uFKreqt_4E1dMwz1kW7nUQ55l_XfSjeRta1IpFCNFoJD8TiJXgVniMjl6Dq8ZeieMqya7LtMIINECEg21_3nBQ8nELBmJqGMFNjte6wI8AATSlx2knLcWe0eonref6cwfwD8l9_6EwODfwKtc7Z8pXu81Ch2zM3LY5OzwMA Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c481a0b055cc4683ac688f94398122cb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 613a6cdb6b7146079687a249c75eb22d Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 228a31d6-e376-44d4-9300-ce6437e626c9 could not be found. Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '228a31d6-e376-44d4-9300-ce6437e626c9'} Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228a31d6-e376-44d4-9300-ce6437e626c9 could not be found. Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228a31d6-e376-44d4-9300-ce6437e626c9 could not be found. Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.543474 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:20.547461 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.547461 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:20.547461 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:20.547461 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:20.547461 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:20.547461 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:20.547461 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228a31d6-e376-44d4-9300-ce6437e626c9 could not be found. Oct 19 07:11:20.547461 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.549506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Returning 404 to user: Instance 228a31d6-e376-44d4-9300-ce6437e626c9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:20.550749 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cc0d437-d8cc-4f0b-8f07-63745eb94e66 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9" status: 404 len: 111 microversion: 2.1 time: 0.040792 Oct 19 07:11:20.551886 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2249/4623] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:20 2022] GET /compute/v2.1/servers/228a31d6-e376-44d4-9300-ce6437e626c9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:11:20.561455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:20.562761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] [instance: d93f0caa-a42d-4d64-87e7-f04c2218c1d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:20.569900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:20.570808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:20.572073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:20.573063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:20.573760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:20.574601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:20.590310 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] HTTP exception thrown: Instance d93f0caa-a42d-4d64-87e7-f04c2218c1d0 could not be found. Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Request method failure captured: Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 HTTP/1.1 Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6LccjE8uFKreqt_4E1dMwz1kW7nUQ55l_XfSjeRta1IpFCNFoJD8TiJXgVniMjl6Dq8ZeieMqya7LtMIINECEg21_3nBQ8nELBmJqGMFNjte6wI8AATSlx2knLcWe0eonref6cwfwD8l9_6EwODfwKtc7Z8pXu81Ch2zM3LY5OzwMA Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c481a0b055cc4683ac688f94398122cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c481a0b055cc4683ac688f94398122cb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c481a0b055cc4683ac688f94398122cb Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-156027931 Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 613a6cdb6b7146079687a249c75eb22d Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-156027931-project Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance d93f0caa-a42d-4d64-87e7-f04c2218c1d0 could not be found. Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'd93f0caa-a42d-4d64-87e7-f04c2218c1d0'} Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93f0caa-a42d-4d64-87e7-f04c2218c1d0 could not be found. Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93f0caa-a42d-4d64-87e7-f04c2218c1d0 could not be found. Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.592595 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:20.596481 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.596481 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:20.596481 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:20.596481 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:20.596481 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:20.596481 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:20.596481 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93f0caa-a42d-4d64-87e7-f04c2218c1d0 could not be found. Oct 19 07:11:20.596481 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:20.599717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] Returning 404 to user: Instance d93f0caa-a42d-4d64-87e7-f04c2218c1d0 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:20.601057 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5cc3b9bd-5b16-4329-bf2d-12e161d878d7 tempest-ListServersNegativeTestJSON-156027931 tempest-ListServersNegativeTestJSON-156027931-project] 10.222.0.39 "GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0" status: 404 len: 111 microversion: 2.1 time: 0.045003 Oct 19 07:11:20.602028 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2375/4624] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:20 2022] GET /compute/v2.1/servers/d93f0caa-a42d-4d64-87e7-f04c2218c1d0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:11:31.048085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0222121b-2a69-4b6a-85a1-d599fa812285 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:31.048736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0222121b-2a69-4b6a-85a1-d599fa812285 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:31.052742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:31.054698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:31.058049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=78,nova_cell1:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:31.075921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0222121b-2a69-4b6a-85a1-d599fa812285 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:31.076151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0222121b-2a69-4b6a-85a1-d599fa812285 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:31.077166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0222121b-2a69-4b6a-85a1-d599fa812285 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:31.077888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0222121b-2a69-4b6a-85a1-d599fa812285 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:31.078362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0222121b-2a69-4b6a-85a1-d599fa812285 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:31.079854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0222121b-2a69-4b6a-85a1-d599fa812285 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:31.162437 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0222121b-2a69-4b6a-85a1-d599fa812285 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments/df783e7c-0a02-4c6a-9855-14d8b118b826" status: 200 len: 194 microversion: 2.20 time: 0.119511 Oct 19 07:11:31.176214 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2250/4625] 10.222.0.39 () {60 vars in 1454 bytes} [Wed Oct 19 07:11:31 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments/df783e7c-0a02-4c6a-9855-14d8b118b826 => generated 194 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:11:31.319080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:31.319669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:31.321817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:31.322556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:31.324616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:31.325349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=54 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:31.337436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:31.339271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:31.340311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:31.346624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:31.347836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:31.348498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:31.590305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lazy-loading 'services' on Instance uuid 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:11:31.882936 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3d3f330-4e78-441b-8729-cc6550b9b794 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments/df783e7c-0a02-4c6a-9855-14d8b118b826" status: 202 len: 0 microversion: 2.20 time: 0.568089 Oct 19 07:11:31.888578 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2376/4626] 10.222.0.39 () {60 vars in 1457 bytes} [Wed Oct 19 07:11:31 2022] DELETE /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments/df783e7c-0a02-4c6a-9855-14d8b118b826 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:11:31.898948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de60aae4-deac-45fe-a243-ba1726ef1c05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:31.901358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de60aae4-deac-45fe-a243-ba1726ef1c05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:31.914080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de60aae4-deac-45fe-a243-ba1726ef1c05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:31.914589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de60aae4-deac-45fe-a243-ba1726ef1c05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:31.921811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de60aae4-deac-45fe-a243-ba1726ef1c05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:31.922585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de60aae4-deac-45fe-a243-ba1726ef1c05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:31.923077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de60aae4-deac-45fe-a243-ba1726ef1c05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:31.923515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de60aae4-deac-45fe-a243-ba1726ef1c05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:32.050552 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de60aae4-deac-45fe-a243-ba1726ef1c05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158647 Oct 19 07:11:32.051257 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2251/4627] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 07:11:31 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:11:33.065608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba25330e-b106-42c1-ac4f-68550375218a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:33.067976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba25330e-b106-42c1-ac4f-68550375218a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:33.094086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba25330e-b106-42c1-ac4f-68550375218a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:33.102821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba25330e-b106-42c1-ac4f-68550375218a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:33.104499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba25330e-b106-42c1-ac4f-68550375218a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:33.105581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba25330e-b106-42c1-ac4f-68550375218a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:33.106075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba25330e-b106-42c1-ac4f-68550375218a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:33.106518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba25330e-b106-42c1-ac4f-68550375218a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:33.175743 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba25330e-b106-42c1-ac4f-68550375218a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112917 Oct 19 07:11:33.186943 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2377/4628] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 07:11:33 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:11:34.195762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66519f0a-9da0-40af-b832-fbc741e5980b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:34.199834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66519f0a-9da0-40af-b832-fbc741e5980b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:34.208029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66519f0a-9da0-40af-b832-fbc741e5980b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:34.209416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66519f0a-9da0-40af-b832-fbc741e5980b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:34.210362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66519f0a-9da0-40af-b832-fbc741e5980b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:34.211310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66519f0a-9da0-40af-b832-fbc741e5980b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:34.211996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66519f0a-9da0-40af-b832-fbc741e5980b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:34.212671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66519f0a-9da0-40af-b832-fbc741e5980b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:34.254274 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66519f0a-9da0-40af-b832-fbc741e5980b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064996 Oct 19 07:11:34.255287 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2252/4629] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 07:11:34 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:11:35.267322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef7fa7a5-99a8-48a4-b367-38b7b846267d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:35.270671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef7fa7a5-99a8-48a4-b367-38b7b846267d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:35.286720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef7fa7a5-99a8-48a4-b367-38b7b846267d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:35.294825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef7fa7a5-99a8-48a4-b367-38b7b846267d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:35.294825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef7fa7a5-99a8-48a4-b367-38b7b846267d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:35.295345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef7fa7a5-99a8-48a4-b367-38b7b846267d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:35.296227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef7fa7a5-99a8-48a4-b367-38b7b846267d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:35.296691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef7fa7a5-99a8-48a4-b367-38b7b846267d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:35.354882 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef7fa7a5-99a8-48a4-b367-38b7b846267d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088913 Oct 19 07:11:35.354882 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2378/4630] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 07:11:35 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:11:36.366179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3edbe10f-567e-422f-b455-984de2f70313 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:36.368413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3edbe10f-567e-422f-b455-984de2f70313 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:36.385422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3edbe10f-567e-422f-b455-984de2f70313 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:36.387105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3edbe10f-567e-422f-b455-984de2f70313 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:36.387561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3edbe10f-567e-422f-b455-984de2f70313 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:36.389002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3edbe10f-567e-422f-b455-984de2f70313 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:36.389470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3edbe10f-567e-422f-b455-984de2f70313 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:36.390914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3edbe10f-567e-422f-b455-984de2f70313 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:36.426995 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3edbe10f-567e-422f-b455-984de2f70313 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065322 Oct 19 07:11:36.428231 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2253/4631] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 07:11:36 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:11:37.440619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f52cf37e-a57a-427b-aec5-63a2d32f3ed2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:37.443497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f52cf37e-a57a-427b-aec5-63a2d32f3ed2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:37.464163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52cf37e-a57a-427b-aec5-63a2d32f3ed2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:37.465876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52cf37e-a57a-427b-aec5-63a2d32f3ed2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:37.468534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52cf37e-a57a-427b-aec5-63a2d32f3ed2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:37.472698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52cf37e-a57a-427b-aec5-63a2d32f3ed2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:37.472698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52cf37e-a57a-427b-aec5-63a2d32f3ed2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:37.474696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52cf37e-a57a-427b-aec5-63a2d32f3ed2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:37.526313 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f52cf37e-a57a-427b-aec5-63a2d32f3ed2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091124 Oct 19 07:11:37.526890 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2379/4632] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 07:11:37 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:11:38.540777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ebb63d67-940e-4f09-a77e-89bc4bd823ab tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:38.545453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ebb63d67-940e-4f09-a77e-89bc4bd823ab tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:38.564979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb63d67-940e-4f09-a77e-89bc4bd823ab tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:38.566393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb63d67-940e-4f09-a77e-89bc4bd823ab tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:38.567280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb63d67-940e-4f09-a77e-89bc4bd823ab tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:38.569433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb63d67-940e-4f09-a77e-89bc4bd823ab tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:38.569931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb63d67-940e-4f09-a77e-89bc4bd823ab tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:38.570517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb63d67-940e-4f09-a77e-89bc4bd823ab tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:38.616448 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ebb63d67-940e-4f09-a77e-89bc4bd823ab tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.081687 Oct 19 07:11:38.618024 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2254/4633] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 07:11:38 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:38.690631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:38.692578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:38.701556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:38.702230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:38.703086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:38.703994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:38.704780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:38.705372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:38.744427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:11:39.353476 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e82cf4bd-109f-4f18-afe9-23bc4bbf2646 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 204 len: 0 microversion: 2.20 time: 0.667799 Oct 19 07:11:39.357948 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2380/4634] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:11:38 2022] DELETE /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:11:39.370068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:39.372036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:39.395557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:39.400039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:39.400952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:39.401936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:39.402620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:39.403282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:39.648954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:39.660235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:39.661989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:39.664582 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-def637ca-0979-467b-a7ed-36d03cb705b2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.301877 Oct 19 07:11:39.672264 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2255/4635] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:11:39 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:11:40.693365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:40.693959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:40.713423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:40.714187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:40.714781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:40.715670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:40.716095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:40.716543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:41.453242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:41.465780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:41.467466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:41.468980 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75850bcb-5c06-4e8e-b95f-b99119561eb8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1724 microversion: 2.20 time: 0.780603 Oct 19 07:11:41.469725 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2381/4636] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:11:40 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1724 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:11:42.513188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:42.514416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:42.522284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:42.522880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:42.523249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:42.524418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:42.527905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:42.528594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:42.710825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:42.722818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:42.725299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:42.747007 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7f225d7-6cdf-449c-be63-39a7b01a2240 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1657 microversion: 2.20 time: 0.217885 Oct 19 07:11:42.747007 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2256/4637] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:11:42 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1657 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:11:43.682573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a2d9e70d-bc31-4072-9ef2-951e7ead9b2e req-214a2604-fbd1-4203-8cd5-a90c014c1ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf", "name": "network-vif-deleted", "tag": "d36dab0c-9d83-4aa8-b6bb-531eafbf58f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:43.702557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a2d9e70d-bc31-4072-9ef2-951e7ead9b2e req-214a2604-fbd1-4203-8cd5-a90c014c1ee2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:43.703231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a2d9e70d-bc31-4072-9ef2-951e7ead9b2e req-214a2604-fbd1-4203-8cd5-a90c014c1ee2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:43.703848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a2d9e70d-bc31-4072-9ef2-951e7ead9b2e req-214a2604-fbd1-4203-8cd5-a90c014c1ee2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:43.727133 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a2d9e70d-bc31-4072-9ef2-951e7ead9b2e req-214a2604-fbd1-4203-8cd5-a90c014c1ee2 service nova] Creating event network-vif-deleted:d36dab0c-9d83-4aa8-b6bb-531eafbf58f6 for instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf on n-h2-861333-10 Oct 19 07:11:43.742631 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a2d9e70d-bc31-4072-9ef2-951e7ead9b2e req-214a2604-fbd1-4203-8cd5-a90c014c1ee2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067879 Oct 19 07:11:43.749323 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2382/4638] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:11:43.759628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:43.761100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:43.775130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:43.777818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:43.777818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:43.779081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:43.781338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:43.784388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:44.154741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:44.171491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:44.175413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:44.178872 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62d06ebe-9175-4b5c-baca-7d69c6a07193 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 200 len: 1657 microversion: 2.20 time: 0.424601 Oct 19 07:11:44.193757 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2257/4639] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:11:43 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 1657 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:11:45.213247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:45.214959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:45.232561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:45.238695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:45.240822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:45.242040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:45.244478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:45.246175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:45.269139 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] HTTP exception thrown: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Request method failure captured: Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf HTTP/1.1 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6JAo7Bw98DynGDOTxYoYef9YzMscFBzehU8wAtrxs1f8PeMRDg2s-TIL-AUJqVfA1VtBmL1SA-F0a3sKhEGx8bEfv_1F8v3xRVfOz41ipa3obQ2j0qSwTrfYivkYZvSIv7Vc4J3kv8_W5kBg6MEQuywAgfRY2vYi2yKBRl_pzCOLig Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c7336f5e48c4c2ea36b25acaffdca60", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 9eadfbc09389478d9bbf2c3f90033135 Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf'} Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:45.291006 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Returning 404 to user: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cf425f0-0e35-4695-a1f0-f88c917d40f6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 404 len: 111 microversion: 2.20 time: 0.088151 Oct 19 07:11:45.296368 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2383/4640] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:11:45 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:11:45.305179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac57bb5a-eafd-4688-90c6-2919e68742cd tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '.version_select at 0x7f6d64075c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:45.423482 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac57bb5a-eafd-4688-90c6-2919e68742cd tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000869835" status: 204 len: 0 microversion: 2.20 time: 0.125075 Oct 19 07:11:45.427514 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2258/4641] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 07:11:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000869835 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 07:11:47.987446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98d179d5-c484-4b3a-afb5-2afc70eabc73 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'create', calling method: .version_select at 0x7f6d5fb51670>, body: {"keypair": {"name": "tempest-keypair-1292389028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUMJqkSudJAS3vO2XlJ+7Hp+Vw6Uq3w5XHrzKZTJsgyqvd1ooDTU1Eyrc41bbCDYfx0zxXKMfcLJQHKiOsIzfSrMjDeEFqjnx2hZ/+kk+FBDRrwNOthQ30JYzlpwJE/zQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:48.022280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-98d179d5-c484-4b3a-afb5-2afc70eabc73 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Getting quotas for project 1c7336f5e48c4c2ea36b25acaffdca60. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:11:48.033214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-98d179d5-c484-4b3a-afb5-2afc70eabc73 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Getting quotas for user 9eadfbc09389478d9bbf2c3f90033135 and project 1c7336f5e48c4c2ea36b25acaffdca60. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:11:48.168168 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98d179d5-c484-4b3a-afb5-2afc70eabc73 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.185655 Oct 19 07:11:48.169515 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2384/4642] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 07:11:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 07:11:52.842185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1630583761", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:52.848990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-714347316", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "3688f973-8cc9-4257-bc25-00b192b70adc"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:52.975376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] validate_networks() for [('3688f973-8cc9-4257-bc25-00b192b70adc', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:11:53.000313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] validate_networks() for [('38e12f1a-c1b9-4ff5-848e-f7ae3dfcbf95', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:11:53.999661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:11:54.000280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:11:54.000560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:11:54.001154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:11:54.001718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:11:54.026208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:54.026949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:54.028320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:54.029380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:54.031596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:54.035206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:54.098302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Getting quotas for project b019a5b91f2c402c98c5c26090a9e8ba. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:11:54.111748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Getting quotas for user 5ec8ddc37c6d4f2f8aae349173dc38b9 and project b019a5b91f2c402c98c5c26090a9e8ba. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:11:54.127290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:11:54.129364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:11:54.166110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=48 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:11:54.246640 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b728b486-4d0c-4dc7-8837-781afc70dc56 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.663002 Oct 19 07:11:54.258167 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2385/4643] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:11:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:11:54.285884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b01bb2a-5113-4997-85c0-48ba23f52f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Action: 'create', calling method: .version_select at 0x7f6d661a5670>, body: {"keypair": {"name": "tempest-keypair-161857772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3Rsn2QK1PgscaDu5vASDwXjsdvtbXWDwIVOB72rudFeJ9LAoBoqbgKx+WjjVbpQqwv6zBVUe+NyQhOHqBe5j6l25YImnjBraNcR2gee3Yqj6nM2/wpKQJbgJQ7ErAxeg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:54.334523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:11:54.335160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:11:54.336033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:11:54.336684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:11:54.337561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:11:54.358711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:54.359034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1b01bb2a-5113-4997-85c0-48ba23f52f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Getting quotas for project db88675ef16546948d70f08f51519d08. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:11:54.359222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:54.360851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:54.364773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:54.367164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:54.367164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:54.379333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1b01bb2a-5113-4997-85c0-48ba23f52f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Getting quotas for user 39ea74ffe6624b2e807e5974c6bb0c8e and project db88675ef16546948d70f08f51519d08. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:11:54.413684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Getting quotas for project 96288b2dc48c49cd9e1ff9fb9157835f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:11:54.426376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Getting quotas for user 7a6dbd4d6c8e4ac59b69fa20a86350ed and project 96288b2dc48c49cd9e1ff9fb9157835f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:11:54.459183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:11:54.468317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:11:54.506393 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b01bb2a-5113-4997-85c0-48ba23f52f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.246171 Oct 19 07:11:54.507107 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2386/4644] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 07:11:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 248 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 07:11:54.519618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f4b6250-a1d1-49b2-aff4-4bb04c0174ad tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:54.520259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f4b6250-a1d1-49b2-aff4-4bb04c0174ad tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:54.702500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f4b6250-a1d1-49b2-aff4-4bb04c0174ad tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:54.718072 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f4b6250-a1d1-49b2-aff4-4bb04c0174ad tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1223 microversion: 2.1 time: 0.203604 Oct 19 07:11:54.721801 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2387/4645] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:54 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1223 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:54.741996 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69eabd30-cb23-45f9-a766-8aeda23c4979 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.247047 Oct 19 07:11:54.742917 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2259/4646] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:11:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:11:54.753893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f759a4cd-aa0f-4f15-8fc7-d20a09cdaa11 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:54.757571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f759a4cd-aa0f-4f15-8fc7-d20a09cdaa11 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:54.945083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f759a4cd-aa0f-4f15-8fc7-d20a09cdaa11 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:54.952865 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f759a4cd-aa0f-4f15-8fc7-d20a09cdaa11 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1216 microversion: 2.1 time: 0.202880 Oct 19 07:11:54.954817 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2388/4647] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:54 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1216 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:11:55.755564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6dbc4d1-d845-4033-955a-33d064a7bfd2 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:55.756206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6dbc4d1-d845-4033-955a-33d064a7bfd2 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:55.883035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6dbc4d1-d845-4033-955a-33d064a7bfd2 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:55.894310 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6dbc4d1-d845-4033-955a-33d064a7bfd2 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1223 microversion: 2.1 time: 0.153028 Oct 19 07:11:55.896804 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2260/4648] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:55 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1223 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:55.979505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-964de9b5-0f65-4bc9-a5be-03588b20d020 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:55.981018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-964de9b5-0f65-4bc9-a5be-03588b20d020 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:56.162899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-964de9b5-0f65-4bc9-a5be-03588b20d020 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:56.183211 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-964de9b5-0f65-4bc9-a5be-03588b20d020 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1216 microversion: 2.1 time: 0.207276 Oct 19 07:11:56.217503 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2389/4649] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:55 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1216 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:56.920031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:56.921625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:56.932665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:56.936556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:56.937108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:56.938064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:56.938697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:56.942003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:57.225745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:57.227052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:57.237600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:57.244956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:57.245914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:57.246930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:57.247647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:57.248372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:57.262680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:57.271927 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6874b552-db4f-4187-83bf-23db7a123913 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1275 microversion: 2.1 time: 0.355122 Oct 19 07:11:57.273775 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2261/4650] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:56 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1275 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:11:57.393839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1203559237", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4b02963-15b9-49b5-82cd-ae709303ad6c"}], "security_groups": [{"name": "tempest-securitygroup--772050514"}], "key_name": "tempest-keypair-1292389028", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:11:57.558911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:57.570586 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3e06cc9-5ebf-40a8-b997-e206fcba61c9 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1220 microversion: 2.1 time: 0.348170 Oct 19 07:11:57.588221 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2390/4651] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:57 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1220 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:57.757440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] validate_networks() for [('a4b02963-15b9-49b5-82cd-ae709303ad6c', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:11:58.327862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:58.330166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:58.362459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:58.370806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:58.370806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:58.374279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:58.374937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:58.379036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:58.574418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:58.599031 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5c950ac-8aee-488f-ad56-04a3aec74d85 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1283 microversion: 2.1 time: 0.273603 Oct 19 07:11:58.605733 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2391/4652] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:58 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1283 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:58.618157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:58.619428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:58.638768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:58.642354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:58.645284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:58.646598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:58.649184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:58.651068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:58.954094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:58.966598 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8d14da8-8274-4f27-97fc-c1eba0f2d57a tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1268 microversion: 2.1 time: 0.361321 Oct 19 07:11:58.972046 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2392/4653] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:58 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1268 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:59.426404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:11:59.427421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:11:59.428063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:11:59.428683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:11:59.429263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:11:59.448261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:59.453204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:59.453920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:59.454895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:59.459052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:59.459902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:59.517371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Getting quotas for project 1c7336f5e48c4c2ea36b25acaffdca60. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:11:59.535222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Getting quotas for user 9eadfbc09389478d9bbf2c3f90033135 and project 1c7336f5e48c4c2ea36b25acaffdca60. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:11:59.565471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:11:59.572536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:11:59.638105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:59.638725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:59.658441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:59.658943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:59.659392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:59.660180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:11:59.665554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:11:59.666358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:11:59.783416 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65c925f4-3f48-4ffa-b8b1-00baa4a229bc tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.392999 Oct 19 07:11:59.786869 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2262/4654] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 07:11:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 07:11:59.803346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd79bec8-3f97-4c76-b8e5-eba26b5297a2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:59.805507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd79bec8-3f97-4c76-b8e5-eba26b5297a2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:11:59.911302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:59.926372 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06fdd542-1f61-4e52-ac5c-a6ff657e47e1 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1281 microversion: 2.1 time: 0.298360 Oct 19 07:11:59.927355 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2393/4655] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:59 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1281 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:11:59.964766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd79bec8-3f97-4c76-b8e5-eba26b5297a2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:59.981980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd79bec8-3f97-4c76-b8e5-eba26b5297a2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:59.984991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd79bec8-3f97-4c76-b8e5-eba26b5297a2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:11:59.997620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:11:59.998346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:00.005386 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd79bec8-3f97-4c76-b8e5-eba26b5297a2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1282 microversion: 2.20 time: 0.211347 Oct 19 07:12:00.018912 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2263/4656] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:11:59 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1282 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:00.028504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:00.028504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:00.028504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:00.028504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:00.028504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:00.028504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:00.862472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:00.882246 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42dfa403-b269-4578-8f87-8ce878454074 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1274 microversion: 2.1 time: 0.888775 Oct 19 07:12:00.885583 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2394/4657] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:11:59 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1274 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:00.953951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:00.954769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:00.983308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:00.983865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:00.984358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:00.985110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:00.989198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:00.993901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:01.039809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ad5387e-0bea-4fc5-980a-9d437be50e05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:01.041353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ad5387e-0bea-4fc5-980a-9d437be50e05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:01.193932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:01.212484 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11fe15fe-dda7-4df3-978e-25a31717e1e9 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1281 microversion: 2.1 time: 0.263173 Oct 19 07:12:01.217441 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2264/4658] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:00 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1281 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:01.709560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ad5387e-0bea-4fc5-980a-9d437be50e05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:01.724627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ad5387e-0bea-4fc5-980a-9d437be50e05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:01.726851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ad5387e-0bea-4fc5-980a-9d437be50e05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:01.728359 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ad5387e-0bea-4fc5-980a-9d437be50e05 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1282 microversion: 2.20 time: 0.694257 Oct 19 07:12:01.729546 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2395/4659] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:01 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1282 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:01.915404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:01.916928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:01.926104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:01.927809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:01.928671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:01.930338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:01.931204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:01.931812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:02.168982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:02.185714 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23ae2c9e-fde1-49eb-ad61-dabeefc9bc3e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1274 microversion: 2.1 time: 0.275329 Oct 19 07:12:02.185966 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2265/4660] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:01 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1274 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:02.244276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:02.245187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:02.255303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:02.257467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:02.259298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:02.260070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:02.260697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:02.261080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:02.756165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:02.756958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:02.771621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:02.772721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:02.776187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:02.778890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:02.779657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:02.786425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:02.841142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:02.876420 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc29febe-e54d-486e-ba67-8498ba10483e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1323 microversion: 2.1 time: 0.636110 Oct 19 07:12:02.877042 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2396/4661] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:02 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:03.210037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:03.211006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:03.215846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:03.224613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:03.227310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:03.228342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:03.231068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:03.231786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:03.234611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:03.235650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:03.243908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:03.246785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:03.260324 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ca71287-74e4-424a-838c-9695bf61b2e4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1334 microversion: 2.20 time: 0.498111 Oct 19 07:12:03.260324 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2266/4662] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:02 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1334 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:03.564956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:03.589078 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38772818-88c1-4f1f-ad46-74dd0f6a0867 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1274 microversion: 2.1 time: 0.373829 Oct 19 07:12:03.590122 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2397/4663] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:03 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1274 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:12:03.904821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:03.909423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:03.931662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:03.935386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:03.937354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:03.939761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:03.944680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:03.948957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:04.279395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:04.280228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:04.288211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:04.289868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:04.290637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:04.292186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:04.293861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:04.296516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:04.297196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:04.548664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:04.564937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:04.568428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:04.574292 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e79c29b-c6b9-4da3-981f-cbf7d0c52fd6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1340 microversion: 2.20 time: 0.297590 Oct 19 07:12:04.575501 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2398/4664] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:04 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1340 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:04.611219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:04.611839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:04.625149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:04.625919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:04.626534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:04.627416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:04.628049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:04.628722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:05.091523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:05.105715 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd7b8be2-484c-4a88-950b-cf13c768faad tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1316 microversion: 2.1 time: 0.498740 Oct 19 07:12:05.115688 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2399/4665] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:04 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:12:05.126204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1777626583", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f05ad9d2-0d23-4a1e-9e62-e04541038e03"}, {"port": "6a1b1b75-b22e-47ca-8550-ad04ec27f870", "tag": "port-1"}, {"port": "f840ba10-b994-4ab6-b88b-ec09ca983e2d", "tag": "port-2"}, {"uuid": "b25de00e-0a9b-4e2b-856c-502606831d67", "tag": "net-1"}, {"uuid": "b25de00e-0a9b-4e2b-856c-502606831d67"}, {"uuid": "8487ccfe-0146-4cc6-9573-09e5b1bcae04", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8487ccfe-0146-4cc6-9573-09e5b1bcae04", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7490d08e-e8c9-4ccd-adb1-5e36f7861f64", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c88e24e9-a72f-4ff8-9dc6-1f93377603b9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "87a62a14-90bd-4bd8-bd4c-408a3be36935", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1234621095"}], "key_name": "tempest-keypair-161857772", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:05.208516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:05.221741 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af53e4c4-9e48-4fed-9ac5-ba935262e00e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1323 microversion: 2.1 time: 1.322183 Oct 19 07:12:05.236742 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2267/4666] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:03 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1323 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:05.244781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd00e4e8-48dd-452e-9970-76f7b397ca03 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Action: 'create', calling method: .version_select at 0x7f6d64075280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1880163577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9zG4CA70YGA4lV7Hdls9kVwsiOo5YBs8mrv+tHsAtU5+uCuzqVRTtt4I1+wZisV4UvxYQqufzKkAtWlZ+UAehEVQp1EEqx7cqe21qYU+tPL2liguYS7O33tw1pvU9Kkw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:05.253224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:05.266041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-bd00e4e8-48dd-452e-9970-76f7b397ca03 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:12:05.276085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-bd00e4e8-48dd-452e-9970-76f7b397ca03 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for user 57cb186cade14d558122b6bf720c2922 and project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:12:05.387345 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd00e4e8-48dd-452e-9970-76f7b397ca03 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.147520 Oct 19 07:12:05.388313 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2268/4667] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:12:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:05.609735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] validate_networks() for [('f05ad9d2-0d23-4a1e-9e62-e04541038e03', None, None, None, None, None), (None, None, '6a1b1b75-b22e-47ca-8550-ad04ec27f870', None, None, None), (None, None, 'f840ba10-b994-4ab6-b88b-ec09ca983e2d', None, None, None), ('b25de00e-0a9b-4e2b-856c-502606831d67', None, None, None, None, None), ('b25de00e-0a9b-4e2b-856c-502606831d67', None, None, None, None, None), ('8487ccfe-0146-4cc6-9573-09e5b1bcae04', '10.2.2.100', None, None, None, None), ('8487ccfe-0146-4cc6-9573-09e5b1bcae04', '10.2.2.200', None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:12:05.615196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:05.616833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:05.626686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:05.627444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:05.628167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:05.629943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:05.630607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:05.634446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:06.378711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:06.387883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:06.389642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:06.391061 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1a56790-2d28-47ef-8d6e-0c325bda26f9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 0.785704 Oct 19 07:12:06.412195 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2269/4668] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:05 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:06.417483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:06.418313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:06.425109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:06.426077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:06.427787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:06.427787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:06.428195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:06.428957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:06.930814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:07.001567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:07.020570 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c879c94-34ed-40ad-ae6b-94ebe1ea133c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1316 microversion: 2.1 time: 0.605786 Oct 19 07:12:07.023536 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2270/4669] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:06 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:07.033096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:07.034834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:07.045565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:07.046351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:07.046965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:07.049721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:07.060920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:07.061658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:07.621254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:07.629790 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9f39d6b-5bc0-4a84-a071-6b43a53bbe2a tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1323 microversion: 2.1 time: 0.604777 Oct 19 07:12:07.646078 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2271/4670] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:07 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1323 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:07.653940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c38bda8f-b0d5-433e-91dd-d6a5a8ef1bd7 req-40d0d99f-d6fd-4aac-abed-6fa92901ac0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9862cb-830e-46cd-bf84-a3c3d6c2cf89", "tag": "dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:07.664503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c38bda8f-b0d5-433e-91dd-d6a5a8ef1bd7 req-40d0d99f-d6fd-4aac-abed-6fa92901ac0d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:07.665369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c38bda8f-b0d5-433e-91dd-d6a5a8ef1bd7 req-40d0d99f-d6fd-4aac-abed-6fa92901ac0d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:07.665872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c38bda8f-b0d5-433e-91dd-d6a5a8ef1bd7 req-40d0d99f-d6fd-4aac-abed-6fa92901ac0d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:07.680077 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c38bda8f-b0d5-433e-91dd-d6a5a8ef1bd7 req-40d0d99f-d6fd-4aac-abed-6fa92901ac0d service nova] Creating event network-changed:dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e for instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 on n-h1-861333-10 Oct 19 07:12:07.686183 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c38bda8f-b0d5-433e-91dd-d6a5a8ef1bd7 req-40d0d99f-d6fd-4aac-abed-6fa92901ac0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038272 Oct 19 07:12:07.688150 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2272/4671] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:07.696332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:07.697567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:07.704886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:07.705648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:07.706304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:07.707935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:07.708831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:07.709731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:08.660674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:08.683783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:08.687446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:08.693010 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d9347b6-d49e-48c7-8be8-24688ed5dfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 1.003266 Oct 19 07:12:08.694336 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2273/4672] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:07 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:08.715825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-54249bae-e0ce-49cf-9fc4-26be519f707c req-6d2474f6-c9af-4cbd-96af-855121d90291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f480ff5b-a738-43f3-ada8-d89e646b90f0", "tag": "434a3b58-b017-45fb-b044-a667dff4db45"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:08.749768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-54249bae-e0ce-49cf-9fc4-26be519f707c req-6d2474f6-c9af-4cbd-96af-855121d90291 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:08.750448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-54249bae-e0ce-49cf-9fc4-26be519f707c req-6d2474f6-c9af-4cbd-96af-855121d90291 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:08.753234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-54249bae-e0ce-49cf-9fc4-26be519f707c req-6d2474f6-c9af-4cbd-96af-855121d90291 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:08.784582 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-54249bae-e0ce-49cf-9fc4-26be519f707c req-6d2474f6-c9af-4cbd-96af-855121d90291 service nova] Creating event network-changed:434a3b58-b017-45fb-b044-a667dff4db45 for instance f480ff5b-a738-43f3-ada8-d89e646b90f0 on n-h1-861333-10 Oct 19 07:12:08.794780 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-54249bae-e0ce-49cf-9fc4-26be519f707c req-6d2474f6-c9af-4cbd-96af-855121d90291 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099946 Oct 19 07:12:08.795624 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2274/4673] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:08.818062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:08.824608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:08.846342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:08.847034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:08.848595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:08.849483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:08.850267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:08.851037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:09.418611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:09.443646 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c488d25d-1ab5-4f56-aa78-13d687e4bed1 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1316 microversion: 2.1 time: 0.646494 Oct 19 07:12:09.444805 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2275/4674] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:08 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1316 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:09.451359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:09.452538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:09.460803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:09.461676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:09.463036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:09.463959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:09.464736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:09.465336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:09.517782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a99d907-10ad-468c-a538-856f93fbad13 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1323 microversion: 2.1 time: 0.554378 Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2276/4675] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:09 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:10.135421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:10.360829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:10.370631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:10.372174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:10.373334 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-452be670-6532-460b-a311-9c189822eda8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 0.368672 Oct 19 07:12:10.373908 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2277/4676] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:10 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:10.378492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-827265eb-9d3d-40be-a474-92f359d0018c req-f74319a5-4ec7-47d9-8467-68e2d97d64fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a4daae-6c1a-4174-a294-85466495b6c1", "tag": "c784c077-e373-459c-a2b3-896b21d78fbc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:10.402912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-827265eb-9d3d-40be-a474-92f359d0018c req-f74319a5-4ec7-47d9-8467-68e2d97d64fa service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:10.403412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-827265eb-9d3d-40be-a474-92f359d0018c req-f74319a5-4ec7-47d9-8467-68e2d97d64fa service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:10.404033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-827265eb-9d3d-40be-a474-92f359d0018c req-f74319a5-4ec7-47d9-8467-68e2d97d64fa service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:10.416396 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-827265eb-9d3d-40be-a474-92f359d0018c req-f74319a5-4ec7-47d9-8467-68e2d97d64fa service nova] Creating event network-changed:c784c077-e373-459c-a2b3-896b21d78fbc for instance 59a4daae-6c1a-4174-a294-85466495b6c1 on n-h2-861333-10 Oct 19 07:12:10.421661 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-827265eb-9d3d-40be-a474-92f359d0018c req-f74319a5-4ec7-47d9-8467-68e2d97d64fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046420 Oct 19 07:12:10.422275 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2278/4677] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:10.474945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:10.475793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:10.486848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:10.487717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:10.489107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:10.490127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:10.490600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:10.491662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:10.854460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:12:10.854987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:12:10.855640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:12:10.856377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:12:10.857017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:12:10.876240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:10.876976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:10.879589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:10.880849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:10.881839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:10.882830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:10.907094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Getting quotas for project db88675ef16546948d70f08f51519d08. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:12:10.914616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Getting quotas for user 39ea74ffe6624b2e807e5974c6bb0c8e and project db88675ef16546948d70f08f51519d08. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:12:10.996152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:11.013986 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f751459-5777-4451-b8b3-80b930fa6610 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1316 microversion: 2.1 time: 0.546372 Oct 19 07:12:11.015429 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2279/4678] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:10 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:11.138423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:11.139872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:11.155311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:12:11.160497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7490d08e-e8c9-4ccd-adb1-5e36f7861f64',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c88e24e9-a72f-4ff8-9dc6-1f93377603b9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87a62a14-90bd-4bd8-bd4c-408a3be36935',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:12:11.165475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:11.166909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:11.167891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:11.176536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:11.183563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:11.183563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:11.561130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:11.570645 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95185b87-012f-4e88-84df-063733fc7427 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1323 microversion: 2.1 time: 0.437647 Oct 19 07:12:11.571412 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2280/4679] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:11 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:11.576560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:11.580833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:11.584554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:11.585302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:11.585988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:11.586934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:11.587695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:11.588381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:11.919787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:11.922800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:11.940319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:11.942405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:11.943777 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59013b79-a419-46d6-9b9f-1d186107eab7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 0.370969 Oct 19 07:12:11.959431 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2281/4680] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:11 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:12.040986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:12.043185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:12.060242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:12.061327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:12.061957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:12.062909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:12.063549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:12.065509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:12.297264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:12.306647 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0382c91f-3147-49db-92eb-be9772869152 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1316 microversion: 2.1 time: 0.271583 Oct 19 07:12:12.307227 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2282/4681] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:12 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:12.312143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-388851957", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "5ae37a34-a799-4ed1-8993-dc45030b5708"}], "key_name": "tempest-TestNetworkBasicOps-1880163577", "security_groups": [{"name": "tempest-secgroup-smoke-368280034"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:12.373963 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d686e1d-007f-4b43-af5e-7c210f0b5231 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.256059 Oct 19 07:12:12.379665 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2400/4682] 10.222.0.39 () {62 vars in 1189 bytes} [Wed Oct 19 07:12:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 7262 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 07:12:12.394518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c9bbd45-e00d-464e-b1e3-414d0febdbf5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:12.401821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c9bbd45-e00d-464e-b1e3-414d0febdbf5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:12.510082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c9bbd45-e00d-464e-b1e3-414d0febdbf5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:12.518972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c9bbd45-e00d-464e-b1e3-414d0febdbf5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:12.521039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c9bbd45-e00d-464e-b1e3-414d0febdbf5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:12.522212 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c9bbd45-e00d-464e-b1e3-414d0febdbf5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1285 microversion: 2.32 time: 0.132161 Oct 19 07:12:12.522785 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2401/4683] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:12 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:12.536254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] validate_networks() for [('5ae37a34-a799-4ed1-8993-dc45030b5708', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:12:12.595363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:12.596051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:12.610901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:12.610901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:12.610901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:12.610901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:12.610901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:12.610901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:12.975765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:12.989107 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02fc9dd6-41dd-41d8-9794-4dd239d86b45 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1323 microversion: 2.1 time: 0.397719 Oct 19 07:12:12.989107 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2402/4684] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:12 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:13.011741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:13.013587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:13.026201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:13.027258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:13.027921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:13.028916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:13.029615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:13.030789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:13.311440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:12:13.312023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:12:13.312501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:12:13.317868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:12:13.317868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:12:13.336336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:13.338287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:13.338848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:13.339857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:13.341083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:13.341638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:13.366786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:12:13.375389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for user 57cb186cade14d558122b6bf720c2922 and project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:12:13.391754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:13.407341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:12:13.411823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:12:13.413051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:13.414573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:13.415722 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1790f18b-b464-4fb2-8710-bc0a06db4790 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 0.414181 Oct 19 07:12:13.416798 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2403/4685] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:12 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:13.421660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:13.423012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:13.446377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:13.446883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:13.447395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:13.448222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:13.448913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:13.449423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:13.596165 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b75c91ec-c750-495a-b2b6-8544095976ab tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.287186 Oct 19 07:12:13.598029 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2283/4686] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:12:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:12:13.603259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3b40ff0f-a850-4b98-af4d-df1062d7223c req-0837525f-bde5-464e-ace9-8557eed356ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9862cb-830e-46cd-bf84-a3c3d6c2cf89", "name": "network-vif-plugged", "status": "completed", "tag": "dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:13.623755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:13.635711 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1e2d93a-0c1f-4bac-86d3-00c31f1215a4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1316 microversion: 2.1 time: 0.215833 Oct 19 07:12:13.635942 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2404/4687] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:13 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:13.645240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51585b0d-7069-43b8-9414-3aaa7284f4de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:13.645859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51585b0d-7069-43b8-9414-3aaa7284f4de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:13.665499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b40ff0f-a850-4b98-af4d-df1062d7223c req-0837525f-bde5-464e-ace9-8557eed356ea service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:13.670126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b40ff0f-a850-4b98-af4d-df1062d7223c req-0837525f-bde5-464e-ace9-8557eed356ea service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:13.670126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b40ff0f-a850-4b98-af4d-df1062d7223c req-0837525f-bde5-464e-ace9-8557eed356ea service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:13.693819 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3b40ff0f-a850-4b98-af4d-df1062d7223c req-0837525f-bde5-464e-ace9-8557eed356ea service nova] Creating event network-vif-plugged:dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e for instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 on n-h1-861333-10 Oct 19 07:12:13.699186 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3b40ff0f-a850-4b98-af4d-df1062d7223c req-0837525f-bde5-464e-ace9-8557eed356ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099551 Oct 19 07:12:13.700839 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2284/4688] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:13.706358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c385e3af-2fb3-440b-9021-aee55623afd6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:13.707662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c385e3af-2fb3-440b-9021-aee55623afd6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:13.787808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c385e3af-2fb3-440b-9021-aee55623afd6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:13.798054 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c385e3af-2fb3-440b-9021-aee55623afd6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1248 microversion: 2.1 time: 0.096009 Oct 19 07:12:13.802584 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2285/4689] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:13 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1248 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:13.860478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51585b0d-7069-43b8-9414-3aaa7284f4de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:13.868797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=31 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:13.871567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51585b0d-7069-43b8-9414-3aaa7284f4de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:13.874799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51585b0d-7069-43b8-9414-3aaa7284f4de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:13.876996 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51585b0d-7069-43b8-9414-3aaa7284f4de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1285 microversion: 2.32 time: 0.236037 Oct 19 07:12:13.877981 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2405/4690] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:13 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:14.013941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:14.015281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:14.025407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:14.025988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:14.026589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:14.027324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:14.027997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:14.028513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:14.204262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:14.222395 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e52e0782-e0df-4358-a5dc-90bb23d0e47b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1323 microversion: 2.1 time: 0.213066 Oct 19 07:12:14.226904 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2286/4691] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:14 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:14.443461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:14.444066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:14.454077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:14.454674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:14.462198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:14.462198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:14.462198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:14.462198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:14.635681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:14.645022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:14.646747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:14.647716 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9fbef623-16f3-4be2-8ca5-0af8fcf93e6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 0.209147 Oct 19 07:12:14.664447 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2406/4692] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:14 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:14.676207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:14.676207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:14.681359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:14.681876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:14.682359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:14.683157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:14.683628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:14.684067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:14.829115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:14.831237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-345b3415-01b4-4546-9777-d50a6438ce06 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:14.833655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-345b3415-01b4-4546-9777-d50a6438ce06 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:14.847295 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ef79395-e24d-44eb-881c-662c4c6933f4 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1316 microversion: 2.1 time: 0.176858 Oct 19 07:12:14.850329 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2287/4693] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:14 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:14.904726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:14.905328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:14.912403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:14.912855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:14.918991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:14.919648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:14.920388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:14.921002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:14.921822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-345b3415-01b4-4546-9777-d50a6438ce06 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:14.930756 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-345b3415-01b4-4546-9777-d50a6438ce06 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1248 microversion: 2.1 time: 0.109466 Oct 19 07:12:14.961068 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2407/4694] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:14 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1248 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:12:14.999897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:15.014020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:15.014581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:15.015369 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db1fbaa6-2be1-4ff5-9e66-2bf88162e577 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1527 microversion: 2.32 time: 0.114615 Oct 19 07:12:15.016130 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2288/4695] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:14 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1527 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:15.247900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:15.248755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:15.257604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:15.258327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:15.258992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:15.259872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:15.260681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:15.265830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:15.507285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:15.518867 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a6da57f-e974-41cf-a792-1fca85f753d8 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1323 microversion: 2.1 time: 0.274632 Oct 19 07:12:15.520800 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2408/4696] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:15 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:15.696337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:15.699234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:15.726203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:15.726924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:15.728445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:15.744322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:15.744802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:15.746521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:15.771108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0390782b-0cc9-43c8-bdfb-998d1bb43246 req-5f9737f5-fc40-4ca3-b332-c8750852f154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f480ff5b-a738-43f3-ada8-d89e646b90f0", "name": "network-vif-plugged", "status": "completed", "tag": "434a3b58-b017-45fb-b044-a667dff4db45"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:15.805523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0390782b-0cc9-43c8-bdfb-998d1bb43246 req-5f9737f5-fc40-4ca3-b332-c8750852f154 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:15.808448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0390782b-0cc9-43c8-bdfb-998d1bb43246 req-5f9737f5-fc40-4ca3-b332-c8750852f154 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:15.810480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0390782b-0cc9-43c8-bdfb-998d1bb43246 req-5f9737f5-fc40-4ca3-b332-c8750852f154 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:15.843411 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0390782b-0cc9-43c8-bdfb-998d1bb43246 req-5f9737f5-fc40-4ca3-b332-c8750852f154 service nova] Creating event network-vif-plugged:434a3b58-b017-45fb-b044-a667dff4db45 for instance f480ff5b-a738-43f3-ada8-d89e646b90f0 on n-h1-861333-10 Oct 19 07:12:15.856643 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0390782b-0cc9-43c8-bdfb-998d1bb43246 req-5f9737f5-fc40-4ca3-b332-c8750852f154 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090805 Oct 19 07:12:15.859967 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2409/4697] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:12:15.871379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:15.879321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:15.888789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:15.889541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:15.890188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:15.892385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:15.893043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:15.894269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:16.005955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:16.015730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:16.017410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:16.018729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5690377a-b98a-435d-91c8-fabde0d257c3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 0.345148 Oct 19 07:12:16.020673 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2289/4698] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:15 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:16.026527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:16.027357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:16.034699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:16.035480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:16.036295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:16.037263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:16.038040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:16.045122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:16.143240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:16.157430 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad809b90-d589-424f-9ef7-aa6e317f8ec3 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1244 microversion: 2.1 time: 0.135073 Oct 19 07:12:16.158380 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2290/4699] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:16 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1244 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:16.163737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:16.164386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:16.171385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:16.172360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:16.173133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:16.174100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:16.174736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:16.175895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:16.322613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:16.337284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:16.348343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:16.356302 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0916d2d6-0cbf-4d13-8e7c-b06acba48be6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1575 microversion: 2.32 time: 0.190348 Oct 19 07:12:16.356302 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2291/4700] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:16 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:16.543903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:16.544765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:16.566194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:16.568551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:16.570216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:16.571125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:16.573948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:16.579933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:16.849102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:16.860016 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-903a0f43-bdd4-4326-9a01-d5c9d148ac8c tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1316 microversion: 2.1 time: 0.993292 Oct 19 07:12:16.860869 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2410/4701] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:15 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1316 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:17.059268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:17.059903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:17.073802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.075576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:17.078235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.079070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:17.082801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.083563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.084291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:17.088735 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a69e361-2994-4922-bb34-c339de2007be tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1518 microversion: 2.1 time: 0.548939 Oct 19 07:12:17.091878 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2292/4702] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:16 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1518 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:12:17.117895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:17.123990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:17.148923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.151411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.152626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:17.154667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.156724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.158323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:17.204347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lazy-loading 'flavor' on Instance uuid 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:12:17.437597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:17.461867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:17.464356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:17.469372 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8161006e-dd60-4dad-bbb8-7dca847acfd1 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 0.423163 Oct 19 07:12:17.470037 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2411/4703] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:17 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:17.485830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:17.492626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:17.511716 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4ce5c55-091d-4b16-8e38-4a8c68018430 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action" status: 200 len: 32 microversion: 2.1 time: 0.398471 Oct 19 07:12:17.517358 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2293/4704] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:12:17 2022] POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action => generated 32 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:12:17.521698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.522256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.522888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:17.524268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.525221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.525942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:17.561213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:17.561929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:17.600353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.607594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.608685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:17.611581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.616797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.617577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:17.775833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:17.796596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8658aaf2-ab7a-44f3-b09b-dfbe9310e889 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1308 microversion: 2.1 time: 0.325366 Oct 19 07:12:17.805008 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2412/4705] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:17 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:17.820562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:17.820562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:17.836216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.839714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.840443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:17.843669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:17.846688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:17.848764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:18.058272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:18.071358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:18.080745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:18.084513 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8e0defc-9412-4bb6-acc6-fec92b68c48d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1593 microversion: 2.32 time: 0.565447 Oct 19 07:12:18.086413 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2294/4706] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:17 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1593 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:18.093017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:18.093958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:18.108512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:18.112286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:18.112286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:18.112286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:18.112286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:18.112286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:18.342135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:18.354114 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6c8d9b7-7c8e-4628-a827-f542da10231b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.547932 Oct 19 07:12:18.354715 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2413/4707] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:17 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:18.499593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:18.505307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:18.524298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:18.524804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:18.533057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:18.533981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:18.535102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:18.536166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:19.161811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:19.193726 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6c12a88-c306-4a57-8b7b-4b6313502a6e tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1316 microversion: 2.1 time: 1.100475 Oct 19 07:12:19.195245 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2295/4708] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:18 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1316 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:19.221847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9825b8ec-6d0b-46ca-b892-fed1e038feca req-f4718a2e-110f-46bd-9ef1-db05009cd624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a4daae-6c1a-4174-a294-85466495b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "c784c077-e373-459c-a2b3-896b21d78fbc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:19.266502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9825b8ec-6d0b-46ca-b892-fed1e038feca req-f4718a2e-110f-46bd-9ef1-db05009cd624 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:19.267210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9825b8ec-6d0b-46ca-b892-fed1e038feca req-f4718a2e-110f-46bd-9ef1-db05009cd624 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:19.268872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9825b8ec-6d0b-46ca-b892-fed1e038feca req-f4718a2e-110f-46bd-9ef1-db05009cd624 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:19.279528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:19.294080 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9825b8ec-6d0b-46ca-b892-fed1e038feca req-f4718a2e-110f-46bd-9ef1-db05009cd624 service nova] Creating event network-vif-plugged:c784c077-e373-459c-a2b3-896b21d78fbc for instance 59a4daae-6c1a-4174-a294-85466495b6c1 on n-h2-861333-10 Oct 19 07:12:19.295656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:19.298499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:19.301520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9825b8ec-6d0b-46ca-b892-fed1e038feca req-f4718a2e-110f-46bd-9ef1-db05009cd624 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100013 Oct 19 07:12:19.304170 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2296/4709] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:19.305196 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9966f7fa-8229-4944-a966-0d5688ce2bbb tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 0.808546 Oct 19 07:12:19.308718 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2414/4710] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:18 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:19.316370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:19.316370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:19.319575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:19.320349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:19.321013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:19.321965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:19.322691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:19.323355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:19.348525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:19.359196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:19.377986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:19.386033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:19.386033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:19.386033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:19.386033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:19.386033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:19.462066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:19.478297 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-060d2e1c-b0d0-40b4-a5ab-e5d86c1066b8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1306 microversion: 2.1 time: 0.168468 Oct 19 07:12:19.478297 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2297/4711] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:19 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1306 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:19.491098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:19.493936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:19.515037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:19.515779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:19.517373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:19.519399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:19.520777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:19.521718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:19.638505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:19.660419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:19.660419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:19.664898 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49739906-4426-4d9b-beef-1078d15a1f12 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1593 microversion: 2.32 time: 0.355020 Oct 19 07:12:19.676931 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2415/4712] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:19 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1593 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:19.801335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:19.812901 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d121bef5-ba9f-438b-9df9-a5e044073e23 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.333733 Oct 19 07:12:19.813677 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2298/4713] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:19 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:20.223122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:20.223792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:20.231525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:20.232023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:20.241771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:20.243925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:20.249330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:20.250357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:20.339201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:20.343253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:20.353502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:20.358272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:20.358739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:20.360805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:20.361292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:20.361744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:20.421457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:20.632698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:20.656477 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89873cc1-211a-46e4-b7d2-66203722cb89 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1506 microversion: 2.1 time: 0.425530 Oct 19 07:12:20.656477 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2416/4714] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:20 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:20.672967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:20.676844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:20.687784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:20.688807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:20.690148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:20.691621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:20.692286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:20.692884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:20.896141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:20.930287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:20.946894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:20.953874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:20.955503 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ddc6d927-0d13-44eb-9105-d8145925f109 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1407 microversion: 2.20 time: 0.620409 Oct 19 07:12:20.957147 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2299/4715] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:20 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1407 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:20.992285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-747910d4-c7c4-4ec7-848b-b3a3c5bdc8ef tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:20.993029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-747910d4-c7c4-4ec7-848b-b3a3c5bdc8ef tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:21.011961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-747910d4-c7c4-4ec7-848b-b3a3c5bdc8ef tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.013253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-747910d4-c7c4-4ec7-848b-b3a3c5bdc8ef tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.015181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-747910d4-c7c4-4ec7-848b-b3a3c5bdc8ef tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.017104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-747910d4-c7c4-4ec7-848b-b3a3c5bdc8ef tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.017842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-747910d4-c7c4-4ec7-848b-b3a3c5bdc8ef tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.018288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-747910d4-c7c4-4ec7-848b-b3a3c5bdc8ef tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.177403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:21.178157 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-747910d4-c7c4-4ec7-848b-b3a3c5bdc8ef tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0/ips" status: 200 len: 110 microversion: 2.1 time: 0.214855 Oct 19 07:12:21.179644 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2300/4716] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:12:20 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0/ips => generated 110 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:21.196267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:21.197130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:21.199056 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9bdb7b05-41c2-43c0-abd8-7e1d31f10e37 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.532087 Oct 19 07:12:21.212518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.215812 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2417/4717] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:20 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:21.216368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.216942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.217808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.220467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.220966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.249063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:21.250725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:21.280648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.282571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.284568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.287491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.288206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.289072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.306434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:21.604641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:21.613100 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1141736c-74f9-435a-9fb8-0e124c0cbc25 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.395671 Oct 19 07:12:21.647132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:21.662265 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2418/4718] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:21 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:21.675970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2540fe79-b2b9-4548-bec3-22f60a75e2e6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:21.676500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2540fe79-b2b9-4548-bec3-22f60a75e2e6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:21.677842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:21.684033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:21.685658 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-173f5fed-c4b6-44a6-aebc-206fb82249dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1661 microversion: 2.32 time: 0.500088 Oct 19 07:12:21.687844 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2301/4719] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:21 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1661 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:21.695284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2540fe79-b2b9-4548-bec3-22f60a75e2e6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.695787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2540fe79-b2b9-4548-bec3-22f60a75e2e6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.696263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2540fe79-b2b9-4548-bec3-22f60a75e2e6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.697021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2540fe79-b2b9-4548-bec3-22f60a75e2e6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.697660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2540fe79-b2b9-4548-bec3-22f60a75e2e6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.698260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2540fe79-b2b9-4548-bec3-22f60a75e2e6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.758051 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2540fe79-b2b9-4548-bec3-22f60a75e2e6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0/ips" status: 200 len: 110 microversion: 2.1 time: 0.094069 Oct 19 07:12:21.773860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ec62502-8bbc-4134-b2ed-6e024a51b326 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:21.774620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ec62502-8bbc-4134-b2ed-6e024a51b326 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:21.779014 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2419/4720] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:12:21 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0/ips => generated 110 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:21.794880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec62502-8bbc-4134-b2ed-6e024a51b326 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.795680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec62502-8bbc-4134-b2ed-6e024a51b326 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.796323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec62502-8bbc-4134-b2ed-6e024a51b326 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.797262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec62502-8bbc-4134-b2ed-6e024a51b326 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.797888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec62502-8bbc-4134-b2ed-6e024a51b326 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.798513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec62502-8bbc-4134-b2ed-6e024a51b326 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.828899 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ec62502-8bbc-4134-b2ed-6e024a51b326 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0/ips/tempest-ServerAddressesTestJSON-1790694305-network" status: 200 len: 95 microversion: 2.1 time: 0.058276 Oct 19 07:12:21.843065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:21.843799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:21.849486 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2302/4721] 10.222.0.39 () {58 vars in 1401 bytes} [Wed Oct 19 07:12:21 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0/ips/tempest-ServerAddressesTestJSON-1790694305-network => generated 95 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 07:12:21.851777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.852321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.852761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.853463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.854099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:21.854709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:21.931161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:12:21.986151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:21.987033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:21.994061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:21.995070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.007635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.007635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.007635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.007635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.293844 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b14bccbc-46db-454e-bb16-3c5edaf52e2d tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 204 len: 0 microversion: 2.1 time: 0.455226 Oct 19 07:12:22.296991 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2420/4722] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:12:21 2022] DELETE /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:12:22.299638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:22.304544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:22.305242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:22.308840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:22.312820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.313586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.314307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.315428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.316372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.317448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.322221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:22.323467 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-282b08c0-ba7b-4bac-81ce-9a11bd04328a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1598 microversion: 2.20 time: 0.341755 Oct 19 07:12:22.336692 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2303/4723] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:21 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1598 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:22.349585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:22.352810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:22.356312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:22.358273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.358962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.359567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.360485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.361102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.361688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.562084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:22.572424 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3ff3e5d-6d3b-4ec6-a6f7-4331b647b3fb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.273640 Oct 19 07:12:22.584475 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2421/4724] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:22 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:22.589903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3300ecc6-f8a0-4e9b-b858-e58e8e79c851 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:22.590945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3300ecc6-f8a0-4e9b-b858-e58e8e79c851 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:22.598768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3300ecc6-f8a0-4e9b-b858-e58e8e79c851 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.599907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3300ecc6-f8a0-4e9b-b858-e58e8e79c851 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.601935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3300ecc6-f8a0-4e9b-b858-e58e8e79c851 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.603023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3300ecc6-f8a0-4e9b-b858-e58e8e79c851 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.603878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3300ecc6-f8a0-4e9b-b858-e58e8e79c851 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.604730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3300ecc6-f8a0-4e9b-b858-e58e8e79c851 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.771595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:22.783378 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b41dd8c-81ae-4105-a109-c3e2de7383b5 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1512 microversion: 2.1 time: 0.445519 Oct 19 07:12:22.799659 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2304/4725] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:22 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:22.810581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:22.811707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:22.819017 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3300ecc6-f8a0-4e9b-b858-e58e8e79c851 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.237215 Oct 19 07:12:22.819513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.819656 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2422/4726] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Oct 19 07:12:22 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:12:22.819788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.826845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.828881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.829612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.834178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:22.836979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:22.845532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.853056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.855756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.856261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:22.857263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:22.857747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:22.859808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:23.109626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:23.121771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:23.124948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:23.127069 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb73c0a3-116c-47bc-bb8f-ca845e77d2a2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1708 microversion: 2.32 time: 0.306288 Oct 19 07:12:23.131078 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2423/4727] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:22 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1708 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:23.355600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:23.474306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:23.484085 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9f6604c-0fa0-4909-ac64-88e8d072ea27 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.678806 Oct 19 07:12:23.489581 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2305/4728] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:22 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:23.603096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:23.604201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:23.619866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:23.620701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:23.622080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:23.624212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:23.627748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:23.629075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:23.785753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-28a6cdb3-d258-4564-8ef7-67383c1e9c1d req-28e230ce-5e8a-466f-93d2-c2b16c408a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486742e7-6b82-4482-95c6-d709cb21e4d5", "tag": "9c8933a5-5d07-48ce-b0c3-ac177f06c4b9"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:23.812889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=28 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:23.826949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-28a6cdb3-d258-4564-8ef7-67383c1e9c1d req-28e230ce-5e8a-466f-93d2-c2b16c408a6b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:23.828283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-28a6cdb3-d258-4564-8ef7-67383c1e9c1d req-28e230ce-5e8a-466f-93d2-c2b16c408a6b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:23.829928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-28a6cdb3-d258-4564-8ef7-67383c1e9c1d req-28e230ce-5e8a-466f-93d2-c2b16c408a6b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:23.868985 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-28a6cdb3-d258-4564-8ef7-67383c1e9c1d req-28e230ce-5e8a-466f-93d2-c2b16c408a6b service nova] Creating event network-changed:9c8933a5-5d07-48ce-b0c3-ac177f06c4b9 for instance 486742e7-6b82-4482-95c6-d709cb21e4d5 on n-h2-861333-10 Oct 19 07:12:23.879945 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-28a6cdb3-d258-4564-8ef7-67383c1e9c1d req-28e230ce-5e8a-466f-93d2-c2b16c408a6b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104987 Oct 19 07:12:23.882609 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2306/4729] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:23.898952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:23.902642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:23.921857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:23.922609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:23.927993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:23.929128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:23.930112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:23.931725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:24.167197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:24.198297 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8116241c-2e1a-4090-bbaa-dff918370d8f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.599675 Oct 19 07:12:24.201844 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2424/4730] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:23 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:12:24.232836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:24.235829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:24.267879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:24.268625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:24.273771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:24.277665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:24.278423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:24.280710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:24.748406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:24.765092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:24.766556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:24.767741 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5b1c6bb-c3b5-46be-9301-3ab0b66f74c4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1708 microversion: 2.32 time: 0.563716 Oct 19 07:12:24.778573 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2425/4731] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:24 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1708 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:24.797950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:24.798955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:24.807069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:24.807821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:24.808468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:24.809352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:24.809969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:24.810580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:24.930441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:25.128301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:25.146257 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b73bdec-db22-42e6-b0d8-fe536ea3bcd6 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1512 microversion: 2.1 time: 1.254310 Oct 19 07:12:25.146949 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2307/4732] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:23 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1512 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:25.230879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:25.231847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:25.244785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:25.245594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:25.246233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:25.247407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:25.248050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:25.248696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:25.556351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:25.565870 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1672dc04-64fb-46b6-a54d-f397ab4c6f50 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.785923 Oct 19 07:12:25.567131 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2426/4733] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:24 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:25.805526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:25.807570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:25.819842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:25.820559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:25.822052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:25.824270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:25.826282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:25.827198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:26.036004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:26.046359 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-900483b5-c8e6-42b9-b7c7-43733c5cfdc4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.821447 Oct 19 07:12:26.050030 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2308/4734] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:25 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:26.170452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:26.171753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:26.181895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:26.182712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:26.184707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:26.185675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:26.188817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:26.189530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:26.403849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:26.406241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:26.431264 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e009315c-cf2c-4410-b6c1-5e8db87359ff tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1470 microversion: 2.1 time: 0.264857 Oct 19 07:12:26.434387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:26.435505 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2309/4735] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:26 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:26.448250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:26.457006 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-518a33e0-081c-41b5-814a-eb1eb13ce7a5 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1708 microversion: 2.32 time: 0.649640 Oct 19 07:12:26.457883 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2427/4736] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:25 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1708 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:26.461231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5cc49e10-7817-4fa0-80cf-175a720f03f7 req-2e292ac8-a35e-4644-a418-5244979ce4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f480ff5b-a738-43f3-ada8-d89e646b90f0", "name": "network-vif-deleted", "tag": "434a3b58-b017-45fb-b044-a667dff4db45"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:26.488326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5cc49e10-7817-4fa0-80cf-175a720f03f7 req-2e292ac8-a35e-4644-a418-5244979ce4e6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:26.492709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5cc49e10-7817-4fa0-80cf-175a720f03f7 req-2e292ac8-a35e-4644-a418-5244979ce4e6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:26.492709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5cc49e10-7817-4fa0-80cf-175a720f03f7 req-2e292ac8-a35e-4644-a418-5244979ce4e6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:26.524706 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5cc49e10-7817-4fa0-80cf-175a720f03f7 req-2e292ac8-a35e-4644-a418-5244979ce4e6 service nova] Creating event network-vif-deleted:434a3b58-b017-45fb-b044-a667dff4db45 for instance f480ff5b-a738-43f3-ada8-d89e646b90f0 on n-h1-861333-10 Oct 19 07:12:26.537787 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5cc49e10-7817-4fa0-80cf-175a720f03f7 req-2e292ac8-a35e-4644-a418-5244979ce4e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098105 Oct 19 07:12:26.542125 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2310/4737] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:26.593778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:26.595896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:26.607581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:26.608530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:26.613533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:26.613533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:26.613533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:26.613533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:27.075397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:27.076650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:27.101541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:27.104013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:27.105066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:27.106970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:27.107655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:27.108350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:27.334753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:27.350223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c8984c5-3f97-4773-9ed7-e8ac94b5b06e tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.763161 Oct 19 07:12:27.351994 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2428/4738] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:26 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:27.365249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b59dc97a-f203-4271-87ee-7153e9f4cfb9 req-5f4103a3-87f0-4a9d-826a-2b16e06a30b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a4daae-6c1a-4174-a294-85466495b6c1", "tag": "c784c077-e373-459c-a2b3-896b21d78fbc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:27.389169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b59dc97a-f203-4271-87ee-7153e9f4cfb9 req-5f4103a3-87f0-4a9d-826a-2b16e06a30b6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:27.390760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b59dc97a-f203-4271-87ee-7153e9f4cfb9 req-5f4103a3-87f0-4a9d-826a-2b16e06a30b6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:27.393725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b59dc97a-f203-4271-87ee-7153e9f4cfb9 req-5f4103a3-87f0-4a9d-826a-2b16e06a30b6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:27.420273 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b59dc97a-f203-4271-87ee-7153e9f4cfb9 req-5f4103a3-87f0-4a9d-826a-2b16e06a30b6 service nova] Creating event network-changed:c784c077-e373-459c-a2b3-896b21d78fbc for instance 59a4daae-6c1a-4174-a294-85466495b6c1 on n-h2-861333-10 Oct 19 07:12:27.460151 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b59dc97a-f203-4271-87ee-7153e9f4cfb9 req-5f4103a3-87f0-4a9d-826a-2b16e06a30b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099990 Oct 19 07:12:27.465416 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2429/4739] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:27.467971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:27.477546 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43434d51-fdbb-4142-ac1d-bc72b98fc7a2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.406675 Oct 19 07:12:27.484905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:27.488919 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2311/4740] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:27 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:27.489017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:27.495885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:27.497536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:27.498255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:27.499530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:27.499941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:27.500529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:27.501197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:27.501339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:27.531268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:27.532555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:27.534893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:27.535134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:27.536936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:27.543205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:27.559546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:27.560448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:27.561397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:27.562167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lazy-loading 'fault' on Instance uuid f480ff5b-a738-43f3-ada8-d89e646b90f0 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:12:27.695220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6dbd4d6c8e4ac59b69fa20a86350ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96288b2dc48c49cd9e1ff9fb9157835f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:27.706072 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d618add-79b5-426c-b163-fbcc65223dae tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 200 len: 1306 microversion: 2.1 time: 0.234831 Oct 19 07:12:27.710752 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2430/4741] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:27 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 1306 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:28.381905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:28.382898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:28.399482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:28.402062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:28.404038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:28.405097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:28.406962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:28.407636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:28.915929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:28.927023 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-091a0611-8076-46c3-98a1-cb28962f5ebb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.552508 Oct 19 07:12:28.928951 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2431/4742] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:28 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:12:28.958625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:28.960235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:28.984244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:28.985476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:28.987081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:28.989490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:28.991395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:28.992027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:29.087470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:29.106761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:29.112033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:29.122612 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b63b042-0257-47d6-bfdc-7d8c35b773f4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1755 microversion: 2.32 time: 1.619538 Oct 19 07:12:29.126627 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2312/4743] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:27 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1755 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:29.160156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:29.163940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] [instance: f480ff5b-a738-43f3-ada8-d89e646b90f0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:29.180899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:29.183256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:29.185344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:29.187763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:29.189169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:29.190092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:29.224071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:29.234344 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f2a61c6-08d4-436d-8613-507134863268 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.287692 Oct 19 07:12:29.236544 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] HTTP exception thrown: Instance f480ff5b-a738-43f3-ada8-d89e646b90f0 could not be found. Oct 19 07:12:29.236997 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2432/4744] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:28 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Request method failure captured: Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 HTTP/1.1 Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6M4McROkV4_xyjnu2xOoF1sXkSoIoZzwooKqp6FajJG3wQGrHXC_HgAAOxsGeeNPYW_c6M8x7mvnckt6ZmHG7xDgETo3cWUD1cHkRXsBX5UjHP_xwPQ-dV_AC3xR6TgR4WucaDAOzBYHTPik9GF9mJEYl-LDo5tg7XkdDSe5YXggHs Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 96288b2dc48c49cd9e1ff9fb9157835f Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerAddressesTestJSON-81119727 Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/96288b2dc48c49cd9e1ff9fb9157835f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/96288b2dc48c49cd9e1ff9fb9157835f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/96288b2dc48c49cd9e1ff9fb9157835f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_96288b2dc48c49cd9e1ff9fb9157835f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerAddressesTestJSON-81119727 Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 96288b2dc48c49cd9e1ff9fb9157835f Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerAddressesTestJSON-81119727 Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerAddressesTestJSON-81119727-project Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 7a6dbd4d6c8e4ac59b69fa20a86350ed Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerAddressesTestJSON-81119727-project Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance f480ff5b-a738-43f3-ada8-d89e646b90f0 could not be found. Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'f480ff5b-a738-43f3-ada8-d89e646b90f0'} Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f480ff5b-a738-43f3-ada8-d89e646b90f0 could not be found. Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f480ff5b-a738-43f3-ada8-d89e646b90f0 could not be found. Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:12:29.257627 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:12:29.261853 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:12:29.261853 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:12:29.261853 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:12:29.261853 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:12:29.261853 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:12:29.261853 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f480ff5b-a738-43f3-ada8-d89e646b90f0 could not be found. Oct 19 07:12:29.261853 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:12:29.263718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] Returning 404 to user: Instance f480ff5b-a738-43f3-ada8-d89e646b90f0 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:12:29.268677 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8f85d2a-84bd-4b68-9ab6-379a31f20573 tempest-ServerAddressesTestJSON-81119727 tempest-ServerAddressesTestJSON-81119727-project] 10.222.0.39 "GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0" status: 404 len: 111 microversion: 2.1 time: 0.135726 Oct 19 07:12:29.272626 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2313/4745] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:29 2022] GET /compute/v2.1/servers/f480ff5b-a738-43f3-ada8-d89e646b90f0 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:12:29.960657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:29.961275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:29.982895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:29.983421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:29.983942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:29.984735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:29.985246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:29.985710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:30.156551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:30.158185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:30.173495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:30.174433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:30.176651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:30.177691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:30.180849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:30.181885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:30.316509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:30.324418 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6a258bc-e10c-4340-bc09-c0b1f0814997 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.371465 Oct 19 07:12:30.348706 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2433/4746] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:29 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:30.355687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:30.356664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:30.379496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:30.380020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:30.380530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:30.388496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:30.389288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:30.391721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:30.409350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:31.130336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:31.154256 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-525ee08f-bf7a-4de3-b845-8dcca27b142c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.804254 Oct 19 07:12:31.154866 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2434/4747] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:30 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:31.349702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:31.350322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:31.365039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:31.365576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:31.367247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:31.369126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:31.369938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:31.373012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:31.828930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:31.859171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:31.866885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:31.868472 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93d1fb84-fa27-4cd9-8933-79d258f35913 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1755 microversion: 2.32 time: 1.716581 Oct 19 07:12:31.893331 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2314/4748] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:30 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1755 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:32.186315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:32.187155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:32.214382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:32.215731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:32.216699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:32.227464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:32.231290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:32.232707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:32.264936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:32.277444 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-028b14cd-fb2d-4693-ac31-ccefb29fb338 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.933063 Oct 19 07:12:32.278285 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2435/4749] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:31 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:32.663706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:32.672750 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75b47bb9-1b9d-4316-9426-16a285e2672a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.497635 Oct 19 07:12:32.673373 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2315/4750] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:32 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:12:32.908129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:32.909106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:32.919633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:32.922055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:32.923146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:32.924052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:32.925049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:32.926141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:32.930519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:33.306348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:33.306889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:33.319597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:33.320257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:33.320685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:33.321412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:33.321869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:33.322299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:33.466975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:33.497081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:33.503077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:33.506787 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5bab63e-42d4-4d9c-a888-cb5e60e0b98f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1802 microversion: 2.32 time: 0.607560 Oct 19 07:12:33.509485 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2436/4751] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:32 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1802 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:33.696357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:33.697319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:33.710059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:33.710895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:33.711563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:33.725148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:33.725148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:33.725148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:33.907873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:33.915077 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8614d88-cea0-470e-bd3b-3fcdc5b02168 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.612917 Oct 19 07:12:33.915696 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2316/4752] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:33 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:34.390933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:34.407880 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-196708c9-1ff6-473b-a7f5-80caee2a59b0 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.713054 Oct 19 07:12:34.410209 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2437/4753] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:33 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:34.547514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:34.549631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:34.585346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:34.585924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:34.590406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:34.591154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:34.591806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:34.599910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:34.939688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:34.941924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:34.955058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:34.957791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:34.957791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:34.970115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:34.971356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:34.975968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:35.450572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:35.489243 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dbc5f26a-c205-45c7-8ee4-6ac9c68bca02 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.553992 Oct 19 07:12:35.492248 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2438/4754] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:34 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:35.510786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c45cf9cc-d808-4cfa-8427-3401cfad80fd req-b93a5546-6835-4896-ac8e-13781cd6a22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486742e7-6b82-4482-95c6-d709cb21e4d5", "name": "network-vif-plugged", "status": "completed", "tag": "9c8933a5-5d07-48ce-b0c3-ac177f06c4b9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:35.530849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c45cf9cc-d808-4cfa-8427-3401cfad80fd req-b93a5546-6835-4896-ac8e-13781cd6a22f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:35.536761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c45cf9cc-d808-4cfa-8427-3401cfad80fd req-b93a5546-6835-4896-ac8e-13781cd6a22f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:35.537516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c45cf9cc-d808-4cfa-8427-3401cfad80fd req-b93a5546-6835-4896-ac8e-13781cd6a22f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:35.566338 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c45cf9cc-d808-4cfa-8427-3401cfad80fd req-b93a5546-6835-4896-ac8e-13781cd6a22f service nova] Creating event network-vif-plugged:9c8933a5-5d07-48ce-b0c3-ac177f06c4b9 for instance 486742e7-6b82-4482-95c6-d709cb21e4d5 on n-h2-861333-10 Oct 19 07:12:35.578864 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c45cf9cc-d808-4cfa-8427-3401cfad80fd req-b93a5546-6835-4896-ac8e-13781cd6a22f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081074 Oct 19 07:12:35.580263 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2439/4755] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:35.588710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:35.589742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:35.598656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:35.599349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:35.600774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:35.602133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:35.602763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:35.603377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:35.740731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:35.754676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:35.766122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:35.771043 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a165a20c-e5ec-4d12-adc9-1ad574e011dc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1849 microversion: 2.32 time: 1.235933 Oct 19 07:12:35.781325 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2317/4756] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:34 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1849 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:35.969429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:35.982305 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7b371cd-fb68-4bd0-9d95-b5e3fe775a58 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.396404 Oct 19 07:12:35.983472 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2440/4757] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:35 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:36.532123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:36.532123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:36.541101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:36.542156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:36.544462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:36.545496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:36.547621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:36.548804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:36.807012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:36.808878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:36.839535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:36.842522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:36.846603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:36.850597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:36.851334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:36.852883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:37.045026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:37.056941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:37.060434 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7277094-9adb-4f99-8c53-0d4eb2fb363c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.543631 Oct 19 07:12:37.073813 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2318/4758] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:36 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:37.091551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:37.092687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:37.100861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:37.101360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:37.101812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:37.102757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:37.103355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:37.103974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:37.274221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:37.286321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:37.288060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:37.289832 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db8d139f-e4b3-4c01-adba-0f5beca42da4 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1849 microversion: 2.32 time: 0.490136 Oct 19 07:12:37.290818 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2441/4759] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:36 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1849 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:37.907198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:37.917227 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e4f45cd-1c16-4260-81ba-9e3a3e2e8355 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1373 microversion: 2.1 time: 0.833262 Oct 19 07:12:37.935049 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2319/4760] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:37 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1373 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:37.961672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-784bdac7-0a96-4818-9f07-c71d847e0b34 req-c4e75ccd-9712-4e00-b658-6ecd5bf1dc64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "tag": "8f1e6341-a749-49f3-847c-932b07769041"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:37.983745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-784bdac7-0a96-4818-9f07-c71d847e0b34 req-c4e75ccd-9712-4e00-b658-6ecd5bf1dc64 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:37.984267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-784bdac7-0a96-4818-9f07-c71d847e0b34 req-c4e75ccd-9712-4e00-b658-6ecd5bf1dc64 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:37.986505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-784bdac7-0a96-4818-9f07-c71d847e0b34 req-c4e75ccd-9712-4e00-b658-6ecd5bf1dc64 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:38.022087 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-784bdac7-0a96-4818-9f07-c71d847e0b34 req-c4e75ccd-9712-4e00-b658-6ecd5bf1dc64 service nova] Creating event network-changed:8f1e6341-a749-49f3-847c-932b07769041 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:12:38.043981 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-784bdac7-0a96-4818-9f07-c71d847e0b34 req-c4e75ccd-9712-4e00-b658-6ecd5bf1dc64 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081792 Oct 19 07:12:38.051077 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2442/4761] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:38.090671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:38.091299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:38.112420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:38.115380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:38.119189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:38.121354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:38.121867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:38.122320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:38.324712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:38.324712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:38.345216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:38.349028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:38.356338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:38.356338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:38.356338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:38.356338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:39.012715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:39.023253 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d556ad40-41e0-460b-b052-e2f50fb4b45c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.938362 Oct 19 07:12:39.024854 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2320/4762] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:38 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:39.031845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:39.032893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:39.039707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:39.040362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:39.041126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:39.042226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:39.043240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:39.043941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:39.210699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:39.237705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:39.241390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:39.251653 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca8b48fc-80fb-48f4-bf37-81a296c6be3b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1849 microversion: 2.32 time: 0.932704 Oct 19 07:12:39.260717 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2443/4763] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:38 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1849 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:40.051847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:40.053128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:40.065775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:40.066292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:40.069105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:40.070017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:40.071886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:40.076894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:40.426618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:40.443840 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-561cc813-d699-4b86-8852-b3dbfe31371c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.392595 Oct 19 07:12:40.444608 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2444/4764] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:40 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:40.461687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:40.469348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:40.472907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:40.482193 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d9a4490-20fb-4fb0-9160-cee64d5c7bbd tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1544 microversion: 2.1 time: 1.455088 Oct 19 07:12:40.484678 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2321/4765] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:39 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1544 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:40.491887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:40.492709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:40.493660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:40.494734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:40.495434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:40.496048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:40.521546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:40.526310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:40.537395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:40.546196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:40.546671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:40.547499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:40.547975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:40.548439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:40.852221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:40.863689 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc75ed2a-8ca6-4eeb-a7ef-c6269302d5ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1544 microversion: 2.1 time: 0.352523 Oct 19 07:12:40.864953 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2322/4766] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:40 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1544 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:12:41.088616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:41.100426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:41.102030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:41.103214 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b82b84f1-4beb-4768-9e31-f749b105b332 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1870 microversion: 2.32 time: 0.656932 Oct 19 07:12:41.104251 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2445/4767] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:40 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1870 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:41.475327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:41.475963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:41.495686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:41.496583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:41.498355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:41.499295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:41.500714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:41.502434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:41.536265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3eb8b010-17f9-4364-8886-4addca4b2d22 req-6091dfc1-3d42-4433-b1b8-6f5e5bddf0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "tag": "6a1b1b75-b22e-47ca-8550-ad04ec27f870"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:41.560946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3eb8b010-17f9-4364-8886-4addca4b2d22 req-6091dfc1-3d42-4433-b1b8-6f5e5bddf0b6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:41.568268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3eb8b010-17f9-4364-8886-4addca4b2d22 req-6091dfc1-3d42-4433-b1b8-6f5e5bddf0b6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:41.568268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3eb8b010-17f9-4364-8886-4addca4b2d22 req-6091dfc1-3d42-4433-b1b8-6f5e5bddf0b6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:41.611553 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3eb8b010-17f9-4364-8886-4addca4b2d22 req-6091dfc1-3d42-4433-b1b8-6f5e5bddf0b6 service nova] Creating event network-changed:6a1b1b75-b22e-47ca-8550-ad04ec27f870 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:12:41.623360 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3eb8b010-17f9-4364-8886-4addca4b2d22 req-6091dfc1-3d42-4433-b1b8-6f5e5bddf0b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090877 Oct 19 07:12:41.625760 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2446/4768] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:12:42.137359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:42.138832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:42.149020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:42.149927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:42.150591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:42.151576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:42.152254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:42.152694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:42.165140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:42.177280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c4e6032-27cc-44d3-a649-625c8716e853 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.709341 Oct 19 07:12:42.178786 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2323/4769] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:41 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:42.473406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:42.494137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:42.497127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:42.505081 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-972f3768-76ed-46c1-aff2-414a2e0f1fad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1870 microversion: 2.32 time: 0.372585 Oct 19 07:12:42.536118 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2447/4770] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:42 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1870 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:43.205286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:43.205987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:43.225378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:43.237706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:43.238949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:43.248212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:43.248929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:43.249567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:43.547744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:43.549396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:43.579126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:43.584943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:43.592507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:43.593752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:43.594474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:43.595195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:43.697267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:43.719294 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b2a914c7-c4e8-40b5-bf58-8253d18679e3 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.516649 Oct 19 07:12:43.743095 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2324/4771] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:43 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:44.143858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-72d488d2-9437-4fa3-8ea6-f4ad2ed22cd5 req-6ca2e11f-6571-47e6-842f-cee4be557a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "tag": "f840ba10-b994-4ab6-b88b-ec09ca983e2d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:44.161638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-72d488d2-9437-4fa3-8ea6-f4ad2ed22cd5 req-6ca2e11f-6571-47e6-842f-cee4be557a83 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:44.168833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-72d488d2-9437-4fa3-8ea6-f4ad2ed22cd5 req-6ca2e11f-6571-47e6-842f-cee4be557a83 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:44.168833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-72d488d2-9437-4fa3-8ea6-f4ad2ed22cd5 req-6ca2e11f-6571-47e6-842f-cee4be557a83 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:44.188573 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-72d488d2-9437-4fa3-8ea6-f4ad2ed22cd5 req-6ca2e11f-6571-47e6-842f-cee4be557a83 service nova] Creating event network-changed:f840ba10-b994-4ab6-b88b-ec09ca983e2d for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:12:44.200647 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-72d488d2-9437-4fa3-8ea6-f4ad2ed22cd5 req-6ca2e11f-6571-47e6-842f-cee4be557a83 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064027 Oct 19 07:12:44.206610 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2325/4772] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:12:44.211033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:44.224142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:44.228862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:44.235255 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e90aa92e-3f94-4097-9a53-0d7a0e45b6b8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1891 microversion: 2.32 time: 0.692547 Oct 19 07:12:44.238698 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2448/4773] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:43 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1891 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:44.771964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:44.779353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:44.828013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:44.830019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:44.830485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:44.840645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:44.840645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:44.840645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:45.268444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:45.272768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:45.281754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:45.282278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:45.282730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:45.283473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:45.283896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:45.284364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:45.885758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:45.918181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:45.923071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:45.929965 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03f8afbe-9991-4517-84b2-01212b60f600 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1891 microversion: 2.32 time: 0.665716 Oct 19 07:12:45.941029 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2449/4774] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:45 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1891 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:46.317911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:46.327209 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1b36781-a298-489e-99f9-57deb0ca6ffa tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 1.580864 Oct 19 07:12:46.327971 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2326/4775] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:44 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:46.963218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:46.968073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:46.978425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:46.979245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:46.980217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:46.982208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:46.982851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:46.986146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:47.329665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c43fd141-8606-48d0-b965-ef5663223ee1 req-ab002243-29b8-4d61-bb73-611071b02e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "tag": "44ef26f9-7bb0-4762-a463-7946d2663176"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:47.355485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c43fd141-8606-48d0-b965-ef5663223ee1 req-ab002243-29b8-4d61-bb73-611071b02e10 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:47.356209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c43fd141-8606-48d0-b965-ef5663223ee1 req-ab002243-29b8-4d61-bb73-611071b02e10 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:47.358526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c43fd141-8606-48d0-b965-ef5663223ee1 req-ab002243-29b8-4d61-bb73-611071b02e10 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:47.381646 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c43fd141-8606-48d0-b965-ef5663223ee1 req-ab002243-29b8-4d61-bb73-611071b02e10 service nova] Creating event network-changed:44ef26f9-7bb0-4762-a463-7946d2663176 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:12:47.393647 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c43fd141-8606-48d0-b965-ef5663223ee1 req-ab002243-29b8-4d61-bb73-611071b02e10 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068702 Oct 19 07:12:47.397050 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2327/4776] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:12:47.410537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:47.411668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:47.433102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:47.434350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:47.440332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:47.440332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:47.440332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:47.440332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:47.497527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:47.512812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:47.515025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:47.518825 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2ed1574-d21d-4e2c-9d8f-3b4c5fa9a10a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.562730 Oct 19 07:12:47.525463 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2450/4777] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:46 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:48.042966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:48.055777 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68150766-529e-4f79-92bb-1d8132a84e97 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1524 microversion: 2.1 time: 0.653994 Oct 19 07:12:48.059535 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2328/4778] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:47 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1524 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:12:48.560382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:48.560382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:48.584457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:48.585330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:48.586088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:48.590229 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:48.592269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:48.598375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:49.083427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:49.084148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:49.099695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:49.107808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:49.108385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:49.111734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:49.116145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:49.116706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:49.341152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:49.376583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:49.384370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:49.386482 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27102857-1007-4dcb-8832-3c942e6de035 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.831443 Oct 19 07:12:49.391070 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2451/4779] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:48 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:49.449220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6a8e48e2-54a1-4e26-a5b3-5de472922e0a req-e7ecacde-9a40-4711-9842-d7a8973b68a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486742e7-6b82-4482-95c6-d709cb21e4d5", "tag": "9c8933a5-5d07-48ce-b0c3-ac177f06c4b9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:49.480851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6a8e48e2-54a1-4e26-a5b3-5de472922e0a req-e7ecacde-9a40-4711-9842-d7a8973b68a0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:49.481748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6a8e48e2-54a1-4e26-a5b3-5de472922e0a req-e7ecacde-9a40-4711-9842-d7a8973b68a0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:49.482636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6a8e48e2-54a1-4e26-a5b3-5de472922e0a req-e7ecacde-9a40-4711-9842-d7a8973b68a0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:49.516605 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6a8e48e2-54a1-4e26-a5b3-5de472922e0a req-e7ecacde-9a40-4711-9842-d7a8973b68a0 service nova] Creating event network-changed:9c8933a5-5d07-48ce-b0c3-ac177f06c4b9 for instance 486742e7-6b82-4482-95c6-d709cb21e4d5 on n-h2-861333-10 Oct 19 07:12:49.534544 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6a8e48e2-54a1-4e26-a5b3-5de472922e0a req-e7ecacde-9a40-4711-9842-d7a8973b68a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089578 Oct 19 07:12:49.536741 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2452/4780] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:49.838069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:49.847686 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-587aa585-6871-4808-a90d-95ebd2b13991 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1504 microversion: 2.1 time: 0.768677 Oct 19 07:12:49.856683 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2329/4781] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:12:49 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1504 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:12:49.889496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b703dda-e8bb-41f9-99a5-b441bd0babe4 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Action: 'create', calling method: .version_select at 0x7f6d5fbfdd30>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1872140446", "description": "tempest-description-1878103456"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:50.425232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:50.426729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:50.442724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:50.444679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:50.444679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:50.445601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:50.447017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:50.451342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:50.613896 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b703dda-e8bb-41f9-99a5-b441bd0babe4 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.732266 Oct 19 07:12:50.620746 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2453/4782] 10.222.0.39 () {60 vars in 1180 bytes} [Wed Oct 19 07:12:49 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:50.628162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1872140446"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:50.628930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:50.638024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:50.638568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:50.639019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:50.641796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:50.642328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:50.642774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:50.662950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:50.859431 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.network.security_group_api [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Adding security group b3fa5599-c5d3-432c-8408-ca0337fa5960 to port dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e Oct 19 07:12:51.541004 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f61c9aba-0f7d-4e24-9f4b-044d8f220cd5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action" status: 202 len: 0 microversion: 2.1 time: 0.911196 Oct 19 07:12:51.542785 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2454/4783] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:12:50 2022] POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action => generated 0 bytes in 920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:12:51.557067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-448213f0-6c49-4e59-955c-5f77302e7ece req-29cda547-eae9-4210-9325-0acc11944621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9862cb-830e-46cd-bf84-a3c3d6c2cf89", "tag": "dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:51.589658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-448213f0-6c49-4e59-955c-5f77302e7ece req-29cda547-eae9-4210-9325-0acc11944621 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:51.592450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-448213f0-6c49-4e59-955c-5f77302e7ece req-29cda547-eae9-4210-9325-0acc11944621 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:51.593090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-448213f0-6c49-4e59-955c-5f77302e7ece req-29cda547-eae9-4210-9325-0acc11944621 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:51.612165 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-448213f0-6c49-4e59-955c-5f77302e7ece req-29cda547-eae9-4210-9325-0acc11944621 service nova] Creating event network-changed:dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e for instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 on n-h1-861333-10 Oct 19 07:12:51.622898 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-448213f0-6c49-4e59-955c-5f77302e7ece req-29cda547-eae9-4210-9325-0acc11944621 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077331 Oct 19 07:12:51.623553 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2455/4784] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:51.630763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1872140446"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:51.632659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:51.640475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:51.642554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:51.642554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:51.648824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:51.649531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:51.650131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:51.872803 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.network.security_group_api [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Removing security group b3fa5599-c5d3-432c-8408-ca0337fa5960 from port dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e Oct 19 07:12:52.334937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:52.345490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:52.347163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:52.348514 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d233d73-73d8-409f-b5c3-ed6f3e6727d3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 1.929357 Oct 19 07:12:52.352815 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2330/4785] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:50 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:52.355202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5e2165c0-d828-4fff-898b-ec5e5aee676a req-dbde8418-6243-4d77-a28a-013163b11d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "tag": "da6715c6-0860-4ad4-9f15-4e0ca617cde0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:52.365840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5e2165c0-d828-4fff-898b-ec5e5aee676a req-dbde8418-6243-4d77-a28a-013163b11d12 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:52.366821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5e2165c0-d828-4fff-898b-ec5e5aee676a req-dbde8418-6243-4d77-a28a-013163b11d12 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:52.367488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5e2165c0-d828-4fff-898b-ec5e5aee676a req-dbde8418-6243-4d77-a28a-013163b11d12 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:52.383008 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5e2165c0-d828-4fff-898b-ec5e5aee676a req-dbde8418-6243-4d77-a28a-013163b11d12 service nova] Creating event network-changed:da6715c6-0860-4ad4-9f15-4e0ca617cde0 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:12:52.396934 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5e2165c0-d828-4fff-898b-ec5e5aee676a req-dbde8418-6243-4d77-a28a-013163b11d12 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045551 Oct 19 07:12:52.397824 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2331/4786] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:53.391406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:53.392584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:53.411861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=56 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:53.422117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:53.422637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:53.423078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:53.423893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:53.424363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:53.424801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:54.083206 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c6e387c-0945-4d17-b391-253b5d46b101 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action" status: 202 len: 0 microversion: 2.1 time: 2.457480 Oct 19 07:12:54.084905 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2456/4787] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:12:51 2022] POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action => generated 0 bytes in 2461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:12:54.094585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89639505-aae2-451d-8394-68dc53f4366b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Action: 'create', calling method: .version_select at 0x7f6d64965160>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:54.119234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:54.130268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:54.143857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:54.145574 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f591c40-27f1-4569-b1c2-b84e0f810e97 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.767438 Oct 19 07:12:54.146663 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2332/4788] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:53 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:54.174447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c57e2f94-f7d4-43e1-9604-e1c4cf12aead req-59d6421b-9ccc-4efe-bae0-16ad34d69f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9862cb-830e-46cd-bf84-a3c3d6c2cf89", "tag": "dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:54.194335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c57e2f94-f7d4-43e1-9604-e1c4cf12aead req-59d6421b-9ccc-4efe-bae0-16ad34d69f8d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:54.195088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c57e2f94-f7d4-43e1-9604-e1c4cf12aead req-59d6421b-9ccc-4efe-bae0-16ad34d69f8d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:54.195705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c57e2f94-f7d4-43e1-9604-e1c4cf12aead req-59d6421b-9ccc-4efe-bae0-16ad34d69f8d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:54.230467 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c57e2f94-f7d4-43e1-9604-e1c4cf12aead req-59d6421b-9ccc-4efe-bae0-16ad34d69f8d service nova] Creating event network-changed:dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e for instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 on n-h1-861333-10 Oct 19 07:12:54.258029 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c57e2f94-f7d4-43e1-9604-e1c4cf12aead req-59d6421b-9ccc-4efe-bae0-16ad34d69f8d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087399 Oct 19 07:12:54.258667 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2333/4789] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:12:54.836537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cca5e530-3baf-46b0-9c8c-50d456a81e62 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:54.838064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cca5e530-3baf-46b0-9c8c-50d456a81e62 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:54.852884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5e530-3baf-46b0-9c8c-50d456a81e62 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:54.853600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5e530-3baf-46b0-9c8c-50d456a81e62 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:54.854244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5e530-3baf-46b0-9c8c-50d456a81e62 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:54.855153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5e530-3baf-46b0-9c8c-50d456a81e62 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:54.855888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5e530-3baf-46b0-9c8c-50d456a81e62 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:54.856518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5e530-3baf-46b0-9c8c-50d456a81e62 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:54.912541 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cca5e530-3baf-46b0-9c8c-50d456a81e62 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/ips" status: 200 len: 151 microversion: 2.20 time: 0.454633 Oct 19 07:12:54.913202 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2334/4790] 10.222.0.39 () {60 vars in 1289 bytes} [Wed Oct 19 07:12:54 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/ips => generated 151 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 07:12:55.172477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:55.173109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:55.193958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:55.194535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:55.194997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:55.195727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:55.196228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:55.196659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:56.160561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:56.170254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:56.171719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:56.172954 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9195f521-3cde-438e-b8da-30744c32f988 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 1.004648 Oct 19 07:12:56.173533 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2335/4791] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:55 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:12:56.196721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7b2bc8c6-45f5-452a-92cc-3a9d8b44c6d2 req-49e238b0-b9df-4b17-8ffb-e787239a5ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "tag": "8169c873-b7ef-442f-9bf4-1f5ee358ef12"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:56.207211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7b2bc8c6-45f5-452a-92cc-3a9d8b44c6d2 req-49e238b0-b9df-4b17-8ffb-e787239a5ebb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:56.217541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7b2bc8c6-45f5-452a-92cc-3a9d8b44c6d2 req-49e238b0-b9df-4b17-8ffb-e787239a5ebb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:56.218230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7b2bc8c6-45f5-452a-92cc-3a9d8b44c6d2 req-49e238b0-b9df-4b17-8ffb-e787239a5ebb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:56.254525 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7b2bc8c6-45f5-452a-92cc-3a9d8b44c6d2 req-49e238b0-b9df-4b17-8ffb-e787239a5ebb service nova] Creating event network-changed:8169c873-b7ef-442f-9bf4-1f5ee358ef12 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:12:56.278716 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7b2bc8c6-45f5-452a-92cc-3a9d8b44c6d2 req-49e238b0-b9df-4b17-8ffb-e787239a5ebb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103917 Oct 19 07:12:56.279448 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2336/4792] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:57.205152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:57.205859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:57.221657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:57.222588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:57.223246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:57.228338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:57.229112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:57.229763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:57.701218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:57.720642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:57.723775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:57.725326 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1db2d1e8-ee55-47d9-bccd-06d88def09a9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.524004 Oct 19 07:12:57.727627 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2337/4793] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:57 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:58.641869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:58.642462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:58.663901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:58.667333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:58.667333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:58.668066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:58.668508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:58.668795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:58.755037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lazy-loading 'flavor' on Instance uuid 59a4daae-6c1a-4174-a294-85466495b6c1 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:12:58.834861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:12:59.437907 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89639505-aae2-451d-8394-68dc53f4366b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.347278 Oct 19 07:12:59.439591 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2457/4794] 10.222.0.39 () {60 vars in 1170 bytes} [Wed Oct 19 07:12:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:59.445425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:59.446329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:59.471887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:59.475232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:59.475232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:59.486710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:59.487645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:59.488935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:59.561882 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4992c5a4-6dce-45c3-a282-2088e936bb51 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/action" status: 202 len: 0 microversion: 2.20 time: 0.930679 Oct 19 07:12:59.563094 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2338/4795] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 07:12:58 2022] POST /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/action => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:12:59.578230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-385a4fe1-21b6-4389-9089-bcb7dd91569b req-17a66b10-891d-4571-a73e-199f4623eea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "tag": "e754f01c-edd6-408f-8951-5fa1db8035bf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:59.601958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-385a4fe1-21b6-4389-9089-bcb7dd91569b req-17a66b10-891d-4571-a73e-199f4623eea9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:59.602862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-385a4fe1-21b6-4389-9089-bcb7dd91569b req-17a66b10-891d-4571-a73e-199f4623eea9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:59.604088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-385a4fe1-21b6-4389-9089-bcb7dd91569b req-17a66b10-891d-4571-a73e-199f4623eea9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:59.641200 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-385a4fe1-21b6-4389-9089-bcb7dd91569b req-17a66b10-891d-4571-a73e-199f4623eea9 service nova] Creating event network-changed:e754f01c-edd6-408f-8951-5fa1db8035bf for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:12:59.650472 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-385a4fe1-21b6-4389-9089-bcb7dd91569b req-17a66b10-891d-4571-a73e-199f4623eea9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083962 Oct 19 07:12:59.653281 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2339/4796] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:12:59.665701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.62"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:12:59.670662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:59.686302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:59.689105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:59.689803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:59.696749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:59.697486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:59.698297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:59.726878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "refresh_cache-9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 07:12:59.727840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquired lock "refresh_cache-9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 07:12:59.809396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:59.824414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:59.825893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:12:59.827724 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22512ca7-0d57-4457-a4cb-31132e946eb7 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.386648 Oct 19 07:12:59.828961 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2458/4797] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:59 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:12:59.838956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:12:59.840823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:12:59.856190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:59.857199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:59.860945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:12:59.862610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:12:59.863893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:12:59.864616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:00.146473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:00.156421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:00.163101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:00.164753 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3b92ce3-ce11-4b82-bdea-d2a759ba47e3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.333730 Oct 19 07:13:00.165928 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2459/4798] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:12:59 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:00.865129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:00.878158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:00.889737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:00.890520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:00.891122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:00.897097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:00.898058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:00.898766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:01.366238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:01.380739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:01.382456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:01.383945 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc2a2645-8a77-47e2-a90a-72e3fbf86bd0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.529639 Oct 19 07:13:01.385157 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2460/4799] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:00 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:01.390412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:01.391107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:01.399036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:01.400418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:01.400879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:01.402286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:01.403003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:01.403674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:01.822197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:01.833960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:01.839375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:01.841021 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b7c34a87-0a81-4a7a-b2d0-5c27b633e87f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.454765 Oct 19 07:13:01.842113 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2461/4800] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:01 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:02.437783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:02.438870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:02.462389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:02.467304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:02.469274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:02.472665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:02.473687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:02.474787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:02.953846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:02.966371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:02.970575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:02.973518 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13bcc995-54af-4ac3-a158-aa796021abf3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.564412 Oct 19 07:13:02.974363 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2462/4801] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:02 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:02.997204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:03.005557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:03.014914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:03.014914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:03.014914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:03.016001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:03.016730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:03.017425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:03.319690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:03.343804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:03.349726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:03.353696 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb744b4c-7820-4519-97af-79397bbc730b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.375360 Oct 19 07:13:03.354141 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2463/4802] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:02 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:03.653231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-680528121", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:03.731449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] validate_networks() for [('ea3be4ee-1c3f-44e1-8e40-ebdb90658b72', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:13:04.550267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:13:04.552487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:13:04.553588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:13:04.556177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:13:04.556177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:13:04.560035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=54 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:04.569705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:04.570453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:04.571158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:04.572263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:04.573997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:04.578670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:04.599683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Getting quotas for project a457b818318a499188fb805286d6c77b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:13:04.606677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Getting quotas for user fc1f35324a234df58ec230f0a99454b4 and project a457b818318a499188fb805286d6c77b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:13:04.627027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:13:04.627468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:13:04.731936 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e17c13a-04e6-40bb-9457-7155b5e00b81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.375627 Oct 19 07:13:04.741316 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2464/4803] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:13:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:13:04.764519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:04.765188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:04.797535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:04.798061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:04.798520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:04.801213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:04.802046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:04.802154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:04.971031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Building network info cache for instance {{(pid=127568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 07:13:05.212476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:05.225039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:05.228096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:05.229365 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cebf8be-694c-4391-9980-6b497dc11f9c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.479579 Oct 19 07:13:05.231046 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2465/4804] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:04 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:05.240570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:05.241195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:05.257720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:05.258086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:05.258533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:05.259248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:05.264175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:05.274736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:05.514805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:05.524595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:05.526516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:05.528054 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cdaef642-ff30-4bfc-aec4-be639823a5ca tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.294930 Oct 19 07:13:05.529071 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2466/4805] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:05 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:05.543394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d04f1a6-188c-4c59-bb1e-99617c321c83 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:05.547182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d04f1a6-188c-4c59-bb1e-99617c321c83 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:05.559233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d04f1a6-188c-4c59-bb1e-99617c321c83 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:05.560182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d04f1a6-188c-4c59-bb1e-99617c321c83 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:05.560855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d04f1a6-188c-4c59-bb1e-99617c321c83 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:05.561823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d04f1a6-188c-4c59-bb1e-99617c321c83 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:05.565474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d04f1a6-188c-4c59-bb1e-99617c321c83 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:05.565474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d04f1a6-188c-4c59-bb1e-99617c321c83 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:05.658376 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d04f1a6-188c-4c59-bb1e-99617c321c83 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "POST /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5/action" status: 200 len: 24557 microversion: 2.1 time: 0.127405 Oct 19 07:13:05.666110 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2467/4806] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:13:05 2022] POST /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5/action => generated 24557 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:13:05.671781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c78f3925-76d0-44b3-84c5-61456ffab467 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:05.672583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c78f3925-76d0-44b3-84c5-61456ffab467 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:05.782144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c78f3925-76d0-44b3-84c5-61456ffab467 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:05.791012 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c78f3925-76d0-44b3-84c5-61456ffab467 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1221 microversion: 2.1 time: 0.129119 Oct 19 07:13:05.791807 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2468/4807] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:05 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:05.801885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5ab724ca-f87e-45eb-8ca2-546248571ff6 req-b234d7a1-3d45-40e4-a941-3f9ae845862d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9862cb-830e-46cd-bf84-a3c3d6c2cf89", "tag": "dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:05.824741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5ab724ca-f87e-45eb-8ca2-546248571ff6 req-b234d7a1-3d45-40e4-a941-3f9ae845862d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:05.825720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5ab724ca-f87e-45eb-8ca2-546248571ff6 req-b234d7a1-3d45-40e4-a941-3f9ae845862d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:05.826447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5ab724ca-f87e-45eb-8ca2-546248571ff6 req-b234d7a1-3d45-40e4-a941-3f9ae845862d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:05.845389 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5ab724ca-f87e-45eb-8ca2-546248571ff6 req-b234d7a1-3d45-40e4-a941-3f9ae845862d service nova] Creating event network-changed:dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e for instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 on n-h1-861333-10 Oct 19 07:13:05.853232 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5ab724ca-f87e-45eb-8ca2-546248571ff6 req-b234d7a1-3d45-40e4-a941-3f9ae845862d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059891 Oct 19 07:13:05.854654 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2469/4808] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:06.092575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1019699703", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:06.291065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] validate_networks() for [('ea3be4ee-1c3f-44e1-8e40-ebdb90658b72', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:13:07.752068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Updating instance_info_cache with network_info: [{"id": "dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e", "address": "fa:16:3e:47:7a:fc", "network": {"id": "38e12f1a-c1b9-4ff5-848e-f7ae3dfcbf95", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-385379990-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b019a5b91f2c402c98c5c26090a9e8ba", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdcb31b7b-1e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 07:13:07.861820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Releasing lock "refresh_cache-9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 07:13:07.863542 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b76ff5b-d980-48c3-a307-920cfb080051 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action" status: 202 len: 0 microversion: 2.1 time: 8.208642 Oct 19 07:13:07.868183 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2340/4809] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:12:59 2022] POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action => generated 0 bytes in 8212 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 07:13:07.907103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:07.912292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:07.938686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:07.940818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:07.942911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:07.946225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:07.948537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:07.950804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:08.085226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:13:08.085765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:13:08.086280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:13:08.086783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:13:08.087247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:13:08.101081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:08.101081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:08.101081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:08.101081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:08.101797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:08.102496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:08.125249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Getting quotas for project a457b818318a499188fb805286d6c77b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:13:08.132218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Getting quotas for user fc1f35324a234df58ec230f0a99454b4 and project a457b818318a499188fb805286d6c77b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:13:08.162991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:13:08.166182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:13:08.413170 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-303395a7-b611-4c86-ab12-7bc7519f3950 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.326214 Oct 19 07:13:08.420872 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2470/4810] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:13:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:13:08.432092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:08.453170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:08.481179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:08.481179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:08.481179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:08.483673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:08.484460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:08.485399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:08.537184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:08.549925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:08.552342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:08.553783 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1616cda-936c-4717-98c4-3d1732d7bfc8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.686190 Oct 19 07:13:08.554788 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2341/4811] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:07 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:08.560386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.62"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:09.006832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:09.015763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:09.017704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:09.019100 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd93dc76-775c-49ad-9bd3-a1e6f65d2a22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.596795 Oct 19 07:13:09.020261 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2471/4812] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:08 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:09.025542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3157bbe4-a6d6-459b-a6b1-81b0e8393ff3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:09.033973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3157bbe4-a6d6-459b-a6b1-81b0e8393ff3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:09.067162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:09.073023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:09.073777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:09.074402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:09.075289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:09.076741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:09.080431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:09.210218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3157bbe4-a6d6-459b-a6b1-81b0e8393ff3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:09.220516 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3157bbe4-a6d6-459b-a6b1-81b0e8393ff3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1222 microversion: 2.1 time: 0.198324 Oct 19 07:13:09.221466 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2472/4813] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:09 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1222 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:09.423590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "refresh_cache-9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 07:13:09.424008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquired lock "refresh_cache-9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 07:13:09.588980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:09.591091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:09.599262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:09.599757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:09.600347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:09.601071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:09.601656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:09.601944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:09.914202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:09.930259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:09.932705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:09.936867 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a2e6a3c-c880-4893-97d0-91a8d2908604 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.354991 Oct 19 07:13:09.938180 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2473/4814] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:09 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:10.053197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:10.054113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:10.098703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:10.099223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:10.107654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:10.109855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:10.110568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:10.111490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:10.544933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:10.566680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:10.566680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:10.571496 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a176e2dd-c1cc-43df-9a1b-71ccd7438137 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.525773 Oct 19 07:13:10.572517 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2474/4815] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:10 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:10.594177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:10.595326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:10.607135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:10.608172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:10.610857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:10.615879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:10.617862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:10.623745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:10.809682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:10.818798 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d03ead9-3651-4d02-9a88-1e1b46d99702 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1274 microversion: 2.1 time: 0.243612 Oct 19 07:13:10.824470 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2475/4816] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:10 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:10.967988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:10.970039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:10.978711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:10.982320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:10.982785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:10.986202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:10.986803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:10.987197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:11.635245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Building network info cache for instance {{(pid=127568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 07:13:11.806793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:11.829628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:11.831157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:11.832477 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8963a22d-0b1f-44f8-b1bf-911329dc91fd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.869757 Oct 19 07:13:11.837249 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2476/4817] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:10 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:11.847200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:11.848381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:11.860003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:11.865905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:11.866550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:11.867767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:11.867937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:11.870267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:12.154298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:12.164711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:12.189466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:12.193756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:12.199189 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ca83cc7-f09d-4ae8-954c-38276e488783 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.360638 Oct 19 07:13:12.208640 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2477/4818] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:11 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:12.243457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ad2132e1-0a0b-428b-82fa-565868469956 req-591206d2-23bd-4481-8f17-ef535122e227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9862cb-830e-46cd-bf84-a3c3d6c2cf89", "tag": "dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:12.258078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ad2132e1-0a0b-428b-82fa-565868469956 req-591206d2-23bd-4481-8f17-ef535122e227 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:12.258738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ad2132e1-0a0b-428b-82fa-565868469956 req-591206d2-23bd-4481-8f17-ef535122e227 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:12.259259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ad2132e1-0a0b-428b-82fa-565868469956 req-591206d2-23bd-4481-8f17-ef535122e227 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:12.277945 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ad2132e1-0a0b-428b-82fa-565868469956 req-591206d2-23bd-4481-8f17-ef535122e227 service nova] Creating event network-changed:dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e for instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 on n-h1-861333-10 Oct 19 07:13:12.280822 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ad2132e1-0a0b-428b-82fa-565868469956 req-591206d2-23bd-4481-8f17-ef535122e227 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070639 Oct 19 07:13:12.281730 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2478/4819] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:12.288645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:12.290225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:12.297735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:12.298855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:12.299258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:12.300222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:12.301404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:12.302158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:12.444377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:12.454501 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96e2276f-f010-404f-ba8a-27441fa3def4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1280 microversion: 2.1 time: 0.171475 Oct 19 07:13:12.456167 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2479/4820] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:12 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:12.866137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:12.866810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:12.875706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:12.876334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:12.876846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:12.881416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:12.882706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:12.883234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:13.203312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:13.214537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:13.216658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:13.218232 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1a5c645-04f0-4995-9bce-ebec6ae0d288 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.356243 Oct 19 07:13:13.219031 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2480/4821] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:12 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:13.294527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Updating instance_info_cache with network_info: [{"id": "dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e", "address": "fa:16:3e:47:7a:fc", "network": {"id": "38e12f1a-c1b9-4ff5-848e-f7ae3dfcbf95", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-385379990-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b019a5b91f2c402c98c5c26090a9e8ba", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdcb31b7b-1e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 07:13:13.345865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Releasing lock "refresh_cache-9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 07:13:13.346903 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-190454d9-2dab-4c81-9064-dedf716e9058 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action" status: 202 len: 0 microversion: 2.1 time: 4.790931 Oct 19 07:13:13.348343 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2342/4822] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:13:08 2022] POST /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89/action => generated 0 bytes in 4793 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 07:13:13.353439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:13.354206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:13.365809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:13.368536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:13.368536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:13.369352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:13.370092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:13.370689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:13.440535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9eeb0aeb-fd55-4056-9266-a1abd8ad591c req-09d265a7-35f4-4291-9ed6-d76f503d5ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47479fa1-5580-49d4-bd9a-dd0759289365", "tag": "3acbc327-d37c-4ec4-9c69-3053c2a529bc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:13.466271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9eeb0aeb-fd55-4056-9266-a1abd8ad591c req-09d265a7-35f4-4291-9ed6-d76f503d5ddf service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:13.466757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9eeb0aeb-fd55-4056-9266-a1abd8ad591c req-09d265a7-35f4-4291-9ed6-d76f503d5ddf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:13.469409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9eeb0aeb-fd55-4056-9266-a1abd8ad591c req-09d265a7-35f4-4291-9ed6-d76f503d5ddf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:13.492872 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9eeb0aeb-fd55-4056-9266-a1abd8ad591c req-09d265a7-35f4-4291-9ed6-d76f503d5ddf service nova] Creating event network-changed:3acbc327-d37c-4ec4-9c69-3053c2a529bc for instance 47479fa1-5580-49d4-bd9a-dd0759289365 on n-h1-861333-10 Oct 19 07:13:13.502215 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9eeb0aeb-fd55-4056-9266-a1abd8ad591c req-09d265a7-35f4-4291-9ed6-d76f503d5ddf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279671 Oct 19 07:13:13.504805 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2481/4823] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:13.511355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-139619f4-c04e-4e2e-8152-32aabe4dd366 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '.version_select at 0x7f6d5f9b7c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:14.153248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:14.167951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:14.170388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:14.172166 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ef8a1eb-e87b-4d84-8e99-477e3c476508 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.822621 Oct 19 07:13:14.174049 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2343/4824] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:13 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:14.183530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:14.187847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:14.200271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:14.201016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:14.201630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:14.202533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:14.202998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:14.203425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:14.544369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:14.578498 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16bb0c5c-8829-4315-bb9a-d23cd7fe0258 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 0.401142 Oct 19 07:13:14.579092 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2344/4825] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:14 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:14.625306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:14.631608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:14.638638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:14.639491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:14.640227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:14.641190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:14.641864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:14.642517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:14.713274 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-139619f4-c04e-4e2e-8152-32aabe4dd366 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/2ae697cd-d4bf-4c94-a0a3-65a07c6980ec" status: 202 len: 0 microversion: 2.1 time: 1.206884 Oct 19 07:13:14.723669 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2482/4826] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 07:13:13 2022] DELETE /compute/v2.1/os-floating-ips/2ae697cd-d4bf-4c94-a0a3-65a07c6980ec => generated 0 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:13:14.729394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e606e2e5-8b29-44f2-895c-1cae3e74854c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '.version_select at 0x7f6d5f841940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:14.876056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:14.890342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:14.892040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:14.896157 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3020b701-ba69-4f73-8664-4b053a076564 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.274655 Oct 19 07:13:14.897578 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2345/4827] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:14 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:15.102323 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e606e2e5-8b29-44f2-895c-1cae3e74854c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/b3fa5599-c5d3-432c-8408-ca0337fa5960" status: 202 len: 0 microversion: 2.1 time: 0.376798 Oct 19 07:13:15.103819 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2483/4828] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:13:14 2022] DELETE /compute/v2.1/os-security-groups/b3fa5599-c5d3-432c-8408-ca0337fa5960 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:13:15.113927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:15.113927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:15.122021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.122519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.122954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:15.123661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.124129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.131771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:15.187674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:13:15.204903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:15.215149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:15.222312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.222824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.223269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:15.223983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.234252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.234252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:15.553190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:15.566858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:15.566858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:15.566858 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3514b538-b1d6-4680-aa33-f0d40f0c0286 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.364997 Oct 19 07:13:15.566858 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2484/4829] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:15 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:15.591948 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e377a82d-9acf-4977-ac12-ecb637d324e0 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 204 len: 0 microversion: 2.1 time: 0.483085 Oct 19 07:13:15.593934 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2346/4830] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:13:15 2022] DELETE /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:13:15.604954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:15.605660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:15.618254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.624477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.624661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:15.624661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:15.624893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:15.624893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.624893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.624893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:15.632276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.634715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.635514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:15.637217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.638046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.638672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:15.891351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:15.903503 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d05356cd-8f06-40d0-9194-9b2912f33ee5 tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1510 microversion: 2.1 time: 0.306060 Oct 19 07:13:15.904702 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2485/4831] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:15 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:15.908272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:15.924249 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e770de6-5fb3-465e-86ba-54df7b2402d1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 0.324591 Oct 19 07:13:15.927425 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2347/4832] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:15 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:15.929327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:15.930325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:15.937494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.938341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.938952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:15.940152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:15.945312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:15.949477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:16.166396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-746a99e8-045b-4286-bc62-2f8305de8e45 req-1e2dec37-76c1-492c-8224-e2eff3d981de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a1aa62a-6f40-4796-aaba-0a5b9ac459cd", "tag": "7e5b95eb-05a1-4fd7-98c4-c027bea3d2c3"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:16.176853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-746a99e8-045b-4286-bc62-2f8305de8e45 req-1e2dec37-76c1-492c-8224-e2eff3d981de service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:16.177664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-746a99e8-045b-4286-bc62-2f8305de8e45 req-1e2dec37-76c1-492c-8224-e2eff3d981de service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:16.178102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-746a99e8-045b-4286-bc62-2f8305de8e45 req-1e2dec37-76c1-492c-8224-e2eff3d981de service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:16.190082 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-746a99e8-045b-4286-bc62-2f8305de8e45 req-1e2dec37-76c1-492c-8224-e2eff3d981de service nova] Creating event network-changed:7e5b95eb-05a1-4fd7-98c4-c027bea3d2c3 for instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd on n-h1-861333-10 Oct 19 07:13:16.196399 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-746a99e8-045b-4286-bc62-2f8305de8e45 req-1e2dec37-76c1-492c-8224-e2eff3d981de service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035629 Oct 19 07:13:16.197022 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2348/4833] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:13:16.591905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:16.593097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:16.600529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:16.601384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:16.601825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:16.602572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:16.603029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:16.603534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:16.618420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:16.638792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:16.642903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:16.648586 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c57eb5ff-60af-4e42-ae1e-6382c1b2c55a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.728904 Oct 19 07:13:16.668936 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2486/4834] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:15 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:16.806995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:16.818977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:16.820472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:16.822000 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-886317a2-b9cd-413a-8170-64fdd8e491d4 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1744 microversion: 2.20 time: 0.234774 Oct 19 07:13:16.822976 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2349/4835] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:16 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1744 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:16.930395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:16.931253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:16.939744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:16.942436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:16.942436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:16.942436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:16.942995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:16.943662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:16.961091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:16.961819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:16.979253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:16.981074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:16.981731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:16.982619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:16.983245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:16.983883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:17.196198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:17.206027 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd06ccd7-9459-4a1d-8ebd-7085eb895aab tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1510 microversion: 2.1 time: 0.280207 Oct 19 07:13:17.222050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:17.224802 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2487/4836] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:16 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:17.234094 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e30cfc1b-11e2-4308-a66b-a874666986fa tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 0.283200 Oct 19 07:13:17.234752 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2350/4837] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:16 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:17.682207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:17.682814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:17.696922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:17.697817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:17.698441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:17.699657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:17.700319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:17.700921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:17.853924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:17.854538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:17.869359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:17.869873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:17.870326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:17.871044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:17.880220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:17.880812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:18.113584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:18.187200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:18.201447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:18.205861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:18.207367 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a93ea2e-f635-4eab-a614-0b12d0916367 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.529191 Oct 19 07:13:18.209041 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2488/4838] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:17 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:18.233826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:18.234622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:18.241994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:18.242699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:18.243308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:18.244240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:18.244693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:18.245289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:18.595495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:18.601139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:18.615707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:18.621071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:18.622359 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3dfb8200-93d5-44b6-b36e-ce0949c1bb6b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.773934 Oct 19 07:13:18.626536 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2351/4839] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:17 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:18.633525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:18.635721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:18.657964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:18.658725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:18.660860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:18.661796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:18.663497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:18.665102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:18.901495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:18.913493 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29ad547c-da9d-40d8-917e-11a682cceacb tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1510 microversion: 2.1 time: 0.683657 Oct 19 07:13:18.916846 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2489/4840] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:18 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1510 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:13:19.240239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:19.241558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:19.256341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=16 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:19.259366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:19.264303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:19.267389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:19.270609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:19.274435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:19.277796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:19.680181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:19.703360 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76043699-1fb5-4b40-aeb6-30f208e53887 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 1.072033 Oct 19 07:13:19.704616 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2352/4841] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:18 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:19.714443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c10bdc13-8252-417e-a36b-8aaeb73f24c7 req-5a64cec5-8f71-4887-a4fd-761e58b588eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47479fa1-5580-49d4-bd9a-dd0759289365", "name": "network-vif-plugged", "status": "completed", "tag": "3acbc327-d37c-4ec4-9c69-3053c2a529bc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:19.740620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c10bdc13-8252-417e-a36b-8aaeb73f24c7 req-5a64cec5-8f71-4887-a4fd-761e58b588eb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:19.741227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c10bdc13-8252-417e-a36b-8aaeb73f24c7 req-5a64cec5-8f71-4887-a4fd-761e58b588eb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:19.741679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c10bdc13-8252-417e-a36b-8aaeb73f24c7 req-5a64cec5-8f71-4887-a4fd-761e58b588eb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:19.762982 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c10bdc13-8252-417e-a36b-8aaeb73f24c7 req-5a64cec5-8f71-4887-a4fd-761e58b588eb service nova] Creating event network-vif-plugged:3acbc327-d37c-4ec4-9c69-3053c2a529bc for instance 47479fa1-5580-49d4-bd9a-dd0759289365 on n-h1-861333-10 Oct 19 07:13:19.767980 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c10bdc13-8252-417e-a36b-8aaeb73f24c7 req-5a64cec5-8f71-4887-a4fd-761e58b588eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061335 Oct 19 07:13:19.769158 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2353/4842] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:19.777604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2b85c474-ece9-497c-abfb-2d14f724cb48 req-35ed6844-8c46-43cc-a2bc-4e1cc0f3c65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9862cb-830e-46cd-bf84-a3c3d6c2cf89", "name": "network-vif-deleted", "tag": "dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:19.797616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2b85c474-ece9-497c-abfb-2d14f724cb48 req-35ed6844-8c46-43cc-a2bc-4e1cc0f3c65b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:19.798346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2b85c474-ece9-497c-abfb-2d14f724cb48 req-35ed6844-8c46-43cc-a2bc-4e1cc0f3c65b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:19.798954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2b85c474-ece9-497c-abfb-2d14f724cb48 req-35ed6844-8c46-43cc-a2bc-4e1cc0f3c65b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:19.814797 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2b85c474-ece9-497c-abfb-2d14f724cb48 req-35ed6844-8c46-43cc-a2bc-4e1cc0f3c65b service nova] Creating event network-vif-deleted:dcb31b7b-1e1d-423f-b2bc-e1db8dc3417e for instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 on n-h1-861333-10 Oct 19 07:13:19.820302 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2b85c474-ece9-497c-abfb-2d14f724cb48 req-35ed6844-8c46-43cc-a2bc-4e1cc0f3c65b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049775 Oct 19 07:13:19.821443 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2354/4843] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:19.827873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:19.829077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:19.836253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:19.840557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:19.840557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:19.840557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:19.840557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:19.840557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:20.119310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:20.135011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:20.137076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:20.138739 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c1de91f-b480-4563-9877-794075c77c3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.903466 Oct 19 07:13:20.143894 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2490/4844] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:19 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:20.149588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:20.151050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:20.162359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:20.163242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:20.177266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:20.177266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:20.177266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:20.178963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:20.221906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:20.245754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:20.252217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:20.254780 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ad2d849-f5af-4a02-bcdf-4ddd48851b6e tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.432036 Oct 19 07:13:20.259344 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2355/4845] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:19 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:20.260322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:20.261335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:20.261958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:20.262779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lazy-loading 'fault' on Instance uuid 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:13:20.425070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec8ddc37c6d4f2f8aae349173dc38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b019a5b91f2c402c98c5c26090a9e8ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:20.437368 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c6eb02f-e221-409d-9a38-b5c26e737e0b tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 200 len: 1313 microversion: 2.1 time: 0.292001 Oct 19 07:13:20.447899 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2491/4846] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:20 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:20.731421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:20.732635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:20.749535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:20.750357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:20.751651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:20.752644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:20.759230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:20.759942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:21.187758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:21.188916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:21.208074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:21.213103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:21.217695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:21.217695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:21.217695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:21.223250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:21.447908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:21.461667 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9061d05-a171-4f1d-8faa-c20e44064deb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 0.734761 Oct 19 07:13:21.464708 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2356/4847] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:20 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:21.479584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:21.482134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:21.498578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:21.498855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:21.501447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:21.501447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:21.502905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:21.503381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:21.680716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:21.695273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:21.706798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:21.713873 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d26c297-34a2-497e-a7cc-30f4ff674041 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.538551 Oct 19 07:13:21.719952 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2492/4848] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:21 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:21.725694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:21.741013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] [instance: 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:21.758844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:21.768828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:21.771904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:21.780093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:21.780093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:21.780093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:21.833125 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] HTTP exception thrown: Instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 could not be found. Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Request method failure captured: Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 HTTP/1.1 Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6M4eE0zGZK9FcRXm1zivC_c0EI1qeXciToO5_XU4iu6b9Rq8DhgOqusCdAM3DOUkiKeO45ZOgpoGYpNb8kZwkTY9-pv3lvslJ0qbZJPHyI5EfgfKMBs2_mZ7x5qLw5yExQ65eqzAh_HCfN9vOezdB5wWkAJtNxaogX0RPNtrv8PFt0 Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b019a5b91f2c402c98c5c26090a9e8ba Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-206282004 Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b019a5b91f2c402c98c5c26090a9e8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b019a5b91f2c402c98c5c26090a9e8ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b019a5b91f2c402c98c5c26090a9e8ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b019a5b91f2c402c98c5c26090a9e8ba", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-206282004 Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b019a5b91f2c402c98c5c26090a9e8ba Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-206282004 Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueTestJSONUnderV235-206282004-project Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 5ec8ddc37c6d4f2f8aae349173dc38b9 Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-206282004-project Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 could not be found. Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '9d9862cb-830e-46cd-bf84-a3c3d6c2cf89'} Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 could not be found. Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 could not be found. Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:13:21.835336 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:13:21.841901 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:13:21.841901 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:13:21.841901 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:13:21.841901 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:13:21.841901 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:13:21.841901 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:13:21.841901 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 could not be found. Oct 19 07:13:21.841901 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:13:21.845200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] Returning 404 to user: Instance 9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:13:21.849089 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2edc56f1-23a6-488e-9aba-6589d818ec3c tempest-ServerRescueTestJSONUnderV235-206282004 tempest-ServerRescueTestJSONUnderV235-206282004-project] 10.222.0.39 "GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89" status: 404 len: 111 microversion: 2.1 time: 0.127698 Oct 19 07:13:21.853064 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2493/4849] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:21 2022] GET /compute/v2.1/servers/9d9862cb-830e-46cd-bf84-a3c3d6c2cf89 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:13:21.867393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-00a4a6aa-0951-4171-acdb-7bc7d5aa3608 req-e2947bb8-19be-4655-aa35-765f3fef1d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a4daae-6c1a-4174-a294-85466495b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "c784c077-e373-459c-a2b3-896b21d78fbc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:21.907738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-00a4a6aa-0951-4171-acdb-7bc7d5aa3608 req-e2947bb8-19be-4655-aa35-765f3fef1d0b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:21.917415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-00a4a6aa-0951-4171-acdb-7bc7d5aa3608 req-e2947bb8-19be-4655-aa35-765f3fef1d0b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:21.918084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-00a4a6aa-0951-4171-acdb-7bc7d5aa3608 req-e2947bb8-19be-4655-aa35-765f3fef1d0b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:21.958239 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-00a4a6aa-0951-4171-acdb-7bc7d5aa3608 req-e2947bb8-19be-4655-aa35-765f3fef1d0b service nova] Creating event network-vif-plugged:c784c077-e373-459c-a2b3-896b21d78fbc for instance 59a4daae-6c1a-4174-a294-85466495b6c1 on n-h2-861333-10 Oct 19 07:13:21.979953 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-00a4a6aa-0951-4171-acdb-7bc7d5aa3608 req-e2947bb8-19be-4655-aa35-765f3fef1d0b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123657 Oct 19 07:13:21.987589 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2494/4850] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:21.994447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:22.004298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:22.014106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:22.020590 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e886678d-9460-4d26-9823-912ef5505e38 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.551981 Oct 19 07:13:22.026939 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2357/4851] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:21 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:22.495075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:22.495947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:22.521724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:22.524484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:22.528499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:22.530242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:22.534260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:22.535235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:22.548860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f3f8207-4f5a-422a-abcc-d744880abbad tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Action: 'create', calling method: .version_select at 0x7f6d5fa28e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1580654841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnZsopidAUApCZxQycFSSQ2V1LTnrz7CKrBoROhZcX70/hImcTdv/X35ryzA+doJsDpqLLClA8MK9VB7ZVeXLJSDQxYv4q3Hc0wV0J5ZOu0ChJv6NqnhIkYUUzBpBju2g=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:22.592424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6f3f8207-4f5a-422a-abcc-d744880abbad tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:13:22.616224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6f3f8207-4f5a-422a-abcc-d744880abbad tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for user 57cb186cade14d558122b6bf720c2922 and project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:13:22.778042 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f3f8207-4f5a-422a-abcc-d744880abbad tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.233287 Oct 19 07:13:22.779302 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2358/4852] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:13:22 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:22.799278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:22.801015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:22.827144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:22.833081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:22.833877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:22.836819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:22.838985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:22.839633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:23.149793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:23.164216 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96e29172-1f49-43cf-81c3-4ca48c49e371 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 0.681790 Oct 19 07:13:23.169692 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2495/4853] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:22 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:23.181985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:23.183609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:23.187197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:23.196930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:23.201818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:23.204844 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae4e6e09-682f-442c-9b7a-09f27f99b432 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.424399 Oct 19 07:13:23.206780 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2359/4854] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:22 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:23.210016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:23.211681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:23.212239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:23.215175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:23.215666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:23.222103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:23.658126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:23.670933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:23.676920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:23.678573 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8225c706-dacb-4033-b41f-b93c74ad3439 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.507885 Oct 19 07:13:23.682683 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2496/4855] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:23 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:24.194097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:24.194640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:24.205982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:24.207969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:24.211954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:24.231350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:24.232604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:24.233275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:24.235163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:24.236785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:24.238589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:24.253505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:24.257934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:24.258565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:24.262675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:24.262950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:24.263518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:24.565928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:24.578426 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d59ef598-7e03-4cfb-ba95-f843b86980dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 0.389214 Oct 19 07:13:24.579648 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2360/4856] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:24 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:24.721034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:24.721668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:24.778849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:24.781200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:24.789363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:24.793656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:24.795174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:24.799506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:24.800380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:24.801443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:24.807788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:24.816685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bcdb883c-2097-4ec6-8c38-6dac5769d9b0 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.564026 Oct 19 07:13:24.840704 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2497/4857] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:24 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:25.364576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:25.387801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:25.391982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:25.395983 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ad1ec05-4065-4420-8157-30efc8e62fbe tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.684660 Oct 19 07:13:25.397291 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2361/4858] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:24 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:25.604365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:25.605510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:25.632354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:25.633238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:25.633883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:25.634891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:25.635764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:25.636528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:25.888566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:25.888566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:25.888566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:25.888566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:25.888566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:25.888566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:25.888566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:25.888566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:26.420183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:26.431713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:26.434284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:26.435754 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0904e94-d6bb-4d51-8125-a06153aa2434 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.592993 Oct 19 07:13:26.436903 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2362/4859] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:25 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:26.442098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:26.443067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:26.452314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:26.454686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:26.454686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:26.454686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:26.460909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:26.461571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:26.794190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:26.812445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:26.814033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:26.815279 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d72fa15-4a34-4a3f-973d-e6d1783a5fb9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.377145 Oct 19 07:13:26.822087 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2363/4860] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:26 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:27.043558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:27.047321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:27.057879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14b929e7-b104-4206-9221-288f7a8f0b4f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 1.458213 Oct 19 07:13:27.073122 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2498/4861] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:25 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:27.464636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:27.465170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:27.486424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:27.486424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:27.493626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:27.510698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:27.511933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:27.515102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:27.849288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:27.849416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:27.864454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:27.864961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:27.865407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:27.866112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:27.886010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:27.886469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:27.891580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:27.907382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:27.910554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:27.916868 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60fb9be3-b8f5-46b5-bf18-009581e9af6e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.453566 Oct 19 07:13:27.919430 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2364/4862] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:27 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:27.950242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1028444326", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b3171ed8-c153-476a-8804-5ab7e8a1237b"}], "key_name": "tempest-TestNetworkBasicOps-1580654841", "security_groups": [{"name": "tempest-secgroup-smoke-1365335316"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:28.196962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] validate_networks() for [('b3171ed8-c153-476a-8804-5ab7e8a1237b', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:13:28.813185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:28.825783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:28.827546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:28.829191 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2aa5ffde-9b8f-4cf0-82b8-4f820d63f3c5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.985078 Oct 19 07:13:28.829910 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2499/4863] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:27 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:28.836207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:28.837331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:28.847131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:28.849814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:28.850650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:28.851403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:28.852511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:28.853264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:28.853731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:29.042645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:29.058285 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86e3e6d7-3825-4fc3-9cf3-201c942ba894 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 0.222936 Oct 19 07:13:29.081324 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2500/4864] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:28 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:29.088787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:29.091230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:29.108910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:29.111073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:29.111684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:29.113971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:29.120048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:29.123465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:29.920987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:13:29.922218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:13:29.922875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:13:29.923988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:13:29.924774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:13:29.949890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:29.950605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:29.958452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:29.961318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:29.962109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:29.963883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:30.010912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:30.024036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:30.025178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:13:30.026176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:30.045310 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ce057b4-3aa9-4743-b4fc-10c1e904734a tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.964743 Oct 19 07:13:30.045310 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2501/4865] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:29 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:30.045585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for user 57cb186cade14d558122b6bf720c2922 and project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:13:30.049116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:30.051881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:30.073047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:30.073561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:30.074612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:30.075529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:30.076276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:30.077294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:30.132895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:13:30.140845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:13:30.343016 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fcb62942-688a-475b-a1be-6d90715f49ee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.410695 Oct 19 07:13:30.344325 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2365/4866] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:13:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:13:30.353790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:30.354759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:30.381073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:30.382508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:30.386752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:30.390987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:30.391612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:30.392070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:30.872333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:30.890449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:30.902051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:30.909505 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d5a5e9e-fe85-4398-a220-1f9f0fe4af32 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.865106 Oct 19 07:13:30.916852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:30.917540 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2502/4867] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:30 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:30.933991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce71ca39-cab8-4888-9537-0019ab083942 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:30.940674 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2b5694d-27b6-43e5-9cf5-9556a66efb23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 0.594968 Oct 19 07:13:30.942574 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2366/4868] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:30 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:30.946962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce71ca39-cab8-4888-9537-0019ab083942 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:30.952013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7adff256-731b-40ea-a6cf-9ebe4cf81f8c req-c91c783c-bd2d-4dcf-a034-75a56f1b409a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1aa62a-6f40-4796-aaba-0a5b9ac459cd", "name": "network-vif-plugged", "status": "completed", "tag": "7e5b95eb-05a1-4fd7-98c4-c027bea3d2c3"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:31.010805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7adff256-731b-40ea-a6cf-9ebe4cf81f8c req-c91c783c-bd2d-4dcf-a034-75a56f1b409a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:31.012767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7adff256-731b-40ea-a6cf-9ebe4cf81f8c req-c91c783c-bd2d-4dcf-a034-75a56f1b409a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:31.013337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7adff256-731b-40ea-a6cf-9ebe4cf81f8c req-c91c783c-bd2d-4dcf-a034-75a56f1b409a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:31.061074 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7adff256-731b-40ea-a6cf-9ebe4cf81f8c req-c91c783c-bd2d-4dcf-a034-75a56f1b409a service nova] Creating event network-vif-plugged:7e5b95eb-05a1-4fd7-98c4-c027bea3d2c3 for instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd on n-h1-861333-10 Oct 19 07:13:31.076326 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7adff256-731b-40ea-a6cf-9ebe4cf81f8c req-c91c783c-bd2d-4dcf-a034-75a56f1b409a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132216 Oct 19 07:13:31.085651 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2367/4869] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:31.092547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:31.135246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:31.156312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:31.157411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:31.159193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:31.162264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:31.162926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:31.165714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:31.244074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce71ca39-cab8-4888-9537-0019ab083942 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:31.247324 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce71ca39-cab8-4888-9537-0019ab083942 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1249 microversion: 2.1 time: 0.328081 Oct 19 07:13:31.247904 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2503/4870] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:30 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1249 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:31.650821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:31.662829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:31.673473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:31.674929 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bbb7314-dba0-4571-b175-c92bb0831112 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.587955 Oct 19 07:13:31.677229 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2368/4871] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:31 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:31.945316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:31.946076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:31.963743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:31.967193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:31.968442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:31.971149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:31.971947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:31.974566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:31.976318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:31.977045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:31.983883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:31.984498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:31.985136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:31.985876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:31.986346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:31.986783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:32.538412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:32.545506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:32.546887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:32.548084 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5e98aa0-c5cf-45c0-9350-8349873f11c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.607190 Oct 19 07:13:32.577258 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2504/4872] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:31 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:32.596459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:32.597226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:32.611642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:32.612170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:32.612621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:32.613877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:32.621465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:32.622621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:32.643460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:32.661798 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36dbe254-0eca-44eb-8d98-4f86423783e7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1322 microversion: 2.1 time: 0.699168 Oct 19 07:13:32.665817 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2369/4873] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:31 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:32.705439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:32.706426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:32.745175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:32.745700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:32.746190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:32.748435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:32.748900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:32.749345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:32.790592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:32.798842 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c628cf2-18cf-45b4-a1ec-ae0eab6be23f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1301 microversion: 2.1 time: 0.220061 Oct 19 07:13:32.810713 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2505/4874] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:32 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1301 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:33.348876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:33.369397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:33.371818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:33.382850 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bd7bbfb-b3a9-4114-87ee-b6adee7e31fc tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.679076 Oct 19 07:13:33.382850 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2370/4875] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:32 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:33.596674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:33.597263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:33.609049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:33.611159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:33.612827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:33.613819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:33.616813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:33.617470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:33.690900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:33.692321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:33.704620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:33.705393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:33.710555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:33.710555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:33.710555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:33.710555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:34.348870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:34.365493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:34.380086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:34.380086 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d23743c2-ef54-4d52-bc6e-d4718dd2c66c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.784660 Oct 19 07:13:34.381782 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2506/4876] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:33 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:34.397183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:34.397804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:34.414954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:34.418820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:34.421149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:34.423178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:34.426908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:34.427798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:34.496769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:34.506762 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1700cf4d-da79-4fce-b10a-96881dd3b222 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1517 microversion: 2.1 time: 0.821250 Oct 19 07:13:34.507349 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2371/4877] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:33 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1517 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:13:34.540576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:34.540576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:34.572758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:34.576019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:34.576679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:34.599821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:34.601026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:34.602057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:34.607571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:34.958730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:34.967132 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf9c54fb-fc0a-4dd7-aa7f-3c28f3aed796 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1307 microversion: 2.1 time: 0.584191 Oct 19 07:13:34.967724 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2507/4878] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:34 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1307 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:34.987932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:35.002533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:35.037457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:35.038278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:35.038728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:35.043634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:35.044879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:35.047603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:35.126498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lazy-loading 'flavor' on Instance uuid 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:13:35.446199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:35.464666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:35.468408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:35.469884 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd300c47-6750-4bee-af43-f1cd3810b8ab tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.954247 Oct 19 07:13:35.473482 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2372/4879] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:34 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:35.481867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:35.489637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:35.508583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:35.517274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:35.518120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:35.519062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:35.519736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:35.527378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:35.592269 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d4d33d8-d8c1-496d-9e9c-c2a55458a534 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd/action" status: 200 len: 32 microversion: 2.1 time: 0.613819 Oct 19 07:13:35.593988 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2508/4880] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:13:34 2022] POST /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd/action => generated 32 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:13:35.608278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:35.612455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:35.628498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:35.631059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:35.631765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:35.634442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:35.635496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:35.636638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:36.258052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:36.267352 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c8ac8d2-9a7a-4eb3-ac8b-daf43a9992d6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.667396 Oct 19 07:13:36.271859 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2509/4881] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:35 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:13:36.278308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:36.279730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:36.327753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:36.328557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:36.331592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:36.333377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:36.335219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:36.335876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:36.350987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:36.362474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:36.364587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:36.365794 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96f84b13-f540-4c0a-94e3-a0a06d9f8ba6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.891052 Oct 19 07:13:36.373561 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2373/4882] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:35 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:36.499478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:36.500137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:36.515438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:36.516053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:36.516644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:36.517367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:36.517830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:36.518260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:37.130519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:37.144449 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5fae0df-a274-44ad-ab35-08cc1526e4a8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.869327 Oct 19 07:13:37.159911 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2510/4883] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:36 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:37.302123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:37.303926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:37.320177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:37.322212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:37.324677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:37.325558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:37.330484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:37.331354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:37.824092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:37.844725 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58095b23-6862-4d42-ab0d-2989b80e3d1e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.546903 Oct 19 07:13:37.845890 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2511/4884] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:37 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:37.860211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:37.862794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:37.891070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:37.895352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:37.897990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:37.904866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:37.908638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:37.920504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:37.956251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:37.974662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:37.976125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:37.982146 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e918f4c-179a-412d-a3e1-0518432a6b49 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 1.487178 Oct 19 07:13:37.982725 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2374/4885] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:36 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:38.167389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:38.168338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:38.182677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:38.183470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:38.184339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:38.185233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:38.185857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:38.186998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:38.300128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:38.313582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:38.318305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:38.319952 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97d57ae2-bbfd-4afd-841d-8451ebdf4746 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.472836 Oct 19 07:13:38.321461 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2512/4886] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:37 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:38.572617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:38.584638 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea0302ec-4c51-43e5-82e1-759cda08b376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.421423 Oct 19 07:13:38.602920 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2375/4887] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:38 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:38.913591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:38.913591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:38.913591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:38.913591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:38.913591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:38.913591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:38.913591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:38.913591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:39.211212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1966978464", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:39.308423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:39.321284 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54f12dde-9288-4929-8743-1015540a865c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.445620 Oct 19 07:13:39.324328 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2376/4888] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:38 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:39.325720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:13:39.326223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:13:39.326891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:13:39.327553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:13:39.328191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:13:39.338255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:39.339898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:39.340845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:39.341135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:39.346208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:39.346208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:39.346208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:39.346208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:39.355829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:39.356367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:39.359251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:39.360077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:39.361723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:39.362178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:39.366206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Getting quotas for project 0cb76d21ff784e3bac760ff67476885d. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:13:39.374409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Getting quotas for user a5596bde56454db7a3aa0a62cd1ae403 and project 0cb76d21ff784e3bac760ff67476885d. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:13:39.408527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:13:39.415983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:13:39.638321 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc1ce330-2078-4177-a4c1-436fcc39ee1d tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.045398 Oct 19 07:13:39.638829 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2513/4889] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 07:13:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 07:13:39.662263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:39.662892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:39.693584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:39.694070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:39.694515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:39.695224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:39.695683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:39.698333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:39.938298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:39.960552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:39.960552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:39.963242 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df19b478-fe95-473b-947c-ff8b722648fa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.313081 Oct 19 07:13:39.968510 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2514/4890] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:39 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:39.983699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:39.998014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:40.005411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:40.016862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:40.017380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:40.017825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:40.018553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:40.019016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:40.019958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:40.055147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:40.090691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:40.329373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:40.346273 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b38799b-3119-4854-bea6-bb4e9e895a3b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.371006 Oct 19 07:13:40.348044 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2515/4891] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:39 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:40.353723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62071341-faa1-4137-8b28-bc8797eab0e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:40.356503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62071341-faa1-4137-8b28-bc8797eab0e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:40.436522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62071341-faa1-4137-8b28-bc8797eab0e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:40.448045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62071341-faa1-4137-8b28-bc8797eab0e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:40.450087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62071341-faa1-4137-8b28-bc8797eab0e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:40.451578 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62071341-faa1-4137-8b28-bc8797eab0e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1278 microversion: 2.54 time: 0.102089 Oct 19 07:13:40.452838 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2516/4892] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:40 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1278 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:40.459669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:40.461181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:40.468862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:40.469727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:40.470459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:40.471549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:40.472314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:40.473597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:40.702924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:40.742722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:40.749204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:40.754356 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3bc3d0ad-3e2d-4fe6-a515-289f027ba353 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 1.427007 Oct 19 07:13:40.756501 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2377/4893] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:39 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:40.782934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:40.802850 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b9cdc8c-b70c-4229-90ac-d0bab4b15edc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.348469 Oct 19 07:13:40.811003 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2517/4894] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:40 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:41.000247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:41.000866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:41.015467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dcd086d7-9105-4e9b-a1b5-f339a0f588e5 req-6460c6f8-a989-4c70-ae19-9e4f14ecb623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-plugged", "status": "completed", "tag": "e754f01c-edd6-408f-8951-5fa1db8035bf"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:41.020238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:41.022096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:41.023146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:41.031620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:41.032150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:41.032611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:41.049024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dcd086d7-9105-4e9b-a1b5-f339a0f588e5 req-6460c6f8-a989-4c70-ae19-9e4f14ecb623 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:41.049875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dcd086d7-9105-4e9b-a1b5-f339a0f588e5 req-6460c6f8-a989-4c70-ae19-9e4f14ecb623 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:41.051828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dcd086d7-9105-4e9b-a1b5-f339a0f588e5 req-6460c6f8-a989-4c70-ae19-9e4f14ecb623 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:41.092414 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dcd086d7-9105-4e9b-a1b5-f339a0f588e5 req-6460c6f8-a989-4c70-ae19-9e4f14ecb623 service nova] Creating event network-vif-plugged:e754f01c-edd6-408f-8951-5fa1db8035bf for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:13:41.104673 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dcd086d7-9105-4e9b-a1b5-f339a0f588e5 req-6460c6f8-a989-4c70-ae19-9e4f14ecb623 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093112 Oct 19 07:13:41.108430 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2518/4895] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:13:41.366987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:41.377175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:41.379632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:41.383258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:41.390619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:41.391451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:41.391899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:41.392569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:41.393476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:41.394621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:41.395234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:41.396244 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76428189-6ca1-4e3b-bc04-90e33a55f6b7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.400522 Oct 19 07:13:41.396836 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2378/4896] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:40 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:41.473459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6ed65575-53dd-4aaa-956a-1b4ced9b6a14 req-2b4ae60a-9cf2-4a48-b03e-c2d05bb4a755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec", "tag": "ff22df55-c130-473b-8800-2e8f07c431e0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:41.496861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6ed65575-53dd-4aaa-956a-1b4ced9b6a14 req-2b4ae60a-9cf2-4a48-b03e-c2d05bb4a755 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:41.497394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6ed65575-53dd-4aaa-956a-1b4ced9b6a14 req-2b4ae60a-9cf2-4a48-b03e-c2d05bb4a755 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:41.505603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6ed65575-53dd-4aaa-956a-1b4ced9b6a14 req-2b4ae60a-9cf2-4a48-b03e-c2d05bb4a755 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:41.568660 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6ed65575-53dd-4aaa-956a-1b4ced9b6a14 req-2b4ae60a-9cf2-4a48-b03e-c2d05bb4a755 service nova] Creating event network-changed:ff22df55-c130-473b-8800-2e8f07c431e0 for instance 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec on n-h2-861333-10 Oct 19 07:13:41.581805 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6ed65575-53dd-4aaa-956a-1b4ced9b6a14 req-2b4ae60a-9cf2-4a48-b03e-c2d05bb4a755 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107672 Oct 19 07:13:41.582910 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2379/4897] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:41.595018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0338a61-4035-4a7a-9aae-854333699bb0 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:41.601304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0338a61-4035-4a7a-9aae-854333699bb0 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:41.761788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0338a61-4035-4a7a-9aae-854333699bb0 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:41.770319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0338a61-4035-4a7a-9aae-854333699bb0 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:41.778577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0338a61-4035-4a7a-9aae-854333699bb0 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:41.780202 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0338a61-4035-4a7a-9aae-854333699bb0 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1278 microversion: 2.54 time: 0.195868 Oct 19 07:13:41.782286 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2380/4898] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:41 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:41.798338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:41.805854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:41.826080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:41.826947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:41.827571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:41.843002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:41.846220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:41.849325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:42.131227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:42.142488 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7cda7008-bb56-4955-80a9-b02716624ee8 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.772233 Oct 19 07:13:42.143919 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2519/4899] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:41 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:13:42.152575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:42.153747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:42.161283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:42.162257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:42.165510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:42.168239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:42.169046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:42.169666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:42.607062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:42.635589 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac3c8d5e-6859-4d73-9284-edca5dd4c503 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.489551 Oct 19 07:13:42.636233 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2520/4900] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:42 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:42.640188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:42.655325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:42.655550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:42.655936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:42.662720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:42.664300 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ec531ae-b230-4dc7-a406-e108ef47833d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.871261 Oct 19 07:13:42.665026 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2381/4901] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:41 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:42.679783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:42.692669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:42.694007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:42.694791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:42.695272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:42.695721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:42.813199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:42.813834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:42.825739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:42.830176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:42.830176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:42.831862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:42.834048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:42.834535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:42.960634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:42.982647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:42.986625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:42.988784 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da73b49b-fbbc-4962-b186-979348c90c75 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1330 microversion: 2.54 time: 0.179826 Oct 19 07:13:42.989979 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2382/4902] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:42 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1330 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:43.172092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:43.172751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:43.217028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:43.217689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:43.218574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:43.220611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:43.222956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:43.228149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:43.487369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:43.502689 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ebab3d22-4abe-44b8-b094-e28493ae69bf tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.335558 Oct 19 07:13:43.503546 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2383/4903] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:43 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:43.520837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-57ae06c7-ef2f-4f3a-9db0-21e588b8e69b req-1c0034ad-398e-451a-ad46-7b4e9497bd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-plugged", "status": "completed", "tag": "8f1e6341-a749-49f3-847c-932b07769041"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:43.542685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57ae06c7-ef2f-4f3a-9db0-21e588b8e69b req-1c0034ad-398e-451a-ad46-7b4e9497bd25 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:43.545794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57ae06c7-ef2f-4f3a-9db0-21e588b8e69b req-1c0034ad-398e-451a-ad46-7b4e9497bd25 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:43.546180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57ae06c7-ef2f-4f3a-9db0-21e588b8e69b req-1c0034ad-398e-451a-ad46-7b4e9497bd25 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:43.575777 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-57ae06c7-ef2f-4f3a-9db0-21e588b8e69b req-1c0034ad-398e-451a-ad46-7b4e9497bd25 service nova] Creating event network-vif-plugged:8f1e6341-a749-49f3-847c-932b07769041 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:13:43.605547 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-57ae06c7-ef2f-4f3a-9db0-21e588b8e69b req-1c0034ad-398e-451a-ad46-7b4e9497bd25 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099016 Oct 19 07:13:43.609232 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2384/4904] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:43.680568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:43.686757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:43.698022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:43.701526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:43.702216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:43.705435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:43.708620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:43.709729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:44.334260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:44.351952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:44.357192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:44.358781 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4455074-0cfd-472d-a5fa-48a9643c8cb5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 1.721566 Oct 19 07:13:44.360847 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2521/4905] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:42 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:44.362192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:44.370756 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a6e765f-875c-4fea-b706-13f20449a5f4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.700577 Oct 19 07:13:44.371401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:44.372140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:44.380370 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2385/4906] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:43 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:44.385691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:44.387944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:44.394376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:44.399374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:44.402101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:44.402925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:44.403326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:44.403693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:44.404020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:44.404193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:44.404687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:44.405636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:44.408805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:44.409376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:44.566326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:44.581521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:44.583922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:44.588635 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d63843b5-23d6-4892-8d33-f95da3c76dfb tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1336 microversion: 2.54 time: 0.206859 Oct 19 07:13:44.615702 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2386/4907] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:44 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1336 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:44.623128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:44.631782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:44.645167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:44.645843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:44.646387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:44.647355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:44.648016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:44.656015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:45.140587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.152000 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e21e251-84ff-40b9-831d-2cd24810819d tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.534759 Oct 19 07:13:45.164684 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2387/4908] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:44 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:45.372265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.388185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:45.398150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:45.410564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.412718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:45.415314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:45.418499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:45.420963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:45.424363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:45.427341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:45.431841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.433246 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3a20245-145a-4fe3-a260-51c03f49b650 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 1.071023 Oct 19 07:13:45.436044 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2522/4909] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:44 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:45.469167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:45.469167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:45.493475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:45.496170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:45.496170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:45.496170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:45.496170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:45.496170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:45.767811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.785007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.786892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.788228 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffef757d-f710-47e2-876f-a54c23a0a570 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.404331 Oct 19 07:13:45.806780 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2388/4910] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:45 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:45.813278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:45.814184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:45.822223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:45.822978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:45.823638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:45.825512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:45.826176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:45.826801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:45.930833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.940193 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b074befd-ef7a-4d8e-9b8c-caa1e47afac1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.503041 Oct 19 07:13:45.957398 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2523/4911] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:45 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:45.963387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4969b0f3-f6fa-4067-8eca-31bdc7ab7844 req-8094817c-bf35-4b00-9177-2f6bc93c5e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-plugged", "status": "completed", "tag": "f840ba10-b994-4ab6-b88b-ec09ca983e2d"}, {"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-plugged", "status": "completed", "tag": "6a1b1b75-b22e-47ca-8550-ad04ec27f870"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:45.974929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.975143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4969b0f3-f6fa-4067-8eca-31bdc7ab7844 req-8094817c-bf35-4b00-9177-2f6bc93c5e17 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:45.975143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4969b0f3-f6fa-4067-8eca-31bdc7ab7844 req-8094817c-bf35-4b00-9177-2f6bc93c5e17 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:45.975847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4969b0f3-f6fa-4067-8eca-31bdc7ab7844 req-8094817c-bf35-4b00-9177-2f6bc93c5e17 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:45.980987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.982473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:45.993519 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4969b0f3-f6fa-4067-8eca-31bdc7ab7844 req-8094817c-bf35-4b00-9177-2f6bc93c5e17 service nova] Creating event network-vif-plugged:f840ba10-b994-4ab6-b88b-ec09ca983e2d for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:13:45.994326 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4969b0f3-f6fa-4067-8eca-31bdc7ab7844 req-8094817c-bf35-4b00-9177-2f6bc93c5e17 service nova] Creating event network-vif-plugged:6a1b1b75-b22e-47ca-8550-ad04ec27f870 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:13:45.994468 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6451008-23b0-44cb-b39b-8e524fdf46e4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1336 microversion: 2.54 time: 0.185992 Oct 19 07:13:45.994962 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2389/4912] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:45 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1336 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:46.008759 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4969b0f3-f6fa-4067-8eca-31bdc7ab7844 req-8094817c-bf35-4b00-9177-2f6bc93c5e17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049627 Oct 19 07:13:46.010652 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2524/4913] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:46.174886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:46.175494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:46.187333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:46.187833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:46.191125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:46.193553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:46.194042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:46.194484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:46.480293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:46.483436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:46.524176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:46.530249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:46.530923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:46.531808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:46.532441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:46.538882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:46.711847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:46.727164 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a1e9b90-ff7d-4d8b-90c1-70387c7d9833 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.555913 Oct 19 07:13:46.744763 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2390/4914] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:46 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:46.814339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:46.815177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:46.837207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:46.841707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:46.841707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:46.843508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:46.846205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:46.848375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:46.866011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:47.137055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.147444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.149325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.153482 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-351a1432-dbbe-4194-99c9-fb9276e26f61 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.689045 Oct 19 07:13:47.172597 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2525/4915] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:46 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:47.186421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:47.187870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:47.196010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:47.196973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:47.197668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:47.198721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:47.199639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:47.201611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:47.379072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.393390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.395386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.396621 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04d569bc-4ff8-418b-ac52-58bd030e2b35 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.586404 Oct 19 07:13:47.397180 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2391/4916] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:46 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:47.433515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:47.434155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:47.446026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:47.446741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:47.447259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:47.448272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:47.449259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:47.449703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:47.510711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.519889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.525685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37eb652d-a92a-4bec-908a-6c8df193f43e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.349529 Oct 19 07:13:47.528401 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2526/4917] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:47 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:47.529408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.530928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:47.532084 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94308ca9-6306-49cc-bd60-56fee37148f2 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1357 microversion: 2.54 time: 0.112406 Oct 19 07:13:47.532805 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2392/4918] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:47 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1357 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:47.560716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce3bcd56-0989-400b-bec9-adfdaba85bab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Action: 'create', calling method: .version_select at 0x7f6d5fba9790>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1983308556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIltcz1vSvCzv3i5TVmr8HR+f/TEyVe+86gJiCdr/Ad6eFn2QYVwuMBvC/NWU7xHQ18WKelbOOLftCsm5ucz6y3J9bWYi2MsLEMJLUq7Xen6yyR10bJ1oL9KzRg+CKQ7KA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:47.578716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ce3bcd56-0989-400b-bec9-adfdaba85bab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Getting quotas for project 0cb76d21ff784e3bac760ff67476885d. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:13:47.584652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ce3bcd56-0989-400b-bec9-adfdaba85bab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Getting quotas for user a5596bde56454db7a3aa0a62cd1ae403 and project 0cb76d21ff784e3bac760ff67476885d. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:13:47.691102 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce3bcd56-0989-400b-bec9-adfdaba85bab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.134447 Oct 19 07:13:47.695524 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2527/4919] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 07:13:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 07:13:47.710180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1983308556", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:47.713224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:47.728259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:47.728767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:47.729206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:47.729919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:47.730380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:47.730801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:47.750735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:47.753122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:47.775760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:47.782070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:47.786346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:47.787793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:47.791974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:47.794674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.015160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:13:48.015588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:13:48.016060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:13:48.028516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:13:48.028516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:13:48.132865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:48.141924 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-633a095f-9565-4c2c-9f52-dedffb3c942a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.394961 Oct 19 07:13:48.142513 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2528/4920] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:47 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:13:48.188931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:48.195478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:48.202143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.204092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.204806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.205739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.206399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.207079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.419461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:48.451159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.452069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.455058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.456092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.457105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.458399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.501750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:48.518748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:48.518748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:48.518748 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2d8e778-48f4-4897-97fc-3ebd3a99f396 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.333681 Oct 19 07:13:48.527591 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fdd68dfb-07a4-4e1e-b3ec-54c0c0350971 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "POST /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e/action" status: 202 len: 1140 microversion: 2.54 time: 0.826751 Oct 19 07:13:48.536706 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2393/4921] 10.222.0.39 () {62 vars in 1320 bytes} [Wed Oct 19 07:13:47 2022] POST /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e/action => generated 1140 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 07:13:48.543212 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2529/4922] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:48 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:48.555693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c6b6af2e-8a88-4512-8190-0d954ed0bc76 req-8bfdac69-0120-4aed-aa3a-c1b6bfbdfa30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-plugged", "status": "completed", "tag": "8169c873-b7ef-442f-9bf4-1f5ee358ef12"}, {"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-plugged", "status": "completed", "tag": "da6715c6-0860-4ad4-9f15-4e0ca617cde0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:48.558799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:48.565801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:48.575287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.579606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.582478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.584279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.586436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.586436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.607672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c6b6af2e-8a88-4512-8190-0d954ed0bc76 req-8bfdac69-0120-4aed-aa3a-c1b6bfbdfa30 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.610851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c6b6af2e-8a88-4512-8190-0d954ed0bc76 req-8bfdac69-0120-4aed-aa3a-c1b6bfbdfa30 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.615267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c6b6af2e-8a88-4512-8190-0d954ed0bc76 req-8bfdac69-0120-4aed-aa3a-c1b6bfbdfa30 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.644329 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c6b6af2e-8a88-4512-8190-0d954ed0bc76 req-8bfdac69-0120-4aed-aa3a-c1b6bfbdfa30 service nova] Creating event network-vif-plugged:8169c873-b7ef-442f-9bf4-1f5ee358ef12 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:13:48.645169 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c6b6af2e-8a88-4512-8190-0d954ed0bc76 req-8bfdac69-0120-4aed-aa3a-c1b6bfbdfa30 service nova] Creating event network-vif-plugged:da6715c6-0860-4ad4-9f15-4e0ca617cde0 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:13:48.653810 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c6b6af2e-8a88-4512-8190-0d954ed0bc76 req-8bfdac69-0120-4aed-aa3a-c1b6bfbdfa30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104496 Oct 19 07:13:48.653810 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2394/4923] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:48.659284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:48.661141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:48.672028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.672663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.673283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.674793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.675278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.676309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.841122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:48.855018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:48.856741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:48.858626 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc784ef7-3ec3-417d-aa58-c81572c94be0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.305994 Oct 19 07:13:48.859340 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2530/4924] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:48 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:48.876760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:48.885919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:48.885919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.885919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.886667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:48.887955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:48.888796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:48.889538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:49.001077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:49.013709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:49.015463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:49.016967 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12235e4c-8688-424a-a5f9-50504c713704 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.156450 Oct 19 07:13:49.017791 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2531/4925] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:48 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:49.093859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:49.104516 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c06a31c9-da9f-43a4-a27d-bbbfa5a17655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.449792 Oct 19 07:13:49.105105 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2395/4926] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:48 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:49.170385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:49.171006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:49.185559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:49.185973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:49.186417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:49.190311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:49.190855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:49.191863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:49.354554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:49.439996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:49.448548 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-118edcd0-a2d9-4f46-9c6a-4e9162143bb5 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.285360 Oct 19 07:13:49.452302 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2532/4927] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:49 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:49.559700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:49.560509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:49.568490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:49.569606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:49.573000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:49.573000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:49.573000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:49.573000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:49.802773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:49.812331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:49.813801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:49.814963 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b42df3df-6f39-4c0a-85ce-45b95bdd8cad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.261203 Oct 19 07:13:49.815662 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2396/4928] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:49 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:49.888303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:49.889651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:49.901564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:49.901564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:49.901564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:49.901564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:49.901564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:49.901564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.044048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:50.044767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:50.051528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:50.052017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:50.055594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.055594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:50.055594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:50.056322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.111413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:50.121821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:50.121821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:50.126827 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-577888ec-301d-4726-8530-a565bcafab2f tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1739 microversion: 2.20 time: 0.239348 Oct 19 07:13:50.126827 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2533/4929] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:49 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:50.127211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:50.136376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:50.137945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:50.139332 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-78e2e092-405c-4a13-919a-5d85409ece8a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.099358 Oct 19 07:13:50.140345 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2397/4930] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:50 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:50.144311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:50.145012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:50.151863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:50.152893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:50.153678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.154464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:50.154991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:50.155485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.373189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:50.390358 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac230645-1ffd-4d2c-9ac1-e129c626bdd0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.265519 Oct 19 07:13:50.392454 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2534/4931] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:50 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:50.471978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:50.474169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:50.476679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:50.484353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:50.484353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:50.484652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.485263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:50.485681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:50.496313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.723182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9f2a84bb-9819-4637-b535-ea00fdb64e08 req-07c09bc0-1d5b-4ddf-808a-d2089de84630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-plugged", "status": "completed", "tag": "44ef26f9-7bb0-4762-a463-7946d2663176"}, {"server_uuid": "2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec", "name": "network-vif-plugged", "status": "completed", "tag": "ff22df55-c130-473b-8800-2e8f07c431e0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:50.737113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9f2a84bb-9819-4637-b535-ea00fdb64e08 req-07c09bc0-1d5b-4ddf-808a-d2089de84630 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:50.737921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9f2a84bb-9819-4637-b535-ea00fdb64e08 req-07c09bc0-1d5b-4ddf-808a-d2089de84630 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:50.738883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9f2a84bb-9819-4637-b535-ea00fdb64e08 req-07c09bc0-1d5b-4ddf-808a-d2089de84630 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.744134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:50.767754 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9f2a84bb-9819-4637-b535-ea00fdb64e08 req-07c09bc0-1d5b-4ddf-808a-d2089de84630 service nova] Creating event network-vif-plugged:44ef26f9-7bb0-4762-a463-7946d2663176 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:13:50.767754 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9f2a84bb-9819-4637-b535-ea00fdb64e08 req-07c09bc0-1d5b-4ddf-808a-d2089de84630 service nova] Creating event network-vif-plugged:ff22df55-c130-473b-8800-2e8f07c431e0 for instance 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec on n-h2-861333-10 Oct 19 07:13:50.775165 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9f2a84bb-9819-4637-b535-ea00fdb64e08 req-07c09bc0-1d5b-4ddf-808a-d2089de84630 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055553 Oct 19 07:13:50.776827 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2535/4932] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:13:50.845171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:50.848248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:50.857758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:50.862730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:50.867364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:50.871688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:50.877807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.877807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:50.877807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:50.877807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:50.880135 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b4b50a2-c5f1-473b-89ea-de1c90780080 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.410563 Oct 19 07:13:50.880746 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2398/4933] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:50 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:51.149888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:51.152137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:51.160274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:51.161030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:51.161728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:51.162821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:51.163503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:51.164199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:51.170061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.183357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.185061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.186562 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7ba8549-d906-4db1-bfee-48ef95ac2162 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.347752 Oct 19 07:13:51.187291 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2536/4934] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:50 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:51.198691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:51.199968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:51.206895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:51.207629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:51.209438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:51.210480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:51.211115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:51.211718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:51.301341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.310075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.311553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.312874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-541b36ac-4df1-4a3d-a6ae-a96a3f6f4ca5 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.123629 Oct 19 07:13:51.313448 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2537/4935] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:51 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:51.416865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:51.417505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:51.423812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:51.428858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:51.428858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:51.428858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:51.428858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:51.428858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:51.573673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.582151 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c1d3961-9794-4432-9cd2-50bcc307b244 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.169163 Oct 19 07:13:51.582825 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2538/4936] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:51 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:13:51.765857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:51.783455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.792863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.794426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:51.795744 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2056f3b7-230f-4bc0-9b26-2a3d7f928ba5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1721 microversion: 2.20 time: 0.650069 Oct 19 07:13:51.808349 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2399/4937] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:51 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1721 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:51.903825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:51.904599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:51.911136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:51.911699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:51.912235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:51.912998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:51.913526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:51.914018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:52.062930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:52.073565 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4058a6c4-4824-4801-beb9-6e5e09bc99c9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1375 microversion: 2.1 time: 0.173782 Oct 19 07:13:52.074832 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2539/4938] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:51 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:52.217996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:52.218602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:52.226471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:52.226974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:52.227597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:52.228527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:52.229161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:52.229904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:52.354167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:52.357259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:52.391002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:52.396523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:52.396523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:52.396523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:52.397732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:52.398741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:52.686345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:52.701482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:52.704394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:52.707247 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1764aa3-3374-4500-8837-2ac1117a9d9d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1879 microversion: 2.32 time: 0.493054 Oct 19 07:13:52.708767 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2400/4939] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:52 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1879 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:52.713524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:52.718766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:52.720512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:52.724665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:52.726381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:52.728246 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fbfadc27-6f00-4cc0-b297-3f2c93a1d4ee tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.391452 Oct 19 07:13:52.737762 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2540/4940] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:52 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:52.738577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:52.738577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:52.738577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:52.738909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:52.739224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:52.740321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:52.828653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:52.829797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:52.837052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:52.837824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:52.841560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:52.842779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:52.843420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:52.844026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:52.960490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:52.974029 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c859720-f997-48b4-b728-a0258ee25d1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.259899 Oct 19 07:13:52.974029 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2401/4941] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:52 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:53.099194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:53.100298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:53.109660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:53.110219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:53.110657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:53.111369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:53.111825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:53.112283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:53.210038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:53.219662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:53.226819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:53.228383 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3f717fb-874d-4a5f-b7c0-0535118b155b tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1721 microversion: 2.20 time: 0.405048 Oct 19 07:13:53.230887 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2541/4942] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:52 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1721 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:53.281014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c2fa74af-f8af-4767-bd95-3afa33980c45 req-6ead070b-3505-4020-8be9-18493e8eb5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a4daae-6c1a-4174-a294-85466495b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "c784c077-e373-459c-a2b3-896b21d78fbc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:53.292468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c2fa74af-f8af-4767-bd95-3afa33980c45 req-6ead070b-3505-4020-8be9-18493e8eb5ce service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:53.293211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c2fa74af-f8af-4767-bd95-3afa33980c45 req-6ead070b-3505-4020-8be9-18493e8eb5ce service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:53.294197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c2fa74af-f8af-4767-bd95-3afa33980c45 req-6ead070b-3505-4020-8be9-18493e8eb5ce service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:53.308042 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c2fa74af-f8af-4767-bd95-3afa33980c45 req-6ead070b-3505-4020-8be9-18493e8eb5ce service nova] Creating event network-vif-unplugged:c784c077-e373-459c-a2b3-896b21d78fbc for instance 59a4daae-6c1a-4174-a294-85466495b6c1 on n-h2-861333-10 Oct 19 07:13:53.311265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:53.315085 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c2fa74af-f8af-4767-bd95-3afa33980c45 req-6ead070b-3505-4020-8be9-18493e8eb5ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037945 Oct 19 07:13:53.315935 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2542/4943] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:13:53.321365 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6118700-aaa2-466b-ac0d-6b05f7b8e222 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1547 microversion: 2.1 time: 0.227642 Oct 19 07:13:53.321990 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2402/4944] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:53 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1547 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:13:53.344522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:53.347145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:53.352576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:53.353011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:53.353461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:53.354204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:53.354782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:53.355037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:53.563970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:53.575443 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b019c8ce-e6e3-4dc6-927d-0dc1bbaf964e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1547 microversion: 2.1 time: 0.235020 Oct 19 07:13:53.576320 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2543/4945] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:53 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1547 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:53.736653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:53.737423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:53.744286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:53.744784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:53.745226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:53.745938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:53.746416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:53.746833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:53.766701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:53.768092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:53.776955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:53.777817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:53.778914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:53.779866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:53.780610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:53.781461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:53.867519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:53.876866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:53.879274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:53.880766 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af6e6498-e5af-4d6b-8ffa-0056f543c784 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.119749 Oct 19 07:13:53.881333 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2544/4946] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:53 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:53.995757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:53.996398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:54.003162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:54.018367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:54.018367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:54.018367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:54.018367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:54.018367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:54.033535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:54.048826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:54.051298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:54.053741 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-78156e34-2f82-4d35-93f0-28dd96228047 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2831 microversion: 2.32 time: 0.321861 Oct 19 07:13:54.055397 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2403/4947] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:53 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2831 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:54.087688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0177200f-3bf8-4ac7-a068-5ed8a6234bb2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:54.088365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0177200f-3bf8-4ac7-a068-5ed8a6234bb2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:54.099723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0177200f-3bf8-4ac7-a068-5ed8a6234bb2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:54.100978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0177200f-3bf8-4ac7-a068-5ed8a6234bb2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:54.102044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0177200f-3bf8-4ac7-a068-5ed8a6234bb2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:54.103131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0177200f-3bf8-4ac7-a068-5ed8a6234bb2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:54.120463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0177200f-3bf8-4ac7-a068-5ed8a6234bb2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:54.121171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0177200f-3bf8-4ac7-a068-5ed8a6234bb2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:54.248923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:54.258914 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38673239-4958-405a-b5f1-78a8bd372c49 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.268097 Oct 19 07:13:54.260085 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2545/4948] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:53 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:54.274394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:54.274394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:54.292189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:54.293117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:54.293823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:54.294829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:54.297920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:54.298649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:54.348082 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0177200f-3bf8-4ac7-a068-5ed8a6234bb2 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.269185 Oct 19 07:13:54.348705 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2404/4949] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Oct 19 07:13:54 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd/os-interface => generated 1831 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:54.560766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:54.574843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:54.576978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:54.583047 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-221de11f-306b-4146-8835-8000daa8ea9a tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1721 microversion: 2.20 time: 0.317026 Oct 19 07:13:54.584077 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2546/4950] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:54 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:54.909115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:54.910854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:54.920272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:54.921151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:54.921945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:54.923297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:54.938861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:54.939286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:55.072259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:55.113703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:55.130300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:55.133861 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aaf9fa57-7ca4-4561-a5c5-a3be3c2b9acc tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.228706 Oct 19 07:13:55.134709 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2405/4951] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:54 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:55.298118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:55.298781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:55.320049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:55.335992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:55.336649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:55.337279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:55.337765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:55.342404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:55.626329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:55.630426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:55.633850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:55.641872 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a2f7985-7c15-4462-bd6c-6500eda687d5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.359889 Oct 19 07:13:55.642449 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2547/4952] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:55 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:55.643141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:55.643841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:55.644574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:55.645811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:55.646442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:55.647039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:55.697769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:13:55.881268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-83713562", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "9dc3cbbe-4324-40d6-ad14-95650bab5aaa"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:55.977332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] validate_networks() for [('9dc3cbbe-4324-40d6-ad14-95650bab5aaa', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:13:56.592524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:56.603324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:56.604808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:56.606158 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6137e6ad-807f-4cb1-bd42-9fe47e3d4ad6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1724 microversion: 2.20 time: 1.000773 Oct 19 07:13:56.606656 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2406/4953] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:55 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1724 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:13:56.617374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:56.629260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:56.637664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:56.638866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:56.639312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:56.640048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:56.640582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:56.641017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:56.806905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:56.834145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:56.836045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:56.837316 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c7a73f5-35be-450f-ac44-2251a19fc872 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.224041 Oct 19 07:13:56.838353 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2407/4954] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:56 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:56.843223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5aacee0-30a9-4e66-bde3-937e12e37a3d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "961d6e03-3d80-411e-aa5e-1ceeb2b240e5"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:56.845675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5aacee0-30a9-4e66-bde3-937e12e37a3d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:56.864084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aacee0-30a9-4e66-bde3-937e12e37a3d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:56.864614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aacee0-30a9-4e66-bde3-937e12e37a3d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:56.865059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aacee0-30a9-4e66-bde3-937e12e37a3d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:56.870075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aacee0-30a9-4e66-bde3-937e12e37a3d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:56.870777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aacee0-30a9-4e66-bde3-937e12e37a3d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:56.879411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aacee0-30a9-4e66-bde3-937e12e37a3d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:57.118943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:13:57.120146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:13:57.120919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:13:57.121576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:13:57.122217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:13:57.139702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:57.140920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:57.142324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:57.144593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:57.145363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:57.146165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:57.202891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Getting quotas for project a96a38d28c9845c88887a3f516ff0d80. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:13:57.212703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Getting quotas for user 562021351b1344f09a097f912dcef7c2 and project a96a38d28c9845c88887a3f516ff0d80. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:13:57.241247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:13:57.248965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:13:57.394591 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0066078-2a14-4e39-ba2f-2c3dc3329c7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.713664 Oct 19 07:13:57.406134 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2548/4955] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:13:57.414154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:57.431645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:57.478836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:57.480276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:57.484462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:57.485539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:57.486146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:57.486599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:57.960156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:57.986301 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94b99333-c3df-452d-89fd-83af680bee23 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.574158 Oct 19 07:13:57.986958 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2549/4956] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:57 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:58.026323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab8d5fca-c25e-4689-8237-aa736e590ba0 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:58.026323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab8d5fca-c25e-4689-8237-aa736e590ba0 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:58.179674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab8d5fca-c25e-4689-8237-aa736e590ba0 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:58.188466 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab8d5fca-c25e-4689-8237-aa736e590ba0 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1212 microversion: 2.1 time: 0.200164 Oct 19 07:13:58.189458 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2550/4957] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:57 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1212 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:58.195580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:58.196574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:58.197186 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5aacee0-30a9-4e66-bde3-937e12e37a3d tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.357622 Oct 19 07:13:58.199080 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2408/4958] 10.222.0.39 () {62 vars in 1364 bytes} [Wed Oct 19 07:13:56 2022] POST /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/os-volume_attachments => generated 188 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:13:58.204054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9a34d5bc-597c-4908-aa30-af4191da8d06 req-345db9be-4228-4def-aa7f-e32134ee8bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "tag": "8f1e6341-a749-49f3-847c-932b07769041"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:58.217486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:58.219935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:58.220971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:58.221984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:58.229213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:58.234697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:58.234827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9a34d5bc-597c-4908-aa30-af4191da8d06 req-345db9be-4228-4def-aa7f-e32134ee8bb4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:58.236301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9a34d5bc-597c-4908-aa30-af4191da8d06 req-345db9be-4228-4def-aa7f-e32134ee8bb4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:58.237068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9a34d5bc-597c-4908-aa30-af4191da8d06 req-345db9be-4228-4def-aa7f-e32134ee8bb4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:58.254098 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9a34d5bc-597c-4908-aa30-af4191da8d06 req-345db9be-4228-4def-aa7f-e32134ee8bb4 service nova] Creating event network-changed:8f1e6341-a749-49f3-847c-932b07769041 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:13:58.260934 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9a34d5bc-597c-4908-aa30-af4191da8d06 req-345db9be-4228-4def-aa7f-e32134ee8bb4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060272 Oct 19 07:13:58.263252 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2409/4959] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:13:58.393695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:58.405566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:58.410440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:58.414614 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f641a562-25aa-4ca0-90e8-f940756f2efe tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.221083 Oct 19 07:13:58.415438 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2551/4960] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:58 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:13:58.543115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d6a08a2-9a59-4847-89b4-45ae00a27463 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:58.543748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3d6a08a2-9a59-4847-89b4-45ae00a27463 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:58.556812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d6a08a2-9a59-4847-89b4-45ae00a27463 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:58.558273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d6a08a2-9a59-4847-89b4-45ae00a27463 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:58.560899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d6a08a2-9a59-4847-89b4-45ae00a27463 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:58.562014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d6a08a2-9a59-4847-89b4-45ae00a27463 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:58.562665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d6a08a2-9a59-4847-89b4-45ae00a27463 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:58.564640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d6a08a2-9a59-4847-89b4-45ae00a27463 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:59.016122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:59.018904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:59.028212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:59.030638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:59.030638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:59.030638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:59.031856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:59.032432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:59.380855 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d6a08a2-9a59-4847-89b4-45ae00a27463 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "DELETE /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/os-volume_attachments/961d6e03-3d80-411e-aa5e-1ceeb2b240e5" status: 202 len: 0 microversion: 2.20 time: 0.842645 Oct 19 07:13:59.381522 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2410/4961] 10.222.0.39 () {60 vars in 1457 bytes} [Wed Oct 19 07:13:58 2022] DELETE /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/os-volume_attachments/961d6e03-3d80-411e-aa5e-1ceeb2b240e5 => generated 0 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:13:59.387069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:59.389383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:59.407496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:59.408194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:59.409155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:59.410546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:59.412584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:59.422664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:59.618491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:59.632905 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-881e7656-7bdb-4530-a868-8e24fd2d9efe tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1216 microversion: 2.1 time: 0.249969 Oct 19 07:13:59.633392 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2411/4962] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:59 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:59.660113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:13:59.662017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:59.679239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:59.679743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:59.680204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:59.683405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:59.683931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:59.686576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:59.723210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:13:59.744557 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5f7fcde-d327-48f0-9b1c-50780a885e82 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.727428 Oct 19 07:13:59.746919 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2552/4963] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:13:59 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:13:59.777406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:13:59.781302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:13:59.812980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:59.816300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:59.818779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:59.822042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:13:59.825534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:13:59.826257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:13:59.941804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 07:14:00.144859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:00.156903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:00.163848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:00.185604 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4192654-13bf-41d0-a38a-6c6e4a8ab93a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.537674 Oct 19 07:14:00.190517 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2412/4964] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:13:59 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:00.244953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:00.434320 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d28ba2b-6c6e-47f1-9482-67961bb017ff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "POST /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/action" status: 202 len: 0 microversion: 2.20 time: 0.677598 Oct 19 07:14:00.436571 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2553/4965] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 07:13:59 2022] POST /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:14:00.449225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:00.449985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:00.459103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:00.462102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:00.464690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:00.465798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:00.469837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:00.470683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:00.664047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:00.664977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:00.680166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:00.681045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:00.682314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:00.683317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:00.684381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:00.685396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:00.773595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:00.784508 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-577b97c1-d0ff-4a78-a3a8-59de6adc698e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1208 microversion: 2.1 time: 0.127561 Oct 19 07:14:00.795116 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2554/4966] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:00 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1208 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:00.807534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:00.808203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:00.831180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:00.831696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:00.832713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:00.838425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:00.838941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:00.839631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:01.022887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:01.034051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:01.042764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:01.044383 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9adf1508-090e-4fcc-b70c-2693ec4aa61c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1672 microversion: 2.20 time: 0.601994 Oct 19 07:14:01.060427 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2413/4967] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:00 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1672 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:01.127070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:01.142543 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f79e4f8a-32ae-4867-83c0-5480f9ebf3f1 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.346201 Oct 19 07:14:01.143154 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2555/4968] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:00 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:01.221060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:01.221675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:01.246552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:01.246871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:01.247247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:01.247974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:01.254622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:01.254622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:01.437274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:01.467307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:01.480255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:01.487736 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91943b7e-ad0b-4d4d-b0c2-fb85edca0101 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.264524 Oct 19 07:14:01.487736 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2414/4969] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:01 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:01.810592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:01.812082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:01.825943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:01.826526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:01.827066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:01.827836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:01.828345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:01.828791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:02.032898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:02.049548 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5bc67041-6357-40c9-adec-c87c096a5c04 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1272 microversion: 2.1 time: 0.242925 Oct 19 07:14:02.050665 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2556/4970] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:01 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:02.075835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:02.076839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:02.084356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:02.085194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:02.085898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:02.086850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:02.087539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:02.088294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:02.169263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:02.170479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:02.182217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:02.186180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:02.187081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:02.188080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:02.189615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:02.190637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:02.563387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:02.588347 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4da208a-5a1f-4b44-b96f-2176c7e1d2f5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.423130 Oct 19 07:14:02.591087 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2557/4971] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:02 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:02.597126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:02.598029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:02.604763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:02.605456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:02.609639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:02.609781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:02.610246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:02.610246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:02.610246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:02.617235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:02.618777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:02.620294 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a717ef9-2b53-4887-9d2e-a4ea3ca1c908 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1672 microversion: 2.20 time: 0.548765 Oct 19 07:14:02.621381 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2415/4972] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:02 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1672 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:02.907403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:02.922200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:02.926613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:02.931989 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7bb0714-1dc1-46db-8c83-84c2a4302773 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.338660 Oct 19 07:14:02.933034 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2558/4973] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:02 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:03.081136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:03.081684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:03.091924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:03.096775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:03.098271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:03.099073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:03.099746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:03.100464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:03.198330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:03.207034 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8cfaac4-55a5-4495-b8ad-73bbdeed9cef tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1270 microversion: 2.1 time: 0.131989 Oct 19 07:14:03.208368 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2416/4974] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:03 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1270 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:03.616968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:03.617832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:03.625783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:03.626416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:03.629081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:03.629081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:03.632172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:03.635470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:03.655728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:03.658674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:03.682756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:03.683257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:03.683726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:03.684470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:03.684938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:03.685365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:04.174725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:04.184241 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77d5b8b8-99f1-42e6-9392-55ed8e1f4c69 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.573292 Oct 19 07:14:04.197290 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2559/4975] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:03 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:04.215149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:04.226289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:04.275927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:04.294513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:04.299070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:04.301983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:04.304661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:04.305367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:04.308393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:04.309282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:04.310359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:04.313660 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03bdfda2-5e21-429c-9e88-a39e64a2fe10 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1674 microversion: 2.20 time: 0.669766 Oct 19 07:14:04.317845 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2417/4976] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:03 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1674 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:04.339700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:04.340922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:04.364717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:04.366317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:04.366317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:04.370528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:04.370528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:04.370528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:04.469626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:04.488595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:04.491834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:04.495837 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b16b527c-1c8a-4d95-9833-9c25b963c97a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.296482 Oct 19 07:14:04.498167 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2560/4977] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:04 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:04.998940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:05.003346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:05.050296 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5c4a6b4-9319-480c-9f75-f1a251ffec7e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1312 microversion: 2.1 time: 0.730506 Oct 19 07:14:05.069882 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2418/4978] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:04 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1312 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:05.213313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:05.214924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:05.231571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:05.232985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:05.233900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:05.238914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:05.238914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:05.238914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:05.357394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:05.358451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:05.375838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:05.376641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:05.379524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:05.381492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:05.382986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:05.385587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:05.546396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:05.559547 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f1532a5-7c35-4a17-9fe2-50c295a96214 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1523 microversion: 2.1 time: 0.352130 Oct 19 07:14:05.561513 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2561/4979] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:05 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1523 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:05.579087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:05.580045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:05.594859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:05.595910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:05.596637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:05.598224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:05.598924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:05.599588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:05.697641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:05.701395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:05.709726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:05.711180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:05.712425 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26e3151f-18a3-495a-8ca3-5d44a8edb2ae tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.361184 Oct 19 07:14:05.713520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:05.714527 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2419/4980] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:05 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:05.719494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:05.721871 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-189cd1d8-5b42-4cb4-a41d-e23e07f8b719 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.158095 Oct 19 07:14:05.722474 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2562/4981] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:05 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:05.842387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8b752d79-f78b-4f08-bdbb-e8fa6faef420 req-646feac7-a1df-44ad-a047-034920c1a53e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3f658c-0589-478c-9ebb-48b7b758fa75", "tag": "635eab1c-e230-4131-a461-8e7685ce8ec4"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:05.864053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8b752d79-f78b-4f08-bdbb-e8fa6faef420 req-646feac7-a1df-44ad-a047-034920c1a53e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:05.869873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8b752d79-f78b-4f08-bdbb-e8fa6faef420 req-646feac7-a1df-44ad-a047-034920c1a53e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:05.870439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8b752d79-f78b-4f08-bdbb-e8fa6faef420 req-646feac7-a1df-44ad-a047-034920c1a53e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:05.903750 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8b752d79-f78b-4f08-bdbb-e8fa6faef420 req-646feac7-a1df-44ad-a047-034920c1a53e service nova] Creating event network-changed:635eab1c-e230-4131-a461-8e7685ce8ec4 for instance ff3f658c-0589-478c-9ebb-48b7b758fa75 on n-h2-861333-10 Oct 19 07:14:05.906954 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8b752d79-f78b-4f08-bdbb-e8fa6faef420 req-646feac7-a1df-44ad-a047-034920c1a53e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069561 Oct 19 07:14:05.910072 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2420/4982] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:14:06.078077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:06.078724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:06.094918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:06.095634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:06.096552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:06.097537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:06.098183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:06.098802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:06.578319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:06.594937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:06.602217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:06.614537 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3d8bb57-c32a-47a9-adc6-84853c77658d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1312 microversion: 2.1 time: 0.536628 Oct 19 07:14:06.616248 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2563/4983] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:06 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:06.617963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:06.618462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:06.619105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:06.619824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:06.620323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:06.620751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:06.745212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:06.745845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:06.755781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:06.756333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:06.757073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:06.758029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:06.758736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:06.759332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:06.834030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:06.855103 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7180b199-c378-49c5-85a6-be82614adb89 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1503 microversion: 2.1 time: 0.270458 Oct 19 07:14:06.866817 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2421/4984] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:06 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:06.872306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:06.873799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:06.880054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:06.880828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:06.882031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:06.882903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:06.883656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:06.884540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:06.991087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:07.004382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:07.005848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:07.007517 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-affda623-31f9-45c4-a2f0-d63a5a2c301e tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.139315 Oct 19 07:14:07.025046 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2422/4985] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:06 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:07.025444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:07.025573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:07.025573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:07.034193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:07.036517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:07.037140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:07.037843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:07.038961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:07.039308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:07.039634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:07.040224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:07.040541 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84bc11ac-bb1c-4624-aa4d-6565ffbebce5 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.300963 Oct 19 07:14:07.041113 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2564/4986] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:06 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:07.336158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:07.352899 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5d9cfc5-b813-4b1e-94a2-2381b59ec3d4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1516 microversion: 2.1 time: 0.337488 Oct 19 07:14:07.354326 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2423/4987] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:07 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1516 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:07.380070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf0cb50b-45ab-45c8-8c76-d536453e1960 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:07.382662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf0cb50b-45ab-45c8-8c76-d536453e1960 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: f0db9a75-c2d6-4510-9388-78650e675dfe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:07.395050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:07.409524 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bf0cb50b-45ab-45c8-8c76-d536453e1960 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] HTTP exception thrown: Instance f0db9a75-c2d6-4510-9388-78650e675dfe could not be found. Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf0cb50b-45ab-45c8-8c76-d536453e1960 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Request method failure captured: Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/f0db9a75-c2d6-4510-9388-78650e675dfe/action HTTP/1.1 Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 14 Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6N-tDItijGcBgGmYG_SAGW3_6j9tHcCoWlwSkFCMVsf1kudeF0pMVbw-7Ar3stxV1wyoNkVWZBpQrwGchitozCNiy9vzY_xtbtitbiu3urH95IzS_orWJGtKLy1RiTvb5DBtzVcx3aKRwG1VXq-GLQyimy0EHWlWBFcGoqSf5R8Vcc Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a457b818318a499188fb805286d6c77b Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a457b818318a499188fb805286d6c77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a457b818318a499188fb805286d6c77b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a457b818318a499188fb805286d6c77b Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc1f35324a234df58ec230f0a99454b4 Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: {"rescue": {}} Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance f0db9a75-c2d6-4510-9388-78650e675dfe could not be found. Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'f0db9a75-c2d6-4510-9388-78650e675dfe', 'body': {'rescue': {}}} Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0db9a75-c2d6-4510-9388-78650e675dfe could not be found. Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0db9a75-c2d6-4510-9388-78650e675dfe could not be found. Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:07.420203 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:07.433596 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:07.433596 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:07.433596 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:14:07.433596 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:14:07.433596 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0db9a75-c2d6-4510-9388-78650e675dfe could not be found. Oct 19 07:14:07.433596 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:07.433596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf0cb50b-45ab-45c8-8c76-d536453e1960 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Returning 404 to user: Instance f0db9a75-c2d6-4510-9388-78650e675dfe could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:14:07.433596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf0cb50b-45ab-45c8-8c76-d536453e1960 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/f0db9a75-c2d6-4510-9388-78650e675dfe/action" status: 404 len: 111 microversion: 2.1 time: 0.046326 Oct 19 07:14:07.433596 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2565/4988] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:14:07 2022] POST /compute/v2.1/servers/f0db9a75-c2d6-4510-9388-78650e675dfe/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:14:07.435493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ba4dbf1-3f2d-44e7-bfdc-a113b94bba3a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:07.436642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ba4dbf1-3f2d-44e7-bfdc-a113b94bba3a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:07.462645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4dbf1-3f2d-44e7-bfdc-a113b94bba3a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:07.463859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4dbf1-3f2d-44e7-bfdc-a113b94bba3a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:07.464808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4dbf1-3f2d-44e7-bfdc-a113b94bba3a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:07.466370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4dbf1-3f2d-44e7-bfdc-a113b94bba3a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:07.470363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4dbf1-3f2d-44e7-bfdc-a113b94bba3a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:07.471519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4dbf1-3f2d-44e7-bfdc-a113b94bba3a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:07.641554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:07.642898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:07.659285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:07.681488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:07.682330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:07.683343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:07.684249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:07.685130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:07.817281 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ba4dbf1-3f2d-44e7-bfdc-a113b94bba3a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action" status: 202 len: 0 microversion: 2.1 time: 0.384614 Oct 19 07:14:07.819573 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2424/4989] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:14:07 2022] POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:14:07.841771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:07.842482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:07.858413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:07.859129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:07.859793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:07.860862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:07.861497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:07.862100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:08.033216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:08.053855 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69a1d5a7-755e-439a-8396-a6ed726e9a50 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1312 microversion: 2.1 time: 0.417352 Oct 19 07:14:08.055377 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2566/4990] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:07 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1312 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:08.098946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:08.099621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:08.101868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:08.114092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:08.114273 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71a97d64-aeed-44ae-ae16-4d7280c7708c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1521 microversion: 2.1 time: 0.287802 Oct 19 07:14:08.114273 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2425/4991] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:07 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:08.121400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:08.122285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:08.123271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:08.124041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:08.124667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:08.138637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:08.139582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:08.147402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:08.148591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:08.149055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:08.150103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:08.150894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:08.151628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:08.191647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:08.245546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:08.260123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:08.268996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:08.268996 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-99a1b4a6-8836-4855-b23e-379dc47a0948 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.205908 Oct 19 07:14:08.268996 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2567/4992] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:08 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:08.309736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:08.317777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:08.319214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:08.322713 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e502bf70-9ef8-4cae-b6b2-5e9a58e21ead tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.193591 Oct 19 07:14:08.322713 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2426/4993] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:08 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:09.078887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:09.079741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:09.090037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.090805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.091457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.092531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.093209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.093845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.142559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:09.144504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:09.159049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.159697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.160285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.161120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.161608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.162020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.430787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:09.444882 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c9d80273-8a05-488b-8525-86557b8b704b tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1312 microversion: 2.1 time: 0.369612 Oct 19 07:14:09.458015 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2568/4994] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:09 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1312 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:09.458502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:09.459924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:09.474933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.475442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.475894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.476658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.477121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.477556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.491441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:09.505195 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6dc948ba-9b55-42f2-ac19-12b2fe57aae4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1501 microversion: 2.1 time: 0.366324 Oct 19 07:14:09.506457 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2427/4995] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:09 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1501 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:14:09.517655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:09.518285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:09.532414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.534784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.534784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.535557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.536342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.537126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.690275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:09.704540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:09.709648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:09.712130 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b401983f-1220-4939-90e5-34105a5f4818 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.262779 Oct 19 07:14:09.715096 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2569/4996] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:09 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:09.741977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:09.747590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:09.757095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.757875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.758508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.759412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.760394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.761013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.795456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lazy-loading 'flavor' on Instance uuid 47479fa1-5580-49d4-bd9a-dd0759289365 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:14:09.835863 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] HTTP exception thrown: Cannot 'rescue' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state paused Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Request method failure captured: Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action HTTP/1.1 Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 14 Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6N-tDItijGcBgGmYG_SAGW3_6j9tHcCoWlwSkFCMVsf1kudeF0pMVbw-7Ar3stxV1wyoNkVWZBpQrwGchitozCNiy9vzY_xtbtitbiu3urH95IzS_orWJGtKLy1RiTvb5DBtzVcx3aKRwG1VXq-GLQyimy0EHWlWBFcGoqSf5R8Vcc Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a457b818318a499188fb805286d6c77b Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a457b818318a499188fb805286d6c77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a457b818318a499188fb805286d6c77b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a457b818318a499188fb805286d6c77b Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc1f35324a234df58ec230f0a99454b4 Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: {"rescue": {}} Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'rescue' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state paused Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '47479fa1-5580-49d4-bd9a-dd0759289365', 'body': {'rescue': {}}} Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47479fa1-5580-49d4-bd9a-dd0759289365 in vm_state paused. Cannot rescue while the instance is in this state. Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state paused Oct 19 07:14:09.839464 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state paused Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Returning 409 to user: Cannot 'rescue' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state paused {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64a980ed-9735-41f2-8f7f-ca34afbe3edd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action" status: 409 len: 144 microversion: 2.1 time: 0.126511 Oct 19 07:14:09.844654 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2570/4997] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:14:09 2022] POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action => generated 144 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:14:09.852762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cd1b9e6-8ee6-4487-b64f-43a6a8f0198c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:09.856082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cd1b9e6-8ee6-4487-b64f-43a6a8f0198c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:09.879471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd1b9e6-8ee6-4487-b64f-43a6a8f0198c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.879908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd1b9e6-8ee6-4487-b64f-43a6a8f0198c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.880540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd1b9e6-8ee6-4487-b64f-43a6a8f0198c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.885937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd1b9e6-8ee6-4487-b64f-43a6a8f0198c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:09.886783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd1b9e6-8ee6-4487-b64f-43a6a8f0198c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:09.888092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cd1b9e6-8ee6-4487-b64f-43a6a8f0198c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:09.924574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:09.959412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:09.980152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:09.982023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:09.983753 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-649f7290-aa1a-444d-8e01-cd825b2f46ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.475875 Oct 19 07:14:09.984744 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2428/4998] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:09 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:10.185573 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cd1b9e6-8ee6-4487-b64f-43a6a8f0198c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action" status: 202 len: 0 microversion: 2.1 time: 0.337449 Oct 19 07:14:10.186615 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2571/4999] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:14:09 2022] POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:14:10.195496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:10.196237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:10.210206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:10.212847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:10.213526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:10.214470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:10.216568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:10.219523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:10.477625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:10.477625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:10.513477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:10.513477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:10.513477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:10.513477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:10.513477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:10.513477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:10.572459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:10.592515 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32e12f0c-f965-402b-9142-7c77d4ffbe81 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1508 microversion: 2.1 time: 0.401659 Oct 19 07:14:10.596288 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2429/5000] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:10 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:10.752329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:10.753049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:10.769272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:10.773498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:10.774005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:10.780252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:10.780865 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fba3b44e-95f6-4d0d-98b4-f9fd45561fcd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1312 microversion: 2.1 time: 0.309608 Oct 19 07:14:10.781861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:10.782877 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2572/5001] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:10 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:14:10.786787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:10.787484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:10.927669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:10.957099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:10.960400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:10.964829 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6cc62bb9-3538-4f7b-ac1c-9f1e68295bd4 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.217303 Oct 19 07:14:10.967182 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2430/5002] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:10 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:14:11.017570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:11.018574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:11.030300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:11.031463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:11.032292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:11.033965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:11.034431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:11.038000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:11.319130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:11.330064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:11.331606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:11.333672 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7158127c-d865-42e4-a5f7-2c1de5881cc6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.320381 Oct 19 07:14:11.335191 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2573/5003] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:11 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:11.620194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:11.621773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:11.629849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:11.630618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:11.631261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:11.632949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:11.633975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:11.634653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:11.809149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:11.810176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:11.821935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:11.822879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:11.825142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:11.826156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:11.830101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:11.831145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:11.902634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:11.920356 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb094f24-6c63-4b7d-a6be-e396516acba3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1516 microversion: 2.1 time: 0.299029 Oct 19 07:14:11.922122 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2431/5004] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:11 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1516 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:11.996555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:11.997368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:12.014933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:12.017375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:12.019969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:12.021041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:12.025886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:12.029927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:12.278669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:12.293074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:12.295136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:12.297671 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a08aee01-740a-4d0c-88f6-d2aced70358a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.305698 Oct 19 07:14:12.299058 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2432/5005] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:11 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:14:12.345288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:12.363344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:12.363965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:12.374752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:12.376420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:12.377032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:12.377164 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74518919-9bf7-4c34-b24a-0dbc27d7d5bc tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1312 microversion: 2.1 time: 0.572260 Oct 19 07:14:12.377776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:12.378253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:12.380586 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2574/5006] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:11 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:14:12.392690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:12.707885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:12.728603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:12.731847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:12.734267 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e6add97-a4e8-4332-84ac-455f3b93ccff tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.374775 Oct 19 07:14:12.736318 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2433/5007] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:12 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:13.352877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:13.353940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:13.393058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:13.403468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:13.404476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:13.405361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:13.410717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:13.411852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:13.418504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:13.418504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:13.418504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:13.418846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:13.418846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:13.419158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:13.420244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:13.421024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:13.421938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:13.640786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:13.657553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:13.659480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:13.661743 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b69bb8bb-0854-4ddb-a57b-866322c44839 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.338240 Oct 19 07:14:13.663126 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2575/5008] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:13 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:13.771025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:13.772971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:13.829141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:13.831176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:13.833219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:13.839226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:13.840135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:13.841346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:13.843919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:13.861171 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f80416f5-25cb-45f0-b30c-31b336743932 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1312 microversion: 2.1 time: 0.462385 Oct 19 07:14:13.878658 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2434/5009] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:13 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1312 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:14.201909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:14.242043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:14.243346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:14.244911 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1528439-beab-45ef-8101-8d51b2ad00cf tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.482594 Oct 19 07:14:14.245990 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2576/5010] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:13 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:14.692043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:14.693288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:14.707024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:14.709783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:14.710464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:14.712791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:14.713496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:14.714411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:14.720212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:14.728614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-30c951bf-bb3d-44be-82d7-e2d757e5cded req-aaeb7442-e2dc-480c-9cd6-0b3dfdacbc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3f658c-0589-478c-9ebb-48b7b758fa75", "name": "network-vif-plugged", "status": "completed", "tag": "635eab1c-e230-4131-a461-8e7685ce8ec4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:14.737859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-30c951bf-bb3d-44be-82d7-e2d757e5cded req-aaeb7442-e2dc-480c-9cd6-0b3dfdacbc67 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:14.739194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-30c951bf-bb3d-44be-82d7-e2d757e5cded req-aaeb7442-e2dc-480c-9cd6-0b3dfdacbc67 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:14.739896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-30c951bf-bb3d-44be-82d7-e2d757e5cded req-aaeb7442-e2dc-480c-9cd6-0b3dfdacbc67 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:14.768579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-30c951bf-bb3d-44be-82d7-e2d757e5cded req-aaeb7442-e2dc-480c-9cd6-0b3dfdacbc67 service nova] Creating event network-vif-plugged:635eab1c-e230-4131-a461-8e7685ce8ec4 for instance ff3f658c-0589-478c-9ebb-48b7b758fa75 on n-h2-861333-10 Oct 19 07:14:14.789256 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-30c951bf-bb3d-44be-82d7-e2d757e5cded req-aaeb7442-e2dc-480c-9cd6-0b3dfdacbc67 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075164 Oct 19 07:14:14.824178 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2577/5011] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:14:14.907937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:14.909593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:14.990089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:14.990089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:14.990089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:14.996778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:14.998568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:15.001548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:15.315801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:15.331429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:15.333508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:15.339583 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9bc8751-2ce8-43e8-97cd-03a91946cfe1 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1409 microversion: 2.54 time: 0.647644 Oct 19 07:14:15.342159 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2435/5012] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:14 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1409 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:15.358938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:15.362599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:15.379987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:15.382928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:15.385962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:15.388651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:15.389402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:15.390553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:15.469611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:15.497536 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9756a958-ad4c-422b-be9c-11f0642a7b8c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1312 microversion: 2.1 time: 0.601952 Oct 19 07:14:15.501091 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2578/5013] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:14 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1312 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:15.689433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:15.698970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:15.705769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:15.707959 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8b6d9e0-95bc-4b06-9127-f40d92bf3605 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.365631 Oct 19 07:14:15.715714 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2436/5014] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:15 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:16.189583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:16.194184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:16.209965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:16.210763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:16.213135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:16.216322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:16.217107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:16.218115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:16.285652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lazy-loading 'flavor' on Instance uuid 47479fa1-5580-49d4-bd9a-dd0759289365 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:14:16.467333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:16.473229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:16.481569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:16.487225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:16.488036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:16.513837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:16.513837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:16.513837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:16.626872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:16.638990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:16.640707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:16.642130 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b71fb674-020d-4d1d-86f3-586ea304c22c tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1415 microversion: 2.54 time: 0.178835 Oct 19 07:14:16.643155 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2437/5015] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:16 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1415 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:14:16.663142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:16.663142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:16.672796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:16.673303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:16.673747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:16.674475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:16.675009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:16.675447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:16.724154 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff50bf76-f8cb-455d-8d8a-192e87ec5cec tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action" status: 200 len: 32 microversion: 2.1 time: 0.539866 Oct 19 07:14:16.724154 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2579/5016] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:14:16 2022] POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action => generated 32 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:14:16.744074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:16.744968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:16.775177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:16.775951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:16.778718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:16.779886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:16.782305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:16.786657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:17.019144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:17.044320 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-628d648a-95bc-4e7e-9c8e-e27cc63ce3b7 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1312 microversion: 2.1 time: 0.393672 Oct 19 07:14:17.064516 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2438/5017] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:16 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:17.073698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:17.079017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:17.090058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:17.090941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:17.092017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:17.097473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:17.098739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:17.099356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:17.213060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:17.221882 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f34f3e2-f636-4883-92c3-b98584e116af tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.492031 Oct 19 07:14:17.222470 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2580/5018] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:16 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:17.565016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:17.625527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:17.648328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:17.648328 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bebba5ee-6a71-4b2e-b4cb-bde8d1c16f71 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.563393 Oct 19 07:14:17.648328 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2439/5019] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:17 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:17.676762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:17.677414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:17.695148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:17.699731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:17.699731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:17.699731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:17.699731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:17.699731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:17.885144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:17.934773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:17.944701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:17.951006 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23e3a479-6305-48a5-996e-e73706ce9959 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1415 microversion: 2.54 time: 0.279479 Oct 19 07:14:17.953951 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2581/5020] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:17 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1415 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:18.072605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:18.073230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:18.104781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:18.105346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:18.105811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:18.106581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:18.107064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:18.107505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:18.254494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:18.255317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:18.279720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:18.280411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:18.282211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:18.284283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:18.286632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:18.288442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:18.625737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:18.637130 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5c90210-37f6-4134-8510-8a932c0d058e tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1495 microversion: 2.1 time: 0.568234 Oct 19 07:14:18.637716 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2440/5021] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:18 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1495 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:18.676081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:18.676081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:18.694162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:18.695888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:18.696438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:18.705335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:18.708086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:18.711435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:18.810175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:18.822789 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ae191a8-e112-4520-a0ba-07b007b91cbb tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.575414 Oct 19 07:14:18.825006 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2582/5022] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:18 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:18.981877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:18.982946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:19.005493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:19.006436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:19.006890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:19.007664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:19.008301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:19.008946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:19.190271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:19.208642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:19.217085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:19.218579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cba291cd-fe3b-44ba-9d83-8065bc0f6042 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1400 microversion: 2.54 time: 0.241978 Oct 19 07:14:19.221822 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2583/5023] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:18 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1400 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:14:19.263479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8012305-7154-42ae-9463-a296d07eba1b tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '.version_select at 0x7f6d64914550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:19.460211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:19.470997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:19.472890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:19.475609 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3f87a00-7f94-4249-95ef-7777c79f4ec9 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.812049 Oct 19 07:14:19.476957 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2441/5024] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:18 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:14:19.494891 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8012305-7154-42ae-9463-a296d07eba1b tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1983308556" status: 204 len: 0 microversion: 2.54 time: 0.247444 Oct 19 07:14:19.497072 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2584/5025] 10.222.0.39 () {60 vars in 1319 bytes} [Wed Oct 19 07:14:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1983308556 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:14:19.512480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:19.512970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:19.526479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:19.527855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:19.528694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:19.530082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:19.530979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:19.531917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:19.594141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:14:19.861133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:19.862539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:19.883065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:19.883797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:19.884780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:19.885990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:19.886795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:19.887533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:20.085169 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa226d61-2faa-42ad-86eb-b6fbac331181 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "DELETE /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 204 len: 0 microversion: 2.54 time: 0.576522 Oct 19 07:14:20.087867 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2442/5026] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:14:19 2022] DELETE /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:14:20.095429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:20.096641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:20.119655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:20.120602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:20.121246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:20.122859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:20.123510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:20.124529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:20.157556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:20.174992 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ef32b04-45a3-496f-ab8f-33571e3514a5 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.330736 Oct 19 07:14:20.179083 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2585/5027] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:19 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:20.517882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:20.519223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:20.553910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:20.557098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:20.559906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:20.562343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:20.563968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:20.565362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:20.684677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:20.695858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:20.701721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:20.705244 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d818bb49-0d8a-438b-bada-41b7678dceab tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1406 microversion: 2.54 time: 0.614429 Oct 19 07:14:20.709119 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2443/5028] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:20 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1406 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:20.943466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:20.945954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:20.954707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:20.956374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:20.958462 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-253f5221-9fb0-4483-9e24-f5834044ee56 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.452471 Oct 19 07:14:20.959742 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2586/5029] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:20 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:21.218202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:21.218202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:21.218202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:21.218202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:21.218202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:21.218202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:21.218202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:21.218202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:21.218202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:21.365942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:21.373811 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ee05d61-c2c4-45e1-b526-9884809aa35e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.177441 Oct 19 07:14:21.374348 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2444/5030] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:21 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:21.739299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:21.739908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:21.747421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:21.747939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:21.748410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:21.749118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:21.749583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:21.750039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:21.820436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:21.828908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:21.831057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:21.832932 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38906041-9677-43bf-9671-75cd806f865a tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1406 microversion: 2.54 time: 0.097973 Oct 19 07:14:21.833502 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2587/5031] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:21 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1406 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:21.987921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:21.989558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:22.021328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:22.021969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:22.022486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:22.023879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:22.024387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:22.027903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:22.392002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:22.399033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:22.400662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:22.402752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:22.404286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:22.411078 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-632e8aff-ef54-483b-94bb-7ab93d25b848 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.427346 Oct 19 07:14:22.413259 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2445/5032] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:21 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:22.430822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:22.437163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:22.437163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:22.437163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:22.437163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:22.437163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:22.737601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:22.751808 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-edca7414-1810-4049-a95f-852e79e52e48 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.357710 Oct 19 07:14:22.752575 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2588/5033] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:22 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:22.864471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:22.865066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:22.872087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:22.872826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:22.873259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:22.874482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:22.874999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:22.875594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:22.919896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:22.920416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:22.921401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:22.921862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lazy-loading 'fault' on Instance uuid 48fc21b4-5f73-474c-8127-1fcd308ce94e {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:14:22.992610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:23.004887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:23.007721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5596bde56454db7a3aa0a62cd1ae403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb76d21ff784e3bac760ff67476885d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:23.008972 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ad86ebb-58de-40e4-bc5a-eee48e4b2d44 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 200 len: 1411 microversion: 2.54 time: 0.149634 Oct 19 07:14:23.009841 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2446/5034] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:22 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 1411 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:23.439787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:23.440507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:23.459650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:23.460198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:23.460612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:23.461326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:23.461786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:23.462214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:23.773764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:23.788926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:23.791773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:23.792469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:23.795187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:23.795307 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31f07db1-9adb-432c-b3ea-232535b82b97 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.359032 Oct 19 07:14:23.795307 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2589/5035] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:23 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:23.810022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:23.812699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:23.818311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:23.818311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:23.818311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:23.818311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:24.037301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:24.038390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] [instance: 48fc21b4-5f73-474c-8127-1fcd308ce94e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:24.046156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:24.048419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:24.052925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:24.052925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:24.052925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:24.052925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:24.067877 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] HTTP exception thrown: Instance 48fc21b4-5f73-474c-8127-1fcd308ce94e could not be found. Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Request method failure captured: Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e HTTP/1.1 Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6OiUiipijWOpFv_zilmJs1Ppwb-xIkmA4XprT_uixXqJcCElxwm_mcJ_piMsRHCv9ImrOaiAqL5HMaEEFzuYy8tbOtIzt_988OBgd82Pzq0yBjfgZ7B5-1TsCsgc4OKpp-EC2MLrv32atDKTC8HcRG6ke5Wot1aM0JTIksizf9Ol5g Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.54 Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0cb76d21ff784e3bac760ff67476885d Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerShowV254Test-1817972745 Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0cb76d21ff784e3bac760ff67476885d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cb76d21ff784e3bac760ff67476885d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0cb76d21ff784e3bac760ff67476885d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0cb76d21ff784e3bac760ff67476885d", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerShowV254Test-1817972745 Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0cb76d21ff784e3bac760ff67476885d Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerShowV254Test-1817972745 Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerShowV254Test-1817972745-project Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: a5596bde56454db7a3aa0a62cd1ae403 Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerShowV254Test-1817972745-project Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 48fc21b4-5f73-474c-8127-1fcd308ce94e could not be found. Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '48fc21b4-5f73-474c-8127-1fcd308ce94e'} Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48fc21b4-5f73-474c-8127-1fcd308ce94e could not be found. Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48fc21b4-5f73-474c-8127-1fcd308ce94e could not be found. Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:24.070182 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:24.083693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:24.083693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:24.083693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:24.083693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:14:24.083693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:14:24.083693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48fc21b4-5f73-474c-8127-1fcd308ce94e could not be found. Oct 19 07:14:24.083693 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:24.083693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] Returning 404 to user: Instance 48fc21b4-5f73-474c-8127-1fcd308ce94e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:14:24.083693 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fd4371e-2bfc-458b-b954-a1bb7ee0d6c3 tempest-ServerShowV254Test-1817972745 tempest-ServerShowV254Test-1817972745-project] 10.222.0.39 "GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e" status: 404 len: 111 microversion: 2.54 time: 0.042322 Oct 19 07:14:24.086210 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2590/5036] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:24 2022] GET /compute/v2.1/servers/48fc21b4-5f73-474c-8127-1fcd308ce94e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:14:24.623742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:24.637204 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8080daa9-ee2d-491c-8a96-5354d13f497d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.861992 Oct 19 07:14:24.639452 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2447/5037] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:23 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:24.831285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:24.832877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:24.845190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:24.846303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:24.847888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:24.850649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:24.852343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:24.852807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.055600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:25.056960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:25.076617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.080983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.084372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.084372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.085994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.086612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.140702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:25.154373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:25.157033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:25.159759 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78a4e201-91d6-439c-85bf-4d12764895e7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.339576 Oct 19 07:14:25.161176 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2591/5038] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:24 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:25.186420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:14:25.228364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:25.324399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:25.325213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:25.331941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.332824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.340375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.340375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.340375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.340375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.365566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:14:25.547696 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0602d219-56aa-4701-b147-04e65f264885 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 204 len: 0 microversion: 2.1 time: 0.498220 Oct 19 07:14:25.554319 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2448/5039] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:14:25 2022] DELETE /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:14:25.561083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:25.562055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:25.568895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.570727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.570727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.570727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.571206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.571386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.745725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:25.755165 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ebf22c3-f058-4893-9f55-a2bfe4b3aefe tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1553 microversion: 2.1 time: 0.199041 Oct 19 07:14:25.755874 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2449/5040] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:25 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:25.762899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:25.763613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:25.770735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.771262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.771779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.772790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.773258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.773695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.855544 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46a15a97-e53b-4e1a-8161-fea763546288 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 204 len: 0 microversion: 2.1 time: 0.535091 Oct 19 07:14:25.858734 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2592/5041] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:14:25 2022] DELETE /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:14:25.871697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:25.873212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:25.902267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.902791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.907397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:25.909408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:25.909408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:25.909408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:26.013946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:26.022343 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd1b1e18-1aea-437f-8914-a159aeed3e1d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.264946 Oct 19 07:14:26.023162 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2450/5042] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:25 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:26.178867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:26.189260 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-222bae22-0cc3-4e55-9afc-b242f6a4dd84 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1501 microversion: 2.1 time: 0.326110 Oct 19 07:14:26.192532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:26.204157 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2593/5043] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:25 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1501 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:14:26.204443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:26.204443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:26.204443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:26.204443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:26.204443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:26.204443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:26.204994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:26.435849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:26.451851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:26.454103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:26.455396 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0fd8a375-be31-4ef3-aeef-fecdb520c036 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.267946 Oct 19 07:14:26.457086 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2451/5044] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:26 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:26.781203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:26.782070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:26.793988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:26.794515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:26.794972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:26.795698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:26.799594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:26.799998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:27.046411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:27.047234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:27.062108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:27.063006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:27.063695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:27.064469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:27.064938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:27.065549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:27.320575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:27.336223 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99d5ff19-28dc-44a3-9785-a9c6e58f0ad4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.293900 Oct 19 07:14:27.352610 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2452/5045] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:27 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:14:27.365854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:27.366547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:27.377582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:27.378375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:27.379293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:27.380213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:27.380842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:27.381453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:27.518477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:27.527502 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f54181b-0f13-4f7a-8ce7-7c3d61340916 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1553 microversion: 2.1 time: 0.752366 Oct 19 07:14:27.544216 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2594/5046] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:26 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1553 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:27.549735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:27.550719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:27.567892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:27.567892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:27.567892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:27.567892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:27.567892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:27.567892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:27.726666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:27.735671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:27.737540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:27.739040 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39c51365-5036-4675-bdda-828f379393ed tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.193406 Oct 19 07:14:27.752376 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2595/5047] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:27 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:27.766047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:27.774542 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e327a67-d31b-45b5-8c08-5a5ed0252a14 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1501 microversion: 2.1 time: 0.420505 Oct 19 07:14:27.780048 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2453/5048] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:27 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1501 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:28.370660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:28.373217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:28.384444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:28.385279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:28.385993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:28.386945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:28.388944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:28.389667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:28.414068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0887f174-a224-46fb-ba7e-77a517ee4183 req-0b0e1e5d-3861-4a0f-a7f7-d13587b71c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a4daae-6c1a-4174-a294-85466495b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "c784c077-e373-459c-a2b3-896b21d78fbc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:28.436836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0887f174-a224-46fb-ba7e-77a517ee4183 req-0b0e1e5d-3861-4a0f-a7f7-d13587b71c26 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:28.437638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0887f174-a224-46fb-ba7e-77a517ee4183 req-0b0e1e5d-3861-4a0f-a7f7-d13587b71c26 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:28.439897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0887f174-a224-46fb-ba7e-77a517ee4183 req-0b0e1e5d-3861-4a0f-a7f7-d13587b71c26 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:28.469403 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0887f174-a224-46fb-ba7e-77a517ee4183 req-0b0e1e5d-3861-4a0f-a7f7-d13587b71c26 service nova] Creating event network-vif-plugged:c784c077-e373-459c-a2b3-896b21d78fbc for instance 59a4daae-6c1a-4174-a294-85466495b6c1 on n-h2-861333-10 Oct 19 07:14:28.482520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0887f174-a224-46fb-ba7e-77a517ee4183 req-0b0e1e5d-3861-4a0f-a7f7-d13587b71c26 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073802 Oct 19 07:14:28.483642 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2454/5049] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:14:28.557764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:28.559473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:28.579853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:28.583221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:28.583790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:28.585486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:28.588497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:28.591444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:28.657604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:28.668128 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-011f2ca1-eca1-47b0-a061-51d4bde6b68f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.306022 Oct 19 07:14:28.668915 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2596/5050] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:28 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:28.770283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:28.770899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:28.777856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:28.787918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:28.787918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:28.787918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:28.787918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:28.787918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:29.119911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:29.129256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:29.131319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:29.133030 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6ee9de1-1c08-42fe-8f0c-465e2ef233c8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.366950 Oct 19 07:14:29.134174 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2597/5051] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:28 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:14:29.153730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:29.155110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:29.163400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:29.166259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:29.166259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:29.166259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:29.166259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:29.167565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:29.271467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:29.282095 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6c3a650-e92f-40e2-8097-810b7a1198d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1553 microversion: 2.1 time: 0.734225 Oct 19 07:14:29.299119 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2455/5052] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:28 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1553 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:29.416070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:29.424757 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6ce0a5a-5b71-4de4-8f07-8dc3533ab28d tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1501 microversion: 2.1 time: 0.289313 Oct 19 07:14:29.430308 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2598/5053] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:29 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1501 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:29.690879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:29.692683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:29.710719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:29.710719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:29.710719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:29.710719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:29.710719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:29.710719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:29.724529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7a7e902e-2bd1-4694-9c69-99c5fa971737 req-0059cf32-3d82-4d3f-9212-865f704f7017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec", "name": "network-vif-deleted", "tag": "ff22df55-c130-473b-8800-2e8f07c431e0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:29.750266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a7e902e-2bd1-4694-9c69-99c5fa971737 req-0059cf32-3d82-4d3f-9212-865f704f7017 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:29.750626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a7e902e-2bd1-4694-9c69-99c5fa971737 req-0059cf32-3d82-4d3f-9212-865f704f7017 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:29.751070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a7e902e-2bd1-4694-9c69-99c5fa971737 req-0059cf32-3d82-4d3f-9212-865f704f7017 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:29.780878 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7a7e902e-2bd1-4694-9c69-99c5fa971737 req-0059cf32-3d82-4d3f-9212-865f704f7017 service nova] Creating event network-vif-deleted:ff22df55-c130-473b-8800-2e8f07c431e0 for instance 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec on n-h2-861333-10 Oct 19 07:14:29.787484 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7a7e902e-2bd1-4694-9c69-99c5fa971737 req-0059cf32-3d82-4d3f-9212-865f704f7017 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066913 Oct 19 07:14:29.790414 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2599/5054] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:14:30.160057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:30.161377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:30.170977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:30.171298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:30.196290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:30.196290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:30.196290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:30.196290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:30.196290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:30.197039 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac9d434c-ee52-44c7-b0a1-e1cdf9f40f20 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.496186 Oct 19 07:14:30.197039 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2456/5055] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:29 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:30.307526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:30.308565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:30.327555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:30.337516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:30.341895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:30.341895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:30.342663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:30.355748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:30.497213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:30.497970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:30.499007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:30.500075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lazy-loading 'fault' on Instance uuid 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:14:30.560956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:30.579527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:30.583672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:30.589885 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c2c4c70-fbdd-414c-8a00-b000216ac799 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.434031 Oct 19 07:14:30.590507 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2600/5056] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:30 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:14:30.630173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:30.646262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:30.668282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:30.669828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:30.670289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:30.673752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:30.675400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:30.677642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:31.071795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:31.084259 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5177a81d-ad17-4e0b-ab59-6835252c40bd tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1297 microversion: 2.1 time: 0.469337 Oct 19 07:14:31.087233 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2601/5057] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:30 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1297 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:31.211808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:31.212806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:31.224459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:31.227349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:31.228092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:31.230430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:31.232370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:31.241898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:31.343219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:31.357698 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d25fcdbd-f2cf-491d-b6e6-11f3a23973bb tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 200 len: 1339 microversion: 2.1 time: 1.053351 Oct 19 07:14:31.363226 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2457/5058] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:30 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 1339 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:31.561908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:31.583144 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58eb8f58-6faa-48a1-8211-31521d37a1ad tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.372823 Oct 19 07:14:31.584037 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2602/5059] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:31 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:31.633553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:31.634180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:31.642322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:31.642803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:31.646743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:31.649124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:31.652599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:31.653474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:31.829552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-30188e5a-58e3-4f37-a94b-efd2571afc1d req-3a415e56-806a-46e4-bb74-f567751ff373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3f658c-0589-478c-9ebb-48b7b758fa75", "name": "network-vif-deleted", "tag": "635eab1c-e230-4131-a461-8e7685ce8ec4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:31.839772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-30188e5a-58e3-4f37-a94b-efd2571afc1d req-3a415e56-806a-46e4-bb74-f567751ff373 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:31.840671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-30188e5a-58e3-4f37-a94b-efd2571afc1d req-3a415e56-806a-46e4-bb74-f567751ff373 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:31.841374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-30188e5a-58e3-4f37-a94b-efd2571afc1d req-3a415e56-806a-46e4-bb74-f567751ff373 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:31.869693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:31.884092 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-30188e5a-58e3-4f37-a94b-efd2571afc1d req-3a415e56-806a-46e4-bb74-f567751ff373 service nova] Creating event network-vif-deleted:635eab1c-e230-4131-a461-8e7685ce8ec4 for instance ff3f658c-0589-478c-9ebb-48b7b758fa75 on n-h2-861333-10 Oct 19 07:14:31.891592 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-30188e5a-58e3-4f37-a94b-efd2571afc1d req-3a415e56-806a-46e4-bb74-f567751ff373 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066827 Oct 19 07:14:31.892750 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2603/5060] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:14:31.919469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:31.931812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:31.933229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:31.934671 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11d8c455-f7ae-4141-85b5-b51e8fa791d8 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.305758 Oct 19 07:14:31.939219 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2458/5061] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:31 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:32.111581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:32.112758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:32.125450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:32.126223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:32.131572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:32.132980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:32.133632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:32.134252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:32.247876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:32.247876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:32.247876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:32.247876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lazy-loading 'fault' on Instance uuid ff3f658c-0589-478c-9ebb-48b7b758fa75 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:14:32.382021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:32.385149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:32.405362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:32.405860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:32.406299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:32.407036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:32.407486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:32.407923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:32.459800 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] HTTP exception thrown: Instance 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec could not be found. Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Request method failure captured: Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec HTTP/1.1 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6MoZKzHotyZ1eTfqssLdaexVaBzyVSfOVgJ9MxjiHTrSptbsyGpzjg_wo8_ePUE5xg0quXoL0Ze0iVWc9woLFMrdBs6Bb85ytuWXmPAgzdrXJ5al0-2dCfbiuXcH8VgKr_duCeitUYcy6Pw9z1ArBFcVL4-j-yF6jvlPDmyrYDn31U Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 5d4e7cd4e1884e7c9b83189f5079e0a5 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkBasicOps-71718984 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d4e7cd4e1884e7c9b83189f5079e0a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d4e7cd4e1884e7c9b83189f5079e0a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d4e7cd4e1884e7c9b83189f5079e0a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d4e7cd4e1884e7c9b83189f5079e0a5", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkBasicOps-71718984 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 5d4e7cd4e1884e7c9b83189f5079e0a5 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkBasicOps-71718984 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestNetworkBasicOps-71718984-project Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 57cb186cade14d558122b6bf720c2922 Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkBasicOps-71718984-project Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec could not be found. Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec'} Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec could not be found. Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec could not be found. Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:32.470793 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec could not be found. Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Returning 404 to user: Instance 2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-380d0460-5349-4d83-8310-de80c434fea1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec" status: 404 len: 111 microversion: 2.1 time: 0.088556 Oct 19 07:14:32.477338 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2459/5062] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:32 2022] GET /compute/v2.1/servers/2f968ea4-0d3f-4d1c-8880-bd44b5d3c2ec => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:14:32.478186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562021351b1344f09a097f912dcef7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96a38d28c9845c88887a3f516ff0d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:32.495791 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c7d648e-a1a0-4d59-aded-e440b5575894 tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 200 len: 1302 microversion: 2.1 time: 0.387109 Oct 19 07:14:32.498614 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2604/5063] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:32 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 1302 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:32.616066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:32.623283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:32.632275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:32.633027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:32.633649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:32.634547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:32.635170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:32.635883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:32.918830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:32.939304 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42effd68-8c78-4c7e-9060-82016ddc4a95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.335933 Oct 19 07:14:32.944974 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2460/5064] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:32 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:32.971656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:32.972323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:32.980243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:32.980999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:32.981653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:32.983233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:32.984230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:32.984998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:32.990530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f86dcac-1e4e-4d2f-894f-a9f53aa54668 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '.version_select at 0x7f6d5f958ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:33.109700 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f86dcac-1e4e-4d2f-894f-a9f53aa54668 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1580654841" status: 202 len: 0 microversion: 2.1 time: 0.129030 Oct 19 07:14:33.110600 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2461/5065] 10.222.0.39 () {58 vars in 1257 bytes} [Wed Oct 19 07:14:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1580654841 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:14:33.292490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:33.306352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:33.310564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:33.315073 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93642622-93ce-4746-bb4f-36426adb6177 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1730 microversion: 2.20 time: 0.347359 Oct 19 07:14:33.334672 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2605/5066] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:32 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1730 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:33.528069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:33.528811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] [instance: ff3f658c-0589-478c-9ebb-48b7b758fa75] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:33.544789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:33.545609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:33.547442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:33.553395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:33.554202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:33.556623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:33.603304 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] HTTP exception thrown: Instance ff3f658c-0589-478c-9ebb-48b7b758fa75 could not be found. Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Request method failure captured: Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 HTTP/1.1 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6Ow7cMoAY9siu0zSgw_TU7-fYYtE6cUfSZ3y66Z8bGM3V96i1aKh6d3tUC_crEXnUyqYbGcswB_cXjbOpbIcPW7c-g9sM8v0VrA5_2loaQugrupHwj1x5MxpAAvu2dod-_e1-Ck29RigcoiCaeN19UWobaLaIU8yiiXfmhZ3CfOkGc Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: a96a38d28c9845c88887a3f516ff0d80 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesActionsTest-823321294 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a96a38d28c9845c88887a3f516ff0d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a96a38d28c9845c88887a3f516ff0d80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a96a38d28c9845c88887a3f516ff0d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a96a38d28c9845c88887a3f516ff0d80", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesActionsTest-823321294 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: a96a38d28c9845c88887a3f516ff0d80 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesActionsTest-823321294 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesActionsTest-823321294-project Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 562021351b1344f09a097f912dcef7c2 Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesActionsTest-823321294-project Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance ff3f658c-0589-478c-9ebb-48b7b758fa75 could not be found. Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'ff3f658c-0589-478c-9ebb-48b7b758fa75'} Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3f658c-0589-478c-9ebb-48b7b758fa75 could not be found. Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3f658c-0589-478c-9ebb-48b7b758fa75 could not be found. Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:33.605285 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:33.610807 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:33.610807 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:33.610807 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:33.610807 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:14:33.610807 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:14:33.610807 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3f658c-0589-478c-9ebb-48b7b758fa75 could not be found. Oct 19 07:14:33.610807 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:33.612932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] Returning 404 to user: Instance ff3f658c-0589-478c-9ebb-48b7b758fa75 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:14:33.614620 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6532431-9d41-4f2b-b3af-b9fef0e51e0c tempest-VolumesActionsTest-823321294 tempest-VolumesActionsTest-823321294-project] 10.222.0.39 "GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75" status: 404 len: 111 microversion: 2.1 time: 0.091788 Oct 19 07:14:33.618738 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2462/5067] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:33 2022] GET /compute/v2.1/servers/ff3f658c-0589-478c-9ebb-48b7b758fa75 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:14:33.965999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:33.966720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:33.981438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:33.981949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:33.982400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:33.993325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:33.993916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:33.994399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:34.346716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:34.348055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:34.361618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:34.365378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:34.365884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:34.366648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:34.367581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:34.368795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:34.369410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:34.385199 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d87831f4-fda3-474f-ae1f-4b47b184c89c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1502 microversion: 2.1 time: 0.422464 Oct 19 07:14:34.386371 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2606/5068] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:33 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:34.419964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d08e9893-dfcb-4974-9bd2-6b899874579f"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:34.425320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:34.446598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:34.453515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:34.455133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:34.458181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:34.458667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:34.461552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:34.567929 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] HTTP exception thrown: Cannot 'attach_volume' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state rescued Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Request method failure captured: Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/os-volume_attachments HTTP/1.1 Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 74 Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6N-tDItijGcBgGmYG_SAGW3_6j9tHcCoWlwSkFCMVsf1kudeF0pMVbw-7Ar3stxV1wyoNkVWZBpQrwGchitozCNiy9vzY_xtbtitbiu3urH95IzS_orWJGtKLy1RiTvb5DBtzVcx3aKRwG1VXq-GLQyimy0EHWlWBFcGoqSf5R8Vcc Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a457b818318a499188fb805286d6c77b Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a457b818318a499188fb805286d6c77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a457b818318a499188fb805286d6c77b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a457b818318a499188fb805286d6c77b Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc1f35324a234df58ec230f0a99454b4 Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: {"volumeAttachment": {"volumeId": "d08e9893-dfcb-4974-9bd2-6b899874579f"}} Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'attach_volume' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state rescued Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': '47479fa1-5580-49d4-bd9a-dd0759289365', 'body': {'volumeAttachment': {'volumeId': 'd08e9893-dfcb-4974-9bd2-6b899874579f'}}} Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47479fa1-5580-49d4-bd9a-dd0759289365 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 19 07:14:34.574735 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state rescued Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state rescued Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:14:34.579025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Returning 409 to user: Cannot 'attach_volume' instance 47479fa1-5580-49d4-bd9a-dd0759289365 while it is in vm_state rescued {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:14:34.580708 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69e31166-2564-4c92-b1ce-bf9c27051c65 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.166513 Oct 19 07:14:34.584570 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2607/5069] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:14:34 2022] POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/os-volume_attachments => generated 152 bytes in 171 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:14:34.602954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7297a50b-7c1c-428b-be91-5f8faa58db1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:34.603654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7297a50b-7c1c-428b-be91-5f8faa58db1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:34.619952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7297a50b-7c1c-428b-be91-5f8faa58db1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:34.620502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7297a50b-7c1c-428b-be91-5f8faa58db1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:34.623770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7297a50b-7c1c-428b-be91-5f8faa58db1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:34.624866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7297a50b-7c1c-428b-be91-5f8faa58db1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:34.625361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7297a50b-7c1c-428b-be91-5f8faa58db1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:34.628177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7297a50b-7c1c-428b-be91-5f8faa58db1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:34.830707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:34.842152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:34.844135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:34.849785 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5b95e032-7ffe-43cb-ace3-b1b5025e2afa tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1717 microversion: 2.20 time: 0.508323 Oct 19 07:14:34.850960 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2463/5070] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:14:34 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1717 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:14:35.053156 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7297a50b-7c1c-428b-be91-5f8faa58db1f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action" status: 202 len: 0 microversion: 2.1 time: 0.464043 Oct 19 07:14:35.057632 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2608/5071] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:14:34 2022] POST /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:14:35.063392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:35.064006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:35.074773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:35.092731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:35.093181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:35.093966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:35.094435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:35.094863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:36.156768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:36.166893 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15d54b78-81f9-44db-b709-0f418e83b444 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1510 microversion: 2.1 time: 1.107953 Oct 19 07:14:36.167898 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2464/5072] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:35 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1510 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:37.194594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:37.196018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:37.211919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:37.212789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:37.213451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:37.214385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:37.215053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:37.215692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:37.636471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:37.646301 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39f814e2-abdc-4e42-8c8e-c228a10389cf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1510 microversion: 2.1 time: 0.457730 Oct 19 07:14:37.647094 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2609/5073] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:37 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1510 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:14:38.202171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:38.202663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:38.211403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:38.211630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-24d0c18a-2d5b-4485-acb3-0b255a1157bf req-37b6088a-f3a7-4e8d-bdd4-ead325267ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486742e7-6b82-4482-95c6-d709cb21e4d5", "tag": "9c8933a5-5d07-48ce-b0c3-ac177f06c4b9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:38.212063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:38.215527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:38.215527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:38.215527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:38.215805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:38.224180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-24d0c18a-2d5b-4485-acb3-0b255a1157bf req-37b6088a-f3a7-4e8d-bdd4-ead325267ab4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:38.228341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-24d0c18a-2d5b-4485-acb3-0b255a1157bf req-37b6088a-f3a7-4e8d-bdd4-ead325267ab4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:38.228341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-24d0c18a-2d5b-4485-acb3-0b255a1157bf req-37b6088a-f3a7-4e8d-bdd4-ead325267ab4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:38.242213 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-24d0c18a-2d5b-4485-acb3-0b255a1157bf req-37b6088a-f3a7-4e8d-bdd4-ead325267ab4 service nova] Creating event network-changed:9c8933a5-5d07-48ce-b0c3-ac177f06c4b9 for instance 486742e7-6b82-4482-95c6-d709cb21e4d5 on n-h2-861333-10 Oct 19 07:14:38.247756 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-24d0c18a-2d5b-4485-acb3-0b255a1157bf req-37b6088a-f3a7-4e8d-bdd4-ead325267ab4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041197 Oct 19 07:14:38.248469 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2610/5074] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:14:38.256372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:14:38.392147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:38.671095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:38.671917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:38.694434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:38.694833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:38.698797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:38.698797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:38.698797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:38.698797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:38.712415 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4bc53dca-c10a-4986-aa40-45f59469a0e9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "DELETE /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 204 len: 0 microversion: 2.1 time: 0.513812 Oct 19 07:14:38.714560 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2465/5075] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:14:38 2022] DELETE /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:14:38.729270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:38.729984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:38.745780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:38.746433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:38.746883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:38.747839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:38.748431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:38.748877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:39.042444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:39.055251 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1669 microversion: 2.1 time: 0.336328 Oct 19 07:14:39.058453 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2466/5076] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:38 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1669 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:39.317136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:39.330862 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a3bb287-2f41-4e2f-b8db-7ef45e97b9dc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1510 microversion: 2.1 time: 0.663032 Oct 19 07:14:39.331858 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2611/5077] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:38 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1510 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:39.824992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:39.825539 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-812df89a-9d33-4895-a747-b5c0ef319dfa tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002179 Oct 19 07:14:39.827085 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2467/5078] 10.222.0.39 () {56 vars in 886 bytes} [Wed Oct 19 07:14:39 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 07:14:40.092122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:40.094396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:40.106055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:40.106970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:40.107792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:40.108872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:40.112812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:40.114009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:40.359106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:40.360047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:40.390794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:40.393946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:40.395886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:40.397451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:40.401012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:40.401650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:40.665248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:40.676673 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee36fb91-8005-49bc-b417-d4f8898cb07e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1669 microversion: 2.1 time: 0.594890 Oct 19 07:14:40.695860 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2612/5079] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:40 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1669 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:41.211030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:41.227153 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1678ffc-1db5-4104-908a-84c5b751b462 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1516 microversion: 2.1 time: 0.870442 Oct 19 07:14:41.241349 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2468/5080] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:40 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1516 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:41.703810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:41.704460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:41.722262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:41.724501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:41.726903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:41.728079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:41.730113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:41.731562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:41.980008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:42.000522 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-735763df-57e9-41e1-b603-2c1aa50ee2de tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1550 microversion: 2.1 time: 0.302592 Oct 19 07:14:42.009152 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2613/5081] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:41 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1550 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:42.169540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5f07ff3d-41a6-475b-aeef-4bb86ee9b853 req-ce4a39a0-9951-44f7-822d-73b4f8b80c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486742e7-6b82-4482-95c6-d709cb21e4d5", "name": "network-vif-deleted", "tag": "9c8933a5-5d07-48ce-b0c3-ac177f06c4b9"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:42.207686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5f07ff3d-41a6-475b-aeef-4bb86ee9b853 req-ce4a39a0-9951-44f7-822d-73b4f8b80c18 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:42.209299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5f07ff3d-41a6-475b-aeef-4bb86ee9b853 req-ce4a39a0-9951-44f7-822d-73b4f8b80c18 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:42.210140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5f07ff3d-41a6-475b-aeef-4bb86ee9b853 req-ce4a39a0-9951-44f7-822d-73b4f8b80c18 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:42.275530 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5f07ff3d-41a6-475b-aeef-4bb86ee9b853 req-ce4a39a0-9951-44f7-822d-73b4f8b80c18 service nova] Creating event network-vif-deleted:9c8933a5-5d07-48ce-b0c3-ac177f06c4b9 for instance 486742e7-6b82-4482-95c6-d709cb21e4d5 on n-h2-861333-10 Oct 19 07:14:42.292385 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5f07ff3d-41a6-475b-aeef-4bb86ee9b853 req-ce4a39a0-9951-44f7-822d-73b4f8b80c18 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118464 Oct 19 07:14:42.297679 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2469/5082] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:14:43.031540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:43.032252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:43.048681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:43.062551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:43.073257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:43.073257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:43.073257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:43.073257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:43.170146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:43.175209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:43.176148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:43.177024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lazy-loading 'fault' on Instance uuid 486742e7-6b82-4482-95c6-d709cb21e4d5 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:14:43.358799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:43.373226 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0783986-e8b3-460d-85dd-3f984f316f02 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 200 len: 1338 microversion: 2.1 time: 0.346738 Oct 19 07:14:43.373817 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2614/5083] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:43 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 1338 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:44.417392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:44.417392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 486742e7-6b82-4482-95c6-d709cb21e4d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:44.423893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:44.427016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:44.430111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:44.431078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:44.431567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:44.431996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:44.486930 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] HTTP exception thrown: Instance 486742e7-6b82-4482-95c6-d709cb21e4d5 could not be found. Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Request method failure captured: Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 HTTP/1.1 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6MoZKzHotyZ1eTfqssLdaexVaBzyVSfOVgJ9MxjiHTrSptbsyGpzjg_wo8_ePUE5xg0quXoL0Ze0iVWc9woLFMrdBs6Bb85ytuWXmPAgzdrXJ5al0-2dCfbiuXcH8VgKr_duCeitUYcy6Pw9z1ArBFcVL4-j-yF6jvlPDmyrYDn31U Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 5d4e7cd4e1884e7c9b83189f5079e0a5 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkBasicOps-71718984 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d4e7cd4e1884e7c9b83189f5079e0a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d4e7cd4e1884e7c9b83189f5079e0a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d4e7cd4e1884e7c9b83189f5079e0a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d4e7cd4e1884e7c9b83189f5079e0a5", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkBasicOps-71718984 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 5d4e7cd4e1884e7c9b83189f5079e0a5 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkBasicOps-71718984 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestNetworkBasicOps-71718984-project Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 57cb186cade14d558122b6bf720c2922 Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkBasicOps-71718984-project Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 486742e7-6b82-4482-95c6-d709cb21e4d5 could not be found. Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '486742e7-6b82-4482-95c6-d709cb21e4d5'} Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 486742e7-6b82-4482-95c6-d709cb21e4d5 could not be found. Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 486742e7-6b82-4482-95c6-d709cb21e4d5 could not be found. Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:14:44.488963 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:44.500289 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:14:44.500289 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:14:44.500289 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:14:44.500289 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:14:44.500289 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:14:44.500289 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 486742e7-6b82-4482-95c6-d709cb21e4d5 could not be found. Oct 19 07:14:44.500289 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:14:44.500289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Returning 404 to user: Instance 486742e7-6b82-4482-95c6-d709cb21e4d5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:14:44.500289 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4d9c9ac-e410-4d03-9ae3-7ae91a550343 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5" status: 404 len: 111 microversion: 2.1 time: 0.096637 Oct 19 07:14:44.522006 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2470/5084] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:44 2022] GET /compute/v2.1/servers/486742e7-6b82-4482-95c6-d709cb21e4d5 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:14:45.160844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6de50415-7032-40f3-a456-ffdec31f4c6c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '.version_select at 0x7f6d64914ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:45.184217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:45.304626 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6de50415-7032-40f3-a456-ffdec31f4c6c tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1880163577" status: 202 len: 0 microversion: 2.1 time: 0.147465 Oct 19 07:14:45.305359 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2615/5085] 10.222.0.39 () {58 vars in 1257 bytes} [Wed Oct 19 07:14:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1880163577 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:14:46.002733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0f5914e-0f12-4fc3-8e3b-8f9fa73d0f79 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'create', calling method: .version_select at 0x7f6d5f5ef790>, body: {"keypair": {"name": "tempest-keypair-1294360590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsgb+Ca+YTQbzZGnvuWa/Q4Bd5oJ6O+8rGL/8tsxmgmQuRYq4myqA9zTY8AYbpGGUZFVhyWy6uCk2m8ft8lo31s1t6HBzUlkBIMa4soNWwfwrlpNFz6OCRuZKdzaSWiIw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:46.025930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b0f5914e-0f12-4fc3-8e3b-8f9fa73d0f79 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Getting quotas for project a457b818318a499188fb805286d6c77b. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:14:46.039812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b0f5914e-0f12-4fc3-8e3b-8f9fa73d0f79 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Getting quotas for user fc1f35324a234df58ec230f0a99454b4 and project a457b818318a499188fb805286d6c77b. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:14:46.136022 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0f5914e-0f12-4fc3-8e3b-8f9fa73d0f79 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138186 Oct 19 07:14:46.143378 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2471/5086] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:14:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:14:51.708585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-450231197", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea3be4ee-1c3f-44e1-8e40-ebdb90658b72"}], "security_groups": [{"name": "tempest-securitygroup--1281967523"}], "key_name": "tempest-keypair-1294360590", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:14:52.288980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] validate_networks() for [('ea3be4ee-1c3f-44e1-8e40-ebdb90658b72', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:14:53.379695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:53.684159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:14:53.684781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:14:53.685933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:14:53.686434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:14:53.686928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:14:53.698488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:53.699568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:53.700420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:53.717255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:53.717255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:53.717255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:53.748033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Getting quotas for project a457b818318a499188fb805286d6c77b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:14:53.754770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Getting quotas for user fc1f35324a234df58ec230f0a99454b4 and project a457b818318a499188fb805286d6c77b. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:14:53.805320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:14:53.807657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:14:54.204833 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23ce55e0-879e-44a8-95a0-70899813b43d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.505740 Oct 19 07:14:54.206772 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2616/5087] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:14:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:14:54.226084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8a89e9d-b484-497d-9358-2000c12b94d3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:54.228372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8a89e9d-b484-497d-9358-2000c12b94d3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:54.239191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:54.439409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:14:54.835802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8a89e9d-b484-497d-9358-2000c12b94d3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:54.845183 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8a89e9d-b484-497d-9358-2000c12b94d3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1245 microversion: 2.1 time: 0.629645 Oct 19 07:14:54.847745 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2472/5088] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:54 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1245 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:55.875385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:55.876213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:55.886580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:55.887187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:55.887884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:55.889236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:55.891208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:55.891900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:55.970429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:55.982118 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c35c416-bd5b-4789-aa17-e8b16bcf8a05 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1249 microversion: 2.1 time: 0.112826 Oct 19 07:14:55.999576 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2617/5089] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:55 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1249 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:57.021222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:57.021867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:57.061732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:57.061732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:57.061732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:57.061732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:57.061732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:57.063073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:57.265774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:57.277526 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43d2e466-c68c-47cf-b487-30f8c2afd213 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1297 microversion: 2.1 time: 0.266131 Oct 19 07:14:57.291551 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2473/5090] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:57 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1297 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:58.311814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:58.314338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:58.331216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:58.333426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:58.334425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:58.337146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:58.338336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:58.345197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:58.539579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:14:58.553651 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0b0ed3a-47d7-471b-98e4-ad22d2f8c12c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1303 microversion: 2.1 time: 0.249227 Oct 19 07:14:58.556481 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2618/5091] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:58 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1303 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:14:59.582119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:14:59.584428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:14:59.600187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:59.601789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:59.602759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:14:59.603987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:14:59.604741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:14:59.605439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:00.380331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:00.412839 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea03a87f-3927-42bf-a8a9-a1c496ff5ffc tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1371 microversion: 2.1 time: 0.822141 Oct 19 07:15:00.412839 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2474/5092] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:14:59 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1371 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:01.423738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:01.424972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:01.450969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:01.451508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:01.457920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:01.462120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:01.462848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:01.463319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:02.567159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:02.577070 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-792a7394-df33-4582-ba55-3d1b08db27ca tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1371 microversion: 2.1 time: 1.158006 Oct 19 07:15:02.585974 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2619/5093] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:01 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1371 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:03.155187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4823fdce-e19b-44f0-a355-3456c8c2ea43 req-5268f105-a617-4346-9bce-226fde820ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a", "tag": "e7ff4e1a-1b17-4f96-a31a-02807f3d1d71"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:03.194439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4823fdce-e19b-44f0-a355-3456c8c2ea43 req-5268f105-a617-4346-9bce-226fde820ed2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:03.195080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4823fdce-e19b-44f0-a355-3456c8c2ea43 req-5268f105-a617-4346-9bce-226fde820ed2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:03.199677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4823fdce-e19b-44f0-a355-3456c8c2ea43 req-5268f105-a617-4346-9bce-226fde820ed2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:03.250695 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4823fdce-e19b-44f0-a355-3456c8c2ea43 req-5268f105-a617-4346-9bce-226fde820ed2 service nova] Creating event network-changed:e7ff4e1a-1b17-4f96-a31a-02807f3d1d71 for instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a on n-h1-861333-10 Oct 19 07:15:03.267903 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4823fdce-e19b-44f0-a355-3456c8c2ea43 req-5268f105-a617-4346-9bce-226fde820ed2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115847 Oct 19 07:15:03.270265 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2475/5094] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:15:03.614901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:03.615607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:03.632332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:03.634495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:03.642024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:03.642024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:03.642024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:03.642024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:03.748575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:03.781299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:04.037729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:04.047375 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e40963b-79c0-46e2-bb0f-14af989a391e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1371 microversion: 2.1 time: 0.438373 Oct 19 07:15:04.049888 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2620/5095] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:03 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1371 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:05.077195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:05.078577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:05.081587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:05.090715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:05.093727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:05.094462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:05.097043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:05.098377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:05.107684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:05.599066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:05.616910 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe975764-9caf-4cb7-a572-f69fb8b10f0b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1371 microversion: 2.1 time: 0.546168 Oct 19 07:15:05.618135 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2476/5096] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:05 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:05.668500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afb2b123-6a9a-4aad-842f-046c86874bd2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:05.670959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afb2b123-6a9a-4aad-842f-046c86874bd2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:05.694909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb2b123-6a9a-4aad-842f-046c86874bd2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:05.695668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb2b123-6a9a-4aad-842f-046c86874bd2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:05.696508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb2b123-6a9a-4aad-842f-046c86874bd2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:05.698054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb2b123-6a9a-4aad-842f-046c86874bd2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:05.700436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb2b123-6a9a-4aad-842f-046c86874bd2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:05.700893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb2b123-6a9a-4aad-842f-046c86874bd2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:05.868594 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afb2b123-6a9a-4aad-842f-046c86874bd2 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.202412 Oct 19 07:15:05.870102 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2621/5097] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 07:15:05 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1/os-volume_attachments => generated 25 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:06.120577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:06.121498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:06.148575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:06.153038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:06.153038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:06.153038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:06.153038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:06.153038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:06.258547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:15:06.639421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:06.641148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:06.650267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:06.650775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:06.651221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:06.655752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:06.656592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:06.659131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:06.953464 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff3914f1-a206-4ac6-a948-23e6425e939c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "DELETE /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 204 len: 0 microversion: 2.20 time: 0.836591 Oct 19 07:15:06.957852 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2477/5098] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:15:06 2022] DELETE /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:15:06.959776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:06.985791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:06.990168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:06.996501 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ca86d79-eb34-4d25-b818-7f240fdad367 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1371 microversion: 2.1 time: 0.359982 Oct 19 07:15:06.998165 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2622/5099] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:06 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:07.015377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:07.015377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:07.015377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:07.015377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:07.015712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:07.016158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:07.340685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:07.355618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:07.365017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:07.366604 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-edddd709-b16b-48a4-bf09-d90c0b899ae6 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 0.401246 Oct 19 07:15:07.372349 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2478/5100] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:15:06 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:15:08.025418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:08.026419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:08.060014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:08.067390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:08.072965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:08.077942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:08.081452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:08.081922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:08.396698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:08.408348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:08.413364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:08.434062 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c003a34f-663e-4abd-95e2-eb6fc09bb5cd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1371 microversion: 2.1 time: 0.414984 Oct 19 07:15:08.436565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:08.437102 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2623/5101] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:08 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:08.437876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:08.438581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:08.439562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:08.440305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:08.440971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:09.461839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:09.462556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:09.476186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:09.476705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:09.477164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:09.477889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:09.488806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:09.489467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:09.749891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:09.769037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:09.771942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:09.773993 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-736f6743-2de9-43e9-9043-db9b41410c01 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1723 microversion: 2.20 time: 1.369746 Oct 19 07:15:09.795090 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2479/5102] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:15:08 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1723 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:15:09.927445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:09.942356 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4adef3a6-fc33-494e-b492-205899a9d1da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1371 microversion: 2.1 time: 0.481444 Oct 19 07:15:09.942356 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2624/5103] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:09 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1371 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:15:10.091323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-144d5c54-2a04-4b08-81f8-aecef9a4fb25 req-035e4f17-8acc-4579-84d5-fa93a8a78e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a", "name": "network-vif-plugged", "status": "completed", "tag": "e7ff4e1a-1b17-4f96-a31a-02807f3d1d71"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:10.108597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-144d5c54-2a04-4b08-81f8-aecef9a4fb25 req-035e4f17-8acc-4579-84d5-fa93a8a78e6f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:10.109611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-144d5c54-2a04-4b08-81f8-aecef9a4fb25 req-035e4f17-8acc-4579-84d5-fa93a8a78e6f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:10.110883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-144d5c54-2a04-4b08-81f8-aecef9a4fb25 req-035e4f17-8acc-4579-84d5-fa93a8a78e6f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:10.131733 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-144d5c54-2a04-4b08-81f8-aecef9a4fb25 req-035e4f17-8acc-4579-84d5-fa93a8a78e6f service nova] Creating event network-vif-plugged:e7ff4e1a-1b17-4f96-a31a-02807f3d1d71 for instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a on n-h1-861333-10 Oct 19 07:15:10.138869 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-144d5c54-2a04-4b08-81f8-aecef9a4fb25 req-035e4f17-8acc-4579-84d5-fa93a8a78e6f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051940 Oct 19 07:15:10.145500 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2480/5104] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:15:10.806251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:10.806886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:10.824491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:10.825135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:10.825538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:10.829081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:10.830112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:10.830590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:10.965407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:10.966146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:10.987471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:10.987983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:10.988504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:10.989236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:10.989702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:10.990140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:11.068392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:11.083989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:11.085500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:11.090848 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-604d11e6-c972-467e-b954-70d4cc6d61ba tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1656 microversion: 2.20 time: 0.287581 Oct 19 07:15:11.092843 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2625/5105] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:15:10 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1656 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:15:11.574217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:11.591280 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a89c67f8-e6ee-4ed2-ae28-30d11799fa5e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1371 microversion: 2.1 time: 0.629285 Oct 19 07:15:11.592451 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2481/5106] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:10 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1371 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:11.725298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a957dd44-ebd0-454b-b72c-68717c382010 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Action: 'create', calling method: .version_select at 0x7f6d68a75d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1149129164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFZvZ8wLJSPWdK5WHKCQE2KQJy8H2OS3VmWb8D7I8rk3DoC5DCMPOWmI3n3LUIooleHv+nDtyPD3XCLVD9ycRgu917mTwHlYUQtjJmQdWLohelyxroMmzxNg8t1OmDmQQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:11.764346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a957dd44-ebd0-454b-b72c-68717c382010 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:15:11.787723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a957dd44-ebd0-454b-b72c-68717c382010 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for user 57cb186cade14d558122b6bf720c2922 and project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:15:11.983233 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a957dd44-ebd0-454b-b72c-68717c382010 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.263768 Oct 19 07:15:11.985058 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2626/5107] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:15:11 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:15:12.007592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-59283547-06f0-4fd8-a06a-60e01a2f8369 req-5a2e256b-a304-4514-93eb-14fab48a7783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a4daae-6c1a-4174-a294-85466495b6c1", "name": "network-vif-deleted", "tag": "c784c077-e373-459c-a2b3-896b21d78fbc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:12.050132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-59283547-06f0-4fd8-a06a-60e01a2f8369 req-5a2e256b-a304-4514-93eb-14fab48a7783 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:12.057642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-59283547-06f0-4fd8-a06a-60e01a2f8369 req-5a2e256b-a304-4514-93eb-14fab48a7783 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:12.061072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-59283547-06f0-4fd8-a06a-60e01a2f8369 req-5a2e256b-a304-4514-93eb-14fab48a7783 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:12.097093 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-59283547-06f0-4fd8-a06a-60e01a2f8369 req-5a2e256b-a304-4514-93eb-14fab48a7783 service nova] Creating event network-vif-deleted:c784c077-e373-459c-a2b3-896b21d78fbc for instance 59a4daae-6c1a-4174-a294-85466495b6c1 on n-h2-861333-10 Oct 19 07:15:12.108408 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-59283547-06f0-4fd8-a06a-60e01a2f8369 req-5a2e256b-a304-4514-93eb-14fab48a7783 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113829 Oct 19 07:15:12.125779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:12.125779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:12.131807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:12.134475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:12.135874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:12.136885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:12.138423 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2482/5108] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:15:12.139241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:12.139887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:12.321822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:12.345507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:12.351694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:12.355393 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1422dccd-24cd-4a23-b2fd-7f452caf7d26 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1656 microversion: 2.20 time: 0.239923 Oct 19 07:15:12.370435 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2627/5109] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:15:12 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1656 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:15:12.617153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:12.618235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:12.643090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:12.647612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:12.649840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:12.659800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:12.659800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:12.659800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:13.128605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:13.141089 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d4040a8-acf2-4e6f-a104-9f29476b57f0 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1565 microversion: 2.1 time: 0.527788 Oct 19 07:15:13.158957 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2483/5110] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:12 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1565 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:13.174310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10e6e7fb-30bd-475b-af34-12e8cb0f669d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:13.177506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10e6e7fb-30bd-475b-af34-12e8cb0f669d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:13.192191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10e6e7fb-30bd-475b-af34-12e8cb0f669d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:13.192974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10e6e7fb-30bd-475b-af34-12e8cb0f669d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:13.202930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10e6e7fb-30bd-475b-af34-12e8cb0f669d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:13.205175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10e6e7fb-30bd-475b-af34-12e8cb0f669d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:13.209046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10e6e7fb-30bd-475b-af34-12e8cb0f669d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:13.210910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10e6e7fb-30bd-475b-af34-12e8cb0f669d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:13.391003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:13.392526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:13.407705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:13.408754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:13.411317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:13.413163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:13.413659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:13.415044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:13.465729 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10e6e7fb-30bd-475b-af34-12e8cb0f669d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299690 Oct 19 07:15:13.466696 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2628/5111] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:15:13 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-interface => generated 284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:15:13.510365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:13.511489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:13.513606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:13.514942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lazy-loading 'fault' on Instance uuid 59a4daae-6c1a-4174-a294-85466495b6c1 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:15:13.722216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:13.735187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:13.741417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eadfbc09389478d9bbf2c3f90033135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7336f5e48c4c2ea36b25acaffdca60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:13.741417 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2994700-f76d-4e1d-a10e-ee983d0ea3d7 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 200 len: 1372 microversion: 2.20 time: 0.353873 Oct 19 07:15:13.741417 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2484/5112] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:15:13 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 1372 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:15:14.773846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:14.774701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:14.788255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:14.794724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:14.794852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:14.795729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:14.796348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:14.796993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:14.848158 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] HTTP exception thrown: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Request method failure captured: Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 HTTP/1.1 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6JAo7Bw98DynGDOTxYoYef9YzMscFBzehU8wAtrxs1f8PeMRDg2s-TIL-AUJqVfA1VtBmL1SA-F0a3sKhEGx8bEfv_1F8v3xRVfOz41ipa3obQ2j0qSwTrfYivkYZvSIv7Vc4J3kv8_W5kBg6MEQuywAgfRY2vYi2yKBRl_pzCOLig Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c7336f5e48c4c2ea36b25acaffdca60", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 9eadfbc09389478d9bbf2c3f90033135 Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '59a4daae-6c1a-4174-a294-85466495b6c1'} Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:14.854465 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:14.858102 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:14.858102 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:14.858102 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:14.858102 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:14.858102 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:15:14.858102 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:15:14.858102 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:14.858102 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:14.862387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Returning 404 to user: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:14.863607 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa6f80ea-b505-4108-8c07-d79348ac33c0 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 404 len: 111 microversion: 2.20 time: 0.097300 Oct 19 07:15:14.866222 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2629/5113] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:15:14 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:15:14.885083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea4aebcc-8658-4b1a-8dc1-2719c52c0458 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '.version_select at 0x7f6d64077b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:15.056517 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea4aebcc-8658-4b1a-8dc1-2719c52c0458 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292389028" status: 204 len: 0 microversion: 2.20 time: 0.184962 Oct 19 07:15:15.057430 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2485/5114] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Oct 19 07:15:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292389028 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:15:17.089525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0fe8d5d8-b833-49e3-9f32-364f32843998 req-3ac4fcf1-f043-43ad-a51d-664d6a7987db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a", "tag": "e7ff4e1a-1b17-4f96-a31a-02807f3d1d71"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:17.106261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0fe8d5d8-b833-49e3-9f32-364f32843998 req-3ac4fcf1-f043-43ad-a51d-664d6a7987db service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:17.111304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0fe8d5d8-b833-49e3-9f32-364f32843998 req-3ac4fcf1-f043-43ad-a51d-664d6a7987db service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:17.112030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0fe8d5d8-b833-49e3-9f32-364f32843998 req-3ac4fcf1-f043-43ad-a51d-664d6a7987db service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:17.132853 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0fe8d5d8-b833-49e3-9f32-364f32843998 req-3ac4fcf1-f043-43ad-a51d-664d6a7987db service nova] Creating event network-changed:e7ff4e1a-1b17-4f96-a31a-02807f3d1d71 for instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a on n-h1-861333-10 Oct 19 07:15:17.139951 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0fe8d5d8-b833-49e3-9f32-364f32843998 req-3ac4fcf1-f043-43ad-a51d-664d6a7987db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054647 Oct 19 07:15:17.145534 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2630/5115] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:15:18.637580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-857885651", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "662c8659-7f69-42ae-b225-18a3cf2e4c3e"}], "key_name": "tempest-TestNetworkBasicOps-1149129164", "security_groups": [{"name": "tempest-secgroup-smoke-607483377"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:18.978320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] validate_networks() for [('662c8659-7f69-42ae-b225-18a3cf2e4c3e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:15:19.727447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:15:19.728596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:15:19.729696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:15:19.732454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:15:19.734525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:15:19.784225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:19.786738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:19.789528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:19.790517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:19.793628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:19.794633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:19.844214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:15:19.875980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Getting quotas for user 57cb186cade14d558122b6bf720c2922 and project 5d4e7cd4e1884e7c9b83189f5079e0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:15:19.898716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:15:19.901896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:15:20.135576 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f8ef7d1-0ec6-44ad-8ac2-d6f627cba2c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.512006 Oct 19 07:15:20.136907 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2486/5116] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:15:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:15:20.151262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c815652b-b74c-4cac-b987-f25b0fbe4e61 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:20.152189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c815652b-b74c-4cac-b987-f25b0fbe4e61 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:20.251941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c815652b-b74c-4cac-b987-f25b0fbe4e61 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:20.263892 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c815652b-b74c-4cac-b987-f25b0fbe4e61 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1248 microversion: 2.1 time: 0.119251 Oct 19 07:15:20.264536 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2631/5117] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:20 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1248 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:21.290503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07b403ce-1052-4d68-b859-05d83c3244af tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:21.291846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07b403ce-1052-4d68-b859-05d83c3244af tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:21.409784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07b403ce-1052-4d68-b859-05d83c3244af tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:21.418040 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07b403ce-1052-4d68-b859-05d83c3244af tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1248 microversion: 2.1 time: 0.132328 Oct 19 07:15:21.426400 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2487/5118] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:21 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1248 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:22.448641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:22.450281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:22.461645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:22.466289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:22.467225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:22.468023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:22.469171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:22.470149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:22.470814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:22.636403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:22.636403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:22.657131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:22.662754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:22.665944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:22.665944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:22.665944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:22.665944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:22.702499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:22.741764 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] HTTP exception thrown: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Request method failure captured: Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 HTTP/1.1 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6JAo7Bw98DynGDOTxYoYef9YzMscFBzehU8wAtrxs1f8PeMRDg2s-TIL-AUJqVfA1VtBmL1SA-F0a3sKhEGx8bEfv_1F8v3xRVfOz41ipa3obQ2j0qSwTrfYivkYZvSIv7Vc4J3kv8_W5kBg6MEQuywAgfRY2vYi2yKBRl_pzCOLig Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c7336f5e48c4c2ea36b25acaffdca60", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 9eadfbc09389478d9bbf2c3f90033135 Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '59a4daae-6c1a-4174-a294-85466495b6c1'} Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:15:22.748252 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.752288 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.752937 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ecd88b76-5892-4044-b295-f27304cf304e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1244 microversion: 2.1 time: 0.305016 Oct 19 07:15:22.760888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Returning 404 to user: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:22.762319 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f28b9ed2-7090-4958-9a80-2a979c39ada3 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "DELETE /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 404 len: 111 microversion: 2.20 time: 0.131859 Oct 19 07:15:22.771909 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2632/5119] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:22 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1244 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:22.772386 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2488/5120] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:15:22 2022] DELETE /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:15:22.779770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:22.781181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 59a4daae-6c1a-4174-a294-85466495b6c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:22.788815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:22.789578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:22.790324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:22.791201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:22.791817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:22.792426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:22.820726 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] HTTP exception thrown: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Request method failure captured: Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 HTTP/1.1 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6JAo7Bw98DynGDOTxYoYef9YzMscFBzehU8wAtrxs1f8PeMRDg2s-TIL-AUJqVfA1VtBmL1SA-F0a3sKhEGx8bEfv_1F8v3xRVfOz41ipa3obQ2j0qSwTrfYivkYZvSIv7Vc4J3kv8_W5kBg6MEQuywAgfRY2vYi2yKBRl_pzCOLig Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c7336f5e48c4c2ea36b25acaffdca60", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 9eadfbc09389478d9bbf2c3f90033135 Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '59a4daae-6c1a-4174-a294-85466495b6c1'} Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.823448 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:22.827212 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.827212 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:22.827212 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:22.827212 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:22.827212 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:15:22.827212 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:15:22.827212 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. Oct 19 07:15:22.827212 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:22.829321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Returning 404 to user: Instance 59a4daae-6c1a-4174-a294-85466495b6c1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:22.830456 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d081097-8ac8-4905-a0c9-ce4a4f60e24c tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1" status: 404 len: 111 microversion: 2.20 time: 0.055659 Oct 19 07:15:22.831319 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2633/5121] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:15:22 2022] GET /compute/v2.1/servers/59a4daae-6c1a-4174-a294-85466495b6c1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:15:23.778139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:23.779306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:23.787350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:23.788041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:23.790766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:23.790766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:23.790766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:23.790766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:23.886135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:23.896125 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97139966-9722-4402-9390-6ef744a62005 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1308 microversion: 2.1 time: 0.122694 Oct 19 07:15:23.904959 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2489/5122] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:23 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:24.931618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:24.937317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:24.966660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:24.967185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:24.967641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:24.973571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:24.974071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:24.977848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:25.089937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:25.099333 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-225366a7-0beb-4cfa-9825-7cdb94a9cf6b tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1306 microversion: 2.1 time: 0.174956 Oct 19 07:15:25.105354 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2634/5123] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:24 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1306 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:26.138861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:26.140364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:26.158675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:26.159406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:26.160011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:26.164494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:26.166600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:26.167991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:26.617800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:26.635680 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5ce4a5d-48c3-4490-b515-063235d2a376 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1373 microversion: 2.1 time: 0.501865 Oct 19 07:15:26.661553 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2490/5124] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:26 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1373 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:27.670433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:27.671220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:27.690968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:27.693454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:27.693454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:27.693454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:27.693454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:27.695066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:27.880882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-98071010-d956-4667-adee-cf2acc5a52c6 req-abbc4c8f-8e80-4ef5-b4b1-4db114994c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6daa5ae4-a91b-4510-a3b9-8de8a8ac8844", "tag": "9930135f-2bac-463a-8ea7-46fd38d63006"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:27.899539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-98071010-d956-4667-adee-cf2acc5a52c6 req-abbc4c8f-8e80-4ef5-b4b1-4db114994c80 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:27.900040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-98071010-d956-4667-adee-cf2acc5a52c6 req-abbc4c8f-8e80-4ef5-b4b1-4db114994c80 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:27.900516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-98071010-d956-4667-adee-cf2acc5a52c6 req-abbc4c8f-8e80-4ef5-b4b1-4db114994c80 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:27.946142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-98071010-d956-4667-adee-cf2acc5a52c6 req-abbc4c8f-8e80-4ef5-b4b1-4db114994c80 service nova] Creating event network-changed:9930135f-2bac-463a-8ea7-46fd38d63006 for instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 on n-h2-861333-10 Oct 19 07:15:27.952335 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-98071010-d956-4667-adee-cf2acc5a52c6 req-abbc4c8f-8e80-4ef5-b4b1-4db114994c80 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.568398 Oct 19 07:15:27.954380 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2635/5125] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:15:28.786934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:28.806603 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0479130f-daf9-485b-8989-2051666ddfb6 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1373 microversion: 2.1 time: 1.140920 Oct 19 07:15:28.809441 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2491/5126] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:27 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1373 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:15:29.841281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:29.843811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:29.867565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:29.870158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:29.870705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:29.871476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:29.872900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:29.873353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:29.927961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=87 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:29.991888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:29.992465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:29.996893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:30.016266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:30.016804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:30.017270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:30.018028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:30.021626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:30.023414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:30.026546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:30.065322 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] HTTP exception thrown: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Request method failure captured: Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf HTTP/1.1 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6JAo7Bw98DynGDOTxYoYef9YzMscFBzehU8wAtrxs1f8PeMRDg2s-TIL-AUJqVfA1VtBmL1SA-F0a3sKhEGx8bEfv_1F8v3xRVfOz41ipa3obQ2j0qSwTrfYivkYZvSIv7Vc4J3kv8_W5kBg6MEQuywAgfRY2vYi2yKBRl_pzCOLig Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c7336f5e48c4c2ea36b25acaffdca60", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 9eadfbc09389478d9bbf2c3f90033135 Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf'} Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:15:30.068089 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.071225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Returning 404 to user: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:30.072903 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c7d61b36-c3ba-447c-a2bf-8e3ccde7eb98 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 404 len: 111 microversion: 2.20 time: 0.086540 Oct 19 07:15:30.073498 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2492/5127] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:15:29 2022] DELETE /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:15:30.092174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:30.093238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] [instance: 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:30.106846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:30.110215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:30.110823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:30.111885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:30.113439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:30.114018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:30.153768 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] HTTP exception thrown: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Request method failure captured: Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf HTTP/1.1 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6JAo7Bw98DynGDOTxYoYef9YzMscFBzehU8wAtrxs1f8PeMRDg2s-TIL-AUJqVfA1VtBmL1SA-F0a3sKhEGx8bEfv_1F8v3xRVfOz41ipa3obQ2j0qSwTrfYivkYZvSIv7Vc4J3kv8_W5kBg6MEQuywAgfRY2vYi2yKBRl_pzCOLig Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c7336f5e48c4c2ea36b25acaffdca60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c7336f5e48c4c2ea36b25acaffdca60", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 1c7336f5e48c4c2ea36b25acaffdca60 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-556330644 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 9eadfbc09389478d9bbf2c3f90033135 Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeShelveTestJSON-556330644-project Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf'} Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.165640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] Returning 404 to user: Instance 1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:30.171414 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cdff0d08-43dd-49bd-9ddf-6309641e2b22 tempest-AttachVolumeShelveTestJSON-556330644 tempest-AttachVolumeShelveTestJSON-556330644-project] 10.222.0.39 "GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf" status: 404 len: 111 microversion: 2.20 time: 0.087157 Oct 19 07:15:30.172493 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2493/5128] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:15:30 2022] GET /compute/v2.1/servers/1f5dbf30-f9de-4bb9-b2fd-fb8954a82abf => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:15:30.257525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:30.364381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:30.379239 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e09964ce-f3f7-4ebd-928a-5143b815a452 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1373 microversion: 2.1 time: 0.545155 Oct 19 07:15:30.381791 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2636/5129] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:29 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1373 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:31.408919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:31.410896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:31.414919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:31.427456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:31.428226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:31.431393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:31.443738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:31.443738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:31.443738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:31.741456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:31.752475 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c0c4947-a4d0-45d6-a05f-4a4f7fed6f27 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1373 microversion: 2.1 time: 0.349972 Oct 19 07:15:31.753848 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2494/5130] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:31 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1373 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:32.777015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:32.778957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:32.798206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:32.799779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:32.800485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:32.803112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:32.804501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:32.807148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:32.875176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-03ed146a-881c-4d01-8a33-4374ce73e8d1 req-c5f2c266-766f-4ad9-bf5f-374d40fea90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daa5ae4-a91b-4510-a3b9-8de8a8ac8844", "name": "network-vif-plugged", "status": "completed", "tag": "9930135f-2bac-463a-8ea7-46fd38d63006"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:32.904373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03ed146a-881c-4d01-8a33-4374ce73e8d1 req-c5f2c266-766f-4ad9-bf5f-374d40fea90d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:32.905047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03ed146a-881c-4d01-8a33-4374ce73e8d1 req-c5f2c266-766f-4ad9-bf5f-374d40fea90d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:32.905530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03ed146a-881c-4d01-8a33-4374ce73e8d1 req-c5f2c266-766f-4ad9-bf5f-374d40fea90d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:32.930644 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-03ed146a-881c-4d01-8a33-4374ce73e8d1 req-c5f2c266-766f-4ad9-bf5f-374d40fea90d service nova] Creating event network-vif-plugged:9930135f-2bac-463a-8ea7-46fd38d63006 for instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 on n-h2-861333-10 Oct 19 07:15:32.949257 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-03ed146a-881c-4d01-8a33-4374ce73e8d1 req-c5f2c266-766f-4ad9-bf5f-374d40fea90d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078672 Oct 19 07:15:32.950428 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2495/5131] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:15:33.286642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:33.301991 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ba61f05-2c0a-41e7-96ac-6aef1d4dcddc tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1373 microversion: 2.1 time: 0.528955 Oct 19 07:15:33.306842 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2637/5132] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:32 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1373 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:34.335809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:34.339574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:34.387224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:34.389498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:34.392223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:34.395262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:34.396658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:34.397337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:34.739738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:34.751656 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cdfd4939-10b1-405a-b344-f19a8f3975d9 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1373 microversion: 2.1 time: 0.421338 Oct 19 07:15:34.752756 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2496/5133] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:34 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1373 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:15:35.786056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:35.786969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:35.802909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:35.803411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:35.805032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:35.807256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:35.811699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:35.812495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:36.046404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:36.060596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1053210-65ff-4310-87aa-209f19962dee tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1546 microversion: 2.1 time: 0.288542 Oct 19 07:15:36.074772 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2638/5134] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:35 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1546 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:36.088743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:36.091239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:36.099167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:15:36.105862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:36.105862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:36.105862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:36.106857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:36.107997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:36.109442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:36.414020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:36.431913 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ebedba1-165d-4c71-8542-8bfe524419c1 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1546 microversion: 2.1 time: 0.348473 Oct 19 07:15:36.432529 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2497/5135] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:15:36 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1546 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:15:38.917437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:38.918635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:38.932524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:38.936208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:38.936780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:38.937918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:38.938579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:38.941702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:39.480581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:39.493282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:39.497437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:15:39.506197 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7dcbdc6-be25-4129-aa3c-35342a364b37 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2950 microversion: 2.32 time: 0.588299 Oct 19 07:15:39.514258 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2639/5136] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:15:38 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2950 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:15:39.538408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-250e47b0-0827-4878-987f-215ac03d8a39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:39.539658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-250e47b0-0827-4878-987f-215ac03d8a39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:39.554815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-250e47b0-0827-4878-987f-215ac03d8a39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:39.555945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-250e47b0-0827-4878-987f-215ac03d8a39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:39.556382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-250e47b0-0827-4878-987f-215ac03d8a39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:39.557463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-250e47b0-0827-4878-987f-215ac03d8a39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:39.558076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-250e47b0-0827-4878-987f-215ac03d8a39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:39.558687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-250e47b0-0827-4878-987f-215ac03d8a39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:39.921611 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-250e47b0-0827-4878-987f-215ac03d8a39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.393072 Oct 19 07:15:39.935677 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2498/5137] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Oct 19 07:15:39 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd/os-interface => generated 1831 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:15:40.180474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8cde6918-e858-4a1c-a35a-592f9b85b484 req-954353f6-0a67-470f-b583-064f724b44fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6daa5ae4-a91b-4510-a3b9-8de8a8ac8844", "tag": "9930135f-2bac-463a-8ea7-46fd38d63006"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:40.189417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8cde6918-e858-4a1c-a35a-592f9b85b484 req-954353f6-0a67-470f-b583-064f724b44fc service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:40.193583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8cde6918-e858-4a1c-a35a-592f9b85b484 req-954353f6-0a67-470f-b583-064f724b44fc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:40.194930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8cde6918-e858-4a1c-a35a-592f9b85b484 req-954353f6-0a67-470f-b583-064f724b44fc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:40.212458 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8cde6918-e858-4a1c-a35a-592f9b85b484 req-954353f6-0a67-470f-b583-064f724b44fc service nova] Creating event network-changed:9930135f-2bac-463a-8ea7-46fd38d63006 for instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 on n-h2-861333-10 Oct 19 07:15:40.219066 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8cde6918-e858-4a1c-a35a-592f9b85b484 req-954353f6-0a67-470f-b583-064f724b44fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066400 Oct 19 07:15:40.219692 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2640/5138] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:15:41.298342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29c00d5b-12be-4ecf-9ae4-19dbcf2d6659 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Action: 'create', calling method: .version_select at 0x7f6d5fa28f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-687156207", "metadata": {"Type": "work"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29c00d5b-12be-4ecf-9ae4-19dbcf2d6659 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Request method failure captured: Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 121 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6QdZ-JKHXuvN2HL06C2DnRu3wTG0nVmnIubeIKEvuVB9MOtdGpbzRF0Zg04VbX1WnA9IbVlU3OzcXjhynaBxKwaF1ZgQK06unnBLDvJTnQjB9L5U-jtraRdHD0-4G4uxQWbWtOmXWVqY5R_xaMvN8C4FXkZ6OtAcMTQWu2IlzhM2hE Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6ee6d3f2b91247a7a79db0475b26f749", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 324d3731bac54d368da8d2f4db91ce87 Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-687156207", "metadata": {"Type": "work"}}} Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-687156207', 'metadata': {'Type': 'work'}}}} Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '#$%' Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:15:41.300629 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29c00d5b-12be-4ecf-9ae4-19dbcf2d6659 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29c00d5b-12be-4ecf-9ae4-19dbcf2d6659 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.172865 Oct 19 07:15:41.306156 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2499/5139] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Oct 19 07:15:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:15:41.329605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-060ea482-84bd-48e9-82af-ef361ec7de19 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Action: 'create', calling method: .version_select at 0x7f6d5f615f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1630589728", "metadata": {"Type": "work"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-060ea482-84bd-48e9-82af-ef361ec7de19 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Request method failure captured: Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 120 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6QdZ-JKHXuvN2HL06C2DnRu3wTG0nVmnIubeIKEvuVB9MOtdGpbzRF0Zg04VbX1WnA9IbVlU3OzcXjhynaBxKwaF1ZgQK06unnBLDvJTnQjB9L5U-jtraRdHD0-4G4uxQWbWtOmXWVqY5R_xaMvN8C4FXkZ6OtAcMTQWu2IlzhM2hE Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6ee6d3f2b91247a7a79db0475b26f749", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 324d3731bac54d368da8d2f4db91ce87 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1630589728", "metadata": {"Type": "work"}}} Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1630589728', 'metadata': {'Type': 'work'}}}} Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '0' Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:15:41.339531 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 07:15:41.343625 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.365012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-060ea482-84bd-48e9-82af-ef361ec7de19 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:41.365922 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-060ea482-84bd-48e9-82af-ef361ec7de19 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.056449 Oct 19 07:15:41.366693 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2641/5140] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Oct 19 07:15:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:15:41.381859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88b8a319-396d-4ceb-8fe1-5cfce02b9997 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Action: 'create', calling method: .version_select at 0x7f6d5fa3d430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1707241450", "metadata": {"Type": "work"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88b8a319-396d-4ceb-8fe1-5cfce02b9997 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Request method failure captured: Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 119 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6QdZ-JKHXuvN2HL06C2DnRu3wTG0nVmnIubeIKEvuVB9MOtdGpbzRF0Zg04VbX1WnA9IbVlU3OzcXjhynaBxKwaF1ZgQK06unnBLDvJTnQjB9L5U-jtraRdHD0-4G4uxQWbWtOmXWVqY5R_xaMvN8C4FXkZ6OtAcMTQWu2IlzhM2hE Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6ee6d3f2b91247a7a79db0475b26f749", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 324d3731bac54d368da8d2f4db91ce87 Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1707241450", "metadata": {"Type": "work"}}} Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1707241450', 'metadata': {'Type': 'work'}}}} Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '' Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:15:41.389295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88b8a319-396d-4ceb-8fe1-5cfce02b9997 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-88b8a319-396d-4ceb-8fe1-5cfce02b9997 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013361 Oct 19 07:15:41.396034 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2500/5141] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Oct 19 07:15:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:15:41.405470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42a344fa-c5fb-4dbf-a4eb-40bd92440c04 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Calling method '.version_select at 0x7f6d649873a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:41.498064 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-42a344fa-c5fb-4dbf-a4eb-40bd92440c04 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] HTTP exception thrown: Volume tempest-invalid-1029415813 could not be found. Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42a344fa-c5fb-4dbf-a4eb-40bd92440c04 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Request method failure captured: Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1029415813 HTTP/1.1 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6QdZ-JKHXuvN2HL06C2DnRu3wTG0nVmnIubeIKEvuVB9MOtdGpbzRF0Zg04VbX1WnA9IbVlU3OzcXjhynaBxKwaF1ZgQK06unnBLDvJTnQjB9L5U-jtraRdHD0-4G4uxQWbWtOmXWVqY5R_xaMvN8C4FXkZ6OtAcMTQWu2IlzhM2hE Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6ee6d3f2b91247a7a79db0475b26f749", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 324d3731bac54d368da8d2f4db91ce87 Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: exception: Volume tempest-invalid-1029415813 could not be found. Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'tempest-invalid-1029415813'} Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1029415813 could not be found. (HTTP 404) (Request-ID: req-d167f0d3-8f04-4a1e-88dd-244588ed724b) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 07:15:41.499402 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1029415813 could not be found. Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1029415813 could not be found. Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1029415813 could not be found. Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42a344fa-c5fb-4dbf-a4eb-40bd92440c04 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Returning 404 to user: Volume tempest-invalid-1029415813 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42a344fa-c5fb-4dbf-a4eb-40bd92440c04 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1029415813" status: 404 len: 99 microversion: 2.1 time: 0.100525 Oct 19 07:15:41.502576 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2642/5142] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 07:15:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1029415813 => generated 99 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:15:41.512316 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f6056b4-8930-422c-8e86-355ecca86bff tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003969 Oct 19 07:15:41.513163 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2501/5143] 10.222.0.39 () {58 vars in 1140 bytes} [Wed Oct 19 07:15:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 07:15:41.523558 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aed14880-1471-443f-a7c0-ddb36496c720 tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004008 Oct 19 07:15:41.526748 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2643/5144] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 07:15:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 07:15:41.535631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81a3bf89-44d6-456b-9138-c7da0004eabe tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Calling method '.version_select at 0x7f6d640754c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:41.601312 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-81a3bf89-44d6-456b-9138-c7da0004eabe tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] HTTP exception thrown: Volume 664e1562-cc79-4efb-a428-64a7c505f1f6 could not be found. Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81a3bf89-44d6-456b-9138-c7da0004eabe tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Request method failure captured: Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-volumes/664e1562-cc79-4efb-a428-64a7c505f1f6 HTTP/1.1 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6QdZ-JKHXuvN2HL06C2DnRu3wTG0nVmnIubeIKEvuVB9MOtdGpbzRF0Zg04VbX1WnA9IbVlU3OzcXjhynaBxKwaF1ZgQK06unnBLDvJTnQjB9L5U-jtraRdHD0-4G4uxQWbWtOmXWVqY5R_xaMvN8C4FXkZ6OtAcMTQWu2IlzhM2hE Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6ee6d3f2b91247a7a79db0475b26f749", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 324d3731bac54d368da8d2f4db91ce87 Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: method: Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: exception: Volume 664e1562-cc79-4efb-a428-64a7c505f1f6 could not be found. Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '664e1562-cc79-4efb-a428-64a7c505f1f6'} Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 664e1562-cc79-4efb-a428-64a7c505f1f6 could not be found. (HTTP 404) (Request-ID: req-7d509a74-9377-4ecc-8602-3126cc299180) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 07:15:41.603951 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 664e1562-cc79-4efb-a428-64a7c505f1f6 could not be found. Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 664e1562-cc79-4efb-a428-64a7c505f1f6 could not be found. Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 664e1562-cc79-4efb-a428-64a7c505f1f6 could not be found. Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81a3bf89-44d6-456b-9138-c7da0004eabe tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Returning 404 to user: Volume 664e1562-cc79-4efb-a428-64a7c505f1f6 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81a3bf89-44d6-456b-9138-c7da0004eabe tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/664e1562-cc79-4efb-a428-64a7c505f1f6" status: 404 len: 109 microversion: 2.1 time: 0.074714 Oct 19 07:15:41.612159 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2502/5145] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:15:41 2022] DELETE /compute/v2.1/os-volumes/664e1562-cc79-4efb-a428-64a7c505f1f6 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:15:41.621650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4381d717-2ef6-421b-9c03-f8abe4acce2c tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Calling method '.version_select at 0x7f6d64f01040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:15:41.670918 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-4381d717-2ef6-421b-9c03-f8abe4acce2c tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] HTTP exception thrown: Volume e229b1fa-d65d-4653-b1fb-b413636d32b7 could not be found. Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4381d717-2ef6-421b-9c03-f8abe4acce2c tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Request method failure captured: Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-volumes/e229b1fa-d65d-4653-b1fb-b413636d32b7 HTTP/1.1 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6QdZ-JKHXuvN2HL06C2DnRu3wTG0nVmnIubeIKEvuVB9MOtdGpbzRF0Zg04VbX1WnA9IbVlU3OzcXjhynaBxKwaF1ZgQK06unnBLDvJTnQjB9L5U-jtraRdHD0-4G4uxQWbWtOmXWVqY5R_xaMvN8C4FXkZ6OtAcMTQWu2IlzhM2hE Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6ee6d3f2b91247a7a79db0475b26f749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6ee6d3f2b91247a7a79db0475b26f749", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 6ee6d3f2b91247a7a79db0475b26f749 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesNegativeTest-1804035272 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 324d3731bac54d368da8d2f4db91ce87 Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesNegativeTest-1804035272-project Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: exception: Volume e229b1fa-d65d-4653-b1fb-b413636d32b7 could not be found. Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'e229b1fa-d65d-4653-b1fb-b413636d32b7'} Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e229b1fa-d65d-4653-b1fb-b413636d32b7 could not be found. (HTTP 404) (Request-ID: req-063468c3-57a5-4dc6-82d2-5add4350a8be) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 07:15:41.673287 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e229b1fa-d65d-4653-b1fb-b413636d32b7 could not be found. Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e229b1fa-d65d-4653-b1fb-b413636d32b7 could not be found. Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e229b1fa-d65d-4653-b1fb-b413636d32b7 could not be found. Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4381d717-2ef6-421b-9c03-f8abe4acce2c tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] Returning 404 to user: Volume e229b1fa-d65d-4653-b1fb-b413636d32b7 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4381d717-2ef6-421b-9c03-f8abe4acce2c tempest-VolumesNegativeTest-1804035272 tempest-VolumesNegativeTest-1804035272-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e229b1fa-d65d-4653-b1fb-b413636d32b7" status: 404 len: 109 microversion: 2.1 time: 0.058327 Oct 19 07:15:41.679944 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2644/5146] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:15:41 2022] GET /compute/v2.1/os-volumes/e229b1fa-d65d-4653-b1fb-b413636d32b7 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:15:49.507828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbc3479f-31b6-48c3-989c-38cccf61109a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b72928d-b211-48d8-a1e6-86a5571ecbfe"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:15:49.510902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbc3479f-31b6-48c3-989c-38cccf61109a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:15:49.525140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc3479f-31b6-48c3-989c-38cccf61109a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:49.525140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc3479f-31b6-48c3-989c-38cccf61109a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:49.525140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc3479f-31b6-48c3-989c-38cccf61109a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:49.525140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc3479f-31b6-48c3-989c-38cccf61109a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:15:49.525140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc3479f-31b6-48c3-989c-38cccf61109a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:15:49.525140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc3479f-31b6-48c3-989c-38cccf61109a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:15:50.673933 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbc3479f-31b6-48c3-989c-38cccf61109a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.174629 Oct 19 07:15:50.674743 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2503/5147] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:15:49 2022] POST /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 194 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:16:00.710234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=17 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:16:00.711726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=25 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:16:00.717012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41d2f2a1-8e29-4fca-b316-2f9cf467ea65 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:16:00.719431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-41d2f2a1-8e29-4fca-b316-2f9cf467ea65 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:00.727769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41d2f2a1-8e29-4fca-b316-2f9cf467ea65 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:00.728964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41d2f2a1-8e29-4fca-b316-2f9cf467ea65 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:00.729418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41d2f2a1-8e29-4fca-b316-2f9cf467ea65 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:00.730139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41d2f2a1-8e29-4fca-b316-2f9cf467ea65 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:00.730769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41d2f2a1-8e29-4fca-b316-2f9cf467ea65 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:00.731382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41d2f2a1-8e29-4fca-b316-2f9cf467ea65 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:00.790178 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41d2f2a1-8e29-4fca-b316-2f9cf467ea65 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "POST /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844/action" status: 200 len: 24570 microversion: 2.1 time: 0.080838 Oct 19 07:16:00.792241 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2645/5148] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:16:00 2022] POST /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844/action => generated 24570 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:16:06.536353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:16:06.539337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:06.547723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:16:06.548494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:16:06.559941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:06.561775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:06.564679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:06.565550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:06.567197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:06.567790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:06.632231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lazy-loading 'flavor' on Instance uuid 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:16:07.194809 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c075a8c-a833-4d2a-8c4a-b24f766c28a4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/action" status: 200 len: 32 microversion: 2.1 time: 0.664833 Oct 19 07:16:07.195528 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2504/5149] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:16:06 2022] POST /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/action => generated 32 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:16:07.206103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:07.206732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:07.221259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:07.221752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:07.222187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:07.223156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:07.223825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:07.224292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:07.407337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:07.420634 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7589e68d-bee7-4c9f-9f9b-a5c97112d951 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.218104 Oct 19 07:16:07.439583 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2646/5150] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:07 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:08.447093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:08.448654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:08.461849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:08.467531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:08.469690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:08.475825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:08.475825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:08.475825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:08.893765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:08.915863 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5be786c5-a438-4e92-b73e-1c9cf3746216 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.473614 Oct 19 07:16:08.919525 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2505/5151] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:08 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:09.942885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:09.943950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:09.955493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:09.956389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:09.957157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:09.958994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:09.959802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:09.960774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:10.186062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:10.197691 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12d78570-963d-4095-b460-bb3e4a005d67 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.259884 Oct 19 07:16:10.198782 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2647/5152] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:09 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:11.224463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:11.225221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:11.232918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:11.235742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:11.235742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:11.235742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:11.235742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:11.236767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:11.578678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:11.589153 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-117c0ebb-2962-4f52-a62c-3110bdc3397a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.370150 Oct 19 07:16:11.590039 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2506/5153] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:11 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:11.905649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-999e45fc-b5b7-46c5-874c-d9af0232dd7f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:16:11.911092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-999e45fc-b5b7-46c5-874c-d9af0232dd7f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:11.922752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-999e45fc-b5b7-46c5-874c-d9af0232dd7f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:11.923555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-999e45fc-b5b7-46c5-874c-d9af0232dd7f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:11.924337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-999e45fc-b5b7-46c5-874c-d9af0232dd7f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:11.929344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-999e45fc-b5b7-46c5-874c-d9af0232dd7f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:11.929344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-999e45fc-b5b7-46c5-874c-d9af0232dd7f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:11.929344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-999e45fc-b5b7-46c5-874c-d9af0232dd7f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:11.999501 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-999e45fc-b5b7-46c5-874c-d9af0232dd7f tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "POST /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844/action" status: 200 len: 32645 microversion: 2.1 time: 0.104136 Oct 19 07:16:12.001141 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2648/5154] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:16:11 2022] POST /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844/action => generated 32645 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:16:12.614311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:12.614924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:12.627451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:12.633272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:12.633272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:12.633272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:12.633272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:12.633272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:12.818917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:12.836304 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d35d491-5fcb-4751-b0b9-b59c130f509f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.226002 Oct 19 07:16:12.853888 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2507/5155] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:12 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:13.596001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:13.596769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:13.597202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d03994fd-5e37-450a-98a6-c5ba421abbbf req-459e707c-2884-48a9-ac47-f830478e23b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6daa5ae4-a91b-4510-a3b9-8de8a8ac8844", "tag": "9930135f-2bac-463a-8ea7-46fd38d63006"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:16:13.609119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d03994fd-5e37-450a-98a6-c5ba421abbbf req-459e707c-2884-48a9-ac47-f830478e23b0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:13.609774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d03994fd-5e37-450a-98a6-c5ba421abbbf req-459e707c-2884-48a9-ac47-f830478e23b0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:13.610778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d03994fd-5e37-450a-98a6-c5ba421abbbf req-459e707c-2884-48a9-ac47-f830478e23b0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:13.620806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:13.621576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:13.623717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:13.624668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:13.625997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:13.627940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:13.633337 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d03994fd-5e37-450a-98a6-c5ba421abbbf req-459e707c-2884-48a9-ac47-f830478e23b0 service nova] Creating event network-changed:9930135f-2bac-463a-8ea7-46fd38d63006 for instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 on n-h2-861333-10 Oct 19 07:16:13.652337 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d03994fd-5e37-450a-98a6-c5ba421abbbf req-459e707c-2884-48a9-ac47-f830478e23b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056423 Oct 19 07:16:13.653327 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2508/5156] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:16:13.680073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:16:13.864502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:13.868782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:13.881314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:13.882638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:13.883409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:13.884498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:13.885171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:13.885790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:14.163188 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f058884a-f678-486f-8b6d-58751e5c53d4 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 204 len: 0 microversion: 2.1 time: 0.572455 Oct 19 07:16:14.166963 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2649/5157] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:16:13 2022] DELETE /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:16:14.173057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:14.173954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:14.205971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:14.206486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:14.207135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:14.215469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:14.216766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:14.217247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:14.288430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:14.305514 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7568e90d-0971-49d3-8a08-c5f708675181 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.447764 Oct 19 07:16:14.322598 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2509/5158] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:13 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:14.519010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:14.527051 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2b778ea-75f8-453c-949d-5229b2447a85 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1670 microversion: 2.1 time: 0.358604 Oct 19 07:16:14.527637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2650/5159] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:14 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1670 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:15.335684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:15.336906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:15.351132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:15.352948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:15.352948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:15.352948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:15.353331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:15.353762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:15.551140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:15.551769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:15.568073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:15.569177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:15.569937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:15.570824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:15.571440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:15.572041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:15.627412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:15.644462 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1cb28a8a-265f-487f-a502-8b2a3346250d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.310951 Oct 19 07:16:15.652597 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2510/5160] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:15 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:15.924417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:15.938299 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3085778f-2e44-45da-9f5f-0627b7a2f39a tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1670 microversion: 2.1 time: 0.390495 Oct 19 07:16:15.939457 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2651/5161] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:15 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1670 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:16.439765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9acd78bf-e2fe-40be-b89d-d447eabada1f req-2d2a369c-f286-4d53-86a4-63286d97cb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daa5ae4-a91b-4510-a3b9-8de8a8ac8844", "name": "network-vif-deleted", "tag": "9930135f-2bac-463a-8ea7-46fd38d63006"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:16:16.451221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9acd78bf-e2fe-40be-b89d-d447eabada1f req-2d2a369c-f286-4d53-86a4-63286d97cb46 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:16.451790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9acd78bf-e2fe-40be-b89d-d447eabada1f req-2d2a369c-f286-4d53-86a4-63286d97cb46 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:16.452336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9acd78bf-e2fe-40be-b89d-d447eabada1f req-2d2a369c-f286-4d53-86a4-63286d97cb46 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:16.467831 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9acd78bf-e2fe-40be-b89d-d447eabada1f req-2d2a369c-f286-4d53-86a4-63286d97cb46 service nova] Creating event network-vif-deleted:9930135f-2bac-463a-8ea7-46fd38d63006 for instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 on n-h2-861333-10 Oct 19 07:16:16.473812 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9acd78bf-e2fe-40be-b89d-d447eabada1f req-2d2a369c-f286-4d53-86a4-63286d97cb46 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037361 Oct 19 07:16:16.474425 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2511/5162] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:16:16.667478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:16.668098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:16.676173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:16.676891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:16.677970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:16.683177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:16.683724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:16.687999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:16.897366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:16.912518 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32462a8c-91df-4faf-8fda-9b523b714c1a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.248623 Oct 19 07:16:16.915879 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2652/5163] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:16 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:16.966331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:16.966418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:16.980958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:16.981839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:16.982297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:16.983030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:16.983542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:16.983980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:17.035552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:17.036037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:17.037343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:17.039721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lazy-loading 'fault' on Instance uuid 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:16:17.116062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb186cade14d558122b6bf720c2922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4e7cd4e1884e7c9b83189f5079e0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:17.125046 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa7b286b-6152-4601-9367-2fff91d1a433 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 200 len: 1338 microversion: 2.1 time: 0.164821 Oct 19 07:16:17.125741 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2512/5164] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:16 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 1338 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:16:17.955272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:17.960300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:17.978127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:17.979368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:17.980130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:17.981388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:17.982146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:17.982803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:18.156293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:18.158250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] [instance: 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:18.168504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:18.169246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:18.169964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:18.170899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:18.171008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:18.171928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:18.172800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:18.182291 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-206b6077-35d1-451f-989a-90ca33a49dde tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.237771 Oct 19 07:16:18.184072 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2653/5165] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:17 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:18.189659 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] HTTP exception thrown: Instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 could not be found. Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Request method failure captured: Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 HTTP/1.1 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6MoZKzHotyZ1eTfqssLdaexVaBzyVSfOVgJ9MxjiHTrSptbsyGpzjg_wo8_ePUE5xg0quXoL0Ze0iVWc9woLFMrdBs6Bb85ytuWXmPAgzdrXJ5al0-2dCfbiuXcH8VgKr_duCeitUYcy6Pw9z1ArBFcVL4-j-yF6jvlPDmyrYDn31U Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 5d4e7cd4e1884e7c9b83189f5079e0a5 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkBasicOps-71718984 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d4e7cd4e1884e7c9b83189f5079e0a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d4e7cd4e1884e7c9b83189f5079e0a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d4e7cd4e1884e7c9b83189f5079e0a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d4e7cd4e1884e7c9b83189f5079e0a5", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkBasicOps-71718984 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 5d4e7cd4e1884e7c9b83189f5079e0a5 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkBasicOps-71718984 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestNetworkBasicOps-71718984-project Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 57cb186cade14d558122b6bf720c2922 Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkBasicOps-71718984-project Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 could not be found. Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '6daa5ae4-a91b-4510-a3b9-8de8a8ac8844'} Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 could not be found. Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 could not be found. Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:16:18.191652 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:16:18.195736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:16:18.195736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:16:18.195736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:16:18.195736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:16:18.195736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:16:18.195736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 could not be found. Oct 19 07:16:18.195736 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:16:18.195736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Returning 404 to user: Instance 6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:16:18.195736 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca7b81b9-d5ae-4f16-9c53-30b31a3aca4e tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844" status: 404 len: 111 microversion: 2.1 time: 0.043240 Oct 19 07:16:18.206719 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2513/5166] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:18 2022] GET /compute/v2.1/servers/6daa5ae4-a91b-4510-a3b9-8de8a8ac8844 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:16:18.531354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b95921c0-037e-46b2-9f1e-8f11ee2724b2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] Calling method '.version_select at 0x7f6d64d91e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:18.630626 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b95921c0-037e-46b2-9f1e-8f11ee2724b2 tempest-TestNetworkBasicOps-71718984 tempest-TestNetworkBasicOps-71718984-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1149129164" status: 202 len: 0 microversion: 2.1 time: 0.103520 Oct 19 07:16:18.632442 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2654/5167] 10.222.0.39 () {58 vars in 1257 bytes} [Wed Oct 19 07:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1149129164 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:16:19.215263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:19.218312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:19.229900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:19.230412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:19.231039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:19.231983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:19.232558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:19.232994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:19.613769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:19.628069 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1ee5191-d829-4ff9-ad81-a99fec9165c2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.420922 Oct 19 07:16:19.639229 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2514/5168] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:19 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:20.665561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:20.666958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:20.684987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:20.686808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:20.687812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:20.694575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:20.696617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:20.697755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:21.184492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:21.194122 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ad5d6c5-55c0-40e4-81f5-539fcec613df tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.537661 Oct 19 07:16:21.198257 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2655/5169] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:20 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:22.223216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:22.225627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:22.253030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:22.253530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:22.258090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:22.259032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:22.259884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:22.260533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:22.754870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:22.772198 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0e9b149-dfa9-4446-a8b9-a0ff5ac5071e tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.551628 Oct 19 07:16:22.773881 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2515/5170] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:22 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:23.797670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:23.799776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:23.809642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:23.810476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:23.811141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:23.812401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:23.813894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:23.814581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:24.221536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:24.236342 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b480fb28-e7a1-4854-ba26-a53b5228038a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.442109 Oct 19 07:16:24.236342 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2656/5171] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:23 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:25.260954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:25.262168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:25.286831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:25.287303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:25.287928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:25.289154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:25.289777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:25.290360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:25.512704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:25.523701 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c856b3b-b48d-4b85-a542-db1ac7b22ab6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.267741 Oct 19 07:16:25.524338 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2516/5172] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:25 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:26.551651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:26.553191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:26.562386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:26.563138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:26.563589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:26.564519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:26.564985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:26.565452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:26.721586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:26.731678 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2169ebd-ee00-4eb3-83cd-671cf64bf35a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1735 microversion: 2.1 time: 0.185035 Oct 19 07:16:26.731764 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2657/5173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:26 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:27.762926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:27.764913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:27.774423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:27.775886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:27.776663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:27.778178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:27.779840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:27.781755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:28.021290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:28.030876 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81e4b973-55a2-48c7-b1b9-ceb247cbafba tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1715 microversion: 2.1 time: 0.277169 Oct 19 07:16:28.043524 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2517/5174] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:27 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1715 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:28.484011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:28.486396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:28.495857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:28.496707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:28.497379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:28.498555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:28.499150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:28.500414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:28.645388 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] HTTP exception thrown: Cannot 'detach_volume' instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a while it is in vm_state rescued Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Request method failure captured: Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments/2b72928d-b211-48d8-a1e6-86a5571ecbfe HTTP/1.1 Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6N-tDItijGcBgGmYG_SAGW3_6j9tHcCoWlwSkFCMVsf1kudeF0pMVbw-7Ar3stxV1wyoNkVWZBpQrwGchitozCNiy9vzY_xtbtitbiu3urH95IzS_orWJGtKLy1RiTvb5DBtzVcx3aKRwG1VXq-GLQyimy0EHWlWBFcGoqSf5R8Vcc Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a457b818318a499188fb805286d6c77b Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a457b818318a499188fb805286d6c77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a457b818318a499188fb805286d6c77b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a457b818318a499188fb805286d6c77b Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc1f35324a234df58ec230f0a99454b4 Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'detach_volume' instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a while it is in vm_state rescued Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': '6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a', 'id': '2b72928d-b211-48d8-a1e6-86a5571ecbfe'} Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a while it is in vm_state rescued Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:16:28.648320 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:16:28.652588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:16:28.652588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:16:28.652588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:16:28.652588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:16:28.652588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a while it is in vm_state rescued Oct 19 07:16:28.652588 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:16:28.666854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Returning 409 to user: Cannot 'detach_volume' instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a while it is in vm_state rescued {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:16:28.669120 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4a2fed3-6ab8-4558-9b0c-2f3e0168a6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments/2b72928d-b211-48d8-a1e6-86a5571ecbfe" status: 409 len: 152 microversion: 2.1 time: 0.190585 Oct 19 07:16:28.673143 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2658/5175] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:16:28 2022] DELETE /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments/2b72928d-b211-48d8-a1e6-86a5571ecbfe => generated 152 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:16:28.682665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-77f89249-c5dc-4d54-87d1-73e1e29bff90 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:16:28.683264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-77f89249-c5dc-4d54-87d1-73e1e29bff90 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:28.691175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f89249-c5dc-4d54-87d1-73e1e29bff90 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:28.692598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f89249-c5dc-4d54-87d1-73e1e29bff90 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:28.692882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f89249-c5dc-4d54-87d1-73e1e29bff90 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:28.696998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f89249-c5dc-4d54-87d1-73e1e29bff90 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:28.699548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f89249-c5dc-4d54-87d1-73e1e29bff90 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:28.701188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f89249-c5dc-4d54-87d1-73e1e29bff90 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:28.920093 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-77f89249-c5dc-4d54-87d1-73e1e29bff90 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/action" status: 202 len: 0 microversion: 2.1 time: 0.239228 Oct 19 07:16:28.920093 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2518/5176] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:16:28 2022] POST /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:16:28.927939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:28.928608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:28.941418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:28.942484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:28.942939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:28.943654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:28.944144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:28.951600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:29.317792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:29.330680 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b4ba84a-2dcc-4bec-a698-32f4e1df8655 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1723 microversion: 2.1 time: 0.406605 Oct 19 07:16:29.345577 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2659/5177] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:28 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:30.367328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:30.367328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:30.379941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:30.380865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:30.381519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:30.382256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:30.382718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:30.383735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:30.390178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:16:30.748868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:30.813461 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8b71c44-0aa7-47cb-ad2a-9c48ec7d7404 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1723 microversion: 2.1 time: 0.453149 Oct 19 07:16:30.833264 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2519/5178] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:30 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:31.369291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Calling method '.version_select at 0x7f6d64797670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:31.371701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:31.372221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:31.372830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:31.393134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:31.393811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:31.394435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:31.411499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:31.412273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:31.413008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:31.421688 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-051f91f8-6df5-4980-b43b-c129c45d0336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1374323915-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.562150 Oct 19 07:16:31.424153 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2660/5179] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 07:16:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:16:31.850567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:31.851133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:31.866338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:31.866838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:31.867270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:31.867989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:31.868499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:31.868929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:32.091018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:32.095710 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe70ce38-d25c-4927-b3db-7174891cfb86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1723 microversion: 2.1 time: 0.249319 Oct 19 07:16:32.096431 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2520/5180] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:31 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:33.119766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:33.120541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:33.127977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:33.128560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:33.129041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:33.130331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:33.131001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:33.131437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:33.150609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:16:33.373050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:33.385717 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32ac269e-1c49-457c-8bb8-f398a671b5e3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1729 microversion: 2.1 time: 0.269964 Oct 19 07:16:33.386571 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2661/5181] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:33 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:33.417770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1088b47b-fe06-4c7d-90d2-53d9f3e01a45 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:33.418286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1088b47b-fe06-4c7d-90d2-53d9f3e01a45 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:33.440289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1088b47b-fe06-4c7d-90d2-53d9f3e01a45 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:33.441010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1088b47b-fe06-4c7d-90d2-53d9f3e01a45 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:33.443671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1088b47b-fe06-4c7d-90d2-53d9f3e01a45 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:33.444425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1088b47b-fe06-4c7d-90d2-53d9f3e01a45 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:33.445117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1088b47b-fe06-4c7d-90d2-53d9f3e01a45 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:33.447251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1088b47b-fe06-4c7d-90d2-53d9f3e01a45 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:33.591418 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1088b47b-fe06-4c7d-90d2-53d9f3e01a45 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177997 Oct 19 07:16:33.592017 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2521/5182] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:16:33 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:16:35.510123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-85165cea-f7df-4b83-ac74-c449d86f0ada req-149d6a46-1120-4e55-9dc8-08a4159da068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a", "tag": "e7ff4e1a-1b17-4f96-a31a-02807f3d1d71"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:16:35.552567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-85165cea-f7df-4b83-ac74-c449d86f0ada req-149d6a46-1120-4e55-9dc8-08a4159da068 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:35.553074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-85165cea-f7df-4b83-ac74-c449d86f0ada req-149d6a46-1120-4e55-9dc8-08a4159da068 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:35.553523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-85165cea-f7df-4b83-ac74-c449d86f0ada req-149d6a46-1120-4e55-9dc8-08a4159da068 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:35.581280 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-85165cea-f7df-4b83-ac74-c449d86f0ada req-149d6a46-1120-4e55-9dc8-08a4159da068 service nova] Creating event network-changed:e7ff4e1a-1b17-4f96-a31a-02807f3d1d71 for instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a on n-h1-861333-10 Oct 19 07:16:35.591857 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-85165cea-f7df-4b83-ac74-c449d86f0ada req-149d6a46-1120-4e55-9dc8-08a4159da068 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086889 Oct 19 07:16:35.592662 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2662/5183] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:16:37.611800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1c1ceb29-c6fa-4cf1-b040-18f77393fb7f req-4fe4eadf-a80c-46dd-a403-6deb2af23573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a", "tag": "e7ff4e1a-1b17-4f96-a31a-02807f3d1d71"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:16:37.634416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=39 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:16:37.636330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1c1ceb29-c6fa-4cf1-b040-18f77393fb7f req-4fe4eadf-a80c-46dd-a403-6deb2af23573 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:37.636816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1c1ceb29-c6fa-4cf1-b040-18f77393fb7f req-4fe4eadf-a80c-46dd-a403-6deb2af23573 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:37.637255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1c1ceb29-c6fa-4cf1-b040-18f77393fb7f req-4fe4eadf-a80c-46dd-a403-6deb2af23573 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:37.657105 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1c1ceb29-c6fa-4cf1-b040-18f77393fb7f req-4fe4eadf-a80c-46dd-a403-6deb2af23573 service nova] Creating event network-changed:e7ff4e1a-1b17-4f96-a31a-02807f3d1d71 for instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a on n-h1-861333-10 Oct 19 07:16:37.664732 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1c1ceb29-c6fa-4cf1-b040-18f77393fb7f req-4fe4eadf-a80c-46dd-a403-6deb2af23573 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057929 Oct 19 07:16:37.671043 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2522/5184] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:16:49.836559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:16:50.112678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Calling method '.version_select at 0x7f6d64797280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:50.114768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:50.116386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:50.117019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:50.135295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:50.135836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:50.136251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:50.148305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:50.148801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:50.149287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:50.157463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e29299a4-460b-4f22-b41c-204dcd16e131 tempest-PortsAdminExtendedAttrsTestJSON-1223630689 tempest-PortsAdminExtendedAttrsTestJSON-1223630689-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.323141 Oct 19 07:16:50.158571 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2663/5185] 10.222.0.39 () {58 vars in 1146 bytes} [Wed Oct 19 07:16:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:16:53.773141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:16:53.778715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1330572972", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:16:53.856578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:16:54.268309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:16:54.268803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:16:54.269291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:16:54.269728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:16:54.270139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:16:54.281115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:54.281621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:54.282072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:54.283232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:54.286524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:54.286524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:54.304557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Getting quotas for project db8ece549c884386a34bdcd24fb794be. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:16:54.311714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Getting quotas for user f283ca42d31a4efbaf4d986fc7ff8422 and project db8ece549c884386a34bdcd24fb794be. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:16:54.325436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:16:54.328525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:16:54.548881 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10ce1740-f06e-494c-a375-d4a989264040 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778863 Oct 19 07:16:54.550285 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2523/5186] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:16:54.566964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e07967b1-5750-4ee8-8f3e-f76c48e8e97e tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:54.570763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e07967b1-5750-4ee8-8f3e-f76c48e8e97e tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:54.640490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e07967b1-5750-4ee8-8f3e-f76c48e8e97e tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:54.649413 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e07967b1-5750-4ee8-8f3e-f76c48e8e97e tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1215 microversion: 2.1 time: 0.086686 Oct 19 07:16:54.650174 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2664/5187] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:54 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:55.682052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d7c4b2f-f397-4ba5-9183-413f502357fe tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:55.682757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d7c4b2f-f397-4ba5-9183-413f502357fe tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:55.765163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d7c4b2f-f397-4ba5-9183-413f502357fe tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:55.775162 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d7c4b2f-f397-4ba5-9183-413f502357fe tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1215 microversion: 2.1 time: 0.102268 Oct 19 07:16:55.792788 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2524/5188] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:55 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:56.801807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:56.802417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:56.813855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:56.814597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:56.815765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:56.826030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:56.826030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:56.826030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:56.890856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:56.900798 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8126f2eb-5db2-481f-b1ed-61b0e7a6f242 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1219 microversion: 2.1 time: 0.102058 Oct 19 07:16:56.900798 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2665/5189] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:56 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:57.925532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:57.926939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:57.937742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:57.938906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:57.939955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:57.940889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:57.941510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:57.942253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:58.070525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:58.084942 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba725a43-5764-4aca-9666-e56c8ccab219 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1267 microversion: 2.1 time: 0.162684 Oct 19 07:16:58.098925 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2525/5190] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:57 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:16:59.114791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:16:59.119316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:16:59.149876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:59.151603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:59.153682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:59.156568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:16:59.157666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:16:59.159639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:16:59.364242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:16:59.380579 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ae00cc4-5a06-495b-b87e-a13f7fa6125a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1273 microversion: 2.1 time: 0.270430 Oct 19 07:16:59.395449 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2666/5191] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:16:59 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:00.413254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:00.414050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:00.450237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:00.450237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:00.454848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:00.461313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:00.462155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:00.463721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:00.644780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:00.658458 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc2d413e-711e-4d59-be2b-186e17123dd4 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1273 microversion: 2.1 time: 0.249500 Oct 19 07:17:00.668545 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2526/5192] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:00 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:01.686937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:01.688918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:01.700350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:01.710279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:01.710279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:01.710279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:01.710279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:01.710279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:01.916297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:01.924142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-542513b8-f520-49ef-a6d5-afe62101a549 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.243847 Oct 19 07:17:01.924650 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2667/5193] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:01 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:02.868362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-48067c7f-57d5-4598-9ffb-2eb1261c1e95 req-f04f0282-8f1b-4af5-a4b8-3f2c40073e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec6b7da-a485-430c-9e54-ae019d9179c9", "tag": "a77ccd67-bbd7-405d-a136-7daceec7aa78"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:02.878615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-48067c7f-57d5-4598-9ffb-2eb1261c1e95 req-f04f0282-8f1b-4af5-a4b8-3f2c40073e47 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:02.879093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-48067c7f-57d5-4598-9ffb-2eb1261c1e95 req-f04f0282-8f1b-4af5-a4b8-3f2c40073e47 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:02.879524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-48067c7f-57d5-4598-9ffb-2eb1261c1e95 req-f04f0282-8f1b-4af5-a4b8-3f2c40073e47 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:02.891013 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-48067c7f-57d5-4598-9ffb-2eb1261c1e95 req-f04f0282-8f1b-4af5-a4b8-3f2c40073e47 service nova] Creating event network-changed:a77ccd67-bbd7-405d-a136-7daceec7aa78 for instance 2ec6b7da-a485-430c-9e54-ae019d9179c9 on n-h2-861333-10 Oct 19 07:17:02.899931 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-48067c7f-57d5-4598-9ffb-2eb1261c1e95 req-f04f0282-8f1b-4af5-a4b8-3f2c40073e47 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035801 Oct 19 07:17:02.901007 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2527/5194] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:02.948624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:02.950236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:02.963234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:02.963728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:02.964286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:02.965186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:02.965649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:02.970659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:03.234638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:03.249035 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1314bd21-70c3-4896-8c7a-afc3ba0b19aa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.304694 Oct 19 07:17:03.264567 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2668/5195] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:02 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:04.279463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:04.280892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:04.294106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:04.295061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:04.295977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:04.297794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:04.298273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:04.298714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:04.299269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:17:04.526803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:04.535990 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4de8f590-eb60-407b-9539-b87fe58a5185 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.262176 Oct 19 07:17:04.548247 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2528/5196] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:04 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:05.559197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:05.560612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:05.567153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:17:05.569178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:05.569891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:05.570549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:05.571476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:05.572251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:05.572917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:05.752556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:05.763173 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ccacc2f3-4211-48a6-8b43-a80f56b24fdd tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.207566 Oct 19 07:17:05.780591 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2669/5197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:05 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:06.787817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:06.788597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:06.808659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:17:06.810784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:06.811282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:06.812456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:06.816084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:06.816586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:06.816845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:06.817326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:06.817420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:06.838559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:06.845640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:06.846205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:06.847149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:06.847638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:06.848080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:07.019331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lazy-loading 'services' on Instance uuid 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:17:07.028242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:07.052220 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-120db774-028d-48b8-80ff-321582860bdc tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.256616 Oct 19 07:17:07.052220 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2529/5198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:06 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:07.262428 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b500dcae-c544-4ae1-9d82-3b1c765d3a98 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments/2b72928d-b211-48d8-a1e6-86a5571ecbfe" status: 202 len: 0 microversion: 2.1 time: 0.452571 Oct 19 07:17:07.263103 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2670/5199] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:17:06 2022] DELETE /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments/2b72928d-b211-48d8-a1e6-86a5571ecbfe => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:17:07.272984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d3fe944-d853-4ffc-a6b2-d0e71c3c45ac tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:07.275596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d3fe944-d853-4ffc-a6b2-d0e71c3c45ac tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:07.293437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d3fe944-d853-4ffc-a6b2-d0e71c3c45ac tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:07.294189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d3fe944-d853-4ffc-a6b2-d0e71c3c45ac tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:07.294794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d3fe944-d853-4ffc-a6b2-d0e71c3c45ac tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:07.295764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d3fe944-d853-4ffc-a6b2-d0e71c3c45ac tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:07.296407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d3fe944-d853-4ffc-a6b2-d0e71c3c45ac tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:07.296991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d3fe944-d853-4ffc-a6b2-d0e71c3c45ac tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:07.337553 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d3fe944-d853-4ffc-a6b2-d0e71c3c45ac tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069765 Oct 19 07:17:07.343162 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2530/5200] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:17:07 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:08.066293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:08.067280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:08.090535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:08.091495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:08.092036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:08.095061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:08.095662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:08.096911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:08.351657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f362ad31-3c4f-42ad-a7f1-2ac4c5389c86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:08.354217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f362ad31-3c4f-42ad-a7f1-2ac4c5389c86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:08.383090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f362ad31-3c4f-42ad-a7f1-2ac4c5389c86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:08.383959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f362ad31-3c4f-42ad-a7f1-2ac4c5389c86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:08.385847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f362ad31-3c4f-42ad-a7f1-2ac4c5389c86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:08.388310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f362ad31-3c4f-42ad-a7f1-2ac4c5389c86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:08.389109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f362ad31-3c4f-42ad-a7f1-2ac4c5389c86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:08.393185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f362ad31-3c4f-42ad-a7f1-2ac4c5389c86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:08.408381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:08.428283 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d130b266-0f91-4bc0-b0f9-b6f48a9874ab tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.368924 Oct 19 07:17:08.430038 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2671/5201] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:08 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:08.454675 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f362ad31-3c4f-42ad-a7f1-2ac4c5389c86 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108063 Oct 19 07:17:08.461488 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2531/5202] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:17:08 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:17:09.453976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:09.455166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:09.468447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e5d8443-1c8d-4c30-ad2f-66c49e303ece tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:09.471559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e5d8443-1c8d-4c30-ad2f-66c49e303ece tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:09.478670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:09.478670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:09.478670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:09.478670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:09.478670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:09.478670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:09.511462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e5d8443-1c8d-4c30-ad2f-66c49e303ece tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:09.514505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e5d8443-1c8d-4c30-ad2f-66c49e303ece tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:09.514505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e5d8443-1c8d-4c30-ad2f-66c49e303ece tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:09.514505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e5d8443-1c8d-4c30-ad2f-66c49e303ece tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:09.514505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e5d8443-1c8d-4c30-ad2f-66c49e303ece tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:09.516557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e5d8443-1c8d-4c30-ad2f-66c49e303ece tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:09.593425 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e5d8443-1c8d-4c30-ad2f-66c49e303ece tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128925 Oct 19 07:17:09.594032 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2532/5203] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:17:09 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:09.786031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:09.814504 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2202af2f-f7a3-44ac-bbc9-80a4c2311542 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.366893 Oct 19 07:17:09.816047 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2672/5204] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:09 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:10.607586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01b7ae8e-4573-4122-97a6-8677699ad3da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:10.609919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01b7ae8e-4573-4122-97a6-8677699ad3da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:10.624072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01b7ae8e-4573-4122-97a6-8677699ad3da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:10.624947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01b7ae8e-4573-4122-97a6-8677699ad3da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:10.625875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01b7ae8e-4573-4122-97a6-8677699ad3da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:10.635570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01b7ae8e-4573-4122-97a6-8677699ad3da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:10.641723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01b7ae8e-4573-4122-97a6-8677699ad3da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:10.642487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01b7ae8e-4573-4122-97a6-8677699ad3da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:10.713322 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01b7ae8e-4573-4122-97a6-8677699ad3da tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110320 Oct 19 07:17:10.721966 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2533/5205] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:17:10 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:10.842253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:10.849462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:10.855674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:10.857969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:10.859617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:10.865770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:10.866416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:10.867024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:11.473254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:11.484984 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a5167bc-dce6-43f5-96f7-627f9ebb5733 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.645366 Oct 19 07:17:11.501429 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2673/5206] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:10 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:11.730703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-607aee68-c63e-4291-9fd8-fd0ac9f5b51a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:11.735444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-607aee68-c63e-4291-9fd8-fd0ac9f5b51a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:11.743881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607aee68-c63e-4291-9fd8-fd0ac9f5b51a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:11.744747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607aee68-c63e-4291-9fd8-fd0ac9f5b51a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:11.752303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607aee68-c63e-4291-9fd8-fd0ac9f5b51a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:11.753530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607aee68-c63e-4291-9fd8-fd0ac9f5b51a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:11.754176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607aee68-c63e-4291-9fd8-fd0ac9f5b51a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:11.754776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607aee68-c63e-4291-9fd8-fd0ac9f5b51a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:11.815180 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-607aee68-c63e-4291-9fd8-fd0ac9f5b51a tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088749 Oct 19 07:17:11.823825 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2534/5207] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:17:11 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:12.511699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:12.519370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:12.541550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:12.543396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:12.543396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:12.546659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:12.549401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:12.550158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:12.924435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cf141f74-b580-43a8-af3e-3c22aa4042fa req-912d47b4-4a5d-4ca0-922e-4fcce370fd98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec6b7da-a485-430c-9e54-ae019d9179c9", "name": "network-vif-plugged", "status": "completed", "tag": "a77ccd67-bbd7-405d-a136-7daceec7aa78"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:12.946297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cf141f74-b580-43a8-af3e-3c22aa4042fa req-912d47b4-4a5d-4ca0-922e-4fcce370fd98 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:12.946883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cf141f74-b580-43a8-af3e-3c22aa4042fa req-912d47b4-4a5d-4ca0-922e-4fcce370fd98 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:12.947327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cf141f74-b580-43a8-af3e-3c22aa4042fa req-912d47b4-4a5d-4ca0-922e-4fcce370fd98 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:12.986907 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cf141f74-b580-43a8-af3e-3c22aa4042fa req-912d47b4-4a5d-4ca0-922e-4fcce370fd98 service nova] Creating event network-vif-plugged:a77ccd67-bbd7-405d-a136-7daceec7aa78 for instance 2ec6b7da-a485-430c-9e54-ae019d9179c9 on n-h2-861333-10 Oct 19 07:17:12.999794 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cf141f74-b580-43a8-af3e-3c22aa4042fa req-912d47b4-4a5d-4ca0-922e-4fcce370fd98 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.419426 Oct 19 07:17:13.000910 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2535/5208] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:17:13.007172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42d72663-4ced-4194-ab09-c428d70af072 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:13.023063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42d72663-4ced-4194-ab09-c428d70af072 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:13.043917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d72663-4ced-4194-ab09-c428d70af072 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:13.046681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d72663-4ced-4194-ab09-c428d70af072 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:13.047399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d72663-4ced-4194-ab09-c428d70af072 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:13.049460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d72663-4ced-4194-ab09-c428d70af072 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:13.050109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d72663-4ced-4194-ab09-c428d70af072 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:13.051080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d72663-4ced-4194-ab09-c428d70af072 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:13.121894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:13.137183 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42d72663-4ced-4194-ab09-c428d70af072 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134836 Oct 19 07:17:13.140844 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a62a2d6f-c48d-41ae-b60e-b959df4f4daa tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.628662 Oct 19 07:17:13.142242 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2674/5209] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:12 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:13.156665 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2536/5210] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:17:13 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:14.154440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4b19838-21cc-4f86-afe7-1f1d7ed1d1e4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:14.157453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4b19838-21cc-4f86-afe7-1f1d7ed1d1e4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:14.167512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:14.168773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:14.178839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:14.179115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:14.179567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:14.194178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b19838-21cc-4f86-afe7-1f1d7ed1d1e4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:14.197154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:14.198764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:14.200037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b19838-21cc-4f86-afe7-1f1d7ed1d1e4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:14.200661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b19838-21cc-4f86-afe7-1f1d7ed1d1e4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:14.204804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:14.205491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b19838-21cc-4f86-afe7-1f1d7ed1d1e4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:14.206006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b19838-21cc-4f86-afe7-1f1d7ed1d1e4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:14.217110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4b19838-21cc-4f86-afe7-1f1d7ed1d1e4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:14.332814 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4b19838-21cc-4f86-afe7-1f1d7ed1d1e4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182674 Oct 19 07:17:14.337476 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2537/5211] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:17:14 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:14.564488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:14.579425 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-379f0b2d-cd28-4b4a-8f11-d66132f5be3c tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1315 microversion: 2.1 time: 0.415134 Oct 19 07:17:14.582593 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2675/5212] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:14 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:17:15.346500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba961c5d-c168-473d-9c32-23d155d1003d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:15.350450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba961c5d-c168-473d-9c32-23d155d1003d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:15.364253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba961c5d-c168-473d-9c32-23d155d1003d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:15.368285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba961c5d-c168-473d-9c32-23d155d1003d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:15.368769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba961c5d-c168-473d-9c32-23d155d1003d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:15.372265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba961c5d-c168-473d-9c32-23d155d1003d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:15.372781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba961c5d-c168-473d-9c32-23d155d1003d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:15.373235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba961c5d-c168-473d-9c32-23d155d1003d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:15.446096 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba961c5d-c168-473d-9c32-23d155d1003d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104124 Oct 19 07:17:15.451014 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2538/5213] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:17:15 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:15.604074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:15.604595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:15.618914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:15.619724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:15.620391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:15.624303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:15.625042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:15.625664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.078213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:16.091332 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e16432d-4a58-439d-ad18-f207b802f23f tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1465 microversion: 2.1 time: 0.489425 Oct 19 07:17:16.092819 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2676/5214] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:15 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1465 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:17:16.185382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:16.186541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:16.206022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.206720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.207406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.208397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.209076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.209672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.248855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:17:16.462866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-654709f0-0cbf-4b91-a106-0df0851d47fd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:16.465689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-654709f0-0cbf-4b91-a106-0df0851d47fd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:16.479073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-654709f0-0cbf-4b91-a106-0df0851d47fd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.480749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-654709f0-0cbf-4b91-a106-0df0851d47fd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.484490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-654709f0-0cbf-4b91-a106-0df0851d47fd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.484829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-654709f0-0cbf-4b91-a106-0df0851d47fd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.485478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-654709f0-0cbf-4b91-a106-0df0851d47fd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.486179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-654709f0-0cbf-4b91-a106-0df0851d47fd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.575315 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-654709f0-0cbf-4b91-a106-0df0851d47fd tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117150 Oct 19 07:17:16.576256 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2677/5215] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:17:16 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:17:16.678338 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec6bb9d2-d6a0-42bc-933c-5036afc6ecee tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 204 len: 0 microversion: 2.1 time: 0.492206 Oct 19 07:17:16.679781 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2539/5216] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:17:16 2022] DELETE /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:17:16.694394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:16.695834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:16.696641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:16.704183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:16.704505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.704839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.705366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.714282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.714828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.716466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.727712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.728826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.731395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.734564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.735202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.736377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.808012 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] HTTP exception thrown: Cannot 'reboot' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Request method failure captured: Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd/action HTTP/1.1 Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 28 Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6N-tDItijGcBgGmYG_SAGW3_6j9tHcCoWlwSkFCMVsf1kudeF0pMVbw-7Ar3stxV1wyoNkVWZBpQrwGchitozCNiy9vzY_xtbtitbiu3urH95IzS_orWJGtKLy1RiTvb5DBtzVcx3aKRwG1VXq-GLQyimy0EHWlWBFcGoqSf5R8Vcc Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a457b818318a499188fb805286d6c77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a457b818318a499188fb805286d6c77b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc1f35324a234df58ec230f0a99454b4 Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: {"reboot": {"type": "HARD"}} Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'reboot' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '5a1aa62a-6f40-4796-aaba-0a5b9ac459cd', 'body': {'reboot': {'type': 'HARD'}}} Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:17:16.811020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued Oct 19 07:17:16.819029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.819972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Returning 409 to user: Cannot 'reboot' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:17:16.821127 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a13ddc4b-5647-43e5-9323-38fde70f3f5d tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd/action" status: 409 len: 145 microversion: 2.1 time: 0.144168 Oct 19 07:17:16.842953 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2678/5217] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:17:16 2022] POST /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd/action => generated 145 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:17:16.848471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:16.853317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:16.863653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.864487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.865205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.865961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:16.866475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:16.866913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:16.917864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:17:16.945343 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] HTTP exception thrown: Cannot 'rebuild' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Request method failure captured: Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd/action HTTP/1.1 Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 65 Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6N-tDItijGcBgGmYG_SAGW3_6j9tHcCoWlwSkFCMVsf1kudeF0pMVbw-7Ar3stxV1wyoNkVWZBpQrwGchitozCNiy9vzY_xtbtitbiu3urH95IzS_orWJGtKLy1RiTvb5DBtzVcx3aKRwG1VXq-GLQyimy0EHWlWBFcGoqSf5R8Vcc Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a457b818318a499188fb805286d6c77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a457b818318a499188fb805286d6c77b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc1f35324a234df58ec230f0a99454b4 Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'rebuild' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '5a1aa62a-6f40-4796-aaba-0a5b9ac459cd', 'body': {'rebuild': {'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084'}}} Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:17:16.947045 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued Oct 19 07:17:16.951413 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:16.967824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Returning 409 to user: Cannot 'rebuild' instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd while it is in vm_state rescued {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:17:16.970961 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ceb726b-76ae-4e78-906a-a714e109d7d2 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "POST /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd/action" status: 409 len: 146 microversion: 2.1 time: 0.126552 Oct 19 07:17:16.978603 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2679/5218] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:17:16 2022] POST /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd/action => generated 146 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:17:16.986313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:16.986824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:17.004025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:17.004871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:17.005527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:17.007489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:17.008196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:17.008821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:17.045438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:17.050247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:17:17.058005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:17:17.059878 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc45ae2f-a667-40aa-9426-767cf9b0b638 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1471 microversion: 2.1 time: 0.372259 Oct 19 07:17:17.072271 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2540/5219] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:16 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1471 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:17:17.433603 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f9ac2ec-2e42-465f-ad34-a1b0ba9ed145 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 204 len: 0 microversion: 2.1 time: 0.452935 Oct 19 07:17:17.434357 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2680/5220] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:17:16 2022] DELETE /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:17:17.444917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:17.445544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:17.472867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:17.473386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:17.473839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:17.476964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:17.477447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:17.477898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:17.963359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:17.988764 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-966c6f70-82e6-44c1-9d25-f29a6012cf26 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1689 microversion: 2.1 time: 0.546432 Oct 19 07:17:17.989574 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2541/5221] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:17 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1689 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:18.088240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:18.090228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:18.105150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:18.105852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:18.120883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:18.122285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:18.122845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:18.124259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:18.540832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:18.550069 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c30f1f1-ec40-4926-aba7-b205f9f10830 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1471 microversion: 2.1 time: 0.468029 Oct 19 07:17:18.550867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2681/5222] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:18 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1471 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:19.025256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:19.027670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:19.044530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:19.046800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:19.051789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:19.053418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:19.054389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:19.055238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:19.574980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:19.576379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:19.584608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:19.585526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:19.586209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:19.587170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:19.587902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:19.588907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:19.893905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:19.928736 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e46f8e9-acde-4baa-ae3d-90e59158bd75 tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1471 microversion: 2.1 time: 0.356772 Oct 19 07:17:19.949523 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2682/5223] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:19 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1471 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:19.956445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:19.971722 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0812c7d-a179-4c16-abc4-8268618877c4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1689 microversion: 2.1 time: 0.960268 Oct 19 07:17:19.989344 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2542/5224] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:19 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1689 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:20.556383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-da5889f8-3da7-4fb8-a58c-d58e636664da req-ed2346ca-7fa1-4f9f-a5d1-0b0e6150cde9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec6b7da-a485-430c-9e54-ae019d9179c9", "name": "network-vif-deleted", "tag": "a77ccd67-bbd7-405d-a136-7daceec7aa78"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:20.578544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-da5889f8-3da7-4fb8-a58c-d58e636664da req-ed2346ca-7fa1-4f9f-a5d1-0b0e6150cde9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:20.579194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-da5889f8-3da7-4fb8-a58c-d58e636664da req-ed2346ca-7fa1-4f9f-a5d1-0b0e6150cde9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:20.579724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-da5889f8-3da7-4fb8-a58c-d58e636664da req-ed2346ca-7fa1-4f9f-a5d1-0b0e6150cde9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:20.613111 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-da5889f8-3da7-4fb8-a58c-d58e636664da req-ed2346ca-7fa1-4f9f-a5d1-0b0e6150cde9 service nova] Creating event network-vif-deleted:a77ccd67-bbd7-405d-a136-7daceec7aa78 for instance 2ec6b7da-a485-430c-9e54-ae019d9179c9 on n-h2-861333-10 Oct 19 07:17:20.630395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-da5889f8-3da7-4fb8-a58c-d58e636664da req-ed2346ca-7fa1-4f9f-a5d1-0b0e6150cde9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078802 Oct 19 07:17:20.632789 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2683/5225] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:20.962378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:20.962995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:20.980092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:20.980959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:20.981636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:20.982585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:20.983260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:20.983923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:21.006103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:21.007163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:21.024714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:21.027106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:21.027775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:21.031106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:21.033329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:21.034587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:21.319502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f283ca42d31a4efbaf4d986fc7ff8422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8ece549c884386a34bdcd24fb794be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:21.341855 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-476b526d-2980-4ae5-862e-16c87a95b81a tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 200 len: 1300 microversion: 2.1 time: 0.383320 Oct 19 07:17:21.342473 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2543/5226] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:20 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 1300 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:22.161917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:22.173444 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6da59399-d79e-4563-958c-f56847823fed tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1689 microversion: 2.1 time: 1.171492 Oct 19 07:17:22.174736 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2684/5227] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:21 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1689 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:22.374076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:22.375022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] [instance: 2ec6b7da-a485-430c-9e54-ae019d9179c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:22.392977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:22.394875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:22.397199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:22.398226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:22.398857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:22.400378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:22.437907 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] HTTP exception thrown: Instance 2ec6b7da-a485-430c-9e54-ae019d9179c9 could not be found. Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Request method failure captured: Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 HTTP/1.1 Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6RiXEbExPVaCByBImazC1X-1y0pYuckr9yolRjPxf3zrDQebDq6Le4X9vOZQESekBlzlSvfQK2n1uK8qNrmH3jbOXaw3F4uNMr-xXGnzHZ104sxUeTwrxPUB3q35xKV621X1E01T3LfrtsHX5nX4IpgkMqnVR_0sAsY-3lbgQXlFOc Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: db8ece549c884386a34bdcd24fb794be Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesNegativeTest-764853491 Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/db8ece549c884386a34bdcd24fb794be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/db8ece549c884386a34bdcd24fb794be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/db8ece549c884386a34bdcd24fb794be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_db8ece549c884386a34bdcd24fb794be", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesNegativeTest-764853491 Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: db8ece549c884386a34bdcd24fb794be Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesNegativeTest-764853491 Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesNegativeTest-764853491-project Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f283ca42d31a4efbaf4d986fc7ff8422 Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesNegativeTest-764853491-project Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 2ec6b7da-a485-430c-9e54-ae019d9179c9 could not be found. Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '2ec6b7da-a485-430c-9e54-ae019d9179c9'} Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec6b7da-a485-430c-9e54-ae019d9179c9 could not be found. Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec6b7da-a485-430c-9e54-ae019d9179c9 could not be found. Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:22.443956 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:17:22.448365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:22.448365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:22.448365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:22.448365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:17:22.448365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:17:22.448365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec6b7da-a485-430c-9e54-ae019d9179c9 could not be found. Oct 19 07:17:22.448365 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:17:22.450196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] Returning 404 to user: Instance 2ec6b7da-a485-430c-9e54-ae019d9179c9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:17:22.451416 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d5ff38a-2a81-4f63-ab51-e7368588a6cf tempest-VolumesNegativeTest-764853491 tempest-VolumesNegativeTest-764853491-project] 10.222.0.39 "GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9" status: 404 len: 111 microversion: 2.1 time: 0.081458 Oct 19 07:17:22.453586 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2544/5228] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:22 2022] GET /compute/v2.1/servers/2ec6b7da-a485-430c-9e54-ae019d9179c9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:17:23.200962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:23.202108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:23.215191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:23.218746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:23.219387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:23.225383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:23.225978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:23.226875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:23.635139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:23.643844 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c551297d-0215-47dd-982c-a9d14e3c6da4 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1689 microversion: 2.1 time: 0.448298 Oct 19 07:17:23.648902 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2685/5229] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:23 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1689 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:24.672556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:24.673181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:24.676867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:17:24.693328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:24.693328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:24.693328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:24.702819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:24.703510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:24.703979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:24.866680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9a17f9a6-324a-4b7a-b56d-a0d34095ed39 req-a8a56f2c-51d3-498d-80a1-7c86e1098b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a", "name": "network-vif-deleted", "tag": "e7ff4e1a-1b17-4f96-a31a-02807f3d1d71"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:24.880474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a17f9a6-324a-4b7a-b56d-a0d34095ed39 req-a8a56f2c-51d3-498d-80a1-7c86e1098b1d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:24.881987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a17f9a6-324a-4b7a-b56d-a0d34095ed39 req-a8a56f2c-51d3-498d-80a1-7c86e1098b1d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:24.882700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a17f9a6-324a-4b7a-b56d-a0d34095ed39 req-a8a56f2c-51d3-498d-80a1-7c86e1098b1d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:24.890487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:24.902887 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b97259f8-b4a1-49ba-b870-4bece7a84b95 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1621 microversion: 2.1 time: 0.234532 Oct 19 07:17:24.911651 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2545/5230] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:24 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1621 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:24.917083 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9a17f9a6-324a-4b7a-b56d-a0d34095ed39 req-a8a56f2c-51d3-498d-80a1-7c86e1098b1d service nova] Creating event network-vif-deleted:e7ff4e1a-1b17-4f96-a31a-02807f3d1d71 for instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a on n-h1-861333-10 Oct 19 07:17:24.926288 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9a17f9a6-324a-4b7a-b56d-a0d34095ed39 req-a8a56f2c-51d3-498d-80a1-7c86e1098b1d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064840 Oct 19 07:17:24.927208 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2686/5231] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:17:25.935033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:25.935033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:25.946608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:25.947073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:25.947521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:25.948277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:25.948746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:25.949185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:26.023814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:26.024541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:26.025111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:26.025975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lazy-loading 'fault' on Instance uuid 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:17:26.172050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:26.188288 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-067784bb-f8e9-4a50-9c7a-c262ffef04f7 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 200 len: 1335 microversion: 2.1 time: 0.256007 Oct 19 07:17:26.220887 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2546/5232] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:25 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 1335 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:27.218879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:27.220263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:27.232815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:17:27.236092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:27.239598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:27.241740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:27.244221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:27.245557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:27.247545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:27.267794 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] HTTP exception thrown: Instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a could not be found. Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Request method failure captured: Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a HTTP/1.1 Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6N-tDItijGcBgGmYG_SAGW3_6j9tHcCoWlwSkFCMVsf1kudeF0pMVbw-7Ar3stxV1wyoNkVWZBpQrwGchitozCNiy9vzY_xtbtitbiu3urH95IzS_orWJGtKLy1RiTvb5DBtzVcx3aKRwG1VXq-GLQyimy0EHWlWBFcGoqSf5R8Vcc Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a457b818318a499188fb805286d6c77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a457b818318a499188fb805286d6c77b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc1f35324a234df58ec230f0a99454b4 Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a could not be found. Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a'} Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a could not be found. Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a could not be found. Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:27.270096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:27.275104 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:27.275104 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:27.275104 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:27.275104 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:27.275104 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:17:27.275104 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:17:27.275104 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a could not be found. Oct 19 07:17:27.275104 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:27.277293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Returning 404 to user: Instance 6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:17:27.278400 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b727fff1-50d7-48bb-9f9b-c04442bff466 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a" status: 404 len: 111 microversion: 2.1 time: 0.065531 Oct 19 07:17:27.279667 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2687/5233] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:27 2022] GET /compute/v2.1/servers/6588eaaf-ea71-45af-ab7c-fbd4abd7ee2a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:17:27.289752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c05d91a3-730e-428b-b17b-eb1032347841 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '.version_select at 0x7f6d6501b550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:27.457948 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c05d91a3-730e-428b-b17b-eb1032347841 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294360590" status: 202 len: 0 microversion: 2.1 time: 0.172713 Oct 19 07:17:27.460057 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2547/5234] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294360590 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:17:40.762145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:40.762712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:40.766270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:17:40.776716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:40.782948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:40.783515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:40.784392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:40.788666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:40.789223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:40.840018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:17:41.215977 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ec13852-9056-4189-96f3-93605a9e004b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 204 len: 0 microversion: 2.1 time: 0.458160 Oct 19 07:17:41.217247 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2688/5235] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:17:40 2022] DELETE /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:17:41.229711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:41.230531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:41.243746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=34 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:17:41.247686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:41.252939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:41.253545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:41.254646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:41.255229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:41.256507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:41.894338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:41.915613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bce90d24-3a15-4639-9b8f-bab7fc9c1fbf tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1509 microversion: 2.1 time: 0.691197 Oct 19 07:17:41.919146 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2548/5236] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:41 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:42.944627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:42.946286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:42.954325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:42.955105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:42.955780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:42.956744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:42.957408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:42.958719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:43.276015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:43.288912 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-856eef07-c2c1-45e7-a82d-a7fd31ff3b7c tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1509 microversion: 2.1 time: 0.349665 Oct 19 07:17:43.289350 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2689/5237] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:42 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1509 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:44.316341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:44.317497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:44.333612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:44.339067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:44.340045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:44.350784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:44.350784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:44.350784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:44.358446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b62ffdaa-0a38-46e4-9fc7-f1bc26b210e0 req-4cd74167-acae-44b9-bba7-17830e977d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1aa62a-6f40-4796-aaba-0a5b9ac459cd", "name": "network-vif-deleted", "tag": "7e5b95eb-05a1-4fd7-98c4-c027bea3d2c3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:44.373178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b62ffdaa-0a38-46e4-9fc7-f1bc26b210e0 req-4cd74167-acae-44b9-bba7-17830e977d2e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:44.373762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b62ffdaa-0a38-46e4-9fc7-f1bc26b210e0 req-4cd74167-acae-44b9-bba7-17830e977d2e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:44.374260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b62ffdaa-0a38-46e4-9fc7-f1bc26b210e0 req-4cd74167-acae-44b9-bba7-17830e977d2e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:44.415909 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b62ffdaa-0a38-46e4-9fc7-f1bc26b210e0 req-4cd74167-acae-44b9-bba7-17830e977d2e service nova] Creating event network-vif-deleted:7e5b95eb-05a1-4fd7-98c4-c027bea3d2c3 for instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd on n-h1-861333-10 Oct 19 07:17:44.430246 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b62ffdaa-0a38-46e4-9fc7-f1bc26b210e0 req-4cd74167-acae-44b9-bba7-17830e977d2e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075132 Oct 19 07:17:44.431605 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2690/5238] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:17:44.519799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:44.539393 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-665093c0-735d-42e2-9ebe-b2dc2f674d3b tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1467 microversion: 2.1 time: 0.221625 Oct 19 07:17:44.548540 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2549/5239] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:44 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1467 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:45.570281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:45.572303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:45.580706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:45.581559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:45.582225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:45.583187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:45.584073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:45.585165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:45.653301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:45.656164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:45.657087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:45.657568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lazy-loading 'fault' on Instance uuid 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:17:45.769356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:45.780188 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00fd54bb-2ee6-4828-b289-599633592634 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 200 len: 1312 microversion: 2.1 time: 0.216257 Oct 19 07:17:45.780893 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2691/5240] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:45 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:46.247717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:46.248851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:46.260450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:46.261265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:46.267854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:46.267854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:46.267854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:46.268955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:46.331407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:17:46.805073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:46.805716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:46.813933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:46.814498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:46.814958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:46.815879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:46.816640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:46.817249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:46.841047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41a6b3a8-0899-405f-9237-d73dc75b7818 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "DELETE /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 204 len: 0 microversion: 2.32 time: 0.955622 Oct 19 07:17:46.841632 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2550/5241] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:17:45 2022] DELETE /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 0 bytes in 957 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:17:46.842776 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] HTTP exception thrown: Instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd could not be found. Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Request method failure captured: Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd HTTP/1.1 Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6N-tDItijGcBgGmYG_SAGW3_6j9tHcCoWlwSkFCMVsf1kudeF0pMVbw-7Ar3stxV1wyoNkVWZBpQrwGchitozCNiy9vzY_xtbtitbiu3urH95IzS_orWJGtKLy1RiTvb5DBtzVcx3aKRwG1VXq-GLQyimy0EHWlWBFcGoqSf5R8Vcc Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a457b818318a499188fb805286d6c77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a457b818318a499188fb805286d6c77b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc1f35324a234df58ec230f0a99454b4 Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd could not be found. Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '5a1aa62a-6f40-4796-aaba-0a5b9ac459cd'} Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd could not be found. Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd could not be found. Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:46.848425 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd could not be found. Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Returning 404 to user: Instance 5a1aa62a-6f40-4796-aaba-0a5b9ac459cd could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-199b063e-769c-4df7-a0b5-d0155f8eb621 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd" status: 404 len: 111 microversion: 2.1 time: 0.052786 Oct 19 07:17:46.853636 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2692/5242] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:46 2022] GET /compute/v2.1/servers/5a1aa62a-6f40-4796-aaba-0a5b9ac459cd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:17:46.858218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:46.859598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:46.868316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:46.869073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:46.870082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:46.871310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:46.871978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:46.872723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:46.873665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:46.874200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:46.885365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:46.891571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:46.894911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:46.894911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:46.894911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:46.896500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:46.973797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:17:47.369827 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14441192-b809-45fa-a41e-4c1b6abcef09 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "DELETE /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 204 len: 0 microversion: 2.1 time: 0.509889 Oct 19 07:17:47.377102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:47.378274 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2693/5243] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:17:46 2022] DELETE /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:17:47.390058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:47.395802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:47.397734 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0fbd1c9-6467-4e20-81e5-26692157a2ec tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2956 microversion: 2.32 time: 0.551625 Oct 19 07:17:47.398249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:47.399936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:47.414861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:47.417170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:47.418916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:47.421620 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2551/5244] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:17:46 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2956 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:17:47.422773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:47.424892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:47.425583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:47.796869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:47.821657 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc048998-f5fe-4749-9887-e3a07b4ae6e6 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.441772 Oct 19 07:17:47.828989 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2694/5245] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:47 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:48.429611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:48.431533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:48.444216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:48.445036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:48.445728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:48.446956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:48.447718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:48.448396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:48.806097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:48.825280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:48.827110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:48.831595 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f32f263-fbf3-43c7-89ae-475322465816 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2956 microversion: 2.32 time: 0.406951 Oct 19 07:17:48.834095 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2552/5246] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:17:48 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2956 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:17:48.846039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:48.848950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:48.866610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:48.867461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:48.868215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:48.869147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:48.869813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:48.870451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:49.279434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:49.292007 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-363accc7-1bb3-454a-8bd5-ba67412c8d00 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.449987 Oct 19 07:17:49.293189 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2695/5247] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:48 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:49.864194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:49.864826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:49.879723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:49.882280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:49.884848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:49.893344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:49.894298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:49.895126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:50.277692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:50.290944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:50.292809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:50.294527 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac1ebdfe-277c-4707-96df-b415efa906f6 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2956 microversion: 2.32 time: 0.435344 Oct 19 07:17:50.295196 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2553/5248] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:17:49 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2956 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:17:50.316924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:50.318206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:50.325791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:50.326534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:50.326988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:50.327711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:50.328207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:50.332264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:50.562398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:50.570573 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a3baf98-801b-417c-a9ff-2becbd7857c3 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1522 microversion: 2.1 time: 0.259334 Oct 19 07:17:50.580198 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2696/5249] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:50 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:51.325419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:51.327212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:51.339470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:51.340432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:51.341588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:51.343053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:51.344292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:51.345173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:51.594997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:51.600795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:51.603601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:51.604207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:51.604585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:51.609330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:51.610276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:51.612352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:51.732440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:51.733196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:51.745502 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb89739c-e644-4ba3-bb28-8d70cd1e561f tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1480 microversion: 2.1 time: 0.154351 Oct 19 07:17:51.746524 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2697/5250] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:51 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1480 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:51.753976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:51.755648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:51.757318 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf6db21d-8604-431d-aa92-c9f777ef53de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2956 microversion: 2.32 time: 0.437200 Oct 19 07:17:51.760401 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2554/5251] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:17:51 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2956 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:17:51.812848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4fcf0e16-be0d-40eb-96d5-e9aa11cce1f5 req-0f2e231b-0947-41f0-b7af-285d4d6f4e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47479fa1-5580-49d4-bd9a-dd0759289365", "name": "network-vif-deleted", "tag": "3acbc327-d37c-4ec4-9c69-3053c2a529bc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:51.826060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4fcf0e16-be0d-40eb-96d5-e9aa11cce1f5 req-0f2e231b-0947-41f0-b7af-285d4d6f4e7d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:51.826861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4fcf0e16-be0d-40eb-96d5-e9aa11cce1f5 req-0f2e231b-0947-41f0-b7af-285d4d6f4e7d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:51.828169 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4fcf0e16-be0d-40eb-96d5-e9aa11cce1f5 req-0f2e231b-0947-41f0-b7af-285d4d6f4e7d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:51.845152 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4fcf0e16-be0d-40eb-96d5-e9aa11cce1f5 req-0f2e231b-0947-41f0-b7af-285d4d6f4e7d service nova] Creating event network-vif-deleted:3acbc327-d37c-4ec4-9c69-3053c2a529bc for instance 47479fa1-5580-49d4-bd9a-dd0759289365 on n-h1-861333-10 Oct 19 07:17:51.854627 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4fcf0e16-be0d-40eb-96d5-e9aa11cce1f5 req-0f2e231b-0947-41f0-b7af-285d4d6f4e7d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045458 Oct 19 07:17:51.855777 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2698/5252] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:52.784593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:52.786429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:52.790815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:52.792187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:52.813276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:52.813276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:52.814264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:52.817769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:52.819235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:52.819914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:52.820538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:52.822657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:52.824096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:52.824917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:52.825406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:52.830015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:52.910124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:52.910634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:52.911084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:52.911552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lazy-loading 'fault' on Instance uuid 47479fa1-5580-49d4-bd9a-dd0759289365 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:17:53.026849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1f35324a234df58ec230f0a99454b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a457b818318a499188fb805286d6c77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:53.041965 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6f23407-93da-4ab4-b288-a3918f010793 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 200 len: 1311 microversion: 2.1 time: 0.265515 Oct 19 07:17:53.056624 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2555/5253] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:52 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 1311 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:17:53.277386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:53.298083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:53.301635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:53.303989 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69c68b65-2e7c-489e-86b7-93ab34f8818e tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2935 microversion: 2.32 time: 0.517917 Oct 19 07:17:53.305701 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2699/5254] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:17:52 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2935 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:17:53.848720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d374581c-3b9d-47be-934c-123676a8299e req-1e25b219-5b19-4a8a-8e82-acf8730c71d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-unplugged", "status": "completed", "tag": "da6715c6-0860-4ad4-9f15-4e0ca617cde0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:53.866034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d374581c-3b9d-47be-934c-123676a8299e req-1e25b219-5b19-4a8a-8e82-acf8730c71d6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:53.877201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d374581c-3b9d-47be-934c-123676a8299e req-1e25b219-5b19-4a8a-8e82-acf8730c71d6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:53.878021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d374581c-3b9d-47be-934c-123676a8299e req-1e25b219-5b19-4a8a-8e82-acf8730c71d6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:53.921698 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d374581c-3b9d-47be-934c-123676a8299e req-1e25b219-5b19-4a8a-8e82-acf8730c71d6 service nova] Creating event network-vif-unplugged:da6715c6-0860-4ad4-9f15-4e0ca617cde0 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:17:53.928971 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d374581c-3b9d-47be-934c-123676a8299e req-1e25b219-5b19-4a8a-8e82-acf8730c71d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083729 Oct 19 07:17:53.929859 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2556/5255] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:54.065670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:54.066285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] [instance: 47479fa1-5580-49d4-bd9a-dd0759289365] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:54.097823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:54.099270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:54.101195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:54.102923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:54.104357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:54.105725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:54.161693 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] HTTP exception thrown: Instance 47479fa1-5580-49d4-bd9a-dd0759289365 could not be found. Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Request method failure captured: Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 HTTP/1.1 Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6N-tDItijGcBgGmYG_SAGW3_6j9tHcCoWlwSkFCMVsf1kudeF0pMVbw-7Ar3stxV1wyoNkVWZBpQrwGchitozCNiy9vzY_xtbtitbiu3urH95IzS_orWJGtKLy1RiTvb5DBtzVcx3aKRwG1VXq-GLQyimy0EHWlWBFcGoqSf5R8Vcc Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a457b818318a499188fb805286d6c77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a457b818318a499188fb805286d6c77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a457b818318a499188fb805286d6c77b", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: a457b818318a499188fb805286d6c77b Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-397095167 Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc1f35324a234df58ec230f0a99454b4 Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-397095167-project Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 47479fa1-5580-49d4-bd9a-dd0759289365 could not be found. Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '47479fa1-5580-49d4-bd9a-dd0759289365'} Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47479fa1-5580-49d4-bd9a-dd0759289365 could not be found. Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47479fa1-5580-49d4-bd9a-dd0759289365 could not be found. Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:54.164337 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47479fa1-5580-49d4-bd9a-dd0759289365 could not be found. Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] Returning 404 to user: Instance 47479fa1-5580-49d4-bd9a-dd0759289365 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:17:54.168067 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3ba2efe-0e34-4b7e-9b27-44c59a75d797 tempest-ServerRescueNegativeTestJSON-397095167 tempest-ServerRescueNegativeTestJSON-397095167-project] 10.222.0.39 "GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365" status: 404 len: 111 microversion: 2.1 time: 0.104044 Oct 19 07:17:54.172777 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2700/5256] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:17:54 2022] GET /compute/v2.1/servers/47479fa1-5580-49d4-bd9a-dd0759289365 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:17:54.341941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:54.342660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:54.359493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:54.362265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:54.362957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:54.369263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:54.371881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:54.374692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:54.757177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-75e2992d-f99b-452a-b847-350ef6e8ed4e req-d789f328-6bd2-4691-9227-026717914353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-deleted", "tag": "da6715c6-0860-4ad4-9f15-4e0ca617cde0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:54.782202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-75e2992d-f99b-452a-b847-350ef6e8ed4e req-d789f328-6bd2-4691-9227-026717914353 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:54.786412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-75e2992d-f99b-452a-b847-350ef6e8ed4e req-d789f328-6bd2-4691-9227-026717914353 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:54.786412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-75e2992d-f99b-452a-b847-350ef6e8ed4e req-d789f328-6bd2-4691-9227-026717914353 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:54.796467 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-75e2992d-f99b-452a-b847-350ef6e8ed4e req-d789f328-6bd2-4691-9227-026717914353 service nova] Creating event network-vif-deleted:da6715c6-0860-4ad4-9f15-4e0ca617cde0 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:17:54.802440 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-75e2992d-f99b-452a-b847-350ef6e8ed4e req-d789f328-6bd2-4691-9227-026717914353 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052868 Oct 19 07:17:54.803551 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2701/5257] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:17:55.164631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:55.179280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:55.181388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:55.183125 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7495b4a2-0b6e-407d-8334-7f7da877af17 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2867 microversion: 2.32 time: 0.847642 Oct 19 07:17:55.197112 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2557/5258] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:17:54 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2867 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:17:55.962967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7811339e-40d9-46fa-9a77-cb8088f27bf6 req-95f88016-7a7b-4e28-93cb-dba51b3add54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-unplugged", "status": "completed", "tag": "e754f01c-edd6-408f-8951-5fa1db8035bf"}, {"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-unplugged", "status": "completed", "tag": "8169c873-b7ef-442f-9bf4-1f5ee358ef12"}, {"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-unplugged", "status": "completed", "tag": "8f1e6341-a749-49f3-847c-932b07769041"}, {"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-unplugged", "status": "completed", "tag": "44ef26f9-7bb0-4762-a463-7946d2663176"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:55.981213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7811339e-40d9-46fa-9a77-cb8088f27bf6 req-95f88016-7a7b-4e28-93cb-dba51b3add54 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:55.982887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7811339e-40d9-46fa-9a77-cb8088f27bf6 req-95f88016-7a7b-4e28-93cb-dba51b3add54 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:55.991752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7811339e-40d9-46fa-9a77-cb8088f27bf6 req-95f88016-7a7b-4e28-93cb-dba51b3add54 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:56.015093 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7811339e-40d9-46fa-9a77-cb8088f27bf6 req-95f88016-7a7b-4e28-93cb-dba51b3add54 service nova] Creating event network-vif-unplugged:e754f01c-edd6-408f-8951-5fa1db8035bf for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:17:56.018316 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7811339e-40d9-46fa-9a77-cb8088f27bf6 req-95f88016-7a7b-4e28-93cb-dba51b3add54 service nova] Creating event network-vif-unplugged:8169c873-b7ef-442f-9bf4-1f5ee358ef12 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:17:56.022412 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7811339e-40d9-46fa-9a77-cb8088f27bf6 req-95f88016-7a7b-4e28-93cb-dba51b3add54 service nova] Creating event network-vif-unplugged:8f1e6341-a749-49f3-847c-932b07769041 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:17:56.023282 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7811339e-40d9-46fa-9a77-cb8088f27bf6 req-95f88016-7a7b-4e28-93cb-dba51b3add54 service nova] Creating event network-vif-unplugged:44ef26f9-7bb0-4762-a463-7946d2663176 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:17:56.032336 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7811339e-40d9-46fa-9a77-cb8088f27bf6 req-95f88016-7a7b-4e28-93cb-dba51b3add54 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.074828 Oct 19 07:17:56.041192 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2702/5259] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:17:56.214456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:56.215243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:56.226897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:56.227703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:56.228200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:56.229123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:56.229769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:56.230381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:56.837010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-55b94464-0aaa-4b92-968c-0f23a775bc29 req-8fd33b1f-2bdc-41a1-b110-443df24a1573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-deleted", "tag": "44ef26f9-7bb0-4762-a463-7946d2663176"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:56.856768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55b94464-0aaa-4b92-968c-0f23a775bc29 req-8fd33b1f-2bdc-41a1-b110-443df24a1573 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:56.868399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55b94464-0aaa-4b92-968c-0f23a775bc29 req-8fd33b1f-2bdc-41a1-b110-443df24a1573 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:56.872010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55b94464-0aaa-4b92-968c-0f23a775bc29 req-8fd33b1f-2bdc-41a1-b110-443df24a1573 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:56.899287 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-55b94464-0aaa-4b92-968c-0f23a775bc29 req-8fd33b1f-2bdc-41a1-b110-443df24a1573 service nova] Creating event network-vif-deleted:44ef26f9-7bb0-4762-a463-7946d2663176 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:17:56.911149 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-55b94464-0aaa-4b92-968c-0f23a775bc29 req-8fd33b1f-2bdc-41a1-b110-443df24a1573 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079640 Oct 19 07:17:56.913657 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2703/5260] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:17:57.342750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:57.354782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:57.361460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:57.371586 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6023f030-9877-452d-b3f5-fb6cd21c84ea tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2706 microversion: 2.32 time: 1.162243 Oct 19 07:17:57.385118 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2558/5261] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:17:56 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2706 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:17:58.403629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:17:58.405061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:17:58.422160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:58.422652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:58.423101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:58.423815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:58.424310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:58.424741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:59.339487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:59.369354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:59.384159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:17:59.392455 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cedc7036-d9f1-49de-9857-83c788cbce29 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2592 microversion: 2.32 time: 0.986488 Oct 19 07:17:59.392455 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2704/5262] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:17:58 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2592 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:17:59.714946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-638a8168-a6a9-4d27-ad04-7ccf87850790 req-46a737ca-be16-4c64-a96a-985ba596774c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-deleted", "tag": "8f1e6341-a749-49f3-847c-932b07769041"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:17:59.737341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-638a8168-a6a9-4d27-ad04-7ccf87850790 req-46a737ca-be16-4c64-a96a-985ba596774c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:17:59.737341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-638a8168-a6a9-4d27-ad04-7ccf87850790 req-46a737ca-be16-4c64-a96a-985ba596774c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:17:59.737341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-638a8168-a6a9-4d27-ad04-7ccf87850790 req-46a737ca-be16-4c64-a96a-985ba596774c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:17:59.781629 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-638a8168-a6a9-4d27-ad04-7ccf87850790 req-46a737ca-be16-4c64-a96a-985ba596774c service nova] Creating event network-vif-deleted:8f1e6341-a749-49f3-847c-932b07769041 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:17:59.798049 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-638a8168-a6a9-4d27-ad04-7ccf87850790 req-46a737ca-be16-4c64-a96a-985ba596774c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087016 Oct 19 07:17:59.798979 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2559/5263] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:18:00.417915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:00.418613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:00.429867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:00.430364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:00.430810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:00.431542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:00.434846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:00.434846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:00.460547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:18:00.701623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:00.713528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:00.714972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:00.716223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-644e6c84-16b9-4813-b89f-404ae6fa541c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2258 microversion: 2.32 time: 0.302619 Oct 19 07:18:00.717411 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2705/5264] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:00 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2258 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:01.747995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:01.748748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:01.778511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:01.779024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:01.784660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:01.785456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:01.785946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:01.788836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:01.865058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3764b408-56c2-44c7-ad89-4fcf4c09c1f2 req-2362d8c5-0cb4-475b-b732-2bb6d992711c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-deleted", "tag": "8169c873-b7ef-442f-9bf4-1f5ee358ef12"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:18:01.892764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3764b408-56c2-44c7-ad89-4fcf4c09c1f2 req-2362d8c5-0cb4-475b-b732-2bb6d992711c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:01.893379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3764b408-56c2-44c7-ad89-4fcf4c09c1f2 req-2362d8c5-0cb4-475b-b732-2bb6d992711c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:01.905078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3764b408-56c2-44c7-ad89-4fcf4c09c1f2 req-2362d8c5-0cb4-475b-b732-2bb6d992711c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:01.923657 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3764b408-56c2-44c7-ad89-4fcf4c09c1f2 req-2362d8c5-0cb4-475b-b732-2bb6d992711c service nova] Creating event network-vif-deleted:8169c873-b7ef-442f-9bf4-1f5ee358ef12 for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:18:01.935837 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3764b408-56c2-44c7-ad89-4fcf4c09c1f2 req-2362d8c5-0cb4-475b-b732-2bb6d992711c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073554 Oct 19 07:18:01.939767 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2706/5265] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:18:02.188772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:02.206375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:02.210706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:02.213240 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-222e4cf1-79dc-4a81-bbd3-f60cce1816dd tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 2211 microversion: 2.32 time: 0.469967 Oct 19 07:18:02.214162 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2560/5266] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:01 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 2211 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:03.249472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:03.260591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:03.263935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:03.264478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:03.268335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:03.272142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:03.272883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:03.273494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:03.449833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:03.473599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:03.474148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:03.481024 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c8247e5-3b4e-4d0b-84f3-0163dab0a003 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.241538 Oct 19 07:18:03.505036 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2707/5267] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:03 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:03.996816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b0e06659-f9cd-411a-97c3-0c79e5a1835f req-43f3ace2-cbe7-4a9e-8562-892bb7772a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e04a6a-d7d6-4b8a-9362-6143356c6ddd", "name": "network-vif-deleted", "tag": "e754f01c-edd6-408f-8951-5fa1db8035bf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:18:04.012502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b0e06659-f9cd-411a-97c3-0c79e5a1835f req-43f3ace2-cbe7-4a9e-8562-892bb7772a1e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:04.013213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b0e06659-f9cd-411a-97c3-0c79e5a1835f req-43f3ace2-cbe7-4a9e-8562-892bb7772a1e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:04.013838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b0e06659-f9cd-411a-97c3-0c79e5a1835f req-43f3ace2-cbe7-4a9e-8562-892bb7772a1e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:04.031863 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b0e06659-f9cd-411a-97c3-0c79e5a1835f req-43f3ace2-cbe7-4a9e-8562-892bb7772a1e service nova] Creating event network-vif-deleted:e754f01c-edd6-408f-8951-5fa1db8035bf for instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd on n-h2-861333-10 Oct 19 07:18:04.048589 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b0e06659-f9cd-411a-97c3-0c79e5a1835f req-43f3ace2-cbe7-4a9e-8562-892bb7772a1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051249 Oct 19 07:18:04.050752 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2561/5268] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:18:04.511532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:04.511532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:04.524722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:04.525234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:04.525666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:04.527940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:04.531426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:04.538499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:04.831841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:04.850697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:04.860578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:04.860578 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-137d4003-9d86-4304-a396-87a1e24def53 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.349960 Oct 19 07:18:04.864049 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2708/5269] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:04 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:05.886874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:05.887610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:05.902070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:05.904911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:05.905383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:05.914971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:05.914971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:05.914971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:06.240993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:06.260976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:06.262982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:06.264205 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-971eac6d-713f-4a71-acd7-903197a5eda1 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.383353 Oct 19 07:18:06.268031 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2562/5270] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:05 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:07.325334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:07.325956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:07.351393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:07.353476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:07.354174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:07.355426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:07.356058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:07.358635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:07.679684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:07.689829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:07.705060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:07.706347 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40000491-b2f2-4cd2-b20d-bcab244a9f31 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.393106 Oct 19 07:18:07.706935 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2709/5271] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:07 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:07.720332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac237aa3-2b8b-4212-b878-2a7004204355 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Action: 'create', calling method: .version_select at 0x7f6d640ecb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-484152490", "metadata": {"Type": "work"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:18:08.735646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:08.736310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:08.749725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:08.752907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:08.758209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:08.759913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:08.761272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:08.762507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:08.962130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:08.985060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:08.987948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:08.991904 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64635bd8-7e72-48f8-8b23-d19b347de058 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.261039 Oct 19 07:18:08.996226 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2710/5272] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:08 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:18:09.130148 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac237aa3-2b8b-4212-b878-2a7004204355 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.658689 Oct 19 07:18:09.132384 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2563/5273] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Oct 19 07:18:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1662 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 19 07:18:09.148302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31d47aec-4b78-449c-a246-7f0e560191ba tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d68b8c4c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:09.259792 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31d47aec-4b78-449c-a246-7f0e560191ba tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 200 len: 352 microversion: 2.1 time: 0.115709 Oct 19 07:18:09.261112 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2711/5274] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:18:09 2022] GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:18:10.023263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:10.025073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:10.041508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:10.043852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:10.046113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:10.048319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:10.049179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:10.049933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:10.214103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:10.230559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:10.233160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:10.241419 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1aa0a5c9-59a2-4e4a-95bd-6d4366bf3728 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.222937 Oct 19 07:18:10.242245 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2564/5275] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:10 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:10.277157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31b16390-733c-4d92-99a5-734bcbe604f6 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d68a75b80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:10.402487 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31b16390-733c-4d92-99a5-734bcbe604f6 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 200 len: 352 microversion: 2.1 time: 0.131531 Oct 19 07:18:10.404520 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2712/5276] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:18:10 2022] GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 352 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:18:11.275967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:11.276825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:11.283300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:11.284043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:11.284519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:11.285339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:11.285803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:11.286243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:11.314485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:18:11.361166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:11.372481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:11.374155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:11.375556 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0ffdf25-dffb-4eca-9198-cf9fed4a59bf tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.109078 Oct 19 07:18:11.388633 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2565/5277] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:11 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:18:11.421255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8f0bd3b-b487-4ce8-b977-a46390483b17 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d647970d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:11.471828 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8f0bd3b-b487-4ce8-b977-a46390483b17 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 200 len: 352 microversion: 2.1 time: 0.056096 Oct 19 07:18:11.472700 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2713/5278] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:18:11 2022] GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:18:12.406785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:12.408432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:12.457483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:18:12.462740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:12.463427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:12.465384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:12.469403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:12.471874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:12.484423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:12.489973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-814b24f1-ec08-4ac7-b26a-b5819f1b02ec tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d5f9b7ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:12.586126 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-814b24f1-ec08-4ac7-b26a-b5819f1b02ec tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 200 len: 353 microversion: 2.1 time: 0.102338 Oct 19 07:18:12.587019 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2714/5279] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:18:12 2022] GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:18:12.603325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad73919d-145a-4389-b15f-7d471a7226f9 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d689ced30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:12.610668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:12.633983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:12.643807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:12.657724 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e74dc9ab-316d-4554-88e0-d5b2d6c10ec9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.255230 Oct 19 07:18:12.658388 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2566/5280] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:12 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:12.710831 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad73919d-145a-4389-b15f-7d471a7226f9 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 200 len: 353 microversion: 2.1 time: 0.113403 Oct 19 07:18:12.720601 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2715/5281] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:18:12 2022] GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:18:12.726513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9f9379a-1d08-441f-afc6-1f89191f48d0 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d5f841040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:13.002304 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9f9379a-1d08-441f-afc6-1f89191f48d0 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 202 len: 0 microversion: 2.1 time: 0.276291 Oct 19 07:18:13.002304 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2567/5282] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:18:12 2022] DELETE /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:18:13.007408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb87af33-02e4-49b8-9e62-100e9cc2252f tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d68a2c040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:13.096912 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb87af33-02e4-49b8-9e62-100e9cc2252f tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 200 len: 352 microversion: 2.1 time: 0.093614 Oct 19 07:18:13.097491 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2716/5283] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:18:13 2022] GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:18:13.690885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:13.691531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:13.718314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:13.719926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:13.720610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:13.722414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:13.724318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:13.728688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:13.884007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:13.901776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:13.903393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:13.909511 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94c6efa1-2bc4-4906-b12e-0675ca14b386 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.226531 Oct 19 07:18:13.911345 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2568/5284] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:13 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:14.108383 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:18:14.108973 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:18:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 (ip 10.222.0.39) !!! Oct 19 07:18:14.118064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ff97cd9-343f-4fef-8959-c6cfd9c41f23 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d64797c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:14.281351 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ff97cd9-343f-4fef-8959-c6cfd9c41f23 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 200 len: 352 microversion: 2.1 time: 0.173736 Oct 19 07:18:14.282194 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2717/5285] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:18:14 2022] GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:18:14.937607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:14.938303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:14.954490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:14.958201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:14.958992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:14.960712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:14.962503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:14.966755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:15.099890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:15.124840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:15.129429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:15.135936 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0df6adfa-cba6-4b2b-a773-633385136d9b tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.202624 Oct 19 07:18:15.140867 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2569/5286] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:14 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:15.298048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3da03a27-00be-4af3-b4db-481445103804 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d68adc040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:15.372405 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3da03a27-00be-4af3-b4db-481445103804 tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 200 len: 352 microversion: 2.1 time: 0.079533 Oct 19 07:18:15.374169 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2718/5287] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:18:15 2022] GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:18:16.168509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:16.173810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:16.176727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:16.177295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:16.177795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:16.178820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:16.179384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:16.179900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:16.317752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:16.324189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:16.326639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:16.328062 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc839e6b-fb2f-468c-a114-7c0983a7a7c3 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.164292 Oct 19 07:18:16.329196 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2570/5288] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:16 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:16.390155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae810314-fd1a-4311-9188-2e135ee1974a tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Calling method '.version_select at 0x7f6d64797af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:16.437334 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ae810314-fd1a-4311-9188-2e135ee1974a tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] HTTP exception thrown: Volume 8502f3d1-2062-4b71-9891-711dc338ce10 could not be found. Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae810314-fd1a-4311-9188-2e135ee1974a tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Request method failure captured: Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 HTTP/1.1 Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6SvPJbVk5NXx0zlhA3vKdc2sANYR34mqAd5Hxky1fZAejfpLdmAlocMfcZ9pngN2DeFXxD5VWE8uKhtzwnZShRMklii-P_gjGp8s9WpOkRxGcuf6KvBuzi9aOLH7bxboNqM02mswXOc63mikA6AppC6QVMexxRehR0lL_V-o3ppyH4 Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 0bea88bb78ed44b4a26cd58c34ee73db Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesGetTestJSON-313576107 Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0bea88bb78ed44b4a26cd58c34ee73db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0bea88bb78ed44b4a26cd58c34ee73db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0bea88bb78ed44b4a26cd58c34ee73db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0bea88bb78ed44b4a26cd58c34ee73db", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesGetTestJSON-313576107 Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 0bea88bb78ed44b4a26cd58c34ee73db Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesGetTestJSON-313576107 Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesGetTestJSON-313576107-project Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 1b2f6e2af1264c3bb9a3ffeb2312b39a Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesGetTestJSON-313576107-project Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: exception: Volume 8502f3d1-2062-4b71-9891-711dc338ce10 could not be found. Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '8502f3d1-2062-4b71-9891-711dc338ce10'} Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8502f3d1-2062-4b71-9891-711dc338ce10 could not be found. (HTTP 404) (Request-ID: req-ee0001ba-b35e-41c1-8d30-a5541413d805) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 07:18:16.440782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8502f3d1-2062-4b71-9891-711dc338ce10 could not be found. Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8502f3d1-2062-4b71-9891-711dc338ce10 could not be found. Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8502f3d1-2062-4b71-9891-711dc338ce10 could not be found. Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae810314-fd1a-4311-9188-2e135ee1974a tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] Returning 404 to user: Volume 8502f3d1-2062-4b71-9891-711dc338ce10 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae810314-fd1a-4311-9188-2e135ee1974a tempest-VolumesGetTestJSON-313576107 tempest-VolumesGetTestJSON-313576107-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10" status: 404 len: 109 microversion: 2.1 time: 0.057941 Oct 19 07:18:16.446726 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2719/5289] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:18:16 2022] GET /compute/v2.1/os-volumes/8502f3d1-2062-4b71-9891-711dc338ce10 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:18:17.369420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:17.370050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:17.385523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:17.387244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:17.387870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:17.393097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:17.393760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:17.394392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:17.767513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:17.777121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:17.778569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:17.779772 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e87ff1d-2b06-485a-9773-c83c6d5f34de tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.425212 Oct 19 07:18:17.789005 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2571/5290] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:17 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:18.823099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:18.827288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:18.832086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:18:18.839474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:18.841865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:18.848177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:18.848965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:18.849460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:18.850454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:18.949658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:18.968098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:18.968098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:18.968098 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88d39b72-70b1-4bb2-b63a-b46c9fe71068 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.149987 Oct 19 07:18:18.968098 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2720/5291] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:18 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:19.998877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:19.999460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:20.019840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:20.020384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:20.020833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:20.021553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:20.022458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:20.023353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:20.500991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:20.511863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:20.513374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:20.514602 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf205477-0ac9-4689-861b-92a5585153e9 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.520507 Oct 19 07:18:20.515681 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2572/5292] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:19 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:21.543730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:21.544387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:21.560968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:21.573103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:21.573103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:21.573103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:21.573103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:21.573103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:21.679157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:21.693873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:21.716421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:21.716421 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5908480-9e60-469c-920c-9dc3884c3d7f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.161488 Oct 19 07:18:21.716421 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2721/5293] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:21 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:22.730580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:22.730580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:22.737054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:22.737564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:22.738098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:22.738912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:22.739434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:22.739872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:22.818333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:22.829721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:22.833864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:22.836595 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5ee00a9-ffa4-4eca-9b3c-b483856e5095 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.112927 Oct 19 07:18:22.837875 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2573/5294] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:22 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:18:23.871156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:23.872438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:23.889264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:23.890037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:23.891969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:23.895997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:23.896928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:23.897603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:24.686770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:24.698785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:24.711518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:24.712804 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-522816b0-b802-4d0c-8bfd-2bc156bd39ae tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.845819 Oct 19 07:18:24.713545 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2722/5295] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:23 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:25.849620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:25.849620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:25.849620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:25.849620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:25.849620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:25.849620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:25.849620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:25.849620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:25.849620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:25.852703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:25.853556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:25.854549 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a12835fc-d50b-4a22-bb1f-8f19caa2b62c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.117785 Oct 19 07:18:25.855131 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2574/5296] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:25 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:26.891218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:26.892966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:26.906971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:26.908403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:26.909152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:26.930613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:26.931416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:26.932386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:27.130669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:27.142580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:27.150245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:27.151586 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52e44f29-46c1-4654-95fa-720a604b2b39 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.274531 Oct 19 07:18:27.152392 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2723/5297] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:26 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:28.183606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:28.185801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:28.200675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:28.201495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:28.221209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:28.226779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:28.227703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:28.230744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:28.433798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:28.444787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:28.446774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:28.451168 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b46ba5f1-e54f-4f07-b28c-4fb4a2c2db58 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.272059 Oct 19 07:18:28.455116 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2575/5298] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:28 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:29.476935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:29.477582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:29.484872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:29.485372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:29.487892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:29.493060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:29.493555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:29.494002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:29.668531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:29.684492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:29.686247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:29.687828 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45472999-01aa-4c4c-9029-29e601023aca tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1604 microversion: 2.32 time: 0.215034 Oct 19 07:18:29.695086 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2724/5299] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:29 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:30.719068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:30.720376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:30.732509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:30.733151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:30.733868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:30.734882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:30.735780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:30.736533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:30.820466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:30.822255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:30.822723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:30.823192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lazy-loading 'fault' on Instance uuid 83e04a6a-d7d6-4b8a-9362-6143356c6ddd {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:18:30.945231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:30.967155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:30.967155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39ea74ffe6624b2e807e5974c6bb0c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db88675ef16546948d70f08f51519d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:18:30.968473 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e68897c2-a0b4-4864-a5cf-5d653194f07d tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 200 len: 1371 microversion: 2.32 time: 0.253439 Oct 19 07:18:30.969419 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2576/5300] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:30 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:18:32.010681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:32.011345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:32.024261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:32.024778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:32.025231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:32.030414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:32.030965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:32.031425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:32.064437 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] HTTP exception thrown: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Request method failure captured: Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd HTTP/1.1 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6LfwEw0VQkd93fVSmg-wb2Haaz_MBeI6Qq337xDH80SkUDsZNjb_QTeygR-1X8rZ7Vvvm1jaf40-8hn9s37aXEkv22WyjFgkHIYpaJRU37sdnynNqMqrKhc-3MApizgPHlpLiJdzdiavXh7Ym52IS1BNQURsMIflhLLAHh4U5HCpvY Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.32 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: db88675ef16546948d70f08f51519d08 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TaggedBootDevicesTest-2114294249 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/db88675ef16546948d70f08f51519d08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/db88675ef16546948d70f08f51519d08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/db88675ef16546948d70f08f51519d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_db88675ef16546948d70f08f51519d08", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TaggedBootDevicesTest-2114294249 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: db88675ef16546948d70f08f51519d08 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2114294249 Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TaggedBootDevicesTest-2114294249-project Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 39ea74ffe6624b2e807e5974c6bb0c8e Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TaggedBootDevicesTest-2114294249-project Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '83e04a6a-d7d6-4b8a-9362-6143356c6ddd'} Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:32.074174 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:18:32.078358 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:32.078358 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:32.078358 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:18:32.078358 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:18:32.078358 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:18:32.078358 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:18:32.078358 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:32.078358 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:32.080824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Returning 404 to user: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:18:32.082059 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e965ca88-bee4-4785-9c60-d323c1e8d3c8 tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 404 len: 111 microversion: 2.32 time: 0.075943 Oct 19 07:18:32.083186 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2725/5301] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:32 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:18:32.102328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36c1512f-eea6-481a-a44d-0df86ef7f3ad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '.version_select at 0x7f6d68b48550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:32.225532 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36c1512f-eea6-481a-a44d-0df86ef7f3ad tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-161857772" status: 204 len: 0 microversion: 2.32 time: 0.127755 Oct 19 07:18:32.232687 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2577/5302] 10.222.0.39 () {60 vars in 1259 bytes} [Wed Oct 19 07:18:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-161857772 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:18:39.551133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:39.552262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:39.560292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:39.562186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:39.563220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:39.564841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:39.569084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:39.569910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:39.573200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=61 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:18:39.598406 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] HTTP exception thrown: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Request method failure captured: Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd HTTP/1.1 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6LfwEw0VQkd93fVSmg-wb2Haaz_MBeI6Qq337xDH80SkUDsZNjb_QTeygR-1X8rZ7Vvvm1jaf40-8hn9s37aXEkv22WyjFgkHIYpaJRU37sdnynNqMqrKhc-3MApizgPHlpLiJdzdiavXh7Ym52IS1BNQURsMIflhLLAHh4U5HCpvY Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.32 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: db88675ef16546948d70f08f51519d08 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TaggedBootDevicesTest-2114294249 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/db88675ef16546948d70f08f51519d08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/db88675ef16546948d70f08f51519d08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/db88675ef16546948d70f08f51519d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_db88675ef16546948d70f08f51519d08", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TaggedBootDevicesTest-2114294249 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: db88675ef16546948d70f08f51519d08 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2114294249 Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TaggedBootDevicesTest-2114294249-project Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 39ea74ffe6624b2e807e5974c6bb0c8e Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TaggedBootDevicesTest-2114294249-project Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '83e04a6a-d7d6-4b8a-9362-6143356c6ddd'} Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:18:39.602227 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.606905 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.627890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Returning 404 to user: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:18:39.629130 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a526bd1b-3d52-4e10-b5ff-4e5417c60a3c tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "DELETE /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 404 len: 111 microversion: 2.32 time: 0.083312 Oct 19 07:18:39.630754 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2726/5303] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:18:39 2022] DELETE /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:18:39.639365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:18:39.640024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] [instance: 83e04a6a-d7d6-4b8a-9362-6143356c6ddd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:18:39.648595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:39.649086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:39.649522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:39.659260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:18:39.659763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:18:39.660245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:18:39.684500 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] HTTP exception thrown: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Request method failure captured: Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd HTTP/1.1 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6LfwEw0VQkd93fVSmg-wb2Haaz_MBeI6Qq337xDH80SkUDsZNjb_QTeygR-1X8rZ7Vvvm1jaf40-8hn9s37aXEkv22WyjFgkHIYpaJRU37sdnynNqMqrKhc-3MApizgPHlpLiJdzdiavXh7Ym52IS1BNQURsMIflhLLAHh4U5HCpvY Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.32 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: db88675ef16546948d70f08f51519d08 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TaggedBootDevicesTest-2114294249 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/db88675ef16546948d70f08f51519d08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/db88675ef16546948d70f08f51519d08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/db88675ef16546948d70f08f51519d08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_db88675ef16546948d70f08f51519d08", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TaggedBootDevicesTest-2114294249 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: db88675ef16546948d70f08f51519d08 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2114294249 Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TaggedBootDevicesTest-2114294249-project Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 39ea74ffe6624b2e807e5974c6bb0c8e Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TaggedBootDevicesTest-2114294249-project Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '83e04a6a-d7d6-4b8a-9362-6143356c6ddd'} Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.686888 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:18:39.691388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.691388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:18:39.691388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:18:39.691388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:18:39.691388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:18:39.691388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:18:39.691388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. Oct 19 07:18:39.691388 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:18:39.692851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] Returning 404 to user: Instance 83e04a6a-d7d6-4b8a-9362-6143356c6ddd could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:18:39.693917 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9d4b4b9-6b82-4128-aaa7-dd3e6298953f tempest-TaggedBootDevicesTest-2114294249 tempest-TaggedBootDevicesTest-2114294249-project] 10.222.0.39 "GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd" status: 404 len: 111 microversion: 2.32 time: 0.059573 Oct 19 07:18:39.694985 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2578/5304] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:18:39 2022] GET /compute/v2.1/servers/83e04a6a-d7d6-4b8a-9362-6143356c6ddd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:20:46.599995 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4decaece-d501-4665-899d-f3f180143e7c] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 07:20:46.601710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:20:46.604582 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 19 07:20:46.627707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dace99c-b78b-47ed-ba7e-aeaefa9fc2df tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Action: 'create', calling method: .version_select at 0x7f6d68a9dd30>, body: {"keypair": {"name": "tempest-keypair-752204103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJKyxuBFL+r7hKXFgK5I7eWFTVErCrjKKHJBQCy0euSRxMCGI+FHbZhVcFvTdWGyYguEGCjEvo9fhJAelaxLBZqFNnGew9toH8IA7tJYEZKuzthE2VEEuhgwKd3LpCTyw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:20:46.681163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2dace99c-b78b-47ed-ba7e-aeaefa9fc2df tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Getting quotas for project ea428bd904c549a9b2f876110a1f10c4. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:20:46.689633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2dace99c-b78b-47ed-ba7e-aeaefa9fc2df tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Getting quotas for user 540c85c9ed04491091363288c0b2a885 and project ea428bd904c549a9b2f876110a1f10c4. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:20:46.833108 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dace99c-b78b-47ed-ba7e-aeaefa9fc2df tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.236770 Oct 19 07:20:46.842302 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2727/5305] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 07:20:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 241 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 07:20:51.536378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-174538928", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dc40b0fe-f6ea-484a-ba1a-ef5cae7d8cf1"}, {"port": "bc9945f1-d06f-48e9-817c-e30001de19fa", "tag": "port-1"}, {"port": "75d48c90-3c9d-4b6b-9e73-e63deb941188", "tag": "port-2"}, {"uuid": "a6788efc-a725-4833-acf3-adfab56bd6b6", "tag": "net-1"}, {"uuid": "a6788efc-a725-4833-acf3-adfab56bd6b6"}, {"uuid": "c8f3110a-4d2d-41cd-94cf-3463144f0927", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c8f3110a-4d2d-41cd-94cf-3463144f0927", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "276a91dc-a968-475c-8382-8e2a0fa8fe06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a7a746a3-a7f7-4a6b-a81c-fb45ca5cfc66", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c95fc02f-4218-414b-994d-ef3bd764c149", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--328704218"}], "key_name": "tempest-keypair-752204103", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:20:51.570233 n-d-861333-10 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e0029dd-ab1a-4c8a-bb57-f6ace2ff8212] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 07:20:51.571162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:20:51.572399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=66 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:20:51.573969 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 07:20:51.574364 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:20:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 19 07:20:51.575986 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:20:51.581269 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:20:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 19 07:20:51.589792 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 19 07:20:52.089794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] validate_networks() for [('dc40b0fe-f6ea-484a-ba1a-ef5cae7d8cf1', None, None, None, None, None), (None, None, 'bc9945f1-d06f-48e9-817c-e30001de19fa', None, None, None), (None, None, '75d48c90-3c9d-4b6b-9e73-e63deb941188', None, None, None), ('a6788efc-a725-4833-acf3-adfab56bd6b6', None, None, None, None, None), ('a6788efc-a725-4833-acf3-adfab56bd6b6', None, None, None, None, None), ('c8f3110a-4d2d-41cd-94cf-3463144f0927', '10.2.2.100', None, None, None, None), ('c8f3110a-4d2d-41cd-94cf-3463144f0927', '10.2.2.200', None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:20:52.580760 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e0029dd-ab1a-4c8a-bb57-f6ace2ff8212] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 50864. Oct 19 07:20:55.176727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:20:55.176727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:20:55.176727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:20:55.176727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:20:55.177689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:20:55.187201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:20:55.187688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:20:55.188146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:20:55.189212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:20:55.189854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:20:55.190283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:20:55.221716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Getting quotas for project ea428bd904c549a9b2f876110a1f10c4. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:20:55.266789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Getting quotas for user 540c85c9ed04491091363288c0b2a885 and project ea428bd904c549a9b2f876110a1f10c4. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:20:55.593943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:20:55.601856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='276a91dc-a968-475c-8382-8e2a0fa8fe06',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a7a746a3-a7f7-4a6b-a81c-fb45ca5cfc66',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c95fc02f-4218-414b-994d-ef3bd764c149',volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:20:57.124523 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f956eb3c-c1be-42cd-b445-49b2b1b51b82 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.595063 Oct 19 07:20:57.126308 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2579/5306] 10.222.0.39 () {62 vars in 1189 bytes} [Wed Oct 19 07:20:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 5598 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 07:20:57.146203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-685db60f-3e0c-482f-820d-fe7a6102cb58 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:20:57.150607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-685db60f-3e0c-482f-820d-fe7a6102cb58 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:20:57.151923 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bca04a53-c8ea-4f59-a487-3dcf4f1196ca] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 07:20:57.157688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:20:57.158632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:20:57.176754 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [4decaece-d501-4665-899d-f3f180143e7c] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 51112. Oct 19 07:20:57.826644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-685db60f-3e0c-482f-820d-fe7a6102cb58 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:20:57.854264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-685db60f-3e0c-482f-820d-fe7a6102cb58 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:20:57.858641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-685db60f-3e0c-482f-820d-fe7a6102cb58 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:20:57.867443 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-685db60f-3e0c-482f-820d-fe7a6102cb58 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1284 microversion: 2.42 time: 0.725334 Oct 19 07:20:57.890966 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2728/5307] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:20:57 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1284 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:20:58.901378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d3e899f2-9726-4b37-a090-a1b67e4b93d4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:20:58.906801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d3e899f2-9726-4b37-a090-a1b67e4b93d4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:20:59.097584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3e899f2-9726-4b37-a090-a1b67e4b93d4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:20:59.109587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3e899f2-9726-4b37-a090-a1b67e4b93d4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:20:59.111151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3e899f2-9726-4b37-a090-a1b67e4b93d4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:20:59.112358 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d3e899f2-9726-4b37-a090-a1b67e4b93d4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1284 microversion: 2.42 time: 0.219571 Oct 19 07:20:59.116742 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2580/5308] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:20:58 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:00.141462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:00.142085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:00.161000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:00.168202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:00.169800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:00.170804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:00.171499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:00.172192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:00.213913 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [bca04a53-c8ea-4f59-a487-3dcf4f1196ca] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 51226. Oct 19 07:21:00.414646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:00.424695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:00.426931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:00.429071 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c50336ee-a967-488f-a209-9457c2b23cdd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1518 microversion: 2.42 time: 0.291440 Oct 19 07:21:00.430479 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2729/5309] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:00 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1518 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:01.466085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:01.466085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:01.478823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:01.479468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:01.480008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:01.480849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:01.481411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:01.481956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:01.809864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:01.858764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:01.865478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:01.874172 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea8e2566-00e7-414d-a317-5b436ad2473e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1582 microversion: 2.42 time: 0.411997 Oct 19 07:21:01.875491 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2581/5310] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:01 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1582 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:02.905468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:02.906413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:02.917950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:02.922131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:02.922584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:02.923342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:02.923809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:02.928453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:03.152978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:03.167103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:03.168569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:03.170007 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-837c3446-1dd1-4435-8abe-895285a0a447 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1592 microversion: 2.42 time: 0.270684 Oct 19 07:21:03.170576 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2730/5311] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:02 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1592 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:04.199878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:04.200625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:04.227962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:04.229537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:04.230399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:04.241699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:04.242451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:04.244996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:04.625087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:04.637292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:04.645057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:04.660594 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f60ccfbb-f0ea-48dd-85cd-9d482250090f tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1659 microversion: 2.42 time: 0.454262 Oct 19 07:21:04.660594 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2582/5312] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:04 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1659 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:05.678128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:05.680082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:05.695830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:05.696367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:05.696812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:05.697525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:05.697985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:05.698403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:05.963021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:05.974230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:05.976752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:05.978359 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba68b942-afb7-4c46-afc8-030e3bebd24c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1705 microversion: 2.42 time: 0.306228 Oct 19 07:21:05.979773 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2731/5313] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:05 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1705 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:07.007184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:07.008547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:07.010825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:07.034686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:07.035234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:07.035700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:07.036503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:07.036965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:07.038117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:07.377843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:07.388292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:07.390581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:07.392049 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc4dc8d4-ab4f-4da1-a336-14587eddd2cc tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1751 microversion: 2.42 time: 0.389292 Oct 19 07:21:07.401602 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2583/5314] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:07 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1751 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:08.419654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:08.420486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:08.423748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:08.430924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:08.435485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:08.435485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:08.435485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:08.435485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:08.435485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:08.974790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:08.991640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:08.994108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:08.997577 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8eaaccb-465f-4dee-adee-246bc7a52660 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1797 microversion: 2.42 time: 0.582561 Oct 19 07:21:08.999312 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2732/5315] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:08 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1797 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:10.023670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:10.024458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:10.029030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:10.058709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:10.059223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:10.059677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:10.060810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:10.066590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:10.066590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:10.578633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:10.592151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:10.598090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:10.601536 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4adccee-30f2-4c4f-940d-1515939ada8e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1843 microversion: 2.42 time: 0.580263 Oct 19 07:21:10.603104 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2584/5316] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:10 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1843 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:11.635318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:11.636255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:11.657125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:11.660407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:11.665331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:11.666248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:11.666746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:11.667195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:11.758120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4f41d4a1-39e0-4b2f-ab7b-6b586c4ac5b6 req-92c3f14f-af6c-4d38-a2f1-1c2cd724f6da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "tag": "9c8c3454-2335-450b-a2b0-10fd7456c950"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:11.784444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4f41d4a1-39e0-4b2f-ab7b-6b586c4ac5b6 req-92c3f14f-af6c-4d38-a2f1-1c2cd724f6da service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:11.786748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4f41d4a1-39e0-4b2f-ab7b-6b586c4ac5b6 req-92c3f14f-af6c-4d38-a2f1-1c2cd724f6da service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:11.793288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4f41d4a1-39e0-4b2f-ab7b-6b586c4ac5b6 req-92c3f14f-af6c-4d38-a2f1-1c2cd724f6da service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:11.839986 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4f41d4a1-39e0-4b2f-ab7b-6b586c4ac5b6 req-92c3f14f-af6c-4d38-a2f1-1c2cd724f6da service nova] Creating event network-changed:9c8c3454-2335-450b-a2b0-10fd7456c950 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:21:11.857909 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4f41d4a1-39e0-4b2f-ab7b-6b586c4ac5b6 req-92c3f14f-af6c-4d38-a2f1-1c2cd724f6da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.446547 Oct 19 07:21:11.861676 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2733/5317] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:12.093838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:12.105374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:12.112462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:12.116757 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a715488e-d772-438c-ad8d-f3a04fb9fb51 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1843 microversion: 2.42 time: 0.488215 Oct 19 07:21:12.117856 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2585/5318] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:11 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1843 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:13.149675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:13.151125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:13.169251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:13.172683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:13.173149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:13.175353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:13.175867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:13.176407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:13.640569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:13.663018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:13.670966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:13.672942 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33c36b14-e5db-4fea-8c55-3d992f09de53 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1864 microversion: 2.42 time: 0.531253 Oct 19 07:21:13.674804 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2734/5319] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:13 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1864 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:14.075202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-78197e4e-4c1f-4cce-9984-fdf432a95d98 req-72ad5668-6cc3-4ac4-8f7e-28d181f9ca30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "tag": "bc9945f1-d06f-48e9-817c-e30001de19fa"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:14.112633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-78197e4e-4c1f-4cce-9984-fdf432a95d98 req-72ad5668-6cc3-4ac4-8f7e-28d181f9ca30 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:14.113213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-78197e4e-4c1f-4cce-9984-fdf432a95d98 req-72ad5668-6cc3-4ac4-8f7e-28d181f9ca30 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:14.115413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-78197e4e-4c1f-4cce-9984-fdf432a95d98 req-72ad5668-6cc3-4ac4-8f7e-28d181f9ca30 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:14.197942 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-78197e4e-4c1f-4cce-9984-fdf432a95d98 req-72ad5668-6cc3-4ac4-8f7e-28d181f9ca30 service nova] Creating event network-changed:bc9945f1-d06f-48e9-817c-e30001de19fa for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:21:14.220277 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-78197e4e-4c1f-4cce-9984-fdf432a95d98 req-72ad5668-6cc3-4ac4-8f7e-28d181f9ca30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149724 Oct 19 07:21:14.222762 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2586/5320] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:14.699726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:14.700385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:14.721622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:14.727155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:14.727645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:14.728458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:14.728943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:14.729388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:15.648090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:15.671437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:15.674669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:15.680302 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e29c6c47-f70e-4ef0-b8f0-f46803331c17 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1864 microversion: 2.42 time: 0.984267 Oct 19 07:21:15.681640 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2735/5321] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:14 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1864 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:16.571824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-eaef5a46-22a0-4f99-8138-ff0e13f67267 req-5c8ee04f-a916-44b5-9117-35ed40bb705b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "tag": "75d48c90-3c9d-4b6b-9e73-e63deb941188"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:16.601414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-eaef5a46-22a0-4f99-8138-ff0e13f67267 req-5c8ee04f-a916-44b5-9117-35ed40bb705b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:16.610092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-eaef5a46-22a0-4f99-8138-ff0e13f67267 req-5c8ee04f-a916-44b5-9117-35ed40bb705b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:16.613925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-eaef5a46-22a0-4f99-8138-ff0e13f67267 req-5c8ee04f-a916-44b5-9117-35ed40bb705b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:16.661184 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-eaef5a46-22a0-4f99-8138-ff0e13f67267 req-5c8ee04f-a916-44b5-9117-35ed40bb705b service nova] Creating event network-changed:75d48c90-3c9d-4b6b-9e73-e63deb941188 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:21:16.689987 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-eaef5a46-22a0-4f99-8138-ff0e13f67267 req-5c8ee04f-a916-44b5-9117-35ed40bb705b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123922 Oct 19 07:21:16.690609 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2587/5322] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:16.713071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:16.713699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:16.735301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:16.737814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:16.738476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:16.739425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:16.744722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:16.746406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:17.284619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:17.300452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:17.304693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:17.306266 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46f3ac9e-65b7-431b-a3bb-ce996c6cf5b0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.597253 Oct 19 07:21:17.336892 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2736/5323] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:16 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:18.339642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:18.340390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:18.360440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:18.360967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:18.364545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:18.365297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:18.368850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:18.369910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:18.735393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-234aec77-c7d5-4a58-bdd9-c10686d2bed8 req-a5487482-f9d3-42cb-bea2-eac919c214d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "tag": "8d53d8ed-0dc4-4c8e-9b38-4944c5be68ab"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:18.780291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-234aec77-c7d5-4a58-bdd9-c10686d2bed8 req-a5487482-f9d3-42cb-bea2-eac919c214d4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:18.789890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-234aec77-c7d5-4a58-bdd9-c10686d2bed8 req-a5487482-f9d3-42cb-bea2-eac919c214d4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:18.790360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-234aec77-c7d5-4a58-bdd9-c10686d2bed8 req-a5487482-f9d3-42cb-bea2-eac919c214d4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:18.841801 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-234aec77-c7d5-4a58-bdd9-c10686d2bed8 req-a5487482-f9d3-42cb-bea2-eac919c214d4 service nova] Creating event network-changed:8d53d8ed-0dc4-4c8e-9b38-4944c5be68ab for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:21:18.854070 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-234aec77-c7d5-4a58-bdd9-c10686d2bed8 req-a5487482-f9d3-42cb-bea2-eac919c214d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122546 Oct 19 07:21:18.857086 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2737/5324] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:19.054745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:19.078765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:19.083217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:19.089162 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36be12e6-ee17-4d2b-9c5e-3dafe29dbf29 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.749934 Oct 19 07:21:19.092689 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2588/5325] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:18 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:19.601216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-374ec9fe-4583-4637-9a91-77d333b279a3 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Action: 'create', calling method: .version_select at 0x7f6d5fbfd310>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-631805450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHT4UHvYkYz2t6sNwvQ032h/eCYERUd18xcm2OQZ14insUn9wpM1URdBTWzG0HzoxuG95IPFFRmnLmoKyi2yVIKT9libA4yPYdw1s4BQr9cXiFp6iwNteJrr/stvsQZKA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:19.643929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-374ec9fe-4583-4637-9a91-77d333b279a3 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Getting quotas for project dd4f4f8316fe4ea094805ab136034ce1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:21:19.663416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-374ec9fe-4583-4637-9a91-77d333b279a3 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Getting quotas for user 333de935e30d455fbf6f45dfdc3ae679 and project dd4f4f8316fe4ea094805ab136034ce1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:21:19.807293 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-374ec9fe-4583-4637-9a91-77d333b279a3 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.211315 Oct 19 07:21:19.809043 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2738/5326] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:21:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:20.120221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:20.120984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:20.130382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:20.134871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:20.135619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:20.137914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:20.152901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:20.157149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:20.709284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:20.733252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:20.734759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:20.737394 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2cb40079-b197-4b3c-9adb-a2063f19f95b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.622447 Oct 19 07:21:20.739193 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2589/5327] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:20 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:20.977731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-79877475-caf5-435b-88ad-bb06cb311a69 req-82b9c992-23d9-4e84-b915-8ca62a3dd709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "tag": "4f64379c-bc44-4c4c-aff7-85eb2d62bef5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:21.012371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79877475-caf5-435b-88ad-bb06cb311a69 req-82b9c992-23d9-4e84-b915-8ca62a3dd709 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:21.012871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79877475-caf5-435b-88ad-bb06cb311a69 req-82b9c992-23d9-4e84-b915-8ca62a3dd709 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:21.020068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79877475-caf5-435b-88ad-bb06cb311a69 req-82b9c992-23d9-4e84-b915-8ca62a3dd709 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:21.040978 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-79877475-caf5-435b-88ad-bb06cb311a69 req-82b9c992-23d9-4e84-b915-8ca62a3dd709 service nova] Creating event network-changed:4f64379c-bc44-4c4c-aff7-85eb2d62bef5 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:21:21.052324 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-79877475-caf5-435b-88ad-bb06cb311a69 req-82b9c992-23d9-4e84-b915-8ca62a3dd709 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086470 Oct 19 07:21:21.056474 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2739/5328] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:21.766654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:21.773301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:21.789595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:21.790071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:21.793169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:21.794109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:21.798418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:21.800407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:21.815444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=49 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:22.661382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:22.673743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:22.681702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:22.683319 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79205bf4-8143-4269-bc85-df31ac4e146b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.921511 Oct 19 07:21:22.685260 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2590/5329] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:21 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:23.162607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f7a46d59-6bec-465d-bf45-9ad59940d904 req-42f0ba00-d74f-4679-b98f-b5199fba435c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "tag": "5202bbc9-e19e-45f0-a8b9-469ff0364621"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:23.190908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f7a46d59-6bec-465d-bf45-9ad59940d904 req-42f0ba00-d74f-4679-b98f-b5199fba435c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:23.191414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f7a46d59-6bec-465d-bf45-9ad59940d904 req-42f0ba00-d74f-4679-b98f-b5199fba435c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:23.191866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f7a46d59-6bec-465d-bf45-9ad59940d904 req-42f0ba00-d74f-4679-b98f-b5199fba435c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:23.230086 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f7a46d59-6bec-465d-bf45-9ad59940d904 req-42f0ba00-d74f-4679-b98f-b5199fba435c service nova] Creating event network-changed:5202bbc9-e19e-45f0-a8b9-469ff0364621 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:21:23.244600 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f7a46d59-6bec-465d-bf45-9ad59940d904 req-42f0ba00-d74f-4679-b98f-b5199fba435c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084509 Oct 19 07:21:23.247774 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2740/5330] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:23.716484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:23.717958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:23.732355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:23.744644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:23.744644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:23.745271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:23.746015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:23.746470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:23.746900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:24.449870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:24.467470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:24.477288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:24.482415 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9235a343-6c3a-40cc-ad6e-d8db1b2992f1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.770267 Oct 19 07:21:24.487573 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2591/5331] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:23 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:25.309440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0aeea999-c7d7-4a82-a4e8-64975fb562ca req-563e72b7-6747-40e9-b060-ef24233f0398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "tag": "a8be6485-4230-4fe4-909f-46e5df66a747"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:25.336143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0aeea999-c7d7-4a82-a4e8-64975fb562ca req-563e72b7-6747-40e9-b060-ef24233f0398 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:25.336652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0aeea999-c7d7-4a82-a4e8-64975fb562ca req-563e72b7-6747-40e9-b060-ef24233f0398 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:25.337110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0aeea999-c7d7-4a82-a4e8-64975fb562ca req-563e72b7-6747-40e9-b060-ef24233f0398 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:25.364799 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0aeea999-c7d7-4a82-a4e8-64975fb562ca req-563e72b7-6747-40e9-b060-ef24233f0398 service nova] Creating event network-changed:a8be6485-4230-4fe4-909f-46e5df66a747 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:21:25.392478 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0aeea999-c7d7-4a82-a4e8-64975fb562ca req-563e72b7-6747-40e9-b060-ef24233f0398 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085914 Oct 19 07:21:25.392478 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2741/5332] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:25.520715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:25.522160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:25.531254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:25.532345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:25.532969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:25.533982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:25.534669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:25.537515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:25.904983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:25.924226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:25.926141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:25.927593 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5cc929c-21c1-4566-9351-32d659a57240 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.414550 Oct 19 07:21:25.929358 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2592/5333] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:25 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:26.765894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1961846052", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1a9a0e22-33e0-4798-a5fa-5f0c2325c88f", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-631805450", "security_groups": [{"name": "tempest-secgroup-smoke-1081103171"}], "networks": [{"uuid": "6e290885-f7ec-468c-8fdd-069541b5e192"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:26.957263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:26.960335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:26.982932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:26.991208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:26.991926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:26.992918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:26.993575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:26.994199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:27.140983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] validate_networks() for [('6e290885-f7ec-468c-8fdd-069541b5e192', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:21:27.505952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:27.518158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:27.526670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:27.536650 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0db6e1fd-6ec4-4845-8605-b7473285c648 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.583029 Oct 19 07:21:27.537550 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2593/5334] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:26 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:27.877006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:28.570395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:28.571225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:28.585506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:28.586006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:28.586443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:28.587165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:28.587627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:28.588052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:28.940055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:21:28.940636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:21:28.941136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:21:28.941620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:21:28.942446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:21:28.963937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:28.976713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:28.977255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:28.978109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:28.985915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:28.988215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:29.018977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=53 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:29.053329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Getting quotas for project dd4f4f8316fe4ea094805ab136034ce1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:21:29.074612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Getting quotas for user 333de935e30d455fbf6f45dfdc3ae679 and project dd4f4f8316fe4ea094805ab136034ce1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:21:29.237579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:21:29.240957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a9a0e22-33e0-4798-a5fa-5f0c2325c88f',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:21:29.370440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:29.382534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:29.384666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:29.386219 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14b15e05-c799-47c4-bec5-db5160f9ccf5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.819998 Oct 19 07:21:29.415572 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2594/5335] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:28 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:29.831782 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [706c3732-afee-407f-b19f-d1cfa90fa6a9] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 07:21:30.420823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:30.422318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:30.436489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:30.441597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:30.441597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:30.441597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:30.448897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:30.450257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:30.850295 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [706c3732-afee-407f-b19f-d1cfa90fa6a9] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 51984. Oct 19 07:21:30.864781 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74653a42-0ea5-4112-849e-d73de60f299d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.096188 Oct 19 07:21:30.864781 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2742/5336] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:21:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 4098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:21:30.870145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-137d2b76-7363-466c-a6d1-349c3808f6c2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:30.876010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-137d2b76-7363-466c-a6d1-349c3808f6c2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:31.141394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-137d2b76-7363-466c-a6d1-349c3808f6c2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:31.153970 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-137d2b76-7363-466c-a6d1-349c3808f6c2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1098 microversion: 2.1 time: 0.287555 Oct 19 07:21:31.155339 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2743/5337] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:30 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1098 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:31.455891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:31.489948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:31.498562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:31.501448 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e80a8e89-85db-42d0-83e1-f6b43b923d0c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 1.085810 Oct 19 07:21:31.505218 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2595/5338] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:30 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:32.181547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aeef99cb-2545-4e43-b750-b04ce008899f tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:32.185589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aeef99cb-2545-4e43-b750-b04ce008899f tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:32.391915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aeef99cb-2545-4e43-b750-b04ce008899f tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:32.415050 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aeef99cb-2545-4e43-b750-b04ce008899f tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1098 microversion: 2.1 time: 0.227354 Oct 19 07:21:32.415719 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2744/5339] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:32 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1098 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:32.529425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:32.532257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:32.549967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:32.551441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:32.552337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:32.553309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:32.554037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:32.555977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:32.995615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:33.010234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:33.012440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:33.024745 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-492dcff2-401a-43d8-94bd-42fd8eaea013 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.499282 Oct 19 07:21:33.025710 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2596/5340] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:32 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:33.449081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:33.450557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:33.463992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:33.465211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:33.469328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:33.470573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:33.474483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:33.475138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:33.723234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:33.735018 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90a564a7-d7bb-4ad2-9d7a-5c2f4f45b4fd tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1196 microversion: 2.1 time: 0.298986 Oct 19 07:21:33.736251 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2745/5341] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:33 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1196 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:34.052854 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:34.053474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:34.066748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:34.068873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:34.069359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:34.070213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:34.071711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:34.071711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:34.744501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:34.760178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:34.760902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:34.778157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:34.783622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:34.784340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:34.785522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:34.793727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:34.795463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:34.799880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:34.801410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:34.815047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ffdcc12-6a86-45b2-9c64-b6ab6ea06c1e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.754319 Oct 19 07:21:34.843746 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2597/5342] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:34 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:21:35.139567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:35.159669 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-220787e2-b6be-43eb-8445-947150fa5520 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1214 microversion: 2.1 time: 0.404660 Oct 19 07:21:35.177022 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2746/5343] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:34 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1214 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:21:35.845547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:35.849058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:35.862109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:35.863292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:35.864823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:35.867249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:35.869304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:35.869816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:36.185196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:36.185835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:36.205636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:36.206144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:36.206610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:36.207368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:36.207833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:36.208311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:36.291627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:36.305776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:36.307228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:36.308443 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0628576f-1191-4d7c-961b-db3d07ac4637 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.466972 Oct 19 07:21:36.314675 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2598/5344] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:35 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:36.719982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:36.736083 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8356dc1-8224-4cfa-a4b3-81da4b54c9c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1282 microversion: 2.1 time: 0.552814 Oct 19 07:21:36.747916 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2747/5345] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:36 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1282 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:21:37.339232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:37.339853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:37.358850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:37.359504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:37.360165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:37.360909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:37.361481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:37.361923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:37.770066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:37.770714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:37.789020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:37.790728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:37.791582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:37.792373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:37.792844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:37.796366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:37.958872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:37.977833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:37.979417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:37.980652 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a925b288-57d4-4c26-a757-c31c35224bd6 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.646178 Oct 19 07:21:37.985775 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2599/5346] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:37 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:38.113149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:38.127188 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8155fa9-aa74-4d38-bc5b-18d243d9305c tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1282 microversion: 2.1 time: 0.366657 Oct 19 07:21:38.129345 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2748/5347] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:37 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1282 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:39.014334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-894d3068-f8b2-456c-b258-afa9e7e34640 req-3f490c58-5f3e-453c-a906-b4be427e475b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfba5e6-412a-46dd-869e-e02d6c0eaf74", "tag": "ffb08c1f-685b-46f1-af1b-e149fc6ed4c4"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:39.021662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:39.021662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:39.021662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:39.027674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:39.028213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:39.028669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:39.029395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:39.029884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:39.030328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:39.032033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-894d3068-f8b2-456c-b258-afa9e7e34640 req-3f490c58-5f3e-453c-a906-b4be427e475b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:39.042375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-894d3068-f8b2-456c-b258-afa9e7e34640 req-3f490c58-5f3e-453c-a906-b4be427e475b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:39.042947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-894d3068-f8b2-456c-b258-afa9e7e34640 req-3f490c58-5f3e-453c-a906-b4be427e475b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:39.061876 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-894d3068-f8b2-456c-b258-afa9e7e34640 req-3f490c58-5f3e-453c-a906-b4be427e475b service nova] Creating event network-changed:ffb08c1f-685b-46f1-af1b-e149fc6ed4c4 for instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 on n-h2-861333-10 Oct 19 07:21:39.071556 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-894d3068-f8b2-456c-b258-afa9e7e34640 req-3f490c58-5f3e-453c-a906-b4be427e475b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319336 Oct 19 07:21:39.073447 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2600/5348] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:39.151565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:39.155970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:39.175978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:39.181159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:39.182646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:39.183516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:39.186481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:39.187055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:39.370988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:39.383555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:39.386322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:39.387811 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13bf3861-d49b-43df-979b-40f98b0e77f0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1885 microversion: 2.42 time: 0.377359 Oct 19 07:21:39.402445 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2749/5349] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:39 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1885 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:40.134703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:40.151037 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a51c5de-699c-440c-a528-6e0025714fb5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1282 microversion: 2.1 time: 1.003768 Oct 19 07:21:40.168060 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2601/5350] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:39 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1282 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:40.414885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:40.415788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:40.426643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:40.430512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:40.431715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:40.432726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:40.433351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:40.433959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:40.929349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:40.948535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:40.950831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:40.952699 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6fae6358-6cf5-4ed8-89c8-8df6e3904707 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.541463 Oct 19 07:21:40.953861 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2750/5351] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:40 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:41.175102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:41.175893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:41.186775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:41.188827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:41.189562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:41.191186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:41.192276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:41.192964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:41.459607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:41.483013 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33631d27-c5e8-4f95-925e-270a2125767e tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1282 microversion: 2.1 time: 0.309690 Oct 19 07:21:41.504512 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2602/5352] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:41 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1282 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:41.983042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:41.984327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:41.991771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:41.994687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:41.994687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:41.994687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:41.994687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:41.994687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:42.401234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:42.509181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:42.509806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:42.525250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:42.525669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:42.535821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:42.537793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:42.539111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:42.544062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:42.750304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:42.768494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:42.770029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:42.776443 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d238eb0-e8dd-4969-91e0-ff7077bf5c93 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.799079 Oct 19 07:21:42.778083 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2751/5353] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:41 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:42.919669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:42.937271 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-def61146-c7c5-4ab4-961e-f385828dc6a1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1282 microversion: 2.1 time: 0.431830 Oct 19 07:21:42.941727 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2603/5354] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:42 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1282 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:43.808251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:43.809638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:43.822481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:43.823265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:43.823976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:43.825794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:43.826475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:43.827073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:43.973978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:43.974652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:43.989137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:43.989566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:43.990020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:44.001655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:44.005278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:44.005948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:44.275950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:44.291378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:44.294822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:44.302466 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0e459e9-7b35-4985-887e-ef005873e8e3 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.498836 Oct 19 07:21:44.304531 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2752/5355] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:43 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:45.126052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:45.156919 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a433e109-0baf-4b60-9209-59c0a36e5874 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1282 microversion: 2.1 time: 1.170661 Oct 19 07:21:45.157795 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2604/5356] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:43 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1282 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:45.339811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:45.340473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:45.356306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:45.360530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:45.360530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:45.360530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:45.360530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:45.360530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:45.735799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:45.748460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:45.750593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:45.754207 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-983144d7-72e0-4c91-bd6b-2449c8c883cb tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.419261 Oct 19 07:21:45.767129 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2753/5357] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:45 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:46.201085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:46.201085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:46.222137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:46.222699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:46.223163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:46.223891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:46.224397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:46.224824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:46.509023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:46.520982 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a7640cd5-0802-4d16-88ab-881f2f8103b0 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.340396 Oct 19 07:21:46.532435 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2605/5358] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:46 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:46.784427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:46.785048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:46.794699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:46.798795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:46.800775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:46.801706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:46.804705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:46.805155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:47.190440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:47.205436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:47.207683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:47.209210 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1cb7916-1d74-4c8d-ada7-4e47416e4a2d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.429010 Oct 19 07:21:47.210435 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2754/5359] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:46 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:47.545395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:47.552687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:47.554420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:47.554974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:47.555541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:47.556547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:47.557201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:47.557688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:48.119383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:48.131206 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-091c4346-f766-492d-8903-0565c91290ff tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.589430 Oct 19 07:21:48.135643 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2606/5360] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:47 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:48.238916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:48.239539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:48.252191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:48.252705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:48.253155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:48.255924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:48.256505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:48.257518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:48.545981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:48.564281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:48.569048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:48.570399 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e73ec76-2292-43a0-910c-b2ac31a78d98 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.335501 Oct 19 07:21:48.574381 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2755/5361] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:48 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:49.161724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:49.163690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:49.171125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:49.183706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:49.184575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:49.185537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:49.186176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:49.186817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:49.214330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:49.593505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:49.601342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:49.603708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:49.614699 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55764259-bbc5-43fc-b890-935c43cd95f1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.456838 Oct 19 07:21:49.632372 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2607/5362] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:49 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:49.634310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:49.635752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:49.636561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:49.637775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:49.638253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:49.638695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:49.997471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:50.009874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:50.011938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:50.013983 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd8637d2-59e5-493c-b7db-e88668f2142c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.416697 Oct 19 07:21:50.026042 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2756/5363] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:49 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:50.639079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:50.639755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:50.646816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:50.647357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:50.647810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:50.648551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:50.649016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:50.649449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:50.949729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:50.970277 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eea7a6c7-3adf-4e9c-8f25-c110a5f32512 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.324987 Oct 19 07:21:50.989872 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2608/5364] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:50 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:51.057811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:51.060628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:51.065827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:51.066399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:51.066902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:51.067843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:51.068466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:51.068957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:51.435713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:51.485566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:51.494101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:51.494101 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2557b271-d6f8-48f0-babd-b04e1975eb8d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.435086 Oct 19 07:21:51.494101 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2757/5365] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:51 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:52.014069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:52.015424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:52.023923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:52.024706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:52.025145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:52.026138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:52.027129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:52.027762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:52.228215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:52.237987 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24e3109d-2e79-404f-b96b-dd1fa7cd7724 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.228231 Oct 19 07:21:52.239876 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2609/5366] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:52 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:52.521638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:52.523709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:52.532203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:52.532993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:52.533992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:52.535115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:52.535801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:52.536507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:52.794578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:52.813401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:52.816787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:52.821004 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b07760ab-e42f-400a-bce0-1074aa3abfb2 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.303915 Oct 19 07:21:52.834226 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2758/5367] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:52 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:53.261739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:53.262896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:53.269544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:53.270034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:53.270649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:53.271528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:53.272182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:53.273342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:53.434775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:53.443905 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-83288b15-2f23-467f-9a61-954641298f41 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.186164 Oct 19 07:21:53.445065 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2610/5368] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:53 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:21:53.855629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:53.857197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:53.878117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:53.878117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:53.878117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:53.878117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:53.878117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:53.878117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:54.240966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:54.246551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:54.248315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:54.249487 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35bff2a4-4619-4a62-a636-c712c47133a0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.399447 Oct 19 07:21:54.250051 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2759/5369] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:53 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:54.467286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:54.467906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:54.477765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:54.478269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:54.478720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:54.479444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:54.479911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:54.480376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:55.028026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:55.040799 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6219bea1-e724-48de-8f18-4b73462e53ca tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.577136 Oct 19 07:21:55.041554 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2611/5370] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:54 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:55.283449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:55.284163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:55.304399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:55.304907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:55.305357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:55.313007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:55.317893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:55.318651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:55.779358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:55.797039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:55.798538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:55.803104 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e3d80a1-0cb2-4bb4-98b9-4928de7a014b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.531395 Oct 19 07:21:55.813862 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2760/5371] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:55 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:56.075445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:56.076185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:56.086510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=42 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:56.103137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:56.105710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:56.107453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:56.108401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:56.111349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:56.113390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:56.513097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:56.525429 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-528d073e-8d0b-4f70-b9f4-8e81df951597 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.463262 Oct 19 07:21:56.526034 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2612/5372] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:56 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:56.836425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:56.836425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:56.858354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:56.875662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:56.876270 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:56.877155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:56.877679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:56.878254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:56.951283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:57.243036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:57.259907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:57.259907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:57.259907 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-702abe8c-f550-45bc-a42b-16c2a104054c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.430274 Oct 19 07:21:57.259907 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2761/5373] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:56 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:21:57.531846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4ae1820a-62de-4a31-b471-16e9232d6b21 req-bc58866b-91e1-4dfb-bcfa-bfb751b64c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cfba5e6-412a-46dd-869e-e02d6c0eaf74", "name": "network-vif-plugged", "status": "completed", "tag": "ffb08c1f-685b-46f1-af1b-e149fc6ed4c4"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:21:57.551171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4ae1820a-62de-4a31-b471-16e9232d6b21 req-bc58866b-91e1-4dfb-bcfa-bfb751b64c72 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:57.553480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4ae1820a-62de-4a31-b471-16e9232d6b21 req-bc58866b-91e1-4dfb-bcfa-bfb751b64c72 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:57.554038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4ae1820a-62de-4a31-b471-16e9232d6b21 req-bc58866b-91e1-4dfb-bcfa-bfb751b64c72 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:57.554320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:57.555814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:57.573017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:57.573017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:57.573017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:57.573017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:57.578788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:57.579109 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4ae1820a-62de-4a31-b471-16e9232d6b21 req-bc58866b-91e1-4dfb-bcfa-bfb751b64c72 service nova] Creating event network-vif-plugged:ffb08c1f-685b-46f1-af1b-e149fc6ed4c4 for instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 on n-h2-861333-10 Oct 19 07:21:57.579445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:57.598012 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4ae1820a-62de-4a31-b471-16e9232d6b21 req-bc58866b-91e1-4dfb-bcfa-bfb751b64c72 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069906 Oct 19 07:21:57.601692 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2613/5374] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:21:57.867427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:57.884705 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35e36dd5-3a3d-46ba-9648-63691e36ada8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.336289 Oct 19 07:21:57.885514 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2762/5375] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:57 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:21:58.288806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:58.289647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:58.304226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:58.306643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:58.309087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:58.310090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:58.311962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:58.312827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:58.908088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:21:58.909617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:21:58.922716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:21:58.925309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:58.926288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:58.930889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:58.931687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:21:58.932215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:21:58.932669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:21:59.251027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:59.261279 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01c048c1-32ff-492f-8d52-72e3edfbb2a8 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1270 microversion: 2.1 time: 0.358283 Oct 19 07:21:59.262373 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2763/5376] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:21:58 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1270 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:21:59.291559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:59.307817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:59.309593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:21:59.311389 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39683f7c-4b73-4d7f-8f11-33b6f52dd152 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 1.027979 Oct 19 07:21:59.312778 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2614/5377] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:21:58 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:00.285194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:00.286806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:00.303182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:00.304543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:00.305529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:00.308684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:00.309333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:00.311684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:00.339824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:00.340571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:00.373806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:00.376354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:00.376867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:00.377610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:00.378092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:00.378531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:00.605378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:00.616927 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-714e36aa-d751-4c28-a44b-2b707aaac8d6 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1458 microversion: 2.1 time: 0.335544 Oct 19 07:22:00.618218 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2764/5378] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:00 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1458 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:00.642178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:00.643159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:00.654494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:00.655329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:00.656227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:00.658998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:00.660178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:00.665930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:00.895912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:00.909207 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d7bb464-857f-4a6d-ae77-687862231833 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1458 microversion: 2.1 time: 0.270973 Oct 19 07:22:00.910505 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2765/5379] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:00 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1458 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:22:01.043467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:01.063647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:01.068771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:01.078501 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a47855de-4a2d-4a59-af17-ea8252631e8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.738239 Oct 19 07:22:01.078501 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2615/5380] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:00 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:02.104361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:02.105097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:02.123431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:02.123431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:02.123431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:02.123431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:02.133910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:02.134503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:02.794821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:02.819932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:02.831214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:02.841398 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-510b4727-9f8d-4301-8c89-997e23caf34c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.739305 Oct 19 07:22:02.843446 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2766/5381] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:02 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:03.879381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:03.880730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:03.894249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:03.895521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:03.895977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:03.896812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:03.897534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:03.897976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:04.424265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:04.435926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:04.459563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:04.462391 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a35ea97c-7c41-4409-b7d5-68b0472a7b42 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.590202 Oct 19 07:22:04.485959 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2616/5382] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:03 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:05.159908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-528dd656-964a-42e2-99ea-ea9dcca502c4 req-8134f805-e596-4bf3-bf25-ebda42f76471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfba5e6-412a-46dd-869e-e02d6c0eaf74", "tag": "ffb08c1f-685b-46f1-af1b-e149fc6ed4c4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:05.198531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-528dd656-964a-42e2-99ea-ea9dcca502c4 req-8134f805-e596-4bf3-bf25-ebda42f76471 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:05.199248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-528dd656-964a-42e2-99ea-ea9dcca502c4 req-8134f805-e596-4bf3-bf25-ebda42f76471 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:05.203362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-528dd656-964a-42e2-99ea-ea9dcca502c4 req-8134f805-e596-4bf3-bf25-ebda42f76471 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:05.233285 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-528dd656-964a-42e2-99ea-ea9dcca502c4 req-8134f805-e596-4bf3-bf25-ebda42f76471 service nova] Creating event network-changed:ffb08c1f-685b-46f1-af1b-e149fc6ed4c4 for instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 on n-h2-861333-10 Oct 19 07:22:05.252900 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-528dd656-964a-42e2-99ea-ea9dcca502c4 req-8134f805-e596-4bf3-bf25-ebda42f76471 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096673 Oct 19 07:22:05.258406 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2767/5383] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:05.503882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:05.504694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:05.532385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:05.534829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:05.534829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:05.537935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:05.541367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:05.545415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:06.548133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1793313846", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "afc8a1b5-cc57-464e-abad-abfc787c40c3"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:06.566139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:06.588766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:06.597755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:06.599205 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0857f2c-16f0-45eb-8978-dbffe1f3b909 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 1.101539 Oct 19 07:22:06.612147 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2617/5384] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:05 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:06.649910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] validate_networks() for [('afc8a1b5-cc57-464e-abad-abfc787c40c3', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:22:07.629755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:07.630351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:07.647862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:07.648551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:07.649017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:07.650040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:07.650675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:07.651467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:07.850126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:22:07.850677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:22:07.851050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:22:07.851467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:22:07.851885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:22:07.867161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:07.868804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:07.870286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:07.871537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:07.872149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:07.873164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:07.905793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Getting quotas for project 74ab18166a124250aa4c825aa9da17eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:22:07.911762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Getting quotas for user b078c3a25bab4c64ac3cfa8a0d4d8eba and project 74ab18166a124250aa4c825aa9da17eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:22:07.928446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:22:07.931719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:22:08.045474 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85d64dc5-e098-407f-9ab1-2033586c596b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501595 Oct 19 07:22:08.046892 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2768/5385] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:22:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:22:08.061503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2921dfdd-3624-4bb9-837b-b0f8bb94d89b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:08.062311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2921dfdd-3624-4bb9-837b-b0f8bb94d89b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:08.094090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:08.104560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:08.106003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:08.111640 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d3496c7b-6a0d-4589-a70b-8054030f8f15 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.486244 Oct 19 07:22:08.115341 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2618/5386] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:07 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:22:08.209222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2921dfdd-3624-4bb9-837b-b0f8bb94d89b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:08.225328 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2921dfdd-3624-4bb9-837b-b0f8bb94d89b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1219 microversion: 2.1 time: 0.171483 Oct 19 07:22:08.226551 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2769/5387] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:08 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:22:09.040758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3bc78b07-27e5-44cb-9457-a69418f4dbed req-7f1e60df-4c68-46f2-b643-f436fbcb9ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfba5e6-412a-46dd-869e-e02d6c0eaf74", "tag": "ffb08c1f-685b-46f1-af1b-e149fc6ed4c4"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:09.069092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3bc78b07-27e5-44cb-9457-a69418f4dbed req-7f1e60df-4c68-46f2-b643-f436fbcb9ced service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:09.083206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3bc78b07-27e5-44cb-9457-a69418f4dbed req-7f1e60df-4c68-46f2-b643-f436fbcb9ced service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:09.084009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3bc78b07-27e5-44cb-9457-a69418f4dbed req-7f1e60df-4c68-46f2-b643-f436fbcb9ced service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:09.101344 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3bc78b07-27e5-44cb-9457-a69418f4dbed req-7f1e60df-4c68-46f2-b643-f436fbcb9ced service nova] Creating event network-changed:ffb08c1f-685b-46f1-af1b-e149fc6ed4c4 for instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 on n-h2-861333-10 Oct 19 07:22:09.107085 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3bc78b07-27e5-44cb-9457-a69418f4dbed req-7f1e60df-4c68-46f2-b643-f436fbcb9ced service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074382 Oct 19 07:22:09.107708 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2619/5388] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:09.142133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:09.143385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:09.151993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:09.152522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:09.152997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:09.153741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:09.154616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:09.158817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:09.291038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37cbeff6-b056-4a89-9163-9504a79b1318 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:09.297566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37cbeff6-b056-4a89-9163-9504a79b1318 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:09.572821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:09.575702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37cbeff6-b056-4a89-9163-9504a79b1318 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:09.586917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:09.589102 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37cbeff6-b056-4a89-9163-9504a79b1318 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1219 microversion: 2.1 time: 0.328082 Oct 19 07:22:09.596236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:09.596424 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2620/5389] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:09 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1219 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:09.597189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0c3397ba-329e-449f-aefe-f039da2922fa req-8dff282e-418d-41f7-a59d-e45e11eb15a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-plugged", "status": "completed", "tag": "5202bbc9-e19e-45f0-a8b9-469ff0364621"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:09.607090 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0dff238-3df7-4290-90e3-1f6a9d930279 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.468966 Oct 19 07:22:09.607843 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2770/5390] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:09 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:09.628761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0c3397ba-329e-449f-aefe-f039da2922fa req-8dff282e-418d-41f7-a59d-e45e11eb15a5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:09.630049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0c3397ba-329e-449f-aefe-f039da2922fa req-8dff282e-418d-41f7-a59d-e45e11eb15a5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:09.632196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0c3397ba-329e-449f-aefe-f039da2922fa req-8dff282e-418d-41f7-a59d-e45e11eb15a5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:09.653340 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0c3397ba-329e-449f-aefe-f039da2922fa req-8dff282e-418d-41f7-a59d-e45e11eb15a5 service nova] Creating event network-vif-plugged:5202bbc9-e19e-45f0-a8b9-469ff0364621 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:22:09.660019 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0c3397ba-329e-449f-aefe-f039da2922fa req-8dff282e-418d-41f7-a59d-e45e11eb15a5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068003 Oct 19 07:22:09.661153 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2621/5391] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:10.617449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:10.618075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:10.633478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:10.634462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:10.634932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:10.635672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:10.636165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:10.639195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:10.639362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:10.640848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:10.654721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:10.660042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:10.661878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:10.662689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:10.665425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:10.665895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:10.803976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:10.813284 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc43a473-2b7a-4677-8e9e-834269888177 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1271 microversion: 2.1 time: 0.199870 Oct 19 07:22:10.813869 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2771/5392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:10 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:11.138064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bb4e3bb9-3286-45e0-b726-95585693046b req-25c303ca-70e1-4dd4-9e0b-b4cd28bb7449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfba5e6-412a-46dd-869e-e02d6c0eaf74", "tag": "ffb08c1f-685b-46f1-af1b-e149fc6ed4c4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:11.162173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bb4e3bb9-3286-45e0-b726-95585693046b req-25c303ca-70e1-4dd4-9e0b-b4cd28bb7449 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:11.163680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bb4e3bb9-3286-45e0-b726-95585693046b req-25c303ca-70e1-4dd4-9e0b-b4cd28bb7449 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:11.164616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bb4e3bb9-3286-45e0-b726-95585693046b req-25c303ca-70e1-4dd4-9e0b-b4cd28bb7449 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:11.178923 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bb4e3bb9-3286-45e0-b726-95585693046b req-25c303ca-70e1-4dd4-9e0b-b4cd28bb7449 service nova] Creating event network-changed:ffb08c1f-685b-46f1-af1b-e149fc6ed4c4 for instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 on n-h2-861333-10 Oct 19 07:22:11.186350 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bb4e3bb9-3286-45e0-b726-95585693046b req-25c303ca-70e1-4dd4-9e0b-b4cd28bb7449 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054688 Oct 19 07:22:11.187642 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2772/5393] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:11.223069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:11.244258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:11.245828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:11.247932 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2db13471-dc42-4d7f-8a48-9736828dc269 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.613389 Oct 19 07:22:11.258011 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2622/5394] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:10 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:22:11.746657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-141d2838-b499-46c6-b66b-3db3e7a5c866 req-71d13f76-7ea6-440e-a8aa-b65039492e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-plugged", "status": "completed", "tag": "a8be6485-4230-4fe4-909f-46e5df66a747"}, {"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-plugged", "status": "completed", "tag": "8d53d8ed-0dc4-4c8e-9b38-4944c5be68ab"}, {"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-plugged", "status": "completed", "tag": "9c8c3454-2335-450b-a2b0-10fd7456c950"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:11.810581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-141d2838-b499-46c6-b66b-3db3e7a5c866 req-71d13f76-7ea6-440e-a8aa-b65039492e33 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:11.815374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-141d2838-b499-46c6-b66b-3db3e7a5c866 req-71d13f76-7ea6-440e-a8aa-b65039492e33 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:11.816314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-141d2838-b499-46c6-b66b-3db3e7a5c866 req-71d13f76-7ea6-440e-a8aa-b65039492e33 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:11.838274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:11.839541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:11.853875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:11.857372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:11.858027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:11.859030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:11.860778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:11.864369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:11.868022 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-141d2838-b499-46c6-b66b-3db3e7a5c866 req-71d13f76-7ea6-440e-a8aa-b65039492e33 service nova] Creating event network-vif-plugged:a8be6485-4230-4fe4-909f-46e5df66a747 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:22:11.868750 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-141d2838-b499-46c6-b66b-3db3e7a5c866 req-71d13f76-7ea6-440e-a8aa-b65039492e33 service nova] Creating event network-vif-plugged:8d53d8ed-0dc4-4c8e-9b38-4944c5be68ab for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:22:11.871275 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-141d2838-b499-46c6-b66b-3db3e7a5c866 req-71d13f76-7ea6-440e-a8aa-b65039492e33 service nova] Creating event network-vif-plugged:9c8c3454-2335-450b-a2b0-10fd7456c950 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:22:11.895623 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-141d2838-b499-46c6-b66b-3db3e7a5c866 req-71d13f76-7ea6-440e-a8aa-b65039492e33 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.148562 Oct 19 07:22:11.897704 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2773/5395] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:11.995550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:12.004582 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76a1ab70-2462-45ae-8132-325b77a6e7df tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1289 microversion: 2.1 time: 0.170609 Oct 19 07:22:12.008279 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2623/5396] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:11 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1289 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:12.280692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:12.282481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:12.295941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:12.296468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:12.302365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:12.303378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:12.303831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:12.304312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:12.805758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:12.815841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:12.817346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:12.818544 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9025e52-f60d-4978-afec-91dfb67e5c4a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.542660 Oct 19 07:22:12.833542 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2774/5397] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:12 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:13.030901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:13.032219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:13.040128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:13.040634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:13.041079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:13.041789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:13.050373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:13.051000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:13.272471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:13.282388 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b318417-c69b-41fe-b8a3-a8c6e5d3c9d8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1319 microversion: 2.1 time: 0.255319 Oct 19 07:22:13.282988 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2624/5398] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:13 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:13.849820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:13.851525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:13.872755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:13.873489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:13.878056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:13.881264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:13.883767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:13.885979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:14.314287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-644cd0b8-40b7-4115-9fd7-cddfc91de9df req-5cdb020d-d7d0-4207-99c6-c9f2d3ba1b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-plugged", "status": "completed", "tag": "4f64379c-bc44-4c4c-aff7-85eb2d62bef5"}, {"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-plugged", "status": "completed", "tag": "75d48c90-3c9d-4b6b-9e73-e63deb941188"}, {"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-plugged", "status": "completed", "tag": "bc9945f1-d06f-48e9-817c-e30001de19fa"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:14.338612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-644cd0b8-40b7-4115-9fd7-cddfc91de9df req-5cdb020d-d7d0-4207-99c6-c9f2d3ba1b5d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:14.339092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-644cd0b8-40b7-4115-9fd7-cddfc91de9df req-5cdb020d-d7d0-4207-99c6-c9f2d3ba1b5d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:14.339562 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-644cd0b8-40b7-4115-9fd7-cddfc91de9df req-5cdb020d-d7d0-4207-99c6-c9f2d3ba1b5d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:14.363152 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-644cd0b8-40b7-4115-9fd7-cddfc91de9df req-5cdb020d-d7d0-4207-99c6-c9f2d3ba1b5d service nova] Creating event network-vif-plugged:4f64379c-bc44-4c4c-aff7-85eb2d62bef5 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:22:14.363952 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-644cd0b8-40b7-4115-9fd7-cddfc91de9df req-5cdb020d-d7d0-4207-99c6-c9f2d3ba1b5d service nova] Creating event network-vif-plugged:75d48c90-3c9d-4b6b-9e73-e63deb941188 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:22:14.365338 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-644cd0b8-40b7-4115-9fd7-cddfc91de9df req-5cdb020d-d7d0-4207-99c6-c9f2d3ba1b5d service nova] Creating event network-vif-plugged:bc9945f1-d06f-48e9-817c-e30001de19fa for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:22:14.379665 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-644cd0b8-40b7-4115-9fd7-cddfc91de9df req-5cdb020d-d7d0-4207-99c6-c9f2d3ba1b5d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.323007 Oct 19 07:22:14.380330 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2625/5399] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:22:14.389286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:14.390002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:14.416726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:14.429701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:14.430181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:14.431393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:14.431871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:14.433350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:14.800300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:14.812815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:14.815506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:14.817184 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3eb63619-69e3-4295-b130-9ca36a02f24d tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.974070 Oct 19 07:22:14.833465 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2775/5400] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:13 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:14.889215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:14.898047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-065ff2d1-927c-496a-8762-91c3a6c16c93 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1319 microversion: 2.1 time: 0.515958 Oct 19 07:22:14.904462 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2626/5401] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:14 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:15.215030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2823d1cf-bd33-400c-90e7-2a12add75202 req-88499db5-16a8-4c8a-8833-69d3e25fd2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3296fc9e-e4a7-4c6e-a33d-90625b5c2270", "tag": "561cd7b8-f61c-45e5-8c15-8fcfcf72e351"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:15.228020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2823d1cf-bd33-400c-90e7-2a12add75202 req-88499db5-16a8-4c8a-8833-69d3e25fd2ac service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:15.228862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2823d1cf-bd33-400c-90e7-2a12add75202 req-88499db5-16a8-4c8a-8833-69d3e25fd2ac service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:15.234426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2823d1cf-bd33-400c-90e7-2a12add75202 req-88499db5-16a8-4c8a-8833-69d3e25fd2ac service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:15.242973 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2823d1cf-bd33-400c-90e7-2a12add75202 req-88499db5-16a8-4c8a-8833-69d3e25fd2ac service nova] Creating event network-changed:561cd7b8-f61c-45e5-8c15-8fcfcf72e351 for instance 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 on n-h1-861333-10 Oct 19 07:22:15.248095 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2823d1cf-bd33-400c-90e7-2a12add75202 req-88499db5-16a8-4c8a-8833-69d3e25fd2ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037457 Oct 19 07:22:15.249054 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2776/5402] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:15.849499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:15.858530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:15.870408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:15.871548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:15.872477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:15.873650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:15.874360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:15.875023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:15.928388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:15.929133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:15.937313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:15.937441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:15.937821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:15.938540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:15.938997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:15.939428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:16.095176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:16.098351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:16.109918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:16.111687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:16.128401 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b73360c-fa46-42a8-9422-4d3202d188ca tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1873 microversion: 2.42 time: 0.270020 Oct 19 07:22:16.129159 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2627/5403] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:15 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1873 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:16.433061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:16.443108 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60e8314d-ae44-4068-a1d0-7fac3cfab664 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1319 microversion: 2.1 time: 0.519494 Oct 19 07:22:16.443714 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2777/5404] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:15 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:17.141094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:17.141710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:17.155630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:17.155630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:17.155630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:17.155630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:17.155630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:17.155630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:17.467383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:17.468146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:17.483209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:17.483850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:17.487525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:17.492344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:17.492481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:17.492606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:17.492606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:17.503159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:17.505014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:17.506547 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e054b591-b885-44ad-a762-2c627068fe5b tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2829 microversion: 2.42 time: 0.369645 Oct 19 07:22:17.507801 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2628/5405] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:22:17 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2829 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:17.537379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6af928aa-9927-4779-bc24-8bec341deeef tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:17.537871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6af928aa-9927-4779-bc24-8bec341deeef tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:17.545445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6af928aa-9927-4779-bc24-8bec341deeef tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:17.550791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6af928aa-9927-4779-bc24-8bec341deeef tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:17.550791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6af928aa-9927-4779-bc24-8bec341deeef tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:17.550791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6af928aa-9927-4779-bc24-8bec341deeef tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:17.550791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6af928aa-9927-4779-bc24-8bec341deeef tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:17.550791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6af928aa-9927-4779-bc24-8bec341deeef tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:17.712841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:17.719096 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6af928aa-9927-4779-bc24-8bec341deeef tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.185688 Oct 19 07:22:17.719690 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2629/5406] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Oct 19 07:22:17 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08/os-interface => generated 1829 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:22:17.730043 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b16371d-8497-4374-816f-c07fc1512aed tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1319 microversion: 2.1 time: 0.259438 Oct 19 07:22:17.736587 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2778/5407] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:17 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:18.752687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:18.753317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:18.774267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:18.775567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:18.776849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:18.777888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:18.778362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:18.780613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:19.102363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:19.115030 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92a22013-7db5-44bf-9b61-6944f465d528 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1319 microversion: 2.1 time: 0.371217 Oct 19 07:22:19.117854 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2630/5408] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:18 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:19.481932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-da5d5ea2-7f67-4e52-8541-0e70cde7b279 req-7b256dcf-037f-4304-9719-a553891bc310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "tag": "9c8c3454-2335-450b-a2b0-10fd7456c950"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:19.530995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:19.534913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:19.549559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-da5d5ea2-7f67-4e52-8541-0e70cde7b279 req-7b256dcf-037f-4304-9719-a553891bc310 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:19.551830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-da5d5ea2-7f67-4e52-8541-0e70cde7b279 req-7b256dcf-037f-4304-9719-a553891bc310 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:19.552878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-da5d5ea2-7f67-4e52-8541-0e70cde7b279 req-7b256dcf-037f-4304-9719-a553891bc310 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:19.570133 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-da5d5ea2-7f67-4e52-8541-0e70cde7b279 req-7b256dcf-037f-4304-9719-a553891bc310 service nova] Creating event network-changed:9c8c3454-2335-450b-a2b0-10fd7456c950 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:22:19.580162 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-da5d5ea2-7f67-4e52-8541-0e70cde7b279 req-7b256dcf-037f-4304-9719-a553891bc310 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117917 Oct 19 07:22:19.587134 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2779/5409] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:20.140882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:20.142205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:20.144386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:20.152449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:20.153208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:20.153818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:20.154710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:20.155496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:20.156187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:20.377528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:20.386801 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-daa193d2-df20-4a36-adab-b5cdaa5064b7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1319 microversion: 2.1 time: 0.251350 Oct 19 07:22:20.388190 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2631/5410] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:20 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:21.412174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:21.414346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:21.430536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:21.431294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:21.432136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:21.434088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:21.434741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:21.435588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:21.623211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:21.632508 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95e365ab-2faf-4b7b-9cc0-45d2542219e4 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1319 microversion: 2.1 time: 0.224597 Oct 19 07:22:21.648878 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2780/5411] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:21 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:22.664782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:22.665428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:22.674106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:22.674623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:22.675197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:22.675874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:22.676600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:22.677286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:22.890647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:22.901160 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3374ad65-fc9d-4eeb-892b-1cbdd1f4d1be tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1319 microversion: 2.1 time: 0.244501 Oct 19 07:22:22.922963 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2632/5412] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:22 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:23.031938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a5eee9dc-74b3-456b-a895-58e9c8731db1 req-bc06cb6c-46e2-48f1-876a-b54d78afcc59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3296fc9e-e4a7-4c6e-a33d-90625b5c2270", "name": "network-vif-plugged", "status": "completed", "tag": "561cd7b8-f61c-45e5-8c15-8fcfcf72e351"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:23.060241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a5eee9dc-74b3-456b-a895-58e9c8731db1 req-bc06cb6c-46e2-48f1-876a-b54d78afcc59 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:23.060683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a5eee9dc-74b3-456b-a895-58e9c8731db1 req-bc06cb6c-46e2-48f1-876a-b54d78afcc59 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:23.061190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a5eee9dc-74b3-456b-a895-58e9c8731db1 req-bc06cb6c-46e2-48f1-876a-b54d78afcc59 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:23.079798 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a5eee9dc-74b3-456b-a895-58e9c8731db1 req-bc06cb6c-46e2-48f1-876a-b54d78afcc59 service nova] Creating event network-vif-plugged:561cd7b8-f61c-45e5-8c15-8fcfcf72e351 for instance 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 on n-h1-861333-10 Oct 19 07:22:23.086094 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a5eee9dc-74b3-456b-a895-58e9c8731db1 req-bc06cb6c-46e2-48f1-876a-b54d78afcc59 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067755 Oct 19 07:22:23.087153 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2781/5413] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:23.927372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:23.928694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:23.939785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:23.940682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:23.941311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:23.950608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:23.950608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:23.950608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:24.286864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:24.306587 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f51702ee-22b7-4c2e-a323-88ff3170dd65 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1319 microversion: 2.1 time: 0.383269 Oct 19 07:22:24.309361 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2633/5414] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:23 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:22:25.333943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:25.334650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:25.341518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:25.342114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:25.343210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:25.343210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:25.351301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:25.351301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:25.561713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:25.571115 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13cbd1e2-e50f-4f94-b988-7de2b181b556 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1507 microversion: 2.1 time: 0.242419 Oct 19 07:22:25.571777 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2782/5415] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:25 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:26.889990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1538462436", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "ddc1d39b-0616-481d-85f5-1807018a3cea"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:26.924028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=46 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:26.981676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] validate_networks() for [('ddc1d39b-0616-481d-85f5-1807018a3cea', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:22:27.707193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:22:27.708762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:22:27.713194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:22:27.713745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:22:27.714270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:22:27.736781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:27.738818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:27.739450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:27.740613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:27.741127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:27.743316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:27.773654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Getting quotas for project e9e8cb0af578457f857c4ced296594fc. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:22:27.786416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Getting quotas for user 4318b091cb70483c804c099fb8504da5 and project e9e8cb0af578457f857c4ced296594fc. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:22:27.803017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:22:27.805932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:22:28.014160 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fef19f24-437d-449c-afbd-3f2d4b629203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123909 Oct 19 07:22:28.046273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66d62db5-e421-47bb-a39e-0edab043e6f7 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:28.046846 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2634/5416] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:22:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:22:28.048623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66d62db5-e421-47bb-a39e-0edab043e6f7 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:28.182820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66d62db5-e421-47bb-a39e-0edab043e6f7 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:28.190901 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66d62db5-e421-47bb-a39e-0edab043e6f7 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1214 microversion: 2.1 time: 0.151538 Oct 19 07:22:28.204579 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2783/5417] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:28 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:29.225560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99cd7c13-2550-43d3-bb60-ac4beafe5520 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:29.232762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99cd7c13-2550-43d3-bb60-ac4beafe5520 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:29.400699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99cd7c13-2550-43d3-bb60-ac4beafe5520 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:29.415226 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99cd7c13-2550-43d3-bb60-ac4beafe5520 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1214 microversion: 2.1 time: 0.194884 Oct 19 07:22:29.441328 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2635/5418] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:29 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:30.450214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:30.451041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:30.459851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:30.477999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:30.478657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:30.479870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:30.480890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:30.482448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:30.483005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:30.508319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:30.563044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:30.575407 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87e81200-9203-4106-be24-2f591dfff578 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1218 microversion: 2.1 time: 0.130709 Oct 19 07:22:30.576038 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2784/5419] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:30 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:31.604384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:31.604384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:31.626252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:31.628022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:31.629451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:31.634270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:31.635826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:31.643271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:31.752358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:31.763788 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e58e39e8-0f6e-4682-a42b-7f931cab393d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1266 microversion: 2.1 time: 0.165301 Oct 19 07:22:31.765239 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2636/5420] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:31 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:32.799262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:32.800858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:32.827116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:32.828343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:32.829081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:32.830048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:32.831139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:32.831812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:32.914213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:32.953716 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b9208ac-c167-4729-a57b-9c111167e3c3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1284 microversion: 2.1 time: 0.159144 Oct 19 07:22:32.955037 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2785/5421] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:32 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:33.987366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:33.989599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:34.023743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:34.023743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:34.023743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:34.023743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:34.023743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:34.023743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:34.331769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:34.343329 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bafd43ae-e489-4710-a110-099526441db3 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1314 microversion: 2.1 time: 0.368144 Oct 19 07:22:34.345695 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2637/5422] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:33 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:35.274611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8a22e0f5-87ae-4041-9032-94e075ade9a6 req-73c39686-df47-4cdc-bf1e-b0624f421d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da9c13b-2f06-459d-9f28-b9c22d7c259e", "tag": "115838b8-9c10-4459-90cf-2eaa3f95ee8d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:35.304575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8a22e0f5-87ae-4041-9032-94e075ade9a6 req-73c39686-df47-4cdc-bf1e-b0624f421d3b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:35.309670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8a22e0f5-87ae-4041-9032-94e075ade9a6 req-73c39686-df47-4cdc-bf1e-b0624f421d3b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:35.309670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8a22e0f5-87ae-4041-9032-94e075ade9a6 req-73c39686-df47-4cdc-bf1e-b0624f421d3b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:35.338461 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8a22e0f5-87ae-4041-9032-94e075ade9a6 req-73c39686-df47-4cdc-bf1e-b0624f421d3b service nova] Creating event network-changed:115838b8-9c10-4459-90cf-2eaa3f95ee8d for instance 7da9c13b-2f06-459d-9f28-b9c22d7c259e on n-h2-861333-10 Oct 19 07:22:35.350471 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8a22e0f5-87ae-4041-9032-94e075ade9a6 req-73c39686-df47-4cdc-bf1e-b0624f421d3b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083361 Oct 19 07:22:35.356863 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2786/5423] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:35.374231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:35.376022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:35.390577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:35.391292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:35.391928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:35.393396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:35.394090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:35.395325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:35.888767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:35.902745 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c783acb-b150-4560-b231-9a0bb26d8203 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1314 microversion: 2.1 time: 0.534982 Oct 19 07:22:35.904217 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2638/5424] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:35 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:36.934585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:36.936637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:36.951280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:36.951798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:36.952267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:36.952970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:36.953427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:36.953850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:37.126988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:37.134714 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f641667a-60dc-41c4-80ac-823e4f6601a6 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1314 microversion: 2.1 time: 0.205926 Oct 19 07:22:37.135817 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2787/5425] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:36 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:38.159243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:38.160662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:38.169322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:38.172250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:38.173549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:38.174367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:38.175464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:38.176302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:38.176976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:38.645410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:38.658630 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-56c91b85-7715-45fc-959a-b978960a1fd0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1314 microversion: 2.1 time: 0.503752 Oct 19 07:22:38.670067 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2639/5426] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:38 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:39.692999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:39.696998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:39.701825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:39.703863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:39.704742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:39.705452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:39.706419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:39.707079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:39.707588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:39.993544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:40.012391 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4ba0bc2-23ab-4842-93e7-7220bb6954ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1314 microversion: 2.1 time: 0.325794 Oct 19 07:22:40.031959 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2788/5427] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:39 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:41.041177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:41.041806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:41.044574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:41.059927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:41.060747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:41.061369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:41.062269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:41.062902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:41.063506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:41.166247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a3a6e9cb-827d-4d83-9d90-f7392c7b1f26 req-1c2ea84d-29ac-4aa0-b373-5ba0108ca430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da9c13b-2f06-459d-9f28-b9c22d7c259e", "name": "network-vif-plugged", "status": "completed", "tag": "115838b8-9c10-4459-90cf-2eaa3f95ee8d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:41.185426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a3a6e9cb-827d-4d83-9d90-f7392c7b1f26 req-1c2ea84d-29ac-4aa0-b373-5ba0108ca430 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:41.193318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a3a6e9cb-827d-4d83-9d90-f7392c7b1f26 req-1c2ea84d-29ac-4aa0-b373-5ba0108ca430 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:41.194160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a3a6e9cb-827d-4d83-9d90-f7392c7b1f26 req-1c2ea84d-29ac-4aa0-b373-5ba0108ca430 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:41.226921 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a3a6e9cb-827d-4d83-9d90-f7392c7b1f26 req-1c2ea84d-29ac-4aa0-b373-5ba0108ca430 service nova] Creating event network-vif-plugged:115838b8-9c10-4459-90cf-2eaa3f95ee8d for instance 7da9c13b-2f06-459d-9f28-b9c22d7c259e on n-h2-861333-10 Oct 19 07:22:41.243309 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a3a6e9cb-827d-4d83-9d90-f7392c7b1f26 req-1c2ea84d-29ac-4aa0-b373-5ba0108ca430 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081167 Oct 19 07:22:41.244195 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2789/5428] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:22:41.556588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:41.573896 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-285f664c-b5d8-40e9-baad-16f94d46f709 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1314 microversion: 2.1 time: 0.537738 Oct 19 07:22:41.574482 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2640/5429] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:41 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:42.598230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:42.598934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:42.608663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:42.609172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:42.609625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:42.610352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:42.614790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:42.616462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:42.815641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:42.825530 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63624ea9-8ba2-4486-8a6e-88a39338788b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1314 microversion: 2.1 time: 0.231878 Oct 19 07:22:42.826534 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2790/5430] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:42 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:43.849432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:43.850056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:43.862834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:43.863331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:43.863774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:43.864536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:43.865000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:43.865432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:44.166746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:44.176902 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85ffc014-cfe4-496d-b94f-655dc7ed4fe0 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1498 microversion: 2.1 time: 0.331329 Oct 19 07:22:44.182616 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2641/5431] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:43 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1498 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:45.459555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:45.466591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:45.468701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:45.469189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:45.469642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:45.470365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:45.470916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:45.471405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:45.502067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:22:45.971119 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ee52167-8a19-4d20-a43f-a9917d6d033d tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 204 len: 0 microversion: 2.1 time: 0.515641 Oct 19 07:22:45.972036 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2791/5432] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:22:45 2022] DELETE /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:22:45.980399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:45.981076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:45.993981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:45.994480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:45.994923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:45.998000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:46.000779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:46.001766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:46.249786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:46.259720 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6fabdfa5-41d9-4ce6-8c85-a7e3638c4736 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1504 microversion: 2.1 time: 0.283312 Oct 19 07:22:46.262032 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2642/5433] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:45 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:47.288542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:47.291711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:47.313052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:47.314260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:47.314944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:47.317048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:47.318655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:47.320047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:47.605040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:47.618684 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21d02546-9821-4062-87e1-1644921b2e89 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1504 microversion: 2.1 time: 0.332998 Oct 19 07:22:47.620612 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2792/5434] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:47 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:48.695254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:48.700233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:48.726949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:48.727463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:48.727881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:48.734041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:48.734705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:48.736730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:48.771137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=80 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:49.005509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:49.009735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d10402f8-fc26-4c5a-8d87-bbe066a83849 req-9e0ed252-870d-4097-9f63-279a735b0119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da9c13b-2f06-459d-9f28-b9c22d7c259e", "name": "network-vif-deleted", "tag": "115838b8-9c10-4459-90cf-2eaa3f95ee8d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:49.017638 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01816e11-f06e-4ddc-a804-50666ceecdbd tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1462 microversion: 2.1 time: 0.357905 Oct 19 07:22:49.032452 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2643/5435] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:48 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1462 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:49.040503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d10402f8-fc26-4c5a-8d87-bbe066a83849 req-9e0ed252-870d-4097-9f63-279a735b0119 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:49.041307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d10402f8-fc26-4c5a-8d87-bbe066a83849 req-9e0ed252-870d-4097-9f63-279a735b0119 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:49.041937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d10402f8-fc26-4c5a-8d87-bbe066a83849 req-9e0ed252-870d-4097-9f63-279a735b0119 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:49.067684 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d10402f8-fc26-4c5a-8d87-bbe066a83849 req-9e0ed252-870d-4097-9f63-279a735b0119 service nova] Creating event network-vif-deleted:115838b8-9c10-4459-90cf-2eaa3f95ee8d for instance 7da9c13b-2f06-459d-9f28-b9c22d7c259e on n-h2-861333-10 Oct 19 07:22:49.079103 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d10402f8-fc26-4c5a-8d87-bbe066a83849 req-9e0ed252-870d-4097-9f63-279a735b0119 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076347 Oct 19 07:22:49.096459 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2793/5436] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:50.042887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:50.044236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:50.057679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:50.058274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:50.058790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:50.059640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:50.062383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:50.064990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:50.113151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:50.113639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:50.114089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:50.114532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lazy-loading 'fault' on Instance uuid 7da9c13b-2f06-459d-9f28-b9c22d7c259e {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:22:50.161386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:50.170248 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af99e327-25ad-4d7e-92c6-8e92882d86c4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 200 len: 1304 microversion: 2.1 time: 0.131110 Oct 19 07:22:50.170844 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2644/5437] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:50 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:51.195539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:51.196286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: 7da9c13b-2f06-459d-9f28-b9c22d7c259e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:51.216356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:51.216356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:51.216356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:51.216356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:51.216356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:51.216356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:51.244015 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] HTTP exception thrown: Instance 7da9c13b-2f06-459d-9f28-b9c22d7c259e could not be found. Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Request method failure captured: Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e HTTP/1.1 Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6Wvw2X3OU4UaVsssnRbPnvNRgnN7dV2E562EGTb7mYD7zQCHQmClvxtITAyIQjDG-R26CPrzOcmx1Ian77s-LNsp1vuxTP5jDd_OlI1xZE2SJYcX4WFvTQKZ0IRYuHSsoksTPeP4SXRghlrJhgkyGYv99xo7bLKf-Jm8J_vCDaJMH0 Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e9e8cb0af578457f857c4ced296594fc Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesActionsTest-446496437 Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e9e8cb0af578457f857c4ced296594fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9e8cb0af578457f857c4ced296594fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9e8cb0af578457f857c4ced296594fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e9e8cb0af578457f857c4ced296594fc", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesActionsTest-446496437 Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e9e8cb0af578457f857c4ced296594fc Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesActionsTest-446496437 Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesActionsTest-446496437-project Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 4318b091cb70483c804c099fb8504da5 Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesActionsTest-446496437-project Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 7da9c13b-2f06-459d-9f28-b9c22d7c259e could not be found. Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '7da9c13b-2f06-459d-9f28-b9c22d7c259e'} Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da9c13b-2f06-459d-9f28-b9c22d7c259e could not be found. Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da9c13b-2f06-459d-9f28-b9c22d7c259e could not be found. Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:22:51.256278 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da9c13b-2f06-459d-9f28-b9c22d7c259e could not be found. Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Returning 404 to user: Instance 7da9c13b-2f06-459d-9f28-b9c22d7c259e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bdc0469c-db72-4ebf-aa99-0b8e38809fcb tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e" status: 404 len: 111 microversion: 2.1 time: 0.065144 Oct 19 07:22:51.270066 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2794/5438] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:51 2022] GET /compute/v2.1/servers/7da9c13b-2f06-459d-9f28-b9c22d7c259e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:22:51.342650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2095535510", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "ddc1d39b-0616-481d-85f5-1807018a3cea"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:51.435413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] validate_networks() for [('ddc1d39b-0616-481d-85f5-1807018a3cea', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:22:51.971918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:22:51.972697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:22:51.973495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:22:51.974113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:22:51.974759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:22:51.994769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:51.995284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:51.995734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:51.997904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:52.002468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:52.002468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:52.039580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Getting quotas for project e9e8cb0af578457f857c4ced296594fc. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:22:52.054423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Getting quotas for user 4318b091cb70483c804c099fb8504da5 and project e9e8cb0af578457f857c4ced296594fc. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:22:52.085080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:22:52.092070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:22:52.273195 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31429153-f819-40b1-a861-9a3848753405 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932784 Oct 19 07:22:52.275131 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2645/5439] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:22:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:22:52.286656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20a73350-2aae-4dcb-9aab-da67748123b4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:52.287272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20a73350-2aae-4dcb-9aab-da67748123b4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:52.401053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20a73350-2aae-4dcb-9aab-da67748123b4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:52.420005 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20a73350-2aae-4dcb-9aab-da67748123b4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1214 microversion: 2.1 time: 0.137100 Oct 19 07:22:52.433448 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2795/5440] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:52 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:53.447934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d201cb68-b69c-44e3-a37a-fa8ff2e73eaa tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:53.448689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d201cb68-b69c-44e3-a37a-fa8ff2e73eaa tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:53.568021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d201cb68-b69c-44e3-a37a-fa8ff2e73eaa tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:53.579907 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d201cb68-b69c-44e3-a37a-fa8ff2e73eaa tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1214 microversion: 2.1 time: 0.136619 Oct 19 07:22:53.581200 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2646/5441] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:53 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:54.605226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:54.605864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:54.613601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:54.614501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:54.615369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:54.616330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:54.617010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:54.617785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:54.733267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:54.761512 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f386ce9-c3ee-4ea1-acd8-fe11dad407a4 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1266 microversion: 2.1 time: 0.158659 Oct 19 07:22:54.762178 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2796/5442] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:54 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:55.786958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:55.787584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:55.796035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:55.797224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:55.797832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:55.799904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:55.800674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:55.801213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:55.897074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:55.905464 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-346c219d-e2cd-44fa-bf23-2321affc4fff tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1274 microversion: 2.1 time: 0.122450 Oct 19 07:22:55.906459 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2647/5443] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:55 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:56.930121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:56.930756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:56.937783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:56.938272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:56.938707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:56.939608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:56.940052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:56.940513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:57.184549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:57.193101 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e863d10-4be3-48ef-b1a8-9d5797dddf9b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1314 microversion: 2.1 time: 0.267253 Oct 19 07:22:57.205611 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2797/5444] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:56 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:22:58.147298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-fc4d8a7f-1a8e-402b-846f-d2fa3c253b94 req-699a5bfd-0301-435b-bbbc-4e13efbf615c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0", "tag": "3069e886-5abf-436b-9539-c93315b20dab"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:22:58.167662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:22:58.175893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fc4d8a7f-1a8e-402b-846f-d2fa3c253b94 req-699a5bfd-0301-435b-bbbc-4e13efbf615c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:58.175893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fc4d8a7f-1a8e-402b-846f-d2fa3c253b94 req-699a5bfd-0301-435b-bbbc-4e13efbf615c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:58.175893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fc4d8a7f-1a8e-402b-846f-d2fa3c253b94 req-699a5bfd-0301-435b-bbbc-4e13efbf615c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:58.195107 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-fc4d8a7f-1a8e-402b-846f-d2fa3c253b94 req-699a5bfd-0301-435b-bbbc-4e13efbf615c service nova] Creating event network-changed:3069e886-5abf-436b-9539-c93315b20dab for instance e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 on n-h2-861333-10 Oct 19 07:22:58.205066 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-fc4d8a7f-1a8e-402b-846f-d2fa3c253b94 req-699a5bfd-0301-435b-bbbc-4e13efbf615c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071104 Oct 19 07:22:58.206057 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2648/5445] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:22:58.221711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:22:58.224592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:22:58.233411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:58.234199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:58.234694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:58.235587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:22:58.236246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:22:58.236846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:22:59.154550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:22:59.166144 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0544b1b-27e8-4273-9389-6c2664153b33 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1314 microversion: 2.1 time: 0.951406 Oct 19 07:22:59.168519 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2798/5446] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:22:58 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:00.193857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:00.196769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:00.220742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:00.221155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:00.221694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:00.222754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:00.223461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:00.224076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:00.950705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:00.964546 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0f48cf1-1caa-471e-aa9a-5a39851f67f8 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1314 microversion: 2.1 time: 0.777128 Oct 19 07:23:00.965934 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2649/5447] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:00 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:01.992208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:01.993775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:02.012064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:02.013011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:02.014533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:02.016159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:02.017204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:02.018027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:02.372258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:02.387632 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b874ba50-ccf1-4840-85a3-8a978582433b tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1314 microversion: 2.1 time: 0.401873 Oct 19 07:23:02.390344 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2799/5448] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:01 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:03.411514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:03.412960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:03.427022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:03.433797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:03.435303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:03.436998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:03.442876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:03.442876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:03.442876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:03.575224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:03.839367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:03.859860 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d010e84a-580b-4520-a15e-edf0d29c1a53 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1314 microversion: 2.1 time: 0.452424 Oct 19 07:23:03.861092 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2650/5449] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:03 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:04.888326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:04.888910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:04.893876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:04.893876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:04.908755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:04.910638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:04.911600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:04.914944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:04.915625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:04.916573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:04.920981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:05.310720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:05.322127 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cbe74c6-70d4-46d8-8076-572a9fa5c0fe tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1314 microversion: 2.1 time: 0.437956 Oct 19 07:23:05.323666 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2800/5450] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:04 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:05.734779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f504ec33-140e-428d-8a8c-61c11dd3c87d req-4aa2ab4a-eb21-40d9-b754-7d737f5344d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0", "name": "network-vif-plugged", "status": "completed", "tag": "3069e886-5abf-436b-9539-c93315b20dab"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:05.770710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f504ec33-140e-428d-8a8c-61c11dd3c87d req-4aa2ab4a-eb21-40d9-b754-7d737f5344d5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:05.771433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f504ec33-140e-428d-8a8c-61c11dd3c87d req-4aa2ab4a-eb21-40d9-b754-7d737f5344d5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:05.772065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f504ec33-140e-428d-8a8c-61c11dd3c87d req-4aa2ab4a-eb21-40d9-b754-7d737f5344d5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:05.793840 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f504ec33-140e-428d-8a8c-61c11dd3c87d req-4aa2ab4a-eb21-40d9-b754-7d737f5344d5 service nova] Creating event network-vif-plugged:3069e886-5abf-436b-9539-c93315b20dab for instance e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 on n-h2-861333-10 Oct 19 07:23:05.803218 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f504ec33-140e-428d-8a8c-61c11dd3c87d req-4aa2ab4a-eb21-40d9-b754-7d737f5344d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076648 Oct 19 07:23:05.810813 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2651/5451] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:23:06.352453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:06.353998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:06.370152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:06.372835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:06.374638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:06.376258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:06.376988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:06.380719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:06.780992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:06.791800 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cdc937a2-10d7-469e-ae6e-3b3751e6ea6f tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1314 microversion: 2.1 time: 0.444635 Oct 19 07:23:06.792442 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2801/5452] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:06 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:07.818619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:07.819974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:07.828607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:07.829318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:07.829966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:07.830846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:07.832004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:07.832633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:07.985637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:07.993809 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bcb288f-8633-44b2-960c-b974e7ff6a45 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1499 microversion: 2.1 time: 0.180274 Oct 19 07:23:07.994981 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2652/5453] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:07 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1499 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:09.603360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:09.605038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:09.639548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:09.645093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:09.645497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:09.652074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:09.654511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:09.655299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:09.744797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:23:10.152543 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-568b90f9-c3e4-4ee7-b8db-48de96edf231 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 204 len: 0 microversion: 2.1 time: 0.561705 Oct 19 07:23:10.153758 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2802/5454] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:23:09 2022] DELETE /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:23:10.162243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:10.162923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:10.177419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:10.179210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:10.179210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:10.179210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:10.179566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:10.181200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:10.494543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:10.514870 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70517f6b-80ba-4491-8d5d-0e353d22dcab tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1505 microversion: 2.1 time: 0.356330 Oct 19 07:23:10.518198 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2653/5455] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:10 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:11.546224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:11.546927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:11.560509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:11.561263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:11.561718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:11.562444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:11.562930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:11.563564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:11.896835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:11.907705 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a05b986d-5a34-45e2-8b6a-8a9e372cb238 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1505 microversion: 2.1 time: 0.365832 Oct 19 07:23:11.926357 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2803/5456] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:11 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:12.933693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:12.934319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:12.948459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:12.949051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:12.949517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:12.956550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:12.957203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:12.957669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:13.076323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c366b485-393b-40ec-b5e1-494face6d35c req-4adda43f-48ed-4935-b8fc-52cbc4c55c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0", "name": "network-vif-deleted", "tag": "3069e886-5abf-436b-9539-c93315b20dab"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:13.082132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:13.093531 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a4eb88c-4edd-4e2f-a767-ed8a4191d8de tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1463 microversion: 2.1 time: 0.163337 Oct 19 07:23:13.096280 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2654/5457] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:12 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:13.115563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c366b485-393b-40ec-b5e1-494face6d35c req-4adda43f-48ed-4935-b8fc-52cbc4c55c29 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:13.116347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c366b485-393b-40ec-b5e1-494face6d35c req-4adda43f-48ed-4935-b8fc-52cbc4c55c29 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:13.117903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c366b485-393b-40ec-b5e1-494face6d35c req-4adda43f-48ed-4935-b8fc-52cbc4c55c29 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:13.131395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c366b485-393b-40ec-b5e1-494face6d35c req-4adda43f-48ed-4935-b8fc-52cbc4c55c29 service nova] Creating event network-vif-deleted:3069e886-5abf-436b-9539-c93315b20dab for instance e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 on n-h2-861333-10 Oct 19 07:23:13.137354 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c366b485-393b-40ec-b5e1-494face6d35c req-4adda43f-48ed-4935-b8fc-52cbc4c55c29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074790 Oct 19 07:23:13.138293 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2804/5458] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:23:14.123328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:14.124696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:14.132201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:14.132709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:14.133171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:14.133915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:14.134444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:14.134880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:14.175590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:14.176659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:14.177628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:14.179470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lazy-loading 'fault' on Instance uuid e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:23:14.231997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318b091cb70483c804c099fb8504da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e8cb0af578457f857c4ced296594fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:14.244054 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0d7bf89-4b7c-4903-b3b7-7d1d23066055 tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 200 len: 1304 microversion: 2.1 time: 0.124566 Oct 19 07:23:14.244958 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2655/5459] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:14 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:15.269314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:15.270319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] [instance: e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:15.285624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:15.286136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:15.288764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:15.289610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:15.292668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:15.293231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:15.325220 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] HTTP exception thrown: Instance e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 could not be found. Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Request method failure captured: Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 HTTP/1.1 Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6Wvw2X3OU4UaVsssnRbPnvNRgnN7dV2E562EGTb7mYD7zQCHQmClvxtITAyIQjDG-R26CPrzOcmx1Ian77s-LNsp1vuxTP5jDd_OlI1xZE2SJYcX4WFvTQKZ0IRYuHSsoksTPeP4SXRghlrJhgkyGYv99xo7bLKf-Jm8J_vCDaJMH0 Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: e9e8cb0af578457f857c4ced296594fc Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesActionsTest-446496437 Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e9e8cb0af578457f857c4ced296594fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9e8cb0af578457f857c4ced296594fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9e8cb0af578457f857c4ced296594fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e9e8cb0af578457f857c4ced296594fc", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesActionsTest-446496437 Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: e9e8cb0af578457f857c4ced296594fc Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesActionsTest-446496437 Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesActionsTest-446496437-project Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 4318b091cb70483c804c099fb8504da5 Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesActionsTest-446496437-project Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 could not be found. Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0'} Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 could not be found. Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 could not be found. Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:23:15.326834 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:15.331848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:23:15.331848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:23:15.331848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:23:15.331848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:23:15.331848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:23:15.331848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 could not be found. Oct 19 07:23:15.331848 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:15.331848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] Returning 404 to user: Instance e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:23:15.338356 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-973d2f18-a7b4-4cb4-af78-c68ea2a3d5ee tempest-VolumesActionsTest-446496437 tempest-VolumesActionsTest-446496437-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0" status: 404 len: 111 microversion: 2.1 time: 0.063484 Oct 19 07:23:15.339188 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2805/5460] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:15 2022] GET /compute/v2.1/servers/e5d55b55-3f10-4f0a-9cec-7e2a0c3c18e0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:23:15.649872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2943280-4315-499c-9195-1c6d7fb708a3 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1648238956", "availability_zone": "foo_zone"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:15.686053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-d2943280-4315-499c-9195-1c6d7fb708a3 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Generated uuid 2e0a890b-c7d7-43c1-9c6c-fd9cb4080280 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 07:23:15.841903 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2943280-4315-499c-9195-1c6d7fb708a3 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.383515 Oct 19 07:23:15.843087 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2656/5461] 10.222.0.39 () {60 vars in 1164 bytes} [Wed Oct 19 07:23:15 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:23:15.855617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0752544b-4581-4e57-9382-2e2a87286e6d tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:15.958214 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0752544b-4581-4e57-9382-2e2a87286e6d tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.107319 Oct 19 07:23:15.966479 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2806/5462] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 07:23:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:23:15.971788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00d893b4-7094-4d48-9557-1dd20504e5ca tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:15.975751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d893b4-7094-4d48-9557-1dd20504e5ca tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:15.979015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d893b4-7094-4d48-9557-1dd20504e5ca tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:15.979614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d893b4-7094-4d48-9557-1dd20504e5ca tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:15.981322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d893b4-7094-4d48-9557-1dd20504e5ca tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:15.981793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d893b4-7094-4d48-9557-1dd20504e5ca tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:15.983203 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d893b4-7094-4d48-9557-1dd20504e5ca tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:16.012021 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00d893b4-7094-4d48-9557-1dd20504e5ca tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.044089 Oct 19 07:23:16.014236 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2657/5463] 10.222.0.39 () {58 vars in 1176 bytes} [Wed Oct 19 07:23:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:23:16.031328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-defd3378-855a-4196-8fb2-9169ad094773 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:16.064728 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-defd3378-855a-4196-8fb2-9169ad094773 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.036815 Oct 19 07:23:16.066358 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2807/5464] 10.222.0.39 () {58 vars in 1143 bytes} [Wed Oct 19 07:23:16 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:23:16.080135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18e0db3f-8a1e-4ba0-915a-dc4bf81f68b9 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:16.095698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18e0db3f-8a1e-4ba0-915a-dc4bf81f68b9 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:16.097471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18e0db3f-8a1e-4ba0-915a-dc4bf81f68b9 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:16.099459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18e0db3f-8a1e-4ba0-915a-dc4bf81f68b9 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:16.591445 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18e0db3f-8a1e-4ba0-915a-dc4bf81f68b9 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.517375 Oct 19 07:23:16.592510 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2658/5465] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 07:23:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:23:16.608271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a29231e-d88c-438c-a12a-1d81e02b29ee tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:16.630026 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a29231e-d88c-438c-a12a-1d81e02b29ee tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.030044 Oct 19 07:23:16.634499 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2808/5466] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 07:23:16 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:23:16.642837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a7cd204-9279-470e-b01a-6d28af871292 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-217357692", "availability_zone": "foo_zone"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:16.821080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14ffcb56-3499-4094-a4ac-8330a0066584 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b154c33d-180f-4b84-8ff1-348c7de6f901", "device": "/dev/sdb"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:16.823910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14ffcb56-3499-4094-a4ac-8330a0066584 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:16.840504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ffcb56-3499-4094-a4ac-8330a0066584 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:16.847998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ffcb56-3499-4094-a4ac-8330a0066584 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:16.847998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ffcb56-3499-4094-a4ac-8330a0066584 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:16.847998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ffcb56-3499-4094-a4ac-8330a0066584 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:16.847998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ffcb56-3499-4094-a4ac-8330a0066584 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:16.847998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ffcb56-3499-4094-a4ac-8330a0066584 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:16.856495 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a7cd204-9279-470e-b01a-6d28af871292 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.217463 Oct 19 07:23:16.857766 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2659/5467] 10.222.0.39 () {60 vars in 1173 bytes} [Wed Oct 19 07:23:16 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:23:16.881634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-639219e0-dd06-4b57-b35e-0cc8c0f95c1a tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:17.034399 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-639219e0-dd06-4b57-b35e-0cc8c0f95c1a tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.169521 Oct 19 07:23:17.038872 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2660/5468] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 07:23:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:23:17.050657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-329418e2-9a5f-4085-81dc-49fe7633a195 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:17.061946 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-329418e2-9a5f-4085-81dc-49fe7633a195 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.018698 Oct 19 07:23:17.064501 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2661/5469] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Oct 19 07:23:17 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:23:17.076589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b6240b9-1de4-4c7f-a15e-4949785e6d36 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861333-10"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:17.091192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b6240b9-1de4-4c7f-a15e-4949785e6d36 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:17.091770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b6240b9-1de4-4c7f-a15e-4949785e6d36 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:17.092238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b6240b9-1de4-4c7f-a15e-4949785e6d36 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:17.621897 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b6240b9-1de4-4c7f-a15e-4949785e6d36 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.549401 Oct 19 07:23:17.623185 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2662/5470] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Oct 19 07:23:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:23:17.641131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3f08880-9fa6-4c64-9b8c-95a20594eb88 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:17.793691 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3f08880-9fa6-4c64-9b8c-95a20594eb88 tempest-TestAggregatesBasicOps-1814893062 tempest-TestAggregatesBasicOps-1814893062-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.161141 Oct 19 07:23:17.797158 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2663/5471] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 07:23:17 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 07:23:18.182732 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14ffcb56-3499-4094-a4ac-8330a0066584 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "POST /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.368188 Oct 19 07:23:18.183352 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2809/5472] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:23:16 2022] POST /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270/os-volume_attachments => generated 194 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:23:34.056008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:34.057765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=73 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:34.058606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:34.071970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:34.073187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:34.075809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:34.076880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:23:34.081338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1e3acc61-b11c-4efb-bd64-3bcde74df5f3 req-3f5f1fca-5a23-459e-86e3-361f29eb5689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfba5e6-412a-46dd-869e-e02d6c0eaf74", "tag": "ffb08c1f-685b-46f1-af1b-e149fc6ed4c4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:34.093858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:34.095261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:34.095732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:34.098423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:34.099220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:34.099677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:34.102204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1e3acc61-b11c-4efb-bd64-3bcde74df5f3 req-3f5f1fca-5a23-459e-86e3-361f29eb5689 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:34.102689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1e3acc61-b11c-4efb-bd64-3bcde74df5f3 req-3f5f1fca-5a23-459e-86e3-361f29eb5689 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:34.103127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1e3acc61-b11c-4efb-bd64-3bcde74df5f3 req-3f5f1fca-5a23-459e-86e3-361f29eb5689 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:34.149019 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1e3acc61-b11c-4efb-bd64-3bcde74df5f3 req-3f5f1fca-5a23-459e-86e3-361f29eb5689 service nova] Creating event network-changed:ffb08c1f-685b-46f1-af1b-e149fc6ed4c4 for instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 on n-h2-861333-10 Oct 19 07:23:34.172879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1e3acc61-b11c-4efb-bd64-3bcde74df5f3 req-3f5f1fca-5a23-459e-86e3-361f29eb5689 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097521 Oct 19 07:23:34.180869 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2810/5473] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:23:34.193610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:23:34.714416 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6fd69ac-3880-47fa-9a03-26a5a55015b1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 204 len: 0 microversion: 2.1 time: 0.661936 Oct 19 07:23:34.715706 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2664/5474] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:23:34 2022] DELETE /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:23:34.724782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:34.726637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:34.760127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:34.763528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:34.766935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:34.769118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:34.769605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:34.770046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:35.150467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:35.161682 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b259d168-6f84-4574-9a72-5dd9b8e863c9 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1583 microversion: 2.1 time: 0.441173 Oct 19 07:23:35.162758 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2811/5475] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:34 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1583 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:36.197587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:36.211174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:36.252642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:36.253380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:36.253939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:36.254791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:36.260182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:36.264256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:37.007051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:37.017849 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d36c139a-232f-4584-820c-385433be316d tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1583 microversion: 2.1 time: 0.828223 Oct 19 07:23:37.022047 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2665/5476] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:36 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1583 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:38.046939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:38.048428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:38.062094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:38.066831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:38.069334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:38.072725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:38.075221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:38.075880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:38.275228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:38.290275 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2d30bb3-c3bf-4abd-a87f-b1a203db5870 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1396 microversion: 2.1 time: 0.247044 Oct 19 07:23:38.298457 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2812/5477] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:38 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1396 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:38.315168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-070ce445-6ee5-45c0-8cf9-065f65ba317f req-c4ffba90-27ab-4f51-b0c4-bf0580d54e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cfba5e6-412a-46dd-869e-e02d6c0eaf74", "name": "network-vif-deleted", "tag": "ffb08c1f-685b-46f1-af1b-e149fc6ed4c4"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:23:38.350546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-070ce445-6ee5-45c0-8cf9-065f65ba317f req-c4ffba90-27ab-4f51-b0c4-bf0580d54e18 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:38.351708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-070ce445-6ee5-45c0-8cf9-065f65ba317f req-c4ffba90-27ab-4f51-b0c4-bf0580d54e18 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:38.352373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-070ce445-6ee5-45c0-8cf9-065f65ba317f req-c4ffba90-27ab-4f51-b0c4-bf0580d54e18 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:38.383633 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-070ce445-6ee5-45c0-8cf9-065f65ba317f req-c4ffba90-27ab-4f51-b0c4-bf0580d54e18 service nova] Creating event network-vif-deleted:ffb08c1f-685b-46f1-af1b-e149fc6ed4c4 for instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 on n-h2-861333-10 Oct 19 07:23:38.401297 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-070ce445-6ee5-45c0-8cf9-065f65ba317f req-c4ffba90-27ab-4f51-b0c4-bf0580d54e18 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090029 Oct 19 07:23:38.403455 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2666/5478] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:23:39.319135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:39.321952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:39.346960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:39.347751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:39.348409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:39.349329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:39.349962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:39.350593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:39.522742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:39.533586 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-209b38e2-2cc7-4bfa-9b34-26a212b63414 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1229 microversion: 2.1 time: 0.218291 Oct 19 07:23:39.542367 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2813/5479] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:39 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1229 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:40.566319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:40.567996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:40.631315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:40.631623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:40.643581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:40.643581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:40.653187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:40.656601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:40.823588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:40.834825 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cfedc02d-e94f-4fc3-8677-32d301a434d5 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1229 microversion: 2.1 time: 0.274615 Oct 19 07:23:40.840403 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2667/5480] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:40 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1229 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:41.866126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:41.868248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:41.883930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:41.884868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:41.885590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:41.886596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:41.888499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:41.889259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:42.539348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:42.552431 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cdd2c02-f6ed-4edc-b3cc-b6f6c3a7eccf tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1229 microversion: 2.1 time: 0.687825 Oct 19 07:23:42.555090 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2814/5481] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:41 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1229 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:43.575814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:43.576528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:43.595261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:43.601510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:43.604845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:43.606914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:43.609081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:43.612070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:43.972051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:43.985244 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5dcacbce-8ae8-46be-bf24-42158ee4bf85 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1229 microversion: 2.1 time: 0.413259 Oct 19 07:23:43.996497 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2668/5482] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:43 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1229 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:45.019521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:45.020174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:45.034476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:45.039111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:45.039775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:45.040760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:45.041428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:45.042042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:45.170484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:45.184390 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ffb8fed-d976-49f2-87e9-fbf445b754a7 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1229 microversion: 2.1 time: 0.168479 Oct 19 07:23:45.185575 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2815/5483] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:45 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:46.231920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:46.236885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:46.262179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:46.262689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:46.263127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:46.263851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:46.264397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:46.264830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:46.320684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:46.321774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:46.322412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:46.323532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lazy-loading 'fault' on Instance uuid 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:23:46.404313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333de935e30d455fbf6f45dfdc3ae679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f4f8316fe4ea094805ab136034ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:23:46.425445 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac18d379-fd09-4fd0-8709-47ef88c129b2 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 200 len: 1234 microversion: 2.1 time: 0.218021 Oct 19 07:23:46.426076 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2669/5484] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:46 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 1234 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:23:47.459580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:47.460804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] [instance: 8cfba5e6-412a-46dd-869e-e02d6c0eaf74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:23:47.490047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:47.490553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:47.491000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:47.491776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:23:47.492279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:23:47.492717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:23:47.547851 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] HTTP exception thrown: Instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 could not be found. Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Request method failure captured: Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 HTTP/1.1 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6R5wfteGW_iOkBmp1Zl2NwErZJAzTC8s3tVZUmLVfT8L0YoMk13JyVgpm1t5lba13An_nfsUu4YGS9hLkBBfduCcbOgItKPWVSVPQ5ErCYP7G9HdOMz13xztdS8KfByrkq_0yuGuvE7iCj7yKEYK5YCLDlsiMWDtcLbUTWIgTTdEn0 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: dd4f4f8316fe4ea094805ab136034ce1 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBackupRestore-1407290718 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dd4f4f8316fe4ea094805ab136034ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dd4f4f8316fe4ea094805ab136034ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dd4f4f8316fe4ea094805ab136034ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dd4f4f8316fe4ea094805ab136034ce1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBackupRestore-1407290718 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: dd4f4f8316fe4ea094805ab136034ce1 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1407290718 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBackupRestore-1407290718-project Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 333de935e30d455fbf6f45dfdc3ae679 Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBackupRestore-1407290718-project Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 could not be found. Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '8cfba5e6-412a-46dd-869e-e02d6c0eaf74'} Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 could not be found. Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 could not be found. Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:23:47.550930 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:47.560228 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:23:47.560228 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:23:47.560228 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:23:47.560228 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:23:47.560228 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:23:47.560228 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 could not be found. Oct 19 07:23:47.560228 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:23:47.560228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Returning 404 to user: Instance 8cfba5e6-412a-46dd-869e-e02d6c0eaf74 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:23:47.560228 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d88134cd-806d-40f9-977f-e052743b6ec1 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74" status: 404 len: 111 microversion: 2.1 time: 0.102483 Oct 19 07:23:47.565101 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2816/5485] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:23:47 2022] GET /compute/v2.1/servers/8cfba5e6-412a-46dd-869e-e02d6c0eaf74 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:23:48.210884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9a7cd4a-e8b9-4c7e-9111-577a38630945 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] Calling method '.version_select at 0x7f6d5f565c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:23:48.331922 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9a7cd4a-e8b9-4c7e-9111-577a38630945 tempest-TestVolumeBackupRestore-1407290718 tempest-TestVolumeBackupRestore-1407290718-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-631805450" status: 202 len: 0 microversion: 2.1 time: 0.122912 Oct 19 07:23:48.338441 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2670/5486] 10.222.0.39 () {58 vars in 1266 bytes} [Wed Oct 19 07:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-631805450 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:24:05.390995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:05.394944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:05.394944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:05.399020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=34 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:05.409520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:05.410177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:05.410767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:05.417356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:05.417356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:05.417356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:05.537783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lazy-loading 'services' on Instance uuid 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:24:05.842122 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d97c3ad4-3612-4efb-829f-a18fbcbd3172 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270/os-volume_attachments/b154c33d-180f-4b84-8ff1-348c7de6f901" status: 202 len: 0 microversion: 2.1 time: 0.455116 Oct 19 07:24:05.846764 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2817/5487] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:24:05 2022] DELETE /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270/os-volume_attachments/b154c33d-180f-4b84-8ff1-348c7de6f901 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:24:10.982637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:10.986712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:11.265107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2c98e5a-58f3-4cbd-aafd-e9c9b9948c5d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:11.267528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c98e5a-58f3-4cbd-aafd-e9c9b9948c5d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:11.268363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c98e5a-58f3-4cbd-aafd-e9c9b9948c5d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:11.269097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c98e5a-58f3-4cbd-aafd-e9c9b9948c5d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:11.270354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c98e5a-58f3-4cbd-aafd-e9c9b9948c5d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:11.272553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c98e5a-58f3-4cbd-aafd-e9c9b9948c5d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:11.276680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c98e5a-58f3-4cbd-aafd-e9c9b9948c5d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:11.350579 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2c98e5a-58f3-4cbd-aafd-e9c9b9948c5d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.376172 Oct 19 07:24:11.354290 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2671/5488] 10.222.0.39 () {58 vars in 1185 bytes} [Wed Oct 19 07:24:10 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:24:11.589293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-683264879", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "availability_zone": "nova:n-h1-861333-10", "networks": [{"uuid": "e9228fc3-23f1-4bb7-ad7a-88db2bd44744"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:11.751508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] validate_networks() for [('e9228fc3-23f1-4bb7-ad7a-88db2bd44744', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 19 07:24:12.687257 n-d-861333-10 devstack@n-api.service[127567]: ERROR sqlalchemy.pool.impl.QueuePool Oct 19 07:24:12.692933 n-d-861333-10 devstack@n-api.service[127567]: Exception ignored in: . at 0x7f6d64797700> Oct 19 07:24:12.692933 n-d-861333-10 devstack@n-api.service[127567]: Traceback (most recent call last): Oct 19 07:24:12.692933 n-d-861333-10 devstack@n-api.service[127567]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 19 07:24:12.692933 n-d-861333-10 devstack@n-api.service[127567]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 19 07:24:12.692933 n-d-861333-10 devstack@n-api.service[127567]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 19 07:24:12.692933 n-d-861333-10 devstack@n-api.service[127567]: connection_record.checkin() Oct 19 07:24:12.692933 n-d-861333-10 devstack@n-api.service[127567]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 19 07:24:12.692933 n-d-861333-10 devstack@n-api.service[127567]: pool.dispatch.checkin(connection, self) Oct 19 07:24:12.692933 n-d-861333-10 devstack@n-api.service[127567]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 19 07:24:12.696675 n-d-861333-10 devstack@n-api.service[127567]: fn(*args, **kw) Oct 19 07:24:12.696984 n-d-861333-10 devstack@n-api.service[127567]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 19 07:24:12.699419 n-d-861333-10 devstack@n-api.service[127567]: time.sleep(0) Oct 19 07:24:12.699677 n-d-861333-10 devstack@n-api.service[127567]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 19 07:24:12.707597 n-d-861333-10 devstack@n-api.service[127567]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 19 07:24:12.707926 n-d-861333-10 devstack@n-api.service[127567]: AssertionError: do not call blocking functions from the mainloop Oct 19 07:24:13.237068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:24:13.237746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:24:13.238479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:24:13.239248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:24:13.239954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:24:13.254940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:13.257008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:13.258309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:13.259776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:13.260919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:13.262893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:13.288978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Getting quotas for project cae6fba5461d4f08a47fd763a6c37af0. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:24:13.296051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Getting quotas for user fe98fcad6ef140d5b6458d66cb3f8924 and project cae6fba5461d4f08a47fd763a6c37af0. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:24:13.310508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:24:13.313143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:24:13.544440 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0fee896-bb4f-4c2c-b706-063fb988868a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.958754 Oct 19 07:24:13.546286 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2818/5489] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:24:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:24:13.558249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3bc9ffa9-264b-4fc7-af34-2d8a629b5d90 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:13.559081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3bc9ffa9-264b-4fc7-af34-2d8a629b5d90 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:13.815880 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3bc9ffa9-264b-4fc7-af34-2d8a629b5d90 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1328 microversion: 2.1 time: 0.258626 Oct 19 07:24:13.816541 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2672/5490] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:13 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1328 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:14.840597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed9d515a-4b9f-4634-898c-0c674a34f2bc tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:14.842024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed9d515a-4b9f-4634-898c-0c674a34f2bc tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:15.062516 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed9d515a-4b9f-4634-898c-0c674a34f2bc tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1328 microversion: 2.1 time: 0.227313 Oct 19 07:24:15.063775 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2819/5491] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:14 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1328 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:15.434243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:15.435742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:15.448474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:15.448474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:15.448474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:15.448474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:15.448474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:15.449126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:15.490488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:24:16.012737 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84e39a3f-3d0e-4475-8eeb-912096343384 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 204 len: 0 microversion: 2.1 time: 0.582965 Oct 19 07:24:16.019708 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2673/5492] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:24:15 2022] DELETE /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:24:16.024568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:16.029337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:16.053214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:16.054850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:16.055534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:16.056518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:16.057373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:16.058080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:16.086175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1458fa4e-fa7e-4e48-b0a7-79a007709334 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:16.087091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1458fa4e-fa7e-4e48-b0a7-79a007709334 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:16.098049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458fa4e-fa7e-4e48-b0a7-79a007709334 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:16.104569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458fa4e-fa7e-4e48-b0a7-79a007709334 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:16.105145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458fa4e-fa7e-4e48-b0a7-79a007709334 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:16.105914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458fa4e-fa7e-4e48-b0a7-79a007709334 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:16.106386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458fa4e-fa7e-4e48-b0a7-79a007709334 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:16.106826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458fa4e-fa7e-4e48-b0a7-79a007709334 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:16.222545 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1458fa4e-fa7e-4e48-b0a7-79a007709334 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1417 microversion: 2.1 time: 0.140439 Oct 19 07:24:16.223786 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2674/5493] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:16 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1417 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:16.576636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:16.595459 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b338585b-4192-4ffe-a9f8-69fd13676c5a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1513 microversion: 2.1 time: 0.576452 Oct 19 07:24:16.601971 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2820/5494] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:16 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1513 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:17.251682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d38026f5-5ec0-4823-91d8-14a64772d9a3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:17.251682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d38026f5-5ec0-4823-91d8-14a64772d9a3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:17.258636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38026f5-5ec0-4823-91d8-14a64772d9a3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:17.259127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38026f5-5ec0-4823-91d8-14a64772d9a3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:17.259566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38026f5-5ec0-4823-91d8-14a64772d9a3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:17.260341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38026f5-5ec0-4823-91d8-14a64772d9a3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:17.260802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38026f5-5ec0-4823-91d8-14a64772d9a3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:17.261233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38026f5-5ec0-4823-91d8-14a64772d9a3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:17.337446 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d38026f5-5ec0-4823-91d8-14a64772d9a3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1417 microversion: 2.1 time: 0.092516 Oct 19 07:24:17.338026 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2675/5495] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:17 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1417 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:17.628651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:17.629279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:17.638615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:17.639135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:17.639603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:17.640364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:17.640823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:17.641259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:17.832036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:17.839490 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4afc49ec-ae2d-44ea-b7f9-1122fadaca90 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1513 microversion: 2.1 time: 0.214985 Oct 19 07:24:17.840084 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2821/5496] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:17 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:18.361518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ef81bbd-6069-463e-bdbc-f431c91ee973 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:18.362439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ef81bbd-6069-463e-bdbc-f431c91ee973 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:18.374317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef81bbd-6069-463e-bdbc-f431c91ee973 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:18.377916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef81bbd-6069-463e-bdbc-f431c91ee973 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:18.379205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef81bbd-6069-463e-bdbc-f431c91ee973 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:18.380801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef81bbd-6069-463e-bdbc-f431c91ee973 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:18.385694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef81bbd-6069-463e-bdbc-f431c91ee973 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:18.386296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ef81bbd-6069-463e-bdbc-f431c91ee973 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:18.487972 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ef81bbd-6069-463e-bdbc-f431c91ee973 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1425 microversion: 2.1 time: 0.131142 Oct 19 07:24:18.489179 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2676/5497] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:18 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1425 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:18.605991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-00a429fe-dbca-41a5-906c-815592c9462b req-c19345f0-6a21-4777-9918-e51f59dd2b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3296fc9e-e4a7-4c6e-a33d-90625b5c2270", "name": "network-vif-deleted", "tag": "561cd7b8-f61c-45e5-8c15-8fcfcf72e351"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:18.625164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-00a429fe-dbca-41a5-906c-815592c9462b req-c19345f0-6a21-4777-9918-e51f59dd2b23 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:18.625653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-00a429fe-dbca-41a5-906c-815592c9462b req-c19345f0-6a21-4777-9918-e51f59dd2b23 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:18.626097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-00a429fe-dbca-41a5-906c-815592c9462b req-c19345f0-6a21-4777-9918-e51f59dd2b23 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:18.658614 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-00a429fe-dbca-41a5-906c-815592c9462b req-c19345f0-6a21-4777-9918-e51f59dd2b23 service nova] Creating event network-vif-deleted:561cd7b8-f61c-45e5-8c15-8fcfcf72e351 for instance 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 on n-h1-861333-10 Oct 19 07:24:18.670117 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-00a429fe-dbca-41a5-906c-815592c9462b req-c19345f0-6a21-4777-9918-e51f59dd2b23 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064419 Oct 19 07:24:18.672246 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2822/5498] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:24:18.865209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:18.867154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:18.874088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:18.874673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:18.875792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:18.876637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:18.877345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:18.877888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:18.984286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:18.994250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52f07912-c681-4a14-b658-7aecc76a7be9 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1304 microversion: 2.1 time: 0.132634 Oct 19 07:24:18.995412 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2677/5499] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:18 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:19.742488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a522e7a-3953-4cc6-a4d6-a5085420e067 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:19.742488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a522e7a-3953-4cc6-a4d6-a5085420e067 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:19.742488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a522e7a-3953-4cc6-a4d6-a5085420e067 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:19.742488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a522e7a-3953-4cc6-a4d6-a5085420e067 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:19.742488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a522e7a-3953-4cc6-a4d6-a5085420e067 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:19.742488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a522e7a-3953-4cc6-a4d6-a5085420e067 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:19.742488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a522e7a-3953-4cc6-a4d6-a5085420e067 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:19.742488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a522e7a-3953-4cc6-a4d6-a5085420e067 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:19.771733 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a522e7a-3953-4cc6-a4d6-a5085420e067 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1465 microversion: 2.1 time: 0.261265 Oct 19 07:24:19.774439 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2823/5500] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:19 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1465 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:20.018757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:20.019661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:20.028824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:20.029335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:20.030231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:20.030856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:20.031737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:20.032960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:20.073781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:20.074453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:20.075038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:20.075700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lazy-loading 'fault' on Instance uuid 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:24:20.121697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:20.130047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d04c7f54-617f-4e72-b675-3255caf63019 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 200 len: 1309 microversion: 2.1 time: 0.115540 Oct 19 07:24:20.130786 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2678/5501] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:20 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:20.682706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-41df856a-7a77-4a92-84a9-29837fcdeee7 req-2df94afc-8edd-4fd1-8b56-c62b41cc2461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74845d0e-0094-4c8b-879d-dd405cf643bd", "tag": "0be237ac-1899-43e6-b1e9-cdfa01f45759"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:20.693167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-41df856a-7a77-4a92-84a9-29837fcdeee7 req-2df94afc-8edd-4fd1-8b56-c62b41cc2461 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:20.709808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-41df856a-7a77-4a92-84a9-29837fcdeee7 req-2df94afc-8edd-4fd1-8b56-c62b41cc2461 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:20.709808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-41df856a-7a77-4a92-84a9-29837fcdeee7 req-2df94afc-8edd-4fd1-8b56-c62b41cc2461 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:20.709808 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-41df856a-7a77-4a92-84a9-29837fcdeee7 req-2df94afc-8edd-4fd1-8b56-c62b41cc2461 service nova] Creating event network-changed:0be237ac-1899-43e6-b1e9-cdfa01f45759 for instance 74845d0e-0094-4c8b-879d-dd405cf643bd on n-h1-861333-10 Oct 19 07:24:20.710774 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-41df856a-7a77-4a92-84a9-29837fcdeee7 req-2df94afc-8edd-4fd1-8b56-c62b41cc2461 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032668 Oct 19 07:24:20.711396 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2824/5502] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:24:20.807711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c83eafca-e23b-40a8-9b98-90e31fe8c8e2 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:20.808356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c83eafca-e23b-40a8-9b98-90e31fe8c8e2 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:20.817330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c83eafca-e23b-40a8-9b98-90e31fe8c8e2 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:20.817762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c83eafca-e23b-40a8-9b98-90e31fe8c8e2 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:20.818210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c83eafca-e23b-40a8-9b98-90e31fe8c8e2 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:20.818916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c83eafca-e23b-40a8-9b98-90e31fe8c8e2 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:20.819376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c83eafca-e23b-40a8-9b98-90e31fe8c8e2 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:20.819806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c83eafca-e23b-40a8-9b98-90e31fe8c8e2 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:21.136944 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c83eafca-e23b-40a8-9b98-90e31fe8c8e2 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1465 microversion: 2.1 time: 0.333548 Oct 19 07:24:21.139973 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2679/5503] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:20 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1465 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:21.157873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:21.161104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: 3296fc9e-e4a7-4c6e-a33d-90625b5c2270] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:21.176461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:21.177044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:21.177489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:21.178355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:21.178826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:21.179268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:21.200252 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] HTTP exception thrown: Instance 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 could not be found. Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Request method failure captured: Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 HTTP/1.1 Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6UkmEUgOSrHbClkehX37n6cC3zWzjVa64FZTtQiQq-OruRtzO18ZnBv1u63Y4wGzZ2CwKWO1PhIsl_GiCN0OuZb5dhKzOEsF2-TQ5ctFndjNimxXQY5SdVKulHFfoLLTpRRYxVev7ArPwh6-o54SkAFboe_lGjLtM73RTApt7efqz8 Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 74ab18166a124250aa4c825aa9da17eb Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1164364686 Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/74ab18166a124250aa4c825aa9da17eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/74ab18166a124250aa4c825aa9da17eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/74ab18166a124250aa4c825aa9da17eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_74ab18166a124250aa4c825aa9da17eb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesSnapshotTestJSON-1164364686 Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 74ab18166a124250aa4c825aa9da17eb Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1164364686 Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesSnapshotTestJSON-1164364686-project Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: b078c3a25bab4c64ac3cfa8a0d4d8eba Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesSnapshotTestJSON-1164364686-project Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 could not be found. Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3296fc9e-e4a7-4c6e-a33d-90625b5c2270'} Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 could not be found. Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 could not be found. Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:24:21.201970 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 could not be found. Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Returning 404 to user: Instance 3296fc9e-e4a7-4c6e-a33d-90625b5c2270 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-047ee946-51c1-4e04-b31d-6331a4255483 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270" status: 404 len: 111 microversion: 2.1 time: 0.053026 Oct 19 07:24:21.213114 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2825/5504] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:21 2022] GET /compute/v2.1/servers/3296fc9e-e4a7-4c6e-a33d-90625b5c2270 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:24:22.063777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:22.064362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:22.066301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:22.074130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:22.074815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:22.075063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:22.075776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:22.076265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:22.076690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:22.161817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6de7ce99-e318-4a36-9c82-9695d18d9ee6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:22.162446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6de7ce99-e318-4a36-9c82-9695d18d9ee6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:22.170292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de7ce99-e318-4a36-9c82-9695d18d9ee6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:22.170730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de7ce99-e318-4a36-9c82-9695d18d9ee6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:22.171181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de7ce99-e318-4a36-9c82-9695d18d9ee6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:22.171901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de7ce99-e318-4a36-9c82-9695d18d9ee6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:22.172404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de7ce99-e318-4a36-9c82-9695d18d9ee6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:22.172846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de7ce99-e318-4a36-9c82-9695d18d9ee6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:22.326058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:22.355786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:22.370350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:22.374465 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8c2a916-54ae-4151-9288-104eeed5eb6c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2948 microversion: 2.42 time: 0.313775 Oct 19 07:24:22.377342 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2680/5505] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:24:22 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2948 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:24:22.408198 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6de7ce99-e318-4a36-9c82-9695d18d9ee6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1465 microversion: 2.1 time: 0.245971 Oct 19 07:24:22.410164 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2826/5506] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:22 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1465 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:22.411853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4ec5494-55dc-494e-8a77-e99cb02ea1a1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:22.412390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4ec5494-55dc-494e-8a77-e99cb02ea1a1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:22.435174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ec5494-55dc-494e-8a77-e99cb02ea1a1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:22.435695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ec5494-55dc-494e-8a77-e99cb02ea1a1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:22.436903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ec5494-55dc-494e-8a77-e99cb02ea1a1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:22.437189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ec5494-55dc-494e-8a77-e99cb02ea1a1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:22.437697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ec5494-55dc-494e-8a77-e99cb02ea1a1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:22.438136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ec5494-55dc-494e-8a77-e99cb02ea1a1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:22.593927 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4ec5494-55dc-494e-8a77-e99cb02ea1a1 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.186457 Oct 19 07:24:22.596292 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2681/5507] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Oct 19 07:24:22 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08/os-interface => generated 1829 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:24:23.451424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3daff9e0-376b-4dce-9424-dc42a9541e13 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:23.452829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3daff9e0-376b-4dce-9424-dc42a9541e13 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:23.486145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:23.496688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3daff9e0-376b-4dce-9424-dc42a9541e13 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:23.497379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3daff9e0-376b-4dce-9424-dc42a9541e13 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:23.497994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3daff9e0-376b-4dce-9424-dc42a9541e13 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:23.498896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3daff9e0-376b-4dce-9424-dc42a9541e13 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:23.499617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3daff9e0-376b-4dce-9424-dc42a9541e13 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:23.500279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3daff9e0-376b-4dce-9424-dc42a9541e13 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:23.719801 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3daff9e0-376b-4dce-9424-dc42a9541e13 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1465 microversion: 2.1 time: 0.281672 Oct 19 07:24:23.721262 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2827/5508] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:23 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1465 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:24.745099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:24.750344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55f2ef95-3275-4b87-b06a-80e7d71987d7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:24.751176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55f2ef95-3275-4b87-b06a-80e7d71987d7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:24.758846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55f2ef95-3275-4b87-b06a-80e7d71987d7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:24.759571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55f2ef95-3275-4b87-b06a-80e7d71987d7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:24.760325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55f2ef95-3275-4b87-b06a-80e7d71987d7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:24.761558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55f2ef95-3275-4b87-b06a-80e7d71987d7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:24.762169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55f2ef95-3275-4b87-b06a-80e7d71987d7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:24.771395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55f2ef95-3275-4b87-b06a-80e7d71987d7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:25.395199 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55f2ef95-3275-4b87-b06a-80e7d71987d7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1465 microversion: 2.1 time: 0.653134 Oct 19 07:24:25.397254 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2682/5509] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:24 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1465 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:26.425168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f8fc226-0223-4630-8852-90d14c130538 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:26.425945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f8fc226-0223-4630-8852-90d14c130538 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:26.444006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:26.449585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8fc226-0223-4630-8852-90d14c130538 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:26.450552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8fc226-0223-4630-8852-90d14c130538 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:26.451329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8fc226-0223-4630-8852-90d14c130538 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:26.452219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8fc226-0223-4630-8852-90d14c130538 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:26.453543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8fc226-0223-4630-8852-90d14c130538 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:26.454123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8fc226-0223-4630-8852-90d14c130538 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:26.723055 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f8fc226-0223-4630-8852-90d14c130538 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1465 microversion: 2.1 time: 0.300673 Oct 19 07:24:26.725210 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2828/5510] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:26 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1465 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:27.754349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-442c5dc3-5456-4e4f-b45d-1ad0bc5b93cd tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:27.758850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-442c5dc3-5456-4e4f-b45d-1ad0bc5b93cd tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:27.778835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-442c5dc3-5456-4e4f-b45d-1ad0bc5b93cd tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:27.782411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-442c5dc3-5456-4e4f-b45d-1ad0bc5b93cd tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:27.784386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-442c5dc3-5456-4e4f-b45d-1ad0bc5b93cd tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:27.786752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-442c5dc3-5456-4e4f-b45d-1ad0bc5b93cd tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:27.788027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-442c5dc3-5456-4e4f-b45d-1ad0bc5b93cd tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:27.789994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-442c5dc3-5456-4e4f-b45d-1ad0bc5b93cd tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:28.023608 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-442c5dc3-5456-4e4f-b45d-1ad0bc5b93cd tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1465 microversion: 2.1 time: 0.276642 Oct 19 07:24:28.024854 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2683/5511] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:27 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1465 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:28.175421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c24e2348-cd41-48b1-99f6-120b95e7ee29 req-11a0445b-512f-41d8-93e9-0841f3e9c9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74845d0e-0094-4c8b-879d-dd405cf643bd", "name": "network-vif-plugged", "status": "completed", "tag": "0be237ac-1899-43e6-b1e9-cdfa01f45759"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:28.202271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c24e2348-cd41-48b1-99f6-120b95e7ee29 req-11a0445b-512f-41d8-93e9-0841f3e9c9c9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:28.206840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c24e2348-cd41-48b1-99f6-120b95e7ee29 req-11a0445b-512f-41d8-93e9-0841f3e9c9c9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:28.209509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c24e2348-cd41-48b1-99f6-120b95e7ee29 req-11a0445b-512f-41d8-93e9-0841f3e9c9c9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:28.226889 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c24e2348-cd41-48b1-99f6-120b95e7ee29 req-11a0445b-512f-41d8-93e9-0841f3e9c9c9 service nova] Creating event network-vif-plugged:0be237ac-1899-43e6-b1e9-cdfa01f45759 for instance 74845d0e-0094-4c8b-879d-dd405cf643bd on n-h1-861333-10 Oct 19 07:24:28.247775 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c24e2348-cd41-48b1-99f6-120b95e7ee29 req-11a0445b-512f-41d8-93e9-0841f3e9c9c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067552 Oct 19 07:24:28.247775 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2829/5512] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:24:29.047082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6dc699eb-a6de-4390-93d4-86d3e168a49c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:29.047519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6dc699eb-a6de-4390-93d4-86d3e168a49c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:29.059762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc699eb-a6de-4390-93d4-86d3e168a49c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:29.060352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc699eb-a6de-4390-93d4-86d3e168a49c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:29.060811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc699eb-a6de-4390-93d4-86d3e168a49c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:29.061564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc699eb-a6de-4390-93d4-86d3e168a49c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:29.062035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc699eb-a6de-4390-93d4-86d3e168a49c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:29.062484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6dc699eb-a6de-4390-93d4-86d3e168a49c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:29.279826 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6dc699eb-a6de-4390-93d4-86d3e168a49c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1465 microversion: 2.1 time: 0.236701 Oct 19 07:24:29.285916 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2684/5513] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:29 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1465 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:30.310364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed046c1d-9090-40e2-b5f3-0d66623edd36 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:30.311143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed046c1d-9090-40e2-b5f3-0d66623edd36 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:30.319535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed046c1d-9090-40e2-b5f3-0d66623edd36 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:30.320063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed046c1d-9090-40e2-b5f3-0d66623edd36 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:30.320681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed046c1d-9090-40e2-b5f3-0d66623edd36 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:30.321780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed046c1d-9090-40e2-b5f3-0d66623edd36 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:30.322290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed046c1d-9090-40e2-b5f3-0d66623edd36 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:30.322734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed046c1d-9090-40e2-b5f3-0d66623edd36 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:30.534758 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed046c1d-9090-40e2-b5f3-0d66623edd36 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1649 microversion: 2.1 time: 0.229361 Oct 19 07:24:30.535802 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2830/5514] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:30 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1649 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:24:30.577531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1caa0833-d467-4836-a394-f6b7770550ee tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:30.578146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1caa0833-d467-4836-a394-f6b7770550ee tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:30.604335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1caa0833-d467-4836-a394-f6b7770550ee tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:30.604837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1caa0833-d467-4836-a394-f6b7770550ee tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:30.611464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1caa0833-d467-4836-a394-f6b7770550ee tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:30.612816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1caa0833-d467-4836-a394-f6b7770550ee tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:30.613603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1caa0833-d467-4836-a394-f6b7770550ee tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:30.614226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1caa0833-d467-4836-a394-f6b7770550ee tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:31.045615 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1caa0833-d467-4836-a394-f6b7770550ee tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1649 microversion: 2.1 time: 0.480752 Oct 19 07:24:31.046321 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2685/5515] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:30 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1649 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:24:31.070283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d73178eb-8877-41ca-9c7b-bbbe5f5b8473 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:31.071240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d73178eb-8877-41ca-9c7b-bbbe5f5b8473 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:31.082015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73178eb-8877-41ca-9c7b-bbbe5f5b8473 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:31.090038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73178eb-8877-41ca-9c7b-bbbe5f5b8473 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:31.090789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73178eb-8877-41ca-9c7b-bbbe5f5b8473 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:31.093496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73178eb-8877-41ca-9c7b-bbbe5f5b8473 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:31.097438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73178eb-8877-41ca-9c7b-bbbe5f5b8473 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:31.097438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73178eb-8877-41ca-9c7b-bbbe5f5b8473 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:31.917284 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d73178eb-8877-41ca-9c7b-bbbe5f5b8473 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1649 microversion: 2.1 time: 0.851042 Oct 19 07:24:31.939243 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2831/5516] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:31 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1649 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:32.090054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1536877607", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "availability_zone": "nova:n-h2-861333-10", "networks": [{"uuid": "e9228fc3-23f1-4bb7-ad7a-88db2bd44744"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:32.209169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] validate_networks() for [('e9228fc3-23f1-4bb7-ad7a-88db2bd44744', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:24:32.690673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-820664364", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "afc8a1b5-cc57-464e-abad-abfc787c40c3"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:32.802178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] validate_networks() for [('afc8a1b5-cc57-464e-abad-abfc787c40c3', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:24:32.901914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:24:32.902355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:24:32.902858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:24:32.903456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:24:32.904020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:24:32.914503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:32.915244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:32.915685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:32.916441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:32.916901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:32.917350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:32.942770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Getting quotas for project cae6fba5461d4f08a47fd763a6c37af0. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:24:32.948140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Getting quotas for user fe98fcad6ef140d5b6458d66cb3f8924 and project cae6fba5461d4f08a47fd763a6c37af0. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:24:32.961773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:24:32.964499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:24:33.077477 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9280f7d8-11ec-4176-88d3-137dfbbc2f75 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992287 Oct 19 07:24:33.084643 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2686/5517] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:24:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:24:33.090904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21f8aeab-2170-423f-a782-135fc10097c1 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:33.092173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21f8aeab-2170-423f-a782-135fc10097c1 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:33.242571 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21f8aeab-2170-423f-a782-135fc10097c1 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1329 microversion: 2.1 time: 0.150192 Oct 19 07:24:33.258598 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2687/5518] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:33 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1329 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:34.184611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:24:34.186160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:24:34.187061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:24:34.187698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:24:34.188410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:24:34.207710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:34.209513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:34.210054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:34.211648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:34.212390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:34.217962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:34.259569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Getting quotas for project 74ab18166a124250aa4c825aa9da17eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:24:34.270173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdfc80a7-e0bf-4560-9953-7aafec0e86aa tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:34.270795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cdfc80a7-e0bf-4560-9953-7aafec0e86aa tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:34.277154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Getting quotas for user b078c3a25bab4c64ac3cfa8a0d4d8eba and project 74ab18166a124250aa4c825aa9da17eb. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:24:34.286785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfc80a7-e0bf-4560-9953-7aafec0e86aa tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:34.290420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfc80a7-e0bf-4560-9953-7aafec0e86aa tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:34.291232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfc80a7-e0bf-4560-9953-7aafec0e86aa tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:34.292211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfc80a7-e0bf-4560-9953-7aafec0e86aa tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:34.294961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfc80a7-e0bf-4560-9953-7aafec0e86aa tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:34.295684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdfc80a7-e0bf-4560-9953-7aafec0e86aa tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:34.306497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:24:34.310482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:24:34.434286 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cdfc80a7-e0bf-4560-9953-7aafec0e86aa tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1346 microversion: 2.1 time: 0.168262 Oct 19 07:24:34.435279 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2688/5519] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:34 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:34.551158 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb43222f-0cd7-4890-8a49-26f68ad68946 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.864567 Oct 19 07:24:34.557280 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2832/5520] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:24:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:24:34.572448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e549df36-91e2-467c-965e-cbead0653e22 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:34.573251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e549df36-91e2-467c-965e-cbead0653e22 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:34.732533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e549df36-91e2-467c-965e-cbead0653e22 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:34.740735 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e549df36-91e2-467c-965e-cbead0653e22 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1218 microversion: 2.1 time: 0.176633 Oct 19 07:24:34.742748 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2689/5521] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:34 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:35.460042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d391fa5-f04c-4ea2-a00f-bd94df7f4cc6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:35.460739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d391fa5-f04c-4ea2-a00f-bd94df7f4cc6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:35.481322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d391fa5-f04c-4ea2-a00f-bd94df7f4cc6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:35.481842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d391fa5-f04c-4ea2-a00f-bd94df7f4cc6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:35.489737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d391fa5-f04c-4ea2-a00f-bd94df7f4cc6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:35.493232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d391fa5-f04c-4ea2-a00f-bd94df7f4cc6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:35.499740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d391fa5-f04c-4ea2-a00f-bd94df7f4cc6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:35.500288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d391fa5-f04c-4ea2-a00f-bd94df7f4cc6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:35.575370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:35.690837 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d391fa5-f04c-4ea2-a00f-bd94df7f4cc6 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1418 microversion: 2.1 time: 0.235782 Oct 19 07:24:35.691433 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2833/5522] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:35 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1418 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:35.763361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6faf1e37-6c65-4f01-b7d3-50c7bdf05261 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:35.764622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6faf1e37-6c65-4f01-b7d3-50c7bdf05261 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:35.858912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6faf1e37-6c65-4f01-b7d3-50c7bdf05261 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:35.866434 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6faf1e37-6c65-4f01-b7d3-50c7bdf05261 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1218 microversion: 2.1 time: 0.107377 Oct 19 07:24:35.869085 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2690/5523] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:35 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:36.722860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f980bcfb-4988-4bed-92a7-699d4fa6a77e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:36.735409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f980bcfb-4988-4bed-92a7-699d4fa6a77e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:36.760879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:36.779967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f980bcfb-4988-4bed-92a7-699d4fa6a77e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:36.782487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f980bcfb-4988-4bed-92a7-699d4fa6a77e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:36.787688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f980bcfb-4988-4bed-92a7-699d4fa6a77e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:36.792890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f980bcfb-4988-4bed-92a7-699d4fa6a77e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:36.793751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f980bcfb-4988-4bed-92a7-699d4fa6a77e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:36.796755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f980bcfb-4988-4bed-92a7-699d4fa6a77e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:36.892383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:36.893955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:36.909658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:36.910451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:36.914477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:36.915718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:36.916830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:36.919282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:36.968811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:37.028639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:37.039807 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c87a840-4efa-44be-9869-8a98033128ae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1270 microversion: 2.1 time: 0.151779 Oct 19 07:24:37.053646 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2691/5524] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:36 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:37.471463 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f980bcfb-4988-4bed-92a7-699d4fa6a77e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1466 microversion: 2.1 time: 0.760772 Oct 19 07:24:37.476405 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2834/5525] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:36 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1466 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:38.076921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:38.078820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:38.095317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:38.097026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:38.097939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:38.100622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:38.100622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:38.114406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:38.241308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:38.252772 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d31ee105-9cc6-40b8-b3a9-c0a161b944a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1276 microversion: 2.1 time: 0.181435 Oct 19 07:24:38.254075 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2692/5526] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:38 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:38.503617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6bdee503-8aa3-4d3f-be73-dd09bbf4712d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:38.504369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6bdee503-8aa3-4d3f-be73-dd09bbf4712d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:38.511511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bdee503-8aa3-4d3f-be73-dd09bbf4712d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:38.512047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bdee503-8aa3-4d3f-be73-dd09bbf4712d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:38.512875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bdee503-8aa3-4d3f-be73-dd09bbf4712d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:38.513740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bdee503-8aa3-4d3f-be73-dd09bbf4712d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:38.514395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bdee503-8aa3-4d3f-be73-dd09bbf4712d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:38.514989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bdee503-8aa3-4d3f-be73-dd09bbf4712d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:38.821842 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6bdee503-8aa3-4d3f-be73-dd09bbf4712d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1466 microversion: 2.1 time: 0.322803 Oct 19 07:24:38.823062 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2835/5527] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:38 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1466 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:39.207082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0cb098c2-d6a2-4aa3-8c46-e3b9e0315acd req-2594a1b0-b345-4338-a859-5606878cb2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9518968-5b67-4902-9b5a-b15cf62639b0", "tag": "5c71c7c7-1d63-4564-ae47-15cbeff101b2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:39.255598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0cb098c2-d6a2-4aa3-8c46-e3b9e0315acd req-2594a1b0-b345-4338-a859-5606878cb2f8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:39.258580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0cb098c2-d6a2-4aa3-8c46-e3b9e0315acd req-2594a1b0-b345-4338-a859-5606878cb2f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:39.259118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0cb098c2-d6a2-4aa3-8c46-e3b9e0315acd req-2594a1b0-b345-4338-a859-5606878cb2f8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:39.283778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:39.285576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:39.286722 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0cb098c2-d6a2-4aa3-8c46-e3b9e0315acd req-2594a1b0-b345-4338-a859-5606878cb2f8 service nova] Creating event network-changed:5c71c7c7-1d63-4564-ae47-15cbeff101b2 for instance d9518968-5b67-4902-9b5a-b15cf62639b0 on n-h2-861333-10 Oct 19 07:24:39.298504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:39.299721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:39.299721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:39.300128 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0cb098c2-d6a2-4aa3-8c46-e3b9e0315acd req-2594a1b0-b345-4338-a859-5606878cb2f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095529 Oct 19 07:24:39.300776 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2693/5528] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:24:39.305360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:39.305947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:39.306616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:39.604214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:39.620367 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-467b6153-1b4f-4430-9399-9bb16dc7e180 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1318 microversion: 2.1 time: 0.342516 Oct 19 07:24:39.621129 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2836/5529] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:39 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:24:39.850499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-387e57eb-6f16-4735-88ab-bf0c373faeb5 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:39.851875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-387e57eb-6f16-4735-88ab-bf0c373faeb5 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:39.867011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-387e57eb-6f16-4735-88ab-bf0c373faeb5 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:39.868187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-387e57eb-6f16-4735-88ab-bf0c373faeb5 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:39.868802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-387e57eb-6f16-4735-88ab-bf0c373faeb5 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:39.869836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-387e57eb-6f16-4735-88ab-bf0c373faeb5 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:39.870476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-387e57eb-6f16-4735-88ab-bf0c373faeb5 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:39.871055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-387e57eb-6f16-4735-88ab-bf0c373faeb5 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:40.613670 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-387e57eb-6f16-4735-88ab-bf0c373faeb5 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1466 microversion: 2.1 time: 0.767977 Oct 19 07:24:40.617928 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2694/5530] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:39 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1466 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:40.647267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:40.648447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:40.663482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:40.664013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:40.665296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:40.666275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:40.667690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:40.668345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:40.956693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:40.976336 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f27e4b96-f0a1-4da7-b7e1-f7b265073da8 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1318 microversion: 2.1 time: 0.322306 Oct 19 07:24:40.977152 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2837/5531] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:40 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:41.644353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aefdb0b3-c578-4277-af4e-28c092335b85 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:41.645777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aefdb0b3-c578-4277-af4e-28c092335b85 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:41.655265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aefdb0b3-c578-4277-af4e-28c092335b85 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:41.656378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aefdb0b3-c578-4277-af4e-28c092335b85 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:41.656994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aefdb0b3-c578-4277-af4e-28c092335b85 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:41.658015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aefdb0b3-c578-4277-af4e-28c092335b85 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:41.658701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aefdb0b3-c578-4277-af4e-28c092335b85 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:41.660205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aefdb0b3-c578-4277-af4e-28c092335b85 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:41.796473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4cb37663-c77d-4335-b2ce-ef2ee28ae564 req-0f1e195a-b4d0-402c-ac79-4ca132b6b165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ce8986-edd4-41db-9563-43295fa53ed5", "tag": "3f7d7899-7af4-4b68-b639-864415726d45"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:41.822203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4cb37663-c77d-4335-b2ce-ef2ee28ae564 req-0f1e195a-b4d0-402c-ac79-4ca132b6b165 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:41.823222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4cb37663-c77d-4335-b2ce-ef2ee28ae564 req-0f1e195a-b4d0-402c-ac79-4ca132b6b165 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:41.824909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4cb37663-c77d-4335-b2ce-ef2ee28ae564 req-0f1e195a-b4d0-402c-ac79-4ca132b6b165 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:41.843673 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4cb37663-c77d-4335-b2ce-ef2ee28ae564 req-0f1e195a-b4d0-402c-ac79-4ca132b6b165 service nova] Creating event network-changed:3f7d7899-7af4-4b68-b639-864415726d45 for instance e8ce8986-edd4-41db-9563-43295fa53ed5 on n-h2-861333-10 Oct 19 07:24:41.854234 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4cb37663-c77d-4335-b2ce-ef2ee28ae564 req-0f1e195a-b4d0-402c-ac79-4ca132b6b165 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062650 Oct 19 07:24:41.856047 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2838/5532] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:24:41.992384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:41.993379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:42.002931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:42.004397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:42.005112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:42.007998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:42.009350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:42.010224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:42.244044 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aefdb0b3-c578-4277-af4e-28c092335b85 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1466 microversion: 2.1 time: 0.603778 Oct 19 07:24:42.262531 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2695/5533] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:41 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1466 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:42.377136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:42.401219 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b51be09c-6330-4006-9045-95e1eb92a6f6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1318 microversion: 2.1 time: 0.414325 Oct 19 07:24:42.408569 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2839/5534] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:41 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:43.292440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a00ac29f-878e-4f53-9f0a-60bbeba606f3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:43.293158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a00ac29f-878e-4f53-9f0a-60bbeba606f3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:43.296131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:43.312037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00ac29f-878e-4f53-9f0a-60bbeba606f3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:43.312647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00ac29f-878e-4f53-9f0a-60bbeba606f3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:43.313168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00ac29f-878e-4f53-9f0a-60bbeba606f3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:43.313965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00ac29f-878e-4f53-9f0a-60bbeba606f3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:43.314500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00ac29f-878e-4f53-9f0a-60bbeba606f3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:43.315004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00ac29f-878e-4f53-9f0a-60bbeba606f3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:43.426987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:43.428862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:43.438233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:43.453530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:43.454309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:43.455258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:43.455907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:43.456674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:43.669405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:43.681190 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20f4065d-a2f5-4615-9404-d6d1b8dc5b3c tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1318 microversion: 2.1 time: 0.258293 Oct 19 07:24:43.682564 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2840/5535] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:43 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:43.789989 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a00ac29f-878e-4f53-9f0a-60bbeba606f3 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1466 microversion: 2.1 time: 0.502845 Oct 19 07:24:43.818579 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2696/5536] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:43 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1466 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:44.707103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:44.707925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:44.714738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:44.719635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:44.722304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:44.722979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:44.723459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:44.724239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:44.724856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:44.725472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:44.824806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47e265a2-ba69-47d1-bbc8-f37bd101f422 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:44.825357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47e265a2-ba69-47d1-bbc8-f37bd101f422 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:44.833054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47e265a2-ba69-47d1-bbc8-f37bd101f422 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:44.835366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47e265a2-ba69-47d1-bbc8-f37bd101f422 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:44.835366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47e265a2-ba69-47d1-bbc8-f37bd101f422 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:44.835911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47e265a2-ba69-47d1-bbc8-f37bd101f422 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:44.836649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47e265a2-ba69-47d1-bbc8-f37bd101f422 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:44.837234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47e265a2-ba69-47d1-bbc8-f37bd101f422 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:44.931799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:44.942454 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0954a59e-bae9-4820-9a4c-8f255b62a20a tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1318 microversion: 2.1 time: 0.239259 Oct 19 07:24:44.958499 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2841/5537] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:44 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:45.083530 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47e265a2-ba69-47d1-bbc8-f37bd101f422 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1466 microversion: 2.1 time: 0.264213 Oct 19 07:24:45.084043 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2697/5538] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:44 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1466 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:24:45.810566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-172f1618-df05-4a3a-aeaf-7fa1bd8ba56e req-d2994b26-6a29-4701-9b1f-1cdb8365b639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9518968-5b67-4902-9b5a-b15cf62639b0", "name": "network-vif-plugged", "status": "completed", "tag": "5c71c7c7-1d63-4564-ae47-15cbeff101b2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:45.826536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-172f1618-df05-4a3a-aeaf-7fa1bd8ba56e req-d2994b26-6a29-4701-9b1f-1cdb8365b639 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:45.827024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-172f1618-df05-4a3a-aeaf-7fa1bd8ba56e req-d2994b26-6a29-4701-9b1f-1cdb8365b639 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:45.827459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-172f1618-df05-4a3a-aeaf-7fa1bd8ba56e req-d2994b26-6a29-4701-9b1f-1cdb8365b639 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:45.843626 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-172f1618-df05-4a3a-aeaf-7fa1bd8ba56e req-d2994b26-6a29-4701-9b1f-1cdb8365b639 service nova] Creating event network-vif-plugged:5c71c7c7-1d63-4564-ae47-15cbeff101b2 for instance d9518968-5b67-4902-9b5a-b15cf62639b0 on n-h2-861333-10 Oct 19 07:24:45.849352 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-172f1618-df05-4a3a-aeaf-7fa1bd8ba56e req-d2994b26-6a29-4701-9b1f-1cdb8365b639 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043140 Oct 19 07:24:45.850509 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2842/5539] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:24:45.972072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:45.972891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:45.980377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:45.981436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:45.985471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:45.986293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:45.986892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:45.988567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:45.989586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:46.000964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:46.122123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f7ab48f-c45e-4b75-9f12-a6826ed53734 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:46.122123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f7ab48f-c45e-4b75-9f12-a6826ed53734 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:46.144337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f7ab48f-c45e-4b75-9f12-a6826ed53734 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:46.144846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f7ab48f-c45e-4b75-9f12-a6826ed53734 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:46.145490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f7ab48f-c45e-4b75-9f12-a6826ed53734 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:46.148208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f7ab48f-c45e-4b75-9f12-a6826ed53734 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:46.149002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f7ab48f-c45e-4b75-9f12-a6826ed53734 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:46.150320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f7ab48f-c45e-4b75-9f12-a6826ed53734 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:46.431256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:46.442455 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9debda73-c1f6-408c-8506-0ed806371bb0 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1318 microversion: 2.1 time: 0.476437 Oct 19 07:24:46.443352 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2698/5540] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:45 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:46.450305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-798069829", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "030bed7b-b5a2-4c9f-8693-0dd464710618", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cedc1025-55fd-4295-a2cd-69fd264b4466"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:46.450882 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f7ab48f-c45e-4b75-9f12-a6826ed53734 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1466 microversion: 2.1 time: 0.346925 Oct 19 07:24:46.451751 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2843/5541] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:46 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1466 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:46.535094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] validate_networks() for [('cedc1025-55fd-4295-a2cd-69fd264b4466', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:24:46.994277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:24:46.994923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:24:46.995160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:24:46.995564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:24:46.997573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:24:47.007011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:47.007504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:47.010991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:47.011778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:47.012272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:47.012714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:47.033148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:24:47.039319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for user 221b692fdbb3495aa63a686796b02ea8 and project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:24:47.098327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:24:47.101186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='030bed7b-b5a2-4c9f-8693-0dd464710618',volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:24:47.471991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:47.472725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:47.481098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:47.481676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:47.482281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:47.482989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:47.483447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:47.483959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:47.634251 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-816bad52-5cf4-4ee1-a7f2-2ed622637d49 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.188885 Oct 19 07:24:47.635169 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2699/5542] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:24:47.636604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:47.640061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2ef50f6-5c9d-4b22-9428-93a5b895344e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:47.641081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2ef50f6-5c9d-4b22-9428-93a5b895344e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:47.652130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2ef50f6-5c9d-4b22-9428-93a5b895344e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:47.653741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2ef50f6-5c9d-4b22-9428-93a5b895344e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:47.654193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2ef50f6-5c9d-4b22-9428-93a5b895344e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:47.655213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2ef50f6-5c9d-4b22-9428-93a5b895344e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:47.655719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2ef50f6-5c9d-4b22-9428-93a5b895344e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:47.656241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2ef50f6-5c9d-4b22-9428-93a5b895344e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:47.661359 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2920b07-aca7-4afa-aebe-f4cac82aa4fa tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1318 microversion: 2.1 time: 0.192414 Oct 19 07:24:47.669090 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2844/5543] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:47 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:47.674486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a8d8c5d-455f-42f4-9c12-a6949f1e744b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:47.689423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a8d8c5d-455f-42f4-9c12-a6949f1e744b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:47.771550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a8d8c5d-455f-42f4-9c12-a6949f1e744b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:47.788087 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a8d8c5d-455f-42f4-9c12-a6949f1e744b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1056 microversion: 2.1 time: 0.109440 Oct 19 07:24:47.788087 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2845/5544] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:47 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1056 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:47.859342 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2ef50f6-5c9d-4b22-9428-93a5b895344e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1466 microversion: 2.1 time: 0.221272 Oct 19 07:24:47.872217 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2700/5545] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:47 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1466 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:47.872466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-17dd20ac-1edd-4e7f-a72a-8c8a053b6cc9 req-661c8455-b535-4ed8-a927-0caeb43b3c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ce8986-edd4-41db-9563-43295fa53ed5", "name": "network-vif-plugged", "status": "completed", "tag": "3f7d7899-7af4-4b68-b639-864415726d45"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:47.880458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-17dd20ac-1edd-4e7f-a72a-8c8a053b6cc9 req-661c8455-b535-4ed8-a927-0caeb43b3c5d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:47.881013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-17dd20ac-1edd-4e7f-a72a-8c8a053b6cc9 req-661c8455-b535-4ed8-a927-0caeb43b3c5d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:47.881558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-17dd20ac-1edd-4e7f-a72a-8c8a053b6cc9 req-661c8455-b535-4ed8-a927-0caeb43b3c5d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:47.901391 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-17dd20ac-1edd-4e7f-a72a-8c8a053b6cc9 req-661c8455-b535-4ed8-a927-0caeb43b3c5d service nova] Creating event network-vif-plugged:3f7d7899-7af4-4b68-b639-864415726d45 for instance e8ce8986-edd4-41db-9563-43295fa53ed5 on n-h2-861333-10 Oct 19 07:24:47.907085 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-17dd20ac-1edd-4e7f-a72a-8c8a053b6cc9 req-661c8455-b535-4ed8-a927-0caeb43b3c5d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043191 Oct 19 07:24:47.907700 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2846/5546] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:24:48.702330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:48.703077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:48.710512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:48.710998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:48.718648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:48.718648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:48.718648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:48.718648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:48.807122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00f1eeeb-979a-4aac-9b99-c15bf6d6f92d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:48.807960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00f1eeeb-979a-4aac-9b99-c15bf6d6f92d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:48.852930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:48.861285 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1c74463-adc2-4c8a-9003-32747bb783e7 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1318 microversion: 2.1 time: 0.162866 Oct 19 07:24:48.862241 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2701/5547] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:48 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:48.864443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00f1eeeb-979a-4aac-9b99-c15bf6d6f92d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:48.872638 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00f1eeeb-979a-4aac-9b99-c15bf6d6f92d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1056 microversion: 2.1 time: 0.070406 Oct 19 07:24:48.873655 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2847/5548] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:48 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1056 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:24:48.888005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4634a250-25f0-4587-bb35-0f5adb4ef946 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:48.888666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4634a250-25f0-4587-bb35-0f5adb4ef946 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:48.895105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4634a250-25f0-4587-bb35-0f5adb4ef946 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:48.895601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4634a250-25f0-4587-bb35-0f5adb4ef946 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:48.896084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4634a250-25f0-4587-bb35-0f5adb4ef946 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:48.899927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4634a250-25f0-4587-bb35-0f5adb4ef946 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:48.900425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4634a250-25f0-4587-bb35-0f5adb4ef946 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:48.900861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4634a250-25f0-4587-bb35-0f5adb4ef946 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.030908 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4634a250-25f0-4587-bb35-0f5adb4ef946 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1651 microversion: 2.1 time: 0.146901 Oct 19 07:24:49.031485 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2702/5549] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:48 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1651 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:49.054181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5d82be9-9bba-412e-ab26-d5f46f8372e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:49.054782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d5d82be9-9bba-412e-ab26-d5f46f8372e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:49.061748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5d82be9-9bba-412e-ab26-d5f46f8372e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.062192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5d82be9-9bba-412e-ab26-d5f46f8372e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.062642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5d82be9-9bba-412e-ab26-d5f46f8372e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.063412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5d82be9-9bba-412e-ab26-d5f46f8372e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.064021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5d82be9-9bba-412e-ab26-d5f46f8372e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.064633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5d82be9-9bba-412e-ab26-d5f46f8372e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.204125 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5d82be9-9bba-412e-ab26-d5f46f8372e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1651 microversion: 2.1 time: 0.151182 Oct 19 07:24:49.204960 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2848/5550] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:49 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1651 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:49.230319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da74831b-a0a3-42cb-ace2-3656757d2882 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:49.230860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da74831b-a0a3-42cb-ace2-3656757d2882 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:49.237139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da74831b-a0a3-42cb-ace2-3656757d2882 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.237827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da74831b-a0a3-42cb-ace2-3656757d2882 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.238421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da74831b-a0a3-42cb-ace2-3656757d2882 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.239268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da74831b-a0a3-42cb-ace2-3656757d2882 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.246116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da74831b-a0a3-42cb-ace2-3656757d2882 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.246116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da74831b-a0a3-42cb-ace2-3656757d2882 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.396065 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da74831b-a0a3-42cb-ace2-3656757d2882 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1651 microversion: 2.1 time: 0.169721 Oct 19 07:24:49.396763 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2703/5551] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:49 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1651 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:49.421958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:49.422621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:49.433310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.434090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.434246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.434979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.435430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.435872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.465145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:24:49.885919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:49.886573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:49.894847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.895340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.895783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.897539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.898158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.898745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.931163 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec7a45f8-66f6-447e-8932-1ee7430e7923 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 204 len: 0 microversion: 2.1 time: 0.508272 Oct 19 07:24:49.949153 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2849/5552] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:24:49 2022] DELETE /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:24:49.949153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:49.949153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:49.949153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.949153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.949153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:49.949153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:49.950186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:49.950799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:50.026234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:50.034691 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35ea3001-e014-4e79-92b4-d9e153487151 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1098 microversion: 2.1 time: 0.100384 Oct 19 07:24:50.035269 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2850/5553] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:49 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1098 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:50.039891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e7b4b97-ef6d-4197-8ff5-f6df33785a6c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:50.040512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e7b4b97-ef6d-4197-8ff5-f6df33785a6c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:50.046441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e7b4b97-ef6d-4197-8ff5-f6df33785a6c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:50.046929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e7b4b97-ef6d-4197-8ff5-f6df33785a6c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:50.048852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:50.051338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e7b4b97-ef6d-4197-8ff5-f6df33785a6c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:50.052404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e7b4b97-ef6d-4197-8ff5-f6df33785a6c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:50.053067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e7b4b97-ef6d-4197-8ff5-f6df33785a6c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:50.053480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e7b4b97-ef6d-4197-8ff5-f6df33785a6c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:50.058211 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd21c175-6252-46ca-8e95-46530edc28a5 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1506 microversion: 2.1 time: 0.176119 Oct 19 07:24:50.059019 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2704/5554] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:49 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:50.103492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74e9761e-7dce-4bb6-ba5b-31bf8360355b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c8b125e-133f-481b-baff-d8f4f0e2a5cf", "device": "/dev/sdb"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:50.106673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74e9761e-7dce-4bb6-ba5b-31bf8360355b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:50.113454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74e9761e-7dce-4bb6-ba5b-31bf8360355b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:50.114202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74e9761e-7dce-4bb6-ba5b-31bf8360355b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:50.114934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74e9761e-7dce-4bb6-ba5b-31bf8360355b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:50.115780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74e9761e-7dce-4bb6-ba5b-31bf8360355b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:50.116407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74e9761e-7dce-4bb6-ba5b-31bf8360355b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:50.116982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74e9761e-7dce-4bb6-ba5b-31bf8360355b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:50.197200 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e7b4b97-ef6d-4197-8ff5-f6df33785a6c tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1657 microversion: 2.1 time: 0.160876 Oct 19 07:24:50.197785 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2851/5555] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:50 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1657 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:51.058152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:51.059910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:51.067678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:51.068503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:51.068951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:51.070043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:51.070507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:51.070977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:51.074072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:51.155959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:51.164279 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63008154-09cd-4458-a111-a4ef91df72b0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1162 microversion: 2.1 time: 0.110437 Oct 19 07:24:51.165002 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2852/5556] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:51 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1162 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:51.225172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-771e127f-a935-49c6-b32f-33e434d48424 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:51.225634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-771e127f-a935-49c6-b32f-33e434d48424 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:51.242093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-771e127f-a935-49c6-b32f-33e434d48424 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:51.242761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-771e127f-a935-49c6-b32f-33e434d48424 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:51.243219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-771e127f-a935-49c6-b32f-33e434d48424 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:51.252393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-771e127f-a935-49c6-b32f-33e434d48424 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:51.252912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-771e127f-a935-49c6-b32f-33e434d48424 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:51.253386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-771e127f-a935-49c6-b32f-33e434d48424 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:51.448395 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-771e127f-a935-49c6-b32f-33e434d48424 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1657 microversion: 2.1 time: 0.229259 Oct 19 07:24:51.449531 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2853/5557] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:51 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1657 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:24:52.018004 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74e9761e-7dce-4bb6-ba5b-31bf8360355b tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "POST /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.921076 Oct 19 07:24:52.018724 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2705/5558] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:24:50 2022] POST /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5/os-volume_attachments => generated 194 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:24:52.188929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:52.189544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:52.197929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:52.198719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:52.199347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:52.200296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:52.200899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:52.201599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:52.283395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:52.301447 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12edcb39-a486-4753-9ea0-be5f57749295 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1172 microversion: 2.1 time: 0.117407 Oct 19 07:24:52.302871 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2854/5559] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:52 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1172 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:52.482584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a4e0753-9430-424e-9bfa-a952b7742e8b tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:52.483920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a4e0753-9430-424e-9bfa-a952b7742e8b tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:52.501805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4e0753-9430-424e-9bfa-a952b7742e8b tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:52.507101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4e0753-9430-424e-9bfa-a952b7742e8b tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:52.507859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4e0753-9430-424e-9bfa-a952b7742e8b tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:52.509450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4e0753-9430-424e-9bfa-a952b7742e8b tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:52.513902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4e0753-9430-424e-9bfa-a952b7742e8b tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:52.514622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4e0753-9430-424e-9bfa-a952b7742e8b tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:52.618917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5aeb3acb-1da4-4ab2-8092-2f1bf28a8801 req-28fcde91-ba14-4780-8168-42b2757d0852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9518968-5b67-4902-9b5a-b15cf62639b0", "name": "network-vif-deleted", "tag": "5c71c7c7-1d63-4564-ae47-15cbeff101b2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:52.663366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5aeb3acb-1da4-4ab2-8092-2f1bf28a8801 req-28fcde91-ba14-4780-8168-42b2757d0852 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:52.667882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5aeb3acb-1da4-4ab2-8092-2f1bf28a8801 req-28fcde91-ba14-4780-8168-42b2757d0852 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:52.668643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5aeb3acb-1da4-4ab2-8092-2f1bf28a8801 req-28fcde91-ba14-4780-8168-42b2757d0852 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:52.706798 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5aeb3acb-1da4-4ab2-8092-2f1bf28a8801 req-28fcde91-ba14-4780-8168-42b2757d0852 service nova] Creating event network-vif-deleted:5c71c7c7-1d63-4564-ae47-15cbeff101b2 for instance d9518968-5b67-4902-9b5a-b15cf62639b0 on n-h2-861333-10 Oct 19 07:24:52.719945 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5aeb3acb-1da4-4ab2-8092-2f1bf28a8801 req-28fcde91-ba14-4780-8168-42b2757d0852 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108309 Oct 19 07:24:52.726771 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2855/5560] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:24:52.806733 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a4e0753-9430-424e-9bfa-a952b7742e8b tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1615 microversion: 2.1 time: 0.335000 Oct 19 07:24:52.829517 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2706/5561] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:52 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1615 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:53.333149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:53.334519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:53.342133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:53.342640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:53.343087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:53.344002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:53.344506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:53.344949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:53.571478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:53.571478 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32ac59e6-d5e0-4acc-a374-1936895ca340 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1214 microversion: 2.1 time: 0.188745 Oct 19 07:24:53.571478 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2856/5562] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:53 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:53.842861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:53.848324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:53.869181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:53.870031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:53.870487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:53.871240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:53.871954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:53.872419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:53.935107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:53.935690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:53.944365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:53.944365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lazy-loading 'fault' on Instance uuid d9518968-5b67-4902-9b5a-b15cf62639b0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:24:53.944365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:54.007932 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d10077c-ec1b-4221-bcbf-c03c3d0676e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 200 len: 1456 microversion: 2.1 time: 0.171469 Oct 19 07:24:54.010489 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2707/5563] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:53 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 1456 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:54.574429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:54.575094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:54.582301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:54.582796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:54.583819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:54.584756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:54.585362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:54.585937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:54.733335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:54.750576 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9dab594a-f59e-452c-9641-8fdea0531fa3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1214 microversion: 2.1 time: 0.180742 Oct 19 07:24:54.751424 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2857/5564] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:54 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:54.796801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7bf54396-c008-4c37-8e2b-80f8f302c97f req-aa26697c-a509-41b4-9402-93123e31fdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3602d053-46b8-44c5-9a72-b3b7fe8b6eb1", "tag": "636b8af2-3125-4b69-ae3b-ca959907727b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:54.812943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7bf54396-c008-4c37-8e2b-80f8f302c97f req-aa26697c-a509-41b4-9402-93123e31fdf2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:54.821748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7bf54396-c008-4c37-8e2b-80f8f302c97f req-aa26697c-a509-41b4-9402-93123e31fdf2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:54.821748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7bf54396-c008-4c37-8e2b-80f8f302c97f req-aa26697c-a509-41b4-9402-93123e31fdf2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:54.826907 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7bf54396-c008-4c37-8e2b-80f8f302c97f req-aa26697c-a509-41b4-9402-93123e31fdf2 service nova] Creating event network-changed:636b8af2-3125-4b69-ae3b-ca959907727b for instance 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 on n-h1-861333-10 Oct 19 07:24:54.832284 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7bf54396-c008-4c37-8e2b-80f8f302c97f req-aa26697c-a509-41b4-9402-93123e31fdf2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043608 Oct 19 07:24:54.832898 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2708/5565] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:24:55.033117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:55.036733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: d9518968-5b67-4902-9b5a-b15cf62639b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:55.042918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:55.043429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:55.044038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:55.044798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:55.045591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:55.046960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:55.060529 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] HTTP exception thrown: Instance d9518968-5b67-4902-9b5a-b15cf62639b0 could not be found. Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Request method failure captured: Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 HTTP/1.1 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6YaHwyiYL9u_vJ9XV7wCPTqhM_CdA2p8dnRvZZZWpRwO2wUmS1jo7uKo3g-cECZtE3YFfOED4gY9hDeABFi8JJHhrY5ZkhwRCkXXqvyzhv-vm9ynSw0o-XMyx0_-Zx5qWU_zOdeKiJmdm3cjs8mTyZAQiHgQYiMx_5G93pPS2r35lc Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: cae6fba5461d4f08a47fd763a6c37af0 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestServerMultinode-629107416 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member,admin Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member,admin Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cae6fba5461d4f08a47fd763a6c37af0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cae6fba5461d4f08a47fd763a6c37af0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cae6fba5461d4f08a47fd763a6c37af0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cae6fba5461d4f08a47fd763a6c37af0", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestServerMultinode-629107416 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: cae6fba5461d4f08a47fd763a6c37af0 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestServerMultinode-629107416 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestServerMultinode-629107416-project-admin Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fe98fcad6ef140d5b6458d66cb3f8924 Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestServerMultinode-629107416-project-admin Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance d9518968-5b67-4902-9b5a-b15cf62639b0 could not be found. Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'd9518968-5b67-4902-9b5a-b15cf62639b0'} Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9518968-5b67-4902-9b5a-b15cf62639b0 could not be found. Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9518968-5b67-4902-9b5a-b15cf62639b0 could not be found. Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:24:55.062405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:55.066229 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:24:55.066229 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:24:55.066229 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:24:55.066229 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:24:55.066229 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:24:55.066229 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9518968-5b67-4902-9b5a-b15cf62639b0 could not be found. Oct 19 07:24:55.066229 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:24:55.068082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Returning 404 to user: Instance d9518968-5b67-4902-9b5a-b15cf62639b0 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:24:55.069195 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22129586-7ff9-418b-86f6-da4afa6c7b48 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0" status: 404 len: 111 microversion: 2.1 time: 0.039856 Oct 19 07:24:55.069941 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2858/5566] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:55 2022] GET /compute/v2.1/servers/d9518968-5b67-4902-9b5a-b15cf62639b0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:24:55.083575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:55.084976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:55.091985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:55.092605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:55.093318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:55.094251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:55.095050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:55.095688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:55.124512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:24:55.550848 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8db380c-e757-4879-b242-24062e73d9e9 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 204 len: 0 microversion: 2.1 time: 0.472498 Oct 19 07:24:55.554821 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2709/5567] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:24:55 2022] DELETE /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:24:55.559706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea9ea0b5-5801-4d29-9cfd-a28b2918409a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:55.560342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea9ea0b5-5801-4d29-9cfd-a28b2918409a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:55.568883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9ea0b5-5801-4d29-9cfd-a28b2918409a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:55.569634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9ea0b5-5801-4d29-9cfd-a28b2918409a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:55.570077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9ea0b5-5801-4d29-9cfd-a28b2918409a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:55.570796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9ea0b5-5801-4d29-9cfd-a28b2918409a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:55.571256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9ea0b5-5801-4d29-9cfd-a28b2918409a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:55.571705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea9ea0b5-5801-4d29-9cfd-a28b2918409a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:55.718787 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea9ea0b5-5801-4d29-9cfd-a28b2918409a tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1655 microversion: 2.1 time: 0.162796 Oct 19 07:24:55.722256 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2859/5568] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:55 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:55.784065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:55.784924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:55.792132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:55.794902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:55.794902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:55.794902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:55.794902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:55.794902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:55.956980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:55.958888 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17af04ff-ee99-4872-a4bb-bc2f506362a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1214 microversion: 2.1 time: 0.178728 Oct 19 07:24:55.968595 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2710/5569] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:55 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:56.744082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0226a037-c2bf-4f53-9f4a-24b07e2976f7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:56.745359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0226a037-c2bf-4f53-9f4a-24b07e2976f7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:56.753134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0226a037-c2bf-4f53-9f4a-24b07e2976f7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:56.753640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0226a037-c2bf-4f53-9f4a-24b07e2976f7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:56.754083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0226a037-c2bf-4f53-9f4a-24b07e2976f7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:56.754838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0226a037-c2bf-4f53-9f4a-24b07e2976f7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:56.755462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0226a037-c2bf-4f53-9f4a-24b07e2976f7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:56.756139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0226a037-c2bf-4f53-9f4a-24b07e2976f7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:56.894739 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0226a037-c2bf-4f53-9f4a-24b07e2976f7 tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1655 microversion: 2.1 time: 0.155557 Oct 19 07:24:56.895986 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2860/5570] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:56 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:56.982528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:56.983169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:56.991414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:56.991937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:56.992412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:56.993123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:56.993583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:56.994035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:57.026887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:57.052043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:57.200566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:57.209433 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18dc79ed-047e-4d4f-a45f-7df83b302872 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1214 microversion: 2.1 time: 0.231239 Oct 19 07:24:57.220421 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2711/5571] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:56 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:57.739818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7ba95693-2349-4344-a8a6-cdfa9eb6a300 req-1f16a1d6-9055-45f7-96a7-3f6faab0a530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74845d0e-0094-4c8b-879d-dd405cf643bd", "name": "network-vif-deleted", "tag": "0be237ac-1899-43e6-b1e9-cdfa01f45759"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:24:57.750623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7ba95693-2349-4344-a8a6-cdfa9eb6a300 req-1f16a1d6-9055-45f7-96a7-3f6faab0a530 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:57.751783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7ba95693-2349-4344-a8a6-cdfa9eb6a300 req-1f16a1d6-9055-45f7-96a7-3f6faab0a530 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:57.752240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7ba95693-2349-4344-a8a6-cdfa9eb6a300 req-1f16a1d6-9055-45f7-96a7-3f6faab0a530 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:57.766921 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7ba95693-2349-4344-a8a6-cdfa9eb6a300 req-1f16a1d6-9055-45f7-96a7-3f6faab0a530 service nova] Creating event network-vif-deleted:0be237ac-1899-43e6-b1e9-cdfa01f45759 for instance 74845d0e-0094-4c8b-879d-dd405cf643bd on n-h1-861333-10 Oct 19 07:24:57.773669 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7ba95693-2349-4344-a8a6-cdfa9eb6a300 req-1f16a1d6-9055-45f7-96a7-3f6faab0a530 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041867 Oct 19 07:24:57.774816 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2861/5572] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:24:57.923139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0898e8af-20f4-4053-b9e9-f7ba84e8911d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:57.923139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0898e8af-20f4-4053-b9e9-f7ba84e8911d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:57.928196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898e8af-20f4-4053-b9e9-f7ba84e8911d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:57.928683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898e8af-20f4-4053-b9e9-f7ba84e8911d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:57.929119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898e8af-20f4-4053-b9e9-f7ba84e8911d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:57.929810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898e8af-20f4-4053-b9e9-f7ba84e8911d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:57.930277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898e8af-20f4-4053-b9e9-f7ba84e8911d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:57.930706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898e8af-20f4-4053-b9e9-f7ba84e8911d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:58.016089 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0898e8af-20f4-4053-b9e9-f7ba84e8911d tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1613 microversion: 2.1 time: 0.100152 Oct 19 07:24:58.018466 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2712/5573] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:57 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1613 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:24:58.244047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:58.249899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:58.252179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:58.252842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:58.253456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:58.254844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:58.255460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:58.256045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:58.421312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:58.430961 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a310ee1-6c73-4400-8866-843b2eb6dd9f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1214 microversion: 2.1 time: 0.193329 Oct 19 07:24:58.432043 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2862/5574] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:58 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:59.044363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:59.044909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:59.057965 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:59.058459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:59.058956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:59.059676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:59.060147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:59.060579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:59.105896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:59.105896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:59.106318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:59.107038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lazy-loading 'fault' on Instance uuid 74845d0e-0094-4c8b-879d-dd405cf643bd {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:24:59.179674 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d6ce24b-7a9d-48d6-bcf1-551403cc502e tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 200 len: 1455 microversion: 2.1 time: 0.140450 Oct 19 07:24:59.180325 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2713/5575] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:59 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:24:59.455326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:24:59.460857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:24:59.467844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:24:59.469776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:59.470558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:59.471215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:59.471990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:24:59.472519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:24:59.473707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:24:59.670952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:24:59.682658 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4fa1a553-4e28-41a1-99fc-bc9d057a3dc3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1214 microversion: 2.1 time: 0.231507 Oct 19 07:24:59.683237 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2863/5576] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:24:59 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:00.202773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:00.203409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] [instance: 74845d0e-0094-4c8b-879d-dd405cf643bd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:00.215474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:00.216064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:00.220417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:00.223041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:00.223813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:00.224291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:00.252911 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] HTTP exception thrown: Instance 74845d0e-0094-4c8b-879d-dd405cf643bd could not be found. Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Request method failure captured: Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd HTTP/1.1 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6YaHwyiYL9u_vJ9XV7wCPTqhM_CdA2p8dnRvZZZWpRwO2wUmS1jo7uKo3g-cECZtE3YFfOED4gY9hDeABFi8JJHhrY5ZkhwRCkXXqvyzhv-vm9ynSw0o-XMyx0_-Zx5qWU_zOdeKiJmdm3cjs8mTyZAQiHgQYiMx_5G93pPS2r35lc Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: cae6fba5461d4f08a47fd763a6c37af0 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestServerMultinode-629107416 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member,admin Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member,admin Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cae6fba5461d4f08a47fd763a6c37af0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cae6fba5461d4f08a47fd763a6c37af0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cae6fba5461d4f08a47fd763a6c37af0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cae6fba5461d4f08a47fd763a6c37af0", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestServerMultinode-629107416 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: cae6fba5461d4f08a47fd763a6c37af0 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestServerMultinode-629107416 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestServerMultinode-629107416-project-admin Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: fe98fcad6ef140d5b6458d66cb3f8924 Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestServerMultinode-629107416-project-admin Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 74845d0e-0094-4c8b-879d-dd405cf643bd could not be found. Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '74845d0e-0094-4c8b-879d-dd405cf643bd'} Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74845d0e-0094-4c8b-879d-dd405cf643bd could not be found. Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74845d0e-0094-4c8b-879d-dd405cf643bd could not be found. Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:25:00.255295 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74845d0e-0094-4c8b-879d-dd405cf643bd could not be found. Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] Returning 404 to user: Instance 74845d0e-0094-4c8b-879d-dd405cf643bd could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1186571d-86d7-4c6c-ad17-ecdc132f0bbe tempest-TestServerMultinode-629107416 tempest-TestServerMultinode-629107416-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd" status: 404 len: 111 microversion: 2.1 time: 0.058688 Oct 19 07:25:00.270511 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2714/5577] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:00 2022] GET /compute/v2.1/servers/74845d0e-0094-4c8b-879d-dd405cf643bd => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:25:00.706538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:00.708780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:00.716822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:00.717423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:00.717945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:00.719009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:00.719712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:00.720389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:01.042705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:01.051932 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-416a81d9-1ba4-4a12-9ec7-fed247e4a1fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1214 microversion: 2.1 time: 0.350455 Oct 19 07:25:01.063583 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2864/5578] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:00 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1214 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:02.075614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:02.076944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:02.086840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:02.087569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:02.088285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:02.089883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:02.090457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:02.090992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:02.272920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:02.286078 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12b88026-615b-485f-a266-84a9bfe5c2b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1202 microversion: 2.1 time: 0.214354 Oct 19 07:25:02.309446 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2715/5579] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:02 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1202 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:03.330202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:03.331442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:03.339476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:03.340470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:03.341178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:03.342245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:03.342993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:03.343627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:03.600207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:03.618032 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23151c5e-73f2-48cb-b3a6-3c99144bd617 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1202 microversion: 2.1 time: 0.298881 Oct 19 07:25:03.619490 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2865/5580] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:03 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1202 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:04.646047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:04.647784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:04.659502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:04.663047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:04.664017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:04.665476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:04.665947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:04.666380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:04.996411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:05.016755 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a09c183b-3d02-42bc-b425-7b7a2b9cc6de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1202 microversion: 2.1 time: 0.374881 Oct 19 07:25:05.017483 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2716/5581] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:04 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1202 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:05.924388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3ae4a011-1228-4e61-8010-fc523300ee0f req-7a981e36-d275-4cbe-bf74-f551dc4202ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3602d053-46b8-44c5-9a72-b3b7fe8b6eb1", "name": "network-vif-plugged", "status": "completed", "tag": "636b8af2-3125-4b69-ae3b-ca959907727b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:25:05.926230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ae4a011-1228-4e61-8010-fc523300ee0f req-7a981e36-d275-4cbe-bf74-f551dc4202ab service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:05.926908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ae4a011-1228-4e61-8010-fc523300ee0f req-7a981e36-d275-4cbe-bf74-f551dc4202ab service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:05.930819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ae4a011-1228-4e61-8010-fc523300ee0f req-7a981e36-d275-4cbe-bf74-f551dc4202ab service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:05.945164 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3ae4a011-1228-4e61-8010-fc523300ee0f req-7a981e36-d275-4cbe-bf74-f551dc4202ab service nova] Creating event network-vif-plugged:636b8af2-3125-4b69-ae3b-ca959907727b for instance 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 on n-h1-861333-10 Oct 19 07:25:05.951187 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3ae4a011-1228-4e61-8010-fc523300ee0f req-7a981e36-d275-4cbe-bf74-f551dc4202ab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050421 Oct 19 07:25:05.954535 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2866/5582] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:25:06.040528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:06.042234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:06.063961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:06.063961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:06.063961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:06.063961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:06.063961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:06.063961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:06.394969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:06.404590 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4256ade-9b80-4696-8dff-b4ab21923039 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1202 microversion: 2.1 time: 0.367069 Oct 19 07:25:06.405353 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2717/5583] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:06 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1202 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:07.433530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:07.435183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:07.465136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:07.465633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:07.466105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:07.466819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:07.467278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:07.467704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:08.053703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:08.070612 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ccadc77-e53c-420d-a585-df83a8d0a609 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1202 microversion: 2.1 time: 0.644755 Oct 19 07:25:08.073604 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2867/5584] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:07 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1202 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:09.095778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:09.097299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:09.110803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:09.113138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:09.113826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:09.114770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:09.116785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:09.117448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:09.680694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:09.690396 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18ce4018-f280-41d0-b00d-83c3f519ea32 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1389 microversion: 2.1 time: 0.600410 Oct 19 07:25:09.704512 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2718/5585] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:09 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1389 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:09.728608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:09.730379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:09.745910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:09.753698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:09.753698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:09.753698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:09.753698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:09.753698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:09.753698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:09.951805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:09.970991 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-136a7a0f-7a7e-48aa-b9d9-9f34eaa99bda tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1389 microversion: 2.1 time: 0.244073 Oct 19 07:25:09.975227 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2868/5586] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:09 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1389 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:09.998322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:09.998948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:10.007654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:10.008178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:10.008821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:10.009697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:10.010318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:10.010905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:10.532540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:10.541564 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc80bdee-791b-460b-b231-d8ba2ec6523e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1389 microversion: 2.1 time: 0.547052 Oct 19 07:25:10.545411 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2719/5587] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:09 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1389 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:10.570859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:10.571360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:10.587647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:10.588344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:10.588793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:10.589698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:10.590314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:10.590900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:10.650690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:25:10.918776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:11.157459 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b111f26-47f1-428d-b1a1-cd500c94e913 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 204 len: 0 microversion: 2.1 time: 0.590548 Oct 19 07:25:11.159121 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2869/5588] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:25:10 2022] DELETE /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:25:11.168712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:11.169532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:11.182385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:11.182919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:11.188664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:11.189986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:11.191075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:11.191680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:11.677695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:11.688415 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f13b169-f9c7-4f4e-b8de-73f9622302a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1395 microversion: 2.1 time: 0.524689 Oct 19 07:25:11.691387 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2720/5589] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:11 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1395 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:12.721734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:12.723178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:12.731399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:12.732322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:12.733051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:12.734014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:12.734970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:12.735616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:13.023855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:13.038142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d23232fe-2be3-41eb-9ca1-73f2938693d4 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1395 microversion: 2.1 time: 0.321285 Oct 19 07:25:13.042325 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2870/5590] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:12 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1395 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:13.922237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2c7c1ff1-044f-4d51-8068-92325037ef89 req-4358eac8-21d6-433a-aea1-c733369e5279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3602d053-46b8-44c5-9a72-b3b7fe8b6eb1", "name": "network-vif-deleted", "tag": "636b8af2-3125-4b69-ae3b-ca959907727b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:25:13.948832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2c7c1ff1-044f-4d51-8068-92325037ef89 req-4358eac8-21d6-433a-aea1-c733369e5279 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:13.949850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2c7c1ff1-044f-4d51-8068-92325037ef89 req-4358eac8-21d6-433a-aea1-c733369e5279 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:13.952052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2c7c1ff1-044f-4d51-8068-92325037ef89 req-4358eac8-21d6-433a-aea1-c733369e5279 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:14.002816 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2c7c1ff1-044f-4d51-8068-92325037ef89 req-4358eac8-21d6-433a-aea1-c733369e5279 service nova] Creating event network-vif-deleted:636b8af2-3125-4b69-ae3b-ca959907727b for instance 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 on n-h1-861333-10 Oct 19 07:25:14.015175 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2c7c1ff1-044f-4d51-8068-92325037ef89 req-4358eac8-21d6-433a-aea1-c733369e5279 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096967 Oct 19 07:25:14.020162 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2721/5591] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:25:14.072673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:14.074188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:14.090219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:14.092783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:14.094610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:14.098532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:14.099386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:14.100040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:14.291410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:14.304134 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e63cee7a-d8bd-47b1-adc2-4bfd8e7f3e7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1353 microversion: 2.1 time: 0.235962 Oct 19 07:25:14.307843 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2871/5592] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:14 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1353 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:15.335710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:15.336955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:15.369388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:15.384970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:15.385721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:15.386629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:15.393935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:15.395456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:15.562909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:15.572912 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc518b56-437b-43e5-b86e-7da22d039a5f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1187 microversion: 2.1 time: 0.241895 Oct 19 07:25:15.573845 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2722/5593] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:15 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1187 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:16.598751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:16.600079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:16.610552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:16.611927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:16.612574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:16.613568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:16.614039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:16.614518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:16.699505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:16.719011 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-710752d5-60a2-40c2-b202-b7eb01629573 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1187 microversion: 2.1 time: 0.124003 Oct 19 07:25:16.732561 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2872/5594] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:16 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1187 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:17.746723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:17.748058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:17.751211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:17.757123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:17.757692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:17.758163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:17.759110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:17.759574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:17.760001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:17.841401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:17.849654 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9041bc62-d7f7-4697-8367-c613216fc628 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1187 microversion: 2.1 time: 0.106976 Oct 19 07:25:17.870002 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2723/5595] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:17 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1187 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:18.876978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:18.877969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:18.885759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:18.886620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:18.887138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:18.888245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:18.888786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:18.889289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:18.982044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:18.991531 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f5a4911-6ff8-4427-adce-6d8080f66e87 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1187 microversion: 2.1 time: 0.118709 Oct 19 07:25:18.992228 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2873/5596] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:18 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:20.016468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:20.017177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:20.034365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:20.034860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:20.035555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:20.036277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:20.036892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:20.037474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:20.044600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:20.073038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:20.073455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:20.073894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:20.074343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lazy-loading 'fault' on Instance uuid 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:25:20.120178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:20.126774 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d60d8a8-30db-4f47-834e-05baa86cc200 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 200 len: 1192 microversion: 2.1 time: 0.116345 Oct 19 07:25:20.127608 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2724/5597] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:20 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 1192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:21.149840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:21.153715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:21.158666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:21.159163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:21.159606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:21.160336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:21.160957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:21.161554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:21.178045 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 could not be found. Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 HTTP/1.1 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 could not be found. Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3602d053-46b8-44c5-9a72-b3b7fe8b6eb1'} Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 could not be found. Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 could not be found. Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:25:21.180001 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:21.183921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:25:21.183921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:25:21.183921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:25:21.183921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:25:21.183921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:25:21.183921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 could not be found. Oct 19 07:25:21.183921 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:21.183921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance 3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:25:21.183921 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-491fce1b-3aad-431d-af63-abefaea7071f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1" status: 404 len: 111 microversion: 2.1 time: 0.035617 Oct 19 07:25:21.185767 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2874/5598] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:21 2022] GET /compute/v2.1/servers/3602d053-46b8-44c5-9a72-b3b7fe8b6eb1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:25:24.360656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:24.361182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:24.367853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:24.368614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:24.369075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:24.369783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:24.370339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:24.370842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:24.479878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lazy-loading 'services' on Instance uuid e8ce8986-edd4-41db-9563-43295fa53ed5 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:25:24.702330 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d208b23-c731-4f45-a529-a59b18650cc1 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5/os-volume_attachments/5c8b125e-133f-481b-baff-d8f4f0e2a5cf" status: 202 len: 0 microversion: 2.1 time: 0.346995 Oct 19 07:25:24.706251 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2725/5599] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:25:24 2022] DELETE /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5/os-volume_attachments/5c8b125e-133f-481b-baff-d8f4f0e2a5cf => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:25:30.037425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-565825416", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "841edde9-338f-4de6-bc9f-9c87fb478f6e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cedc1025-55fd-4295-a2cd-69fd264b4466"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:25:30.108233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] validate_networks() for [('cedc1025-55fd-4295-a2cd-69fd264b4466', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:25:30.518518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:25:30.518954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:25:30.519439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:25:30.519858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:25:30.520304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:25:30.533185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:30.534681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:30.535969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:30.536890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:30.537703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:30.538218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:30.559422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:25:30.565919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for user 221b692fdbb3495aa63a686796b02ea8 and project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:25:30.634223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:25:30.636602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='841edde9-338f-4de6-bc9f-9c87fb478f6e',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:25:30.692534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:30.694833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:30.704784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:30.705477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:30.705957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:30.706675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:30.707155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:30.707628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:30.747897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:25:31.158796 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fe396f4-941e-4703-a1bf-db94d6fd69c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125303 Oct 19 07:25:31.159603 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2875/5600] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:25:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:25:31.185589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fe3c630-b094-4d12-9131-a7aad5b50cb7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:31.186477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fe3c630-b094-4d12-9131-a7aad5b50cb7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:31.188710 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecf76e8d-e632-458b-a524-33d7900fe714 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 204 len: 0 microversion: 2.1 time: 0.503189 Oct 19 07:25:31.190520 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2726/5601] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:25:30 2022] DELETE /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:25:31.199743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:31.204078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:31.241145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:31.241786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:31.242336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:31.243162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:31.243741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:31.245752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:31.299842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1fe3c630-b094-4d12-9131-a7aad5b50cb7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:31.310402 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fe3c630-b094-4d12-9131-a7aad5b50cb7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1056 microversion: 2.1 time: 0.141796 Oct 19 07:25:31.322386 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2876/5602] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:31 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1056 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:25:31.455314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:31.464084 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd325a52-8b52-4a3c-adb6-07b3e868fc05 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1512 microversion: 2.1 time: 0.268836 Oct 19 07:25:31.475176 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2727/5603] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:31 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:25:32.335259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-faf0f990-4aff-4cef-8276-1af98301da0f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:32.335950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-faf0f990-4aff-4cef-8276-1af98301da0f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:32.394006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-faf0f990-4aff-4cef-8276-1af98301da0f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:32.401193 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-faf0f990-4aff-4cef-8276-1af98301da0f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1056 microversion: 2.1 time: 0.070936 Oct 19 07:25:32.401935 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2877/5604] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:32 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1056 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:32.487463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:32.488313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:32.495253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:32.495739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:32.496197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:32.496898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:32.497354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:32.497776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:32.648497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:32.657493 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d70f55a-caf1-471e-90fe-cabee9c8dbae tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1512 microversion: 2.1 time: 0.174129 Oct 19 07:25:32.658364 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2728/5605] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:32 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:33.430797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:33.431645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:33.456870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:33.457745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:33.458577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:33.459351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:33.459824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:33.460464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:33.532511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:33.547435 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1d0358e-f18e-46ef-9394-5b6754e185ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1154 microversion: 2.1 time: 0.122376 Oct 19 07:25:33.552185 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2878/5606] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:33 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1154 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:33.640607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-79625810-29e1-4398-bbcb-53e14a910a8e req-d9e5eeb7-ee32-4e5b-9873-40e91f7550eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ce8986-edd4-41db-9563-43295fa53ed5", "name": "network-vif-deleted", "tag": "3f7d7899-7af4-4b68-b639-864415726d45"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:25:33.654008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-79625810-29e1-4398-bbcb-53e14a910a8e req-d9e5eeb7-ee32-4e5b-9873-40e91f7550eb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:33.654490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-79625810-29e1-4398-bbcb-53e14a910a8e req-d9e5eeb7-ee32-4e5b-9873-40e91f7550eb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:33.654919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-79625810-29e1-4398-bbcb-53e14a910a8e req-d9e5eeb7-ee32-4e5b-9873-40e91f7550eb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:33.668761 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-79625810-29e1-4398-bbcb-53e14a910a8e req-d9e5eeb7-ee32-4e5b-9873-40e91f7550eb service nova] Creating event network-vif-deleted:3f7d7899-7af4-4b68-b639-864415726d45 for instance e8ce8986-edd4-41db-9563-43295fa53ed5 on n-h2-861333-10 Oct 19 07:25:33.674551 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-79625810-29e1-4398-bbcb-53e14a910a8e req-d9e5eeb7-ee32-4e5b-9873-40e91f7550eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039180 Oct 19 07:25:33.675102 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2729/5607] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:25:33.683002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:33.683673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:33.691438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:33.692126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:33.692558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:33.693538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:33.694140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:33.694725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:33.762406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:33.771461 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0a00043-8782-4770-9557-4a13eb3c1003 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1470 microversion: 2.1 time: 0.092372 Oct 19 07:25:33.772217 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2879/5608] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:33 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:34.575905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:34.576750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:34.584070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:34.589768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:34.589768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:34.589768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:34.589768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:34.589768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:34.711373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:34.721388 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ce12a9a-d138-467f-b3cf-01a61b7dc0b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1172 microversion: 2.1 time: 0.150203 Oct 19 07:25:34.721986 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2730/5609] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:34 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1172 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:34.799574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:34.800422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:34.810455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:34.811741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:34.812574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:34.813642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:34.814741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:34.815407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:34.866813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:34.868210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:34.869422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:34.869886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lazy-loading 'fault' on Instance uuid e8ce8986-edd4-41db-9563-43295fa53ed5 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:25:34.933284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078c3a25bab4c64ac3cfa8a0d4d8eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ab18166a124250aa4c825aa9da17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:34.941256 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e753445-21fc-4666-a564-f7eedd3410a6 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 200 len: 1308 microversion: 2.1 time: 0.150783 Oct 19 07:25:34.954002 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2880/5610] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:34 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:35.752276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:35.753864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:35.760908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:35.761607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:35.762303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:35.763235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:35.763766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:35.764289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:35.939514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:35.948435 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61e0d3a4-7acb-4e33-b50c-c6ecf61f845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1214 microversion: 2.1 time: 0.201890 Oct 19 07:25:35.949032 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2731/5611] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:35 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:35.968814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:35.969593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] [instance: e8ce8986-edd4-41db-9563-43295fa53ed5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:35.976824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:35.977409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:35.977929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:35.978709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:35.979311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:35.979752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:35.997245 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] HTTP exception thrown: Instance e8ce8986-edd4-41db-9563-43295fa53ed5 could not be found. Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Request method failure captured: Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 HTTP/1.1 Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6UkmEUgOSrHbClkehX37n6cC3zWzjVa64FZTtQiQq-OruRtzO18ZnBv1u63Y4wGzZ2CwKWO1PhIsl_GiCN0OuZb5dhKzOEsF2-TQ5ctFndjNimxXQY5SdVKulHFfoLLTpRRYxVev7ArPwh6-o54SkAFboe_lGjLtM73RTApt7efqz8 Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 74ab18166a124250aa4c825aa9da17eb Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1164364686 Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/74ab18166a124250aa4c825aa9da17eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/74ab18166a124250aa4c825aa9da17eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/74ab18166a124250aa4c825aa9da17eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_74ab18166a124250aa4c825aa9da17eb", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesSnapshotTestJSON-1164364686 Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 74ab18166a124250aa4c825aa9da17eb Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1164364686 Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-VolumesSnapshotTestJSON-1164364686-project Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: b078c3a25bab4c64ac3cfa8a0d4d8eba Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesSnapshotTestJSON-1164364686-project Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance e8ce8986-edd4-41db-9563-43295fa53ed5 could not be found. Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'e8ce8986-edd4-41db-9563-43295fa53ed5'} Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ce8986-edd4-41db-9563-43295fa53ed5 could not be found. Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ce8986-edd4-41db-9563-43295fa53ed5 could not be found. Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:25:35.999162 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:36.003512 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:25:36.003512 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:25:36.003512 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:25:36.003512 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:25:36.003512 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:25:36.003512 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ce8986-edd4-41db-9563-43295fa53ed5 could not be found. Oct 19 07:25:36.003512 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:25:36.003512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] Returning 404 to user: Instance e8ce8986-edd4-41db-9563-43295fa53ed5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:25:36.003512 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21516c11-3961-46f8-bdc7-7e858fc20b16 tempest-VolumesSnapshotTestJSON-1164364686 tempest-VolumesSnapshotTestJSON-1164364686-project] 10.222.0.39 "GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5" status: 404 len: 111 microversion: 2.1 time: 0.037177 Oct 19 07:25:36.004489 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2881/5612] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:35 2022] GET /compute/v2.1/servers/e8ce8986-edd4-41db-9563-43295fa53ed5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:25:36.973190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:36.977808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:36.998054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:37.001065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:37.005150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:37.007002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:37.007954 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:37.009162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:37.037974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-45b20888-f239-46f3-adb5-2b76565c9ea3 req-34b5dcd9-83bc-4bd1-b301-d3047dc69d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "506770b1-d69d-4d45-b8f0-353026972237", "tag": "c36c9f06-35ed-4d8f-946d-925309f53338"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:25:37.059970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-45b20888-f239-46f3-adb5-2b76565c9ea3 req-34b5dcd9-83bc-4bd1-b301-d3047dc69d26 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:37.063292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-45b20888-f239-46f3-adb5-2b76565c9ea3 req-34b5dcd9-83bc-4bd1-b301-d3047dc69d26 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:37.064308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-45b20888-f239-46f3-adb5-2b76565c9ea3 req-34b5dcd9-83bc-4bd1-b301-d3047dc69d26 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:37.085647 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-45b20888-f239-46f3-adb5-2b76565c9ea3 req-34b5dcd9-83bc-4bd1-b301-d3047dc69d26 service nova] Creating event network-changed:c36c9f06-35ed-4d8f-946d-925309f53338 for instance 506770b1-d69d-4d45-b8f0-353026972237 on n-h1-861333-10 Oct 19 07:25:37.091931 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-45b20888-f239-46f3-adb5-2b76565c9ea3 req-34b5dcd9-83bc-4bd1-b301-d3047dc69d26 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057993 Oct 19 07:25:37.093031 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2882/5613] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:25:37.303323 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:37.318337 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9b64403-d3bc-4bba-b9e1-7f27bfbef6f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1214 microversion: 2.1 time: 0.350871 Oct 19 07:25:37.319580 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2732/5614] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:36 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1214 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:38.342118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:38.343369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:38.355268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:38.356435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:38.356986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:38.358183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:38.364435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:38.364959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:38.581533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:38.589574 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33ed97a6-00e6-41e3-a9cc-aa946560cf7d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1214 microversion: 2.1 time: 0.251914 Oct 19 07:25:38.595639 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2883/5615] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:38 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:39.613753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:39.615176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:39.641900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:39.642492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:39.642827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:39.643541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:39.643994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:39.644458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:39.804663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:39.818797 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1167c48a-ba28-4a27-9b02-7545bd8c8cc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1214 microversion: 2.1 time: 0.209366 Oct 19 07:25:39.829011 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2733/5616] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:39 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:40.844625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:40.847980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:40.852206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:40.852911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:40.859163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:40.859900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:40.860379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:40.861112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:40.864273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:40.864931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:41.046635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:41.055082 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15ef5e0a-8a64-4233-acbc-69022df965cf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1214 microversion: 2.1 time: 0.215001 Oct 19 07:25:41.055982 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2884/5617] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:40 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:42.082104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:42.082646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:42.091441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:42.095962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:42.095962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:42.095962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:42.095962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:42.095962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:42.275187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:42.285727 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46baedb6-46f7-4323-8bbd-4160e4c5a8df tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.207685 Oct 19 07:25:42.286864 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2734/5618] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:42 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:43.313249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:43.313861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:43.316610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:43.321638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:43.322130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:43.322570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:43.323372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:43.323847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:43.324336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:43.329005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=65 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:43.463337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:43.472378 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06cbf9e1-4481-4d33-928c-2226a8e646f0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.164016 Oct 19 07:25:43.473160 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2885/5619] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:43 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:44.495707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:44.496330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:44.503388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:44.503924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:44.507604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:44.507604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:44.507604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:44.507604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:44.641132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:44.649241 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-448d6282-4257-4441-8b38-8eaabfdae4ab tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.157508 Oct 19 07:25:44.649811 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2735/5620] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:44 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:45.673930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:45.674603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:45.683471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:45.683964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:45.684439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:45.685137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:45.685602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:45.686035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:45.824726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:45.832961 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0dec361-225b-4c3c-81a1-2b22c0331694 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.163779 Oct 19 07:25:45.833526 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2886/5621] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:45 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:46.856683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:46.857830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:46.864664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:46.865150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:46.865594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:46.866282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:46.866754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:46.867182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:47.010518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:47.018331 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d7d573b-7e2b-48fe-9fd2-611b71df16a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.165562 Oct 19 07:25:47.018912 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2736/5622] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:46 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:48.041788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:48.042299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:48.050527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:48.051014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:48.051458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:48.052177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:48.052642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:48.053075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:48.218295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:48.229015 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0744d36-3c15-4fd4-8580-cd0320697728 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.191196 Oct 19 07:25:48.229598 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2887/5623] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:48 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:49.252465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:49.253100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:49.260269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:49.262551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:49.262551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:49.262551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:49.262551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:49.262999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:49.419556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:49.428749 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8db1493-8434-4296-a70a-f2e01043a374 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.180419 Oct 19 07:25:49.429429 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2737/5624] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:49 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:50.451499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:50.453057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:50.463566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:50.467180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:50.469663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:50.470801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:50.471392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:50.473214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:50.622068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:50.630008 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-111d46ac-cc71-4863-a391-78293ae4501c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.182482 Oct 19 07:25:50.630581 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2888/5625] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:50 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:51.653940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:51.655479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:51.662814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:51.663318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:51.663779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:51.664508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:51.665394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:51.673657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:52.063786 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3fae9abc-1bc9-4b94-a8e5-e23635f9fbe7 req-0fec875b-b91c-4f52-9d7f-6caf596ccb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "506770b1-d69d-4d45-b8f0-353026972237", "name": "network-vif-plugged", "status": "completed", "tag": "c36c9f06-35ed-4d8f-946d-925309f53338"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:25:52.077437 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:25:52.077925 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:25:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 19 07:25:52.081951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3fae9abc-1bc9-4b94-a8e5-e23635f9fbe7 req-0fec875b-b91c-4f52-9d7f-6caf596ccb02 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:52.085360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3fae9abc-1bc9-4b94-a8e5-e23635f9fbe7 req-0fec875b-b91c-4f52-9d7f-6caf596ccb02 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:52.085360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3fae9abc-1bc9-4b94-a8e5-e23635f9fbe7 req-0fec875b-b91c-4f52-9d7f-6caf596ccb02 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:52.098976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:52.102795 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3fae9abc-1bc9-4b94-a8e5-e23635f9fbe7 req-0fec875b-b91c-4f52-9d7f-6caf596ccb02 service nova] Creating event network-vif-plugged:c36c9f06-35ed-4d8f-946d-925309f53338 for instance 506770b1-d69d-4d45-b8f0-353026972237 on n-h1-861333-10 Oct 19 07:25:52.103030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:52.108910 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85847b76-8aa0-4a84-964b-94c0204180d0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.460194 Oct 19 07:25:52.109589 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3fae9abc-1bc9-4b94-a8e5-e23635f9fbe7 req-0fec875b-b91c-4f52-9d7f-6caf596ccb02 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050147 Oct 19 07:25:52.114375 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2889/5626] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:25:52.124721 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2738/5627] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:51 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:53.134519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:53.135230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:53.142713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:53.143260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:53.143665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:53.144399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:53.144867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:53.151003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:53.292517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:53.300868 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3e54b11-c6c1-4ac1-805e-5af2a632f393 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1202 microversion: 2.1 time: 0.171543 Oct 19 07:25:53.301668 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2890/5628] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:53 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1202 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:54.323651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:54.324287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:54.327217 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:25:54.327344 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:25:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 (ip 10.222.0.39) !!! Oct 19 07:25:54.336362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:54.336857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:54.337350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:54.338060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:54.338522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:54.339000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:54.478358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:54.488685 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4392120-ba46-41b4-8a47-eccf577439ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1388 microversion: 2.1 time: 0.169051 Oct 19 07:25:54.489285 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2739/5629] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:54 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1388 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:54.511382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:54.517654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:54.518860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:54.519461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:54.519976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:54.520825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:54.521417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:54.521926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:54.670751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:54.679158 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f278256d-6f46-4bc7-83cc-6c3c635b239e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1388 microversion: 2.1 time: 0.172202 Oct 19 07:25:54.679682 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2891/5630] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:54 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1388 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:54.700616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:54.701215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:54.707513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:25:54.709263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:54.709906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:54.711143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:54.712247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:54.712867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:54.713443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:54.863692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:54.871825 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5331f15b-dd4c-4f85-b4c0-237b5e0bd33f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1388 microversion: 2.1 time: 0.174981 Oct 19 07:25:54.872468 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2740/5631] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:54 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1388 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:54.894930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:54.895433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:54.901560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:54.904385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:54.904385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:54.904385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:54.904385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:54.904708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:54.933075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:25:55.362224 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f23193b5-023a-4c08-9b22-5cb36303fce9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 204 len: 0 microversion: 2.1 time: 0.470930 Oct 19 07:25:55.363018 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2892/5632] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:25:54 2022] DELETE /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:25:55.372881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:55.374082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:55.380907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:55.381469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:55.381981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:55.382812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:55.383335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:55.383987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:55.523117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:55.531054 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-819707a8-74f6-472c-b038-005e51ac57dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1394 microversion: 2.1 time: 0.162827 Oct 19 07:25:55.531616 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2741/5633] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:55 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1394 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:56.555525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:56.556290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:56.563474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:56.564230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:56.564882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:56.565783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:56.566248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:56.566682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:56.907120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:56.916166 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85b37476-a02f-4345-a87f-5bd9268807d5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1394 microversion: 2.1 time: 0.364893 Oct 19 07:25:56.917499 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2893/5634] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:56 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1394 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:57.661128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0f246488-1891-4560-b1a0-317f2dcf5ee1 req-84e8367c-178a-4ee7-9569-98a227c924cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "506770b1-d69d-4d45-b8f0-353026972237", "name": "network-vif-deleted", "tag": "c36c9f06-35ed-4d8f-946d-925309f53338"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:25:57.673576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0f246488-1891-4560-b1a0-317f2dcf5ee1 req-84e8367c-178a-4ee7-9569-98a227c924cf service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:57.674075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0f246488-1891-4560-b1a0-317f2dcf5ee1 req-84e8367c-178a-4ee7-9569-98a227c924cf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:57.674557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0f246488-1891-4560-b1a0-317f2dcf5ee1 req-84e8367c-178a-4ee7-9569-98a227c924cf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:57.692331 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0f246488-1891-4560-b1a0-317f2dcf5ee1 req-84e8367c-178a-4ee7-9569-98a227c924cf service nova] Creating event network-vif-deleted:c36c9f06-35ed-4d8f-946d-925309f53338 for instance 506770b1-d69d-4d45-b8f0-353026972237 on n-h1-861333-10 Oct 19 07:25:57.697887 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0f246488-1891-4560-b1a0-317f2dcf5ee1 req-84e8367c-178a-4ee7-9569-98a227c924cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046354 Oct 19 07:25:57.699013 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2742/5635] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:25:57.945648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:57.945648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:57.963503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:57.964256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:57.964965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:57.966084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:57.967485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:57.968093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:58.089543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:58.103983 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8490079-d9d6-497b-bb2f-0829e748957c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1187 microversion: 2.1 time: 0.164013 Oct 19 07:25:58.105267 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2894/5636] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:57 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1187 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:25:59.129672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:25:59.130386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:25:59.137079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:59.137749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:59.138919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:59.139802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:25:59.140521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:25:59.141197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:25:59.314898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:25:59.332359 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db538900-3042-45d6-bdc8-7f11d0acef90 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1187 microversion: 2.1 time: 0.207832 Oct 19 07:25:59.333247 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2743/5637] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:25:59 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1187 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:26:00.360825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:00.362026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:00.368486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:00.369158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:00.373657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:00.373657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:00.373657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:00.373657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:00.458243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:00.469719 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d78223ea-f675-4d48-8b3d-f0c60c98e712 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1187 microversion: 2.1 time: 0.112932 Oct 19 07:26:00.471097 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2895/5638] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:26:00 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:26:01.493245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:01.494424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:01.509879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:01.511674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:01.512223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:01.513961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:01.515889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:01.516374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:01.617747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:01.638677 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3671ef11-0483-415e-a009-2e8d5e3881af tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1187 microversion: 2.1 time: 0.138258 Oct 19 07:26:01.638677 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2744/5639] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:26:01 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1187 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:26:02.654357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:02.655190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:02.670501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:02.671151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:02.671586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:02.672331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:02.674508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:02.675005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:02.817693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:02.832953 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a401eb6-6ab5-4650-9872-3b66891b59cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1187 microversion: 2.1 time: 0.182726 Oct 19 07:26:02.835435 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2896/5640] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:26:02 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1187 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:26:03.876907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:03.879179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:03.890632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:03.892240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:03.896924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:03.896924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:03.896924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:03.896924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:03.945681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:03.946253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:03.946936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:03.947687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lazy-loading 'fault' on Instance uuid 506770b1-d69d-4d45-b8f0-353026972237 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:26:03.999023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:04.008696 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a0e4d89-b58f-41e5-90e1-e9b22b8c7e1e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 200 len: 1192 microversion: 2.1 time: 0.137738 Oct 19 07:26:04.016903 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2745/5641] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:26:03 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 1192 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:26:05.041360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:05.042487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 506770b1-d69d-4d45-b8f0-353026972237] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:05.050176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:05.050899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:05.051343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:05.052088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:05.052608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:05.053039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:05.071508 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance 506770b1-d69d-4d45-b8f0-353026972237 could not be found. Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 HTTP/1.1 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 506770b1-d69d-4d45-b8f0-353026972237 could not be found. Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '506770b1-d69d-4d45-b8f0-353026972237'} Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 506770b1-d69d-4d45-b8f0-353026972237 could not be found. Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 506770b1-d69d-4d45-b8f0-353026972237 could not be found. Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:26:05.073096 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 506770b1-d69d-4d45-b8f0-353026972237 could not be found. Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance 506770b1-d69d-4d45-b8f0-353026972237 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9ed82c2-d2cd-4558-bbfc-5c76ecc151b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237" status: 404 len: 111 microversion: 2.1 time: 0.037580 Oct 19 07:26:05.078344 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2897/5642] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:26:05 2022] GET /compute/v2.1/servers/506770b1-d69d-4d45-b8f0-353026972237 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:26:27.551799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=13 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:26:27.554322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=40 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:26:27.750103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:27.750849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:27.760139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:27.761011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:27.761685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:27.762644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:27.763543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:27.764618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:27.809902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:26:28.159793 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f353cdd1-bf76-4a1c-82ac-db49e4ab1573 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 204 len: 0 microversion: 2.42 time: 0.621597 Oct 19 07:26:28.160899 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2746/5643] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:26:27 2022] DELETE /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 07:26:28.174614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:28.174614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:28.176435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:26:28.177276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:26:28.178886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:28.179619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:28.180325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:28.182600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:28.183283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:28.185238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:28.491652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:28.502410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:28.503875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:28.506040 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1eee20e-a068-4ada-a486-4daca5d89d76 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2954 microversion: 2.42 time: 0.340149 Oct 19 07:26:28.507834 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2898/5644] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:28 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2954 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:29.535356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:29.536221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:29.565461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:29.565461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:29.565461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:29.565461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:29.565461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:29.565461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:29.757839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:29.770677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:29.772340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:29.773807 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b70ad4c4-889b-4045-9fdc-7fbc782408c8 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2954 microversion: 2.42 time: 0.242795 Oct 19 07:26:29.775343 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2747/5645] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:29 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2954 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:30.809764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:30.811066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:30.820906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:30.822571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:30.823759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:30.824768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:30.825908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:30.826548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:31.091036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:31.103500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:31.105849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:31.107859 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9485fc10-bfd9-4f8d-bb79-a51d3d1b69ba tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2954 microversion: 2.42 time: 0.308746 Oct 19 07:26:31.108948 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2899/5646] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:30 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2954 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:32.139557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:32.140442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:32.153817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:32.155680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:32.157251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:32.159406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:32.160189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:32.161104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:32.503533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:32.520456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:32.522006 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:32.523382 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d859095-9e2b-47f2-a6ea-3dc020bdeb7a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2954 microversion: 2.42 time: 0.387722 Oct 19 07:26:32.523977 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2748/5647] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:32 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2954 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:33.552959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:33.553514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:33.560964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:33.561453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:33.561900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:33.562630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:33.563091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:33.563524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:33.747575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:33.757260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:33.758952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:33.760340 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35427dea-3981-49e1-bb39-d9f9f4db7ef4 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2933 microversion: 2.42 time: 0.211491 Oct 19 07:26:33.760896 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2900/5648] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:33 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2933 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:34.136525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d5ed7171-7bc7-45d5-a648-fda0449b41b2 req-762cc327-8dcf-4293-91d0-fa5955809280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-unplugged", "status": "completed", "tag": "5202bbc9-e19e-45f0-a8b9-469ff0364621"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:26:34.152719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d5ed7171-7bc7-45d5-a648-fda0449b41b2 req-762cc327-8dcf-4293-91d0-fa5955809280 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:34.154916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d5ed7171-7bc7-45d5-a648-fda0449b41b2 req-762cc327-8dcf-4293-91d0-fa5955809280 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:34.155447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d5ed7171-7bc7-45d5-a648-fda0449b41b2 req-762cc327-8dcf-4293-91d0-fa5955809280 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:34.185314 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d5ed7171-7bc7-45d5-a648-fda0449b41b2 req-762cc327-8dcf-4293-91d0-fa5955809280 service nova] Creating event network-vif-unplugged:5202bbc9-e19e-45f0-a8b9-469ff0364621 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:26:34.191217 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d5ed7171-7bc7-45d5-a648-fda0449b41b2 req-762cc327-8dcf-4293-91d0-fa5955809280 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061798 Oct 19 07:26:34.192073 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2749/5649] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:26:34.791350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:34.793568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:34.807039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:34.807930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:34.812084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:34.813335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:34.814015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:34.814677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:35.259374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:35.275911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:35.277773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:35.291241 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d57b7cf-da82-45b2-8b9a-55e6b373dd8a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2912 microversion: 2.42 time: 0.504181 Oct 19 07:26:35.292519 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2901/5650] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:34 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2912 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:35.694315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-93a7298f-dc2f-4d33-b945-41f0706dc872 req-391aea45-25f7-4e15-9152-4612f2f70c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-deleted", "tag": "9c8c3454-2335-450b-a2b0-10fd7456c950"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:26:35.732531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93a7298f-dc2f-4d33-b945-41f0706dc872 req-391aea45-25f7-4e15-9152-4612f2f70c99 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:35.738118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93a7298f-dc2f-4d33-b945-41f0706dc872 req-391aea45-25f7-4e15-9152-4612f2f70c99 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:35.738118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93a7298f-dc2f-4d33-b945-41f0706dc872 req-391aea45-25f7-4e15-9152-4612f2f70c99 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:35.775206 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-93a7298f-dc2f-4d33-b945-41f0706dc872 req-391aea45-25f7-4e15-9152-4612f2f70c99 service nova] Creating event network-vif-deleted:9c8c3454-2335-450b-a2b0-10fd7456c950 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:26:35.797977 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-93a7298f-dc2f-4d33-b945-41f0706dc872 req-391aea45-25f7-4e15-9152-4612f2f70c99 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109308 Oct 19 07:26:35.803887 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2750/5651] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:26:36.235149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b35c4697-f7eb-49e1-8f04-494a9baf84cd req-72dbda41-1e2d-4663-a5b1-fef91ef1fe4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-unplugged", "status": "completed", "tag": "a8be6485-4230-4fe4-909f-46e5df66a747"}, {"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-unplugged", "status": "completed", "tag": "8d53d8ed-0dc4-4c8e-9b38-4944c5be68ab"}, {"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-unplugged", "status": "completed", "tag": "4f64379c-bc44-4c4c-aff7-85eb2d62bef5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:26:36.265927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b35c4697-f7eb-49e1-8f04-494a9baf84cd req-72dbda41-1e2d-4663-a5b1-fef91ef1fe4e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:36.268053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b35c4697-f7eb-49e1-8f04-494a9baf84cd req-72dbda41-1e2d-4663-a5b1-fef91ef1fe4e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:36.271971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b35c4697-f7eb-49e1-8f04-494a9baf84cd req-72dbda41-1e2d-4663-a5b1-fef91ef1fe4e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:36.323514 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b35c4697-f7eb-49e1-8f04-494a9baf84cd req-72dbda41-1e2d-4663-a5b1-fef91ef1fe4e service nova] Creating event network-vif-unplugged:a8be6485-4230-4fe4-909f-46e5df66a747 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:26:36.324036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:36.324823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:36.325462 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b35c4697-f7eb-49e1-8f04-494a9baf84cd req-72dbda41-1e2d-4663-a5b1-fef91ef1fe4e service nova] Creating event network-vif-unplugged:8d53d8ed-0dc4-4c8e-9b38-4944c5be68ab for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:26:36.326096 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b35c4697-f7eb-49e1-8f04-494a9baf84cd req-72dbda41-1e2d-4663-a5b1-fef91ef1fe4e service nova] Creating event network-vif-unplugged:4f64379c-bc44-4c4c-aff7-85eb2d62bef5 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:26:36.334049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:36.340320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:36.340862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:36.341713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:36.343170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:36.343170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:36.350024 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b35c4697-f7eb-49e1-8f04-494a9baf84cd req-72dbda41-1e2d-4663-a5b1-fef91ef1fe4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.119052 Oct 19 07:26:36.353574 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2902/5652] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:26:37.025568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:37.050276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:37.054518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:37.058122 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00c0b296-d4de-4383-bb44-e23fec37336c tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2574 microversion: 2.42 time: 0.738901 Oct 19 07:26:37.060938 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2751/5653] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:36 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2574 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:37.844799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-fe8ed4e0-ea00-43df-bd56-c62e9b2229a0 req-8e17f743-bed2-4f01-b230-337744c7c575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-deleted", "tag": "a8be6485-4230-4fe4-909f-46e5df66a747"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:26:37.861519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fe8ed4e0-ea00-43df-bd56-c62e9b2229a0 req-8e17f743-bed2-4f01-b230-337744c7c575 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:37.862389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fe8ed4e0-ea00-43df-bd56-c62e9b2229a0 req-8e17f743-bed2-4f01-b230-337744c7c575 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:37.863511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fe8ed4e0-ea00-43df-bd56-c62e9b2229a0 req-8e17f743-bed2-4f01-b230-337744c7c575 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:37.884780 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-fe8ed4e0-ea00-43df-bd56-c62e9b2229a0 req-8e17f743-bed2-4f01-b230-337744c7c575 service nova] Creating event network-vif-deleted:a8be6485-4230-4fe4-909f-46e5df66a747 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:26:37.891556 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-fe8ed4e0-ea00-43df-bd56-c62e9b2229a0 req-8e17f743-bed2-4f01-b230-337744c7c575 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052630 Oct 19 07:26:37.893024 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2903/5654] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:26:38.093915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:38.094680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:38.108365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:38.109713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:38.110162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:38.110924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:38.111349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:38.116667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:38.680561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:38.702795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:38.708091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:38.709879 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-caeb9632-075d-47de-be73-c7ad062553d0 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2368 microversion: 2.42 time: 0.619924 Oct 19 07:26:38.710602 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2752/5655] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:38 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2368 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:39.740994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:39.741661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:39.756415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:39.757486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:39.760240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:39.761109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:39.761714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:39.764430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:40.126451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-407baed4-314a-4a37-964c-80f0eaffb41f req-1e55ccc7-10d6-41c7-a70f-b264cbe614b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-deleted", "tag": "4f64379c-bc44-4c4c-aff7-85eb2d62bef5"}, {"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-deleted", "tag": "5202bbc9-e19e-45f0-a8b9-469ff0364621"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:26:40.167977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-407baed4-314a-4a37-964c-80f0eaffb41f req-1e55ccc7-10d6-41c7-a70f-b264cbe614b0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:40.168528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-407baed4-314a-4a37-964c-80f0eaffb41f req-1e55ccc7-10d6-41c7-a70f-b264cbe614b0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:40.169154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-407baed4-314a-4a37-964c-80f0eaffb41f req-1e55ccc7-10d6-41c7-a70f-b264cbe614b0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:40.220728 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-407baed4-314a-4a37-964c-80f0eaffb41f req-1e55ccc7-10d6-41c7-a70f-b264cbe614b0 service nova] Creating event network-vif-deleted:4f64379c-bc44-4c4c-aff7-85eb2d62bef5 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:26:40.221442 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-407baed4-314a-4a37-964c-80f0eaffb41f req-1e55ccc7-10d6-41c7-a70f-b264cbe614b0 service nova] Creating event network-vif-deleted:5202bbc9-e19e-45f0-a8b9-469ff0364621 for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:26:40.232718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:40.237498 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-407baed4-314a-4a37-964c-80f0eaffb41f req-1e55ccc7-10d6-41c7-a70f-b264cbe614b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.297156 Oct 19 07:26:40.238610 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2753/5656] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:26:40.252439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:40.261373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:40.263042 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05a9bcfc-0aed-4f78-b44b-7c1c99a037ea tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 2322 microversion: 2.42 time: 0.528640 Oct 19 07:26:40.264271 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2904/5657] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:39 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 2322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:41.295409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:41.296221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:41.311460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:41.314093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:41.314734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:41.316725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:41.317357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:41.327084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:41.502532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:41.514337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:41.520626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:41.530465 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71fa5bc6-1cce-4736-9684-811ee9c39d92 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.239393 Oct 19 07:26:41.531630 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2754/5658] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:41 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:42.290742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-56de6723-c93d-4196-8b97-c2cafbb3d10c req-7c26839a-b07c-457a-b981-8f2e5e2209e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bac43-04da-4e44-b1cc-8ef0a0865f08", "name": "network-vif-deleted", "tag": "8d53d8ed-0dc4-4c8e-9b38-4944c5be68ab"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:26:42.302693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-56de6723-c93d-4196-8b97-c2cafbb3d10c req-7c26839a-b07c-457a-b981-8f2e5e2209e8 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:42.303183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-56de6723-c93d-4196-8b97-c2cafbb3d10c req-7c26839a-b07c-457a-b981-8f2e5e2209e8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:42.303645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-56de6723-c93d-4196-8b97-c2cafbb3d10c req-7c26839a-b07c-457a-b981-8f2e5e2209e8 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:42.315418 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-56de6723-c93d-4196-8b97-c2cafbb3d10c req-7c26839a-b07c-457a-b981-8f2e5e2209e8 service nova] Creating event network-vif-deleted:8d53d8ed-0dc4-4c8e-9b38-4944c5be68ab for instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 on n-h1-861333-10 Oct 19 07:26:42.321539 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-56de6723-c93d-4196-8b97-c2cafbb3d10c req-7c26839a-b07c-457a-b981-8f2e5e2209e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036196 Oct 19 07:26:42.322157 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2905/5659] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:26:42.563306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:42.564083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:42.572287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:42.572942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:42.573448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:42.574286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:42.574795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:42.575230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:42.655174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:42.666213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:42.667716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:42.669071 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23383a82-fdba-485a-8f72-94d6f5bdbcbd tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.109883 Oct 19 07:26:42.669754 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2755/5660] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:42 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:43.708649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:43.709431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:43.716052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:43.716585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:43.717023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:43.717729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:43.718181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:43.718613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:43.789069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:43.798447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:43.800430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:43.801622 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ccdd6a34-14db-4586-b045-cb2c55a6e34a tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.098343 Oct 19 07:26:43.802291 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2906/5661] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:43 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 07:26:44.829786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:44.830948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:44.842330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:44.842825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:44.843270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:44.843984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:44.844471 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:44.844909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:44.973230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:44.997240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:44.998729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:44.999937 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dafea8c6-95e9-452e-9a4b-5c3140191225 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.174825 Oct 19 07:26:45.000530 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2756/5662] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:44 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:46.035591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:46.044019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:46.055273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:46.055896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:46.056664 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:46.067747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:46.072412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:46.073269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:46.155889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:46.167998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:46.169676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:46.171957 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20e6531b-a0d1-4d62-b3e2-455f03f994b5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.146013 Oct 19 07:26:46.172816 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2907/5663] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:46 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:47.199869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:47.200979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:47.208547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:47.209039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:47.209475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:47.210191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:47.210644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:47.211112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:47.278489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:47.289285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:47.291000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:47.292272 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dee97285-1ee2-4009-a80b-e8d5e7ac75f7 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.096582 Oct 19 07:26:47.292843 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2757/5664] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:47 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:48.319924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:48.320772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:48.328608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:48.328862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:48.329218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:48.329978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:48.330663 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:48.331024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:48.398728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:48.408673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:48.410210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:48.411441 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4985d5c4-cce2-4208-80ab-a8eaa90e64c5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.096116 Oct 19 07:26:48.412012 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2908/5665] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:48 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:49.438176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:49.438837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:49.447187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:49.447762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:49.448316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:49.449187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:49.451094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:49.451550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:49.530354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:49.541427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:49.542998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:49.544303 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f593ab35-10c8-4253-8a9c-4b34b0929472 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.110366 Oct 19 07:26:49.544867 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2758/5666] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:49 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:50.572525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:50.573490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:50.590584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:50.591280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:50.591732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:50.592638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:50.593301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:50.593740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:50.672907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:50.683783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:50.685647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:50.687062 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-770a60f2-1192-474a-8167-444c2e1d69d5 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.119563 Oct 19 07:26:50.688138 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2909/5667] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:50 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:51.717276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:51.718648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:51.726486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:51.727298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:51.727989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:51.728974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:51.729651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:51.730281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:51.799853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:51.809841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:51.811621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:51.813061 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c16b1242-ee17-4bc9-bacf-158d655d7a69 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.099811 Oct 19 07:26:51.815212 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2759/5668] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:51 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:52.839688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:52.840524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:52.847884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:52.848449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:52.848942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:52.850396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:52.851698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:52.852164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:52.920008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:52.931083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:52.933365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:52.935270 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2a51be7-9341-4af7-831f-378ff1d12ace tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.099423 Oct 19 07:26:52.936609 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2910/5669] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:52 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:53.962298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:53.963692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:53.981022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:53.986207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:53.986207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:53.986207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:53.986207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:53.986207 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:54.057777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:54.068474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:54.080534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:54.080534 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-80cc489b-78a7-4f22-936a-9f4093ba520e tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.113254 Oct 19 07:26:54.080534 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2760/5670] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:53 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:55.103477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:55.104237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:55.121137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:55.123655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:55.124790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:55.126020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:55.126755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:55.127403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:55.205069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:55.224219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:55.225763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:55.227007 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff244171-be78-4060-ae08-9219b072df40 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1603 microversion: 2.42 time: 0.133301 Oct 19 07:26:55.228671 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2911/5671] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:55 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1603 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:56.255018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:56.255648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:56.263419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:56.268319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:56.268319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:56.268319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:56.268319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:56.268319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:56.321545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:56.324900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:56.325566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:56.326050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lazy-loading 'fault' on Instance uuid d91bac43-04da-4e44-b1cc-8ef0a0865f08 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:26:56.408062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:56.422241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:56.423932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '540c85c9ed04491091363288c0b2a885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea428bd904c549a9b2f876110a1f10c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:26:56.425357 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a933e98-17b3-46cd-b44a-0bf7cf2fdc34 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 200 len: 1608 microversion: 2.42 time: 0.174276 Oct 19 07:26:56.435168 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2761/5672] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:56 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 1608 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 07:26:57.452445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:57.453208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:26:57.460501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:57.461085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:57.461696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:57.462488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:26:57.463125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:26:57.463630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:26:57.483308 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] HTTP exception thrown: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Request method failure captured: Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 HTTP/1.1 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6UD5ukjkUFSmHyoiRFUv8NGHhsga3qovJq3wBEnb2yJHmq8vay9wathVXxl5qtLD_Diyy0Qm9Wuc0Rd-LpeTL9xII6In_-wT6Pd-xdsUFJxJUdYxMkvIxatYMRcQA_jNWDKrijFLs5hEeYPN2QFeZQ_j4OWmaJxEDNQJv9bcxL4phs Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.42 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: ea428bd904c549a9b2f876110a1f10c4 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1799921728 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ea428bd904c549a9b2f876110a1f10c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea428bd904c549a9b2f876110a1f10c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea428bd904c549a9b2f876110a1f10c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ea428bd904c549a9b2f876110a1f10c4", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1799921728 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: ea428bd904c549a9b2f876110a1f10c4 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1799921728 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TaggedBootDevicesTest_v242-1799921728-project Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 540c85c9ed04491091363288c0b2a885 Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1799921728-project Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'd91bac43-04da-4e44-b1cc-8ef0a0865f08'} Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:57.485323 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Returning 404 to user: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:26:57.490139 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e29cdce-0cbe-40d0-ba0f-3682f64f42be tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 404 len: 111 microversion: 2.42 time: 0.038680 Oct 19 07:26:57.494056 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2912/5673] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:26:57 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:26:57.495901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68b3a8ea-767c-4bfd-95f1-ac6cd47b8425 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '.version_select at 0x7f6d5f981ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:26:57.616082 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68b3a8ea-767c-4bfd-95f1-ac6cd47b8425 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-752204103" status: 204 len: 0 microversion: 2.42 time: 0.123433 Oct 19 07:26:57.620256 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2762/5674] 10.222.0.39 () {60 vars in 1259 bytes} [Wed Oct 19 07:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-752204103 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 07:27:00.545125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2062162702", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3cad343e-876b-4011-a1c1-23c58807dc6e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "cedc1025-55fd-4295-a2cd-69fd264b4466"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:00.572579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=31 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:00.657874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] validate_networks() for [('cedc1025-55fd-4295-a2cd-69fd264b4466', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:27:01.648581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:27:01.649188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:27:01.649974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:27:01.650678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:27:01.651358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:27:01.663806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:01.664564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:01.665146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:01.665991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:01.666575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:01.667109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:01.674390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=75 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:01.685236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:27:01.690644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for user 221b692fdbb3495aa63a686796b02ea8 and project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:27:01.703807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:27:01.705991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3cad343e-876b-4011-a1c1-23c58807dc6e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:27:01.899932 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-029c745b-9134-4717-87ec-409f55566b1a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358686 Oct 19 07:27:01.900842 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2913/5675] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:27:01.912945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4dd6cb75-94d1-4509-9e67-2b7add09ed82 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:01.913557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4dd6cb75-94d1-4509-9e67-2b7add09ed82 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:01.920071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:02.008498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4dd6cb75-94d1-4509-9e67-2b7add09ed82 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:02.018221 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4dd6cb75-94d1-4509-9e67-2b7add09ed82 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1057 microversion: 2.1 time: 0.109758 Oct 19 07:27:02.030785 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2763/5676] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:01 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1057 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:02.325967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:02.326440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:02.338019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:02.338518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:02.338961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:02.339734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:02.340221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:02.346009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:02.360243 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] HTTP exception thrown: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Request method failure captured: Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 HTTP/1.1 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6UD5ukjkUFSmHyoiRFUv8NGHhsga3qovJq3wBEnb2yJHmq8vay9wathVXxl5qtLD_Diyy0Qm9Wuc0Rd-LpeTL9xII6In_-wT6Pd-xdsUFJxJUdYxMkvIxatYMRcQA_jNWDKrijFLs5hEeYPN2QFeZQ_j4OWmaJxEDNQJv9bcxL4phs Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.42 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: ea428bd904c549a9b2f876110a1f10c4 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1799921728 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ea428bd904c549a9b2f876110a1f10c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea428bd904c549a9b2f876110a1f10c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea428bd904c549a9b2f876110a1f10c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ea428bd904c549a9b2f876110a1f10c4", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1799921728 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: ea428bd904c549a9b2f876110a1f10c4 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1799921728 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TaggedBootDevicesTest_v242-1799921728-project Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 540c85c9ed04491091363288c0b2a885 Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1799921728-project Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'd91bac43-04da-4e44-b1cc-8ef0a0865f08'} Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:27:02.361871 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Returning 404 to user: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8eb8ecd4-b76b-4fb6-86f4-272883713510 tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 404 len: 111 microversion: 2.42 time: 0.041464 Oct 19 07:27:02.371140 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2914/5677] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 07:27:02 2022] DELETE /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:27:02.372926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:02.373527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] [instance: d91bac43-04da-4e44-b1cc-8ef0a0865f08] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:02.379990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:02.380542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:02.381172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:02.381894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:02.382355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:02.382783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:02.385844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:02.399233 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] HTTP exception thrown: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Request method failure captured: Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 HTTP/1.1 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6UD5ukjkUFSmHyoiRFUv8NGHhsga3qovJq3wBEnb2yJHmq8vay9wathVXxl5qtLD_Diyy0Qm9Wuc0Rd-LpeTL9xII6In_-wT6Pd-xdsUFJxJUdYxMkvIxatYMRcQA_jNWDKrijFLs5hEeYPN2QFeZQ_j4OWmaJxEDNQJv9bcxL4phs Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.42 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: ea428bd904c549a9b2f876110a1f10c4 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1799921728 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ea428bd904c549a9b2f876110a1f10c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea428bd904c549a9b2f876110a1f10c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea428bd904c549a9b2f876110a1f10c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ea428bd904c549a9b2f876110a1f10c4", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1799921728 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: ea428bd904c549a9b2f876110a1f10c4 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1799921728 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TaggedBootDevicesTest_v242-1799921728-project Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 540c85c9ed04491091363288c0b2a885 Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1799921728-project Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'd91bac43-04da-4e44-b1cc-8ef0a0865f08'} Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.401011 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] Returning 404 to user: Instance d91bac43-04da-4e44-b1cc-8ef0a0865f08 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-834168d9-4b64-4fc3-9a77-85681bdffbda tempest-TaggedBootDevicesTest_v242-1799921728 tempest-TaggedBootDevicesTest_v242-1799921728-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08" status: 404 len: 111 microversion: 2.42 time: 0.033534 Oct 19 07:27:02.404910 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2764/5678] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 07:27:02 2022] GET /compute/v2.1/servers/d91bac43-04da-4e44-b1cc-8ef0a0865f08 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:27:03.043490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:03.044122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:03.051306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:03.051870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:03.052410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:03.053236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:03.053805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:03.054342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:03.122575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:03.130871 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97231bf1-638b-4d0e-95ea-c005d87faec8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1061 microversion: 2.1 time: 0.091446 Oct 19 07:27:03.131440 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2915/5679] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:03 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1061 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:04.155046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:04.155654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:04.164800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:04.165733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:04.166187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:04.166897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:04.167386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:04.167818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:04.254711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:04.263021 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6cc0a578-042a-4cb1-8b12-64a9e998e409 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1109 microversion: 2.1 time: 0.111742 Oct 19 07:27:04.264327 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2765/5680] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:04 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1109 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:05.288817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:05.289935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:05.297468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:05.298308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:05.298392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:05.299107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:05.299565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:05.300001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:05.461696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:05.481138 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31f291e9-63ec-4f40-9ac8-df1d190bd7c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.197309 Oct 19 07:27:05.482040 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2916/5681] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:05 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:06.462817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-25d748b6-bb3e-4fe4-8c5c-73b5eed38665 req-f6210625-f65d-4b5a-ad7c-9b411fb79f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd658359-f981-438d-a548-68f0f3778ae5", "tag": "d28ef1ca-3f05-4977-ace8-f405165c3c93"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:06.486103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-25d748b6-bb3e-4fe4-8c5c-73b5eed38665 req-f6210625-f65d-4b5a-ad7c-9b411fb79f65 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:06.486614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-25d748b6-bb3e-4fe4-8c5c-73b5eed38665 req-f6210625-f65d-4b5a-ad7c-9b411fb79f65 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:06.487045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-25d748b6-bb3e-4fe4-8c5c-73b5eed38665 req-f6210625-f65d-4b5a-ad7c-9b411fb79f65 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:06.505490 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-25d748b6-bb3e-4fe4-8c5c-73b5eed38665 req-f6210625-f65d-4b5a-ad7c-9b411fb79f65 service nova] Creating event network-changed:d28ef1ca-3f05-4977-ace8-f405165c3c93 for instance bd658359-f981-438d-a548-68f0f3778ae5 on n-h2-861333-10 Oct 19 07:27:06.506823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:06.507430 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:06.513276 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-25d748b6-bb3e-4fe4-8c5c-73b5eed38665 req-f6210625-f65d-4b5a-ad7c-9b411fb79f65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056572 Oct 19 07:27:06.514395 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2766/5682] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:27:06.523045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:06.523543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:06.523996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:06.524748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:06.525188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:06.525614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:06.690828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:06.699590 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c8d936c8-782d-4a49-9c0a-c487e15e83a0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.196603 Oct 19 07:27:06.712736 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2917/5683] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:06 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:07.726630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:07.728700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:07.736547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:07.737822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:07.738450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:07.739345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:07.739969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:07.740621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:08.037003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:08.051744 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29208f51-9f70-4608-a95e-32836cff1311 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.331126 Oct 19 07:27:08.052390 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2767/5684] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:07 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:09.075630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:09.077534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:09.085576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:09.086361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:09.087622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:09.088640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:09.089344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:09.090133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:09.262295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:09.272162 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e63d50e7-23a3-4cfc-a4aa-e01dfb78eb2a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.200694 Oct 19 07:27:09.287824 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2918/5685] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:09 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:10.301528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:10.301528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:10.303657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:10.304481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:10.304970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:10.305623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:10.306088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:10.306518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:10.462880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:10.473511 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fce237f-1f56-407a-9701-66c62cf812c5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.182563 Oct 19 07:27:10.484573 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2768/5686] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:10 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:11.501604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:11.502465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:11.510153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:11.510771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:11.511424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:11.512425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:11.513068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:11.513564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:11.671965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:11.679679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:11.685681 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48cfe31e-e598-44df-b2ed-514a19f0efe8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.188982 Oct 19 07:27:11.686360 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2919/5687] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:11 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:12.708742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:12.709361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:12.712690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:12.717970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:12.718909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:12.724633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:12.724633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:12.724633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:12.724633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:12.876470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:12.885337 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5391aa5e-1d91-4143-960b-a1e4cc3bf6d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.180565 Oct 19 07:27:12.886000 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2769/5688] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:12 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:13.911464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:13.912088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:13.914373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:13.920415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:13.920946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:13.921961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:13.922102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:13.922753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:13.923348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:14.092685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:14.102011 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3bdb0c95-029d-465f-a96d-9ef23974c222 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.194879 Oct 19 07:27:14.102605 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2920/5689] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:13 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:15.125162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:15.126005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:15.133908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:15.134424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:15.134875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:15.135593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:15.136090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:15.136680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:15.309963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:15.320136 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c7134561-5738-4272-8850-a5ec19a9381b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.199291 Oct 19 07:27:15.321185 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2770/5690] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:15 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:16.353435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:16.354060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:16.371673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:16.372518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:16.373325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:16.374237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:16.374881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:16.375489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:16.557244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:16.568507 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f148759-0750-441c-accf-5210134f2ddc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.227159 Oct 19 07:27:16.569412 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2921/5691] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:16 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:17.594841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:17.603481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:17.623016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:17.623519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:17.623995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:17.625184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:17.625960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:17.628548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:17.874350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:17.889956 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af3a8303-75ab-4b76-a664-6f93b5aa1a5a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.302076 Oct 19 07:27:17.900185 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2771/5692] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:17 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:18.919174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:18.920382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:18.928069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:18.928590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:18.929211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:18.929925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:18.930383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:18.930816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:19.250023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:19.259022 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62554c31-6932-455d-a567-5226643c84ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.345941 Oct 19 07:27:19.259832 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2922/5693] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:18 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:20.283086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:20.285189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:20.304815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:20.308148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:20.309054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:20.310184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:20.312363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:20.313216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:20.560080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:20.568987 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1940b30a-10b8-4758-b7fd-521b10092838 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.290319 Oct 19 07:27:20.581407 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2772/5694] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:20 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:21.599180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:21.599797 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:21.609339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:21.609836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:21.610283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:21.610993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:21.611456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:21.612487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:21.758679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:21.767187 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef5c1e05-a31d-4b76-96cc-d3337033f1ad tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.172448 Oct 19 07:27:21.767763 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2923/5695] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:21 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:22.794845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:22.795460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:22.809284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:22.810059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:22.810662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:22.811558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:22.812192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:22.813997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:22.989342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:23.003730 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ee5d90e-e705-48b8-aded-0c8f222a56ae tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.207133 Oct 19 07:27:23.003730 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2773/5696] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:22 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:24.025326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:24.025947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:24.033154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:24.035235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:24.035235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:24.035235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:24.035561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:24.035999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:24.220179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:24.244403 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e9d4f72-ad2b-44d5-959e-1ec8651ec0f8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.209180 Oct 19 07:27:24.244403 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2924/5697] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:24 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:25.275072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:25.275684 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:25.282431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:25.283192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:25.284576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:25.285434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:25.286029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:25.286685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:25.450616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:25.459023 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-560804e3-0566-42d1-8976-eebc6ce12b2f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.188036 Oct 19 07:27:25.459932 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2774/5698] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:25 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:26.484728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:26.485344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:26.493081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:26.493570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:26.494013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:26.494821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:26.495280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:26.495837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:26.632487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:26.640066 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a6c573b-5733-4ecd-88d2-6400387da03d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.159691 Oct 19 07:27:26.643611 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2925/5699] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:26 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:27.664881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:27.665499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:27.672414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:27.672893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:27.673343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:27.674117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:27.674592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:27.675476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:27.818093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:27.840271 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8581e3e-ca3e-4ca7-a6d0-b7f7a821e326 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.165422 Oct 19 07:27:27.840271 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2775/5700] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:27 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:28.852587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:28.853198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:28.859730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:28.860259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:28.860711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:28.861445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:28.861884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:28.862344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:29.053723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:29.062274 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f08b3fd5-527a-45b2-a95f-690a0b4804b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.213695 Oct 19 07:27:29.062987 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2926/5701] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:28 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:30.088183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:30.089348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:30.100824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:30.101326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:30.101776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:30.107244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:30.107952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:30.108588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:30.318228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:30.326354 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c58f625-20eb-4067-af93-2aa53471bc13 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.242975 Oct 19 07:27:30.327050 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2776/5702] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:30 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:31.350108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:31.350889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:31.364255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:31.366191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:31.368895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:31.369468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:31.372996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:31.373673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:31.374295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:31.630106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:31.640150 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16ba789e-91da-4efd-931d-adc2a5821dd2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.294496 Oct 19 07:27:31.653320 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2927/5703] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:31 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:32.666551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:32.668287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:32.672500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=30 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:32.680943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:32.681631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:32.682251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:32.683182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:32.684286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:32.685021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:32.855058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:32.866272 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e30e9eb5-10c9-48de-97d2-280aa7b50fb3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.205249 Oct 19 07:27:32.866957 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2777/5704] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:32 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:33.889314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:33.892220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:33.907575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:33.910524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:33.911182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:33.912183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:33.914158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:33.914892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:33.925317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=82 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:34.137927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:34.152436 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afd1ced3-d9bd-46f0-9714-1d347c0ae0a3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.267021 Oct 19 07:27:34.154269 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2928/5705] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:33 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:35.179566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:35.180883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:35.186496 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:27:35.186869 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:27:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 (ip 10.222.0.39) !!! Oct 19 07:27:35.206640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:35.207267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:35.207818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:35.208674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:35.209246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:35.209799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:35.514128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:35.524312 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc1c350e-008a-4e37-a36a-5c4daed755a7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.350031 Oct 19 07:27:35.525544 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2778/5706] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:35 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:36.163976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1743216700", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "de69160a-150e-4ddb-ac80-af5da256e7f9"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:36.262351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] validate_networks() for [('de69160a-150e-4ddb-ac80-af5da256e7f9', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:27:36.546768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:36.548590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:36.563844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:36.565759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:36.566507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:36.576049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:36.576805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:36.577420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:36.604007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=82 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:36.763718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:36.772708 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63b20db7-f2fa-47e3-8795-99c7421491ff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.229500 Oct 19 07:27:36.773892 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2779/5707] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:36 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:36.867942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:27:36.869279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-748185280", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "6c71839e-59db-4bd2-b9fb-18e654233995"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:36.869426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:27:36.869426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:27:36.870112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:27:36.870690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:27:36.881345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:36.882065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:36.882517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:36.883263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:36.883730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:36.884204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:36.910756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Getting quotas for project defeff04e62a40e1adaf86c7de1d7cf4. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:27:36.920602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Getting quotas for user f229473afa0c4b3ab1652bac92279e74 and project defeff04e62a40e1adaf86c7de1d7cf4. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:27:36.939152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:27:36.939152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:27:36.940874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] validate_networks() for [('6c71839e-59db-4bd2-b9fb-18e654233995', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:27:37.129625 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5cf39f95-036d-4701-a023-f0609c734749 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169588 Oct 19 07:27:37.131316 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2929/5708] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:27:37.145275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35158d97-a9b6-4ca8-890f-410858fcd7e2 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:37.146324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35158d97-a9b6-4ca8-890f-410858fcd7e2 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:37.219301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35158d97-a9b6-4ca8-890f-410858fcd7e2 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:37.231117 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35158d97-a9b6-4ca8-890f-410858fcd7e2 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1225 microversion: 2.1 time: 0.089420 Oct 19 07:27:37.232229 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2930/5709] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:37 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:37.793773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:27:37.794691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:27:37.795321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:27:37.795907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:27:37.796509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:27:37.798563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:37.799283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:37.809266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:37.809428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:37.809757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:37.810192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:37.811139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:37.811598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:37.812018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:37.813042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:37.813508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:37.816793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:37.819189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:37.826580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:37.838759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Getting quotas for project 726d9507842446b789682d245dfa7f59. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:27:37.845515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Getting quotas for user 418b6833aa7f4c588173ba49bdde2b6e and project 726d9507842446b789682d245dfa7f59. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:27:37.859039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:27:37.861594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:27:37.988189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:37.990298 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06e59328-304e-4fbc-9284-f83a7ab44beb tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215246 Oct 19 07:27:37.991177 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2780/5710] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:27:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:27:37.998187 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ba87f71-5eba-449b-a767-82c04fdfb784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.205135 Oct 19 07:27:38.000704 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2931/5711] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:37 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:38.006483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e377fe34-f5fd-4395-8e5c-f714c7cbc2cd tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:38.007317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e377fe34-f5fd-4395-8e5c-f714c7cbc2cd tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:38.069860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e377fe34-f5fd-4395-8e5c-f714c7cbc2cd tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:38.077806 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e377fe34-f5fd-4395-8e5c-f714c7cbc2cd tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1214 microversion: 2.1 time: 0.079338 Oct 19 07:27:38.079581 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2781/5712] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:37 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:38.261268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84f2a2e6-b36d-4d37-a448-a767f5e4a47b tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:38.261958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84f2a2e6-b36d-4d37-a448-a767f5e4a47b tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:38.342037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84f2a2e6-b36d-4d37-a448-a767f5e4a47b tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:38.349618 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84f2a2e6-b36d-4d37-a448-a767f5e4a47b tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1225 microversion: 2.1 time: 0.096802 Oct 19 07:27:38.350202 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2932/5713] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:38 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:39.026266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:39.027639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:39.036470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:39.037193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:39.037631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:39.038505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:39.038973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:39.039408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:39.102144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-677e4050-3c3e-45b2-901e-ffa42ec51488 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:39.103037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-677e4050-3c3e-45b2-901e-ffa42ec51488 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:39.176727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-677e4050-3c3e-45b2-901e-ffa42ec51488 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:39.186159 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-677e4050-3c3e-45b2-901e-ffa42ec51488 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1214 microversion: 2.1 time: 0.088544 Oct 19 07:27:39.187703 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2933/5714] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:39 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:39.243349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:39.254894 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0caea143-d45d-433a-ad61-8b0c36ff30d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1169 microversion: 2.1 time: 0.232249 Oct 19 07:27:39.261421 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2782/5715] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:39 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1169 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:39.373397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:39.374189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:39.381526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:39.382024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:39.382470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:39.383214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:39.383674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:39.384134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:39.474968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:39.483200 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab2c8198-031d-41a8-910d-6b25aa1704ca tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1277 microversion: 2.1 time: 0.114450 Oct 19 07:27:39.483792 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2934/5716] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:39 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:40.211805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:40.212985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:40.229296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:40.230165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:40.230842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:40.231789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:40.236050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:40.236710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:40.278095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:40.278947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:40.300088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:40.300981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:40.301673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:40.303249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:40.303963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:40.308348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:40.332798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:40.341911 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-549713f7-4d4d-4bd2-829d-b52dd9f548a8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1266 microversion: 2.1 time: 0.135745 Oct 19 07:27:40.342502 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2783/5717] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:40 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:40.479995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:40.491375 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51a029aa-e49a-4e02-9a48-96fc33ea0d81 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1215 microversion: 2.1 time: 0.216986 Oct 19 07:27:40.492565 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2935/5718] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:40 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:40.513691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:40.514314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:40.521568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:40.522064 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:40.522569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:40.523538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:40.524174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:40.524915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:40.622893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:40.631769 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-677075f3-8477-4771-a12c-7947f45d21ef tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1295 microversion: 2.1 time: 0.122204 Oct 19 07:27:40.649895 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2784/5719] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:40 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1295 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:41.366542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:41.367449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:41.386413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:41.389176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:41.389176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:41.389176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:41.389176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:41.389176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:41.474359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:41.482511 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa715c2d-2192-43f0-8428-a59bd82943aa tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1272 microversion: 2.1 time: 0.119872 Oct 19 07:27:41.486917 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2936/5720] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:41 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:41.518487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:41.520850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:41.526059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:41.526546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:41.527166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:41.527876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:41.528367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:41.528796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:41.659906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:41.661375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:41.668198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:41.668800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:41.669570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:41.671072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:41.671654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:41.672178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:41.725130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:41.733511 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a94b0b67-d830-42fa-a7cf-546f10ad3eac tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.218929 Oct 19 07:27:41.734103 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2785/5721] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:41 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:41.846468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:41.856575 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-140cd826-26bd-4d5e-b251-f6a782a1bf4e tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1325 microversion: 2.1 time: 0.202823 Oct 19 07:27:41.857412 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2937/5722] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:41 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1325 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:42.135714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8a8e0c02-d4bc-4b88-8623-ecab0f5b6800 req-733d079f-4840-4148-87e7-128a63e69ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f3abea-9010-48da-b2ea-bc7d4f42146d", "tag": "3942c2ca-0835-46e5-ae2e-eb673e2c6557"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:42.146478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8a8e0c02-d4bc-4b88-8623-ecab0f5b6800 req-733d079f-4840-4148-87e7-128a63e69ddb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:42.147252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8a8e0c02-d4bc-4b88-8623-ecab0f5b6800 req-733d079f-4840-4148-87e7-128a63e69ddb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:42.147883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8a8e0c02-d4bc-4b88-8623-ecab0f5b6800 req-733d079f-4840-4148-87e7-128a63e69ddb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:42.161015 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8a8e0c02-d4bc-4b88-8623-ecab0f5b6800 req-733d079f-4840-4148-87e7-128a63e69ddb service nova] Creating event network-changed:3942c2ca-0835-46e5-ae2e-eb673e2c6557 for instance a1f3abea-9010-48da-b2ea-bc7d4f42146d on n-h1-861333-10 Oct 19 07:27:42.166430 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8a8e0c02-d4bc-4b88-8623-ecab0f5b6800 req-733d079f-4840-4148-87e7-128a63e69ddb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034410 Oct 19 07:27:42.171067 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2786/5723] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:27:42.506710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:42.507360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:42.514543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:42.515264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:42.515710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:42.516471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:42.516936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:42.517366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:42.711020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:42.722690 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8342ed1b-bd29-4b6c-9c5a-21987a400788 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1314 microversion: 2.1 time: 0.219582 Oct 19 07:27:42.724314 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2938/5724] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:42 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:42.755455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-db09570a-ba79-49d5-8e69-da333d8f9d20 req-c3cac3a9-430b-446d-b7f4-d00539ae6960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad30fb4f-f0fd-4461-aa23-5eaa9b75a111", "tag": "49f71c07-31f5-425d-8a4b-c0c164091e1e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:42.756255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:42.756562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:42.765267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:42.766286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:42.766746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:42.767456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:42.767914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:42.768377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:42.768502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db09570a-ba79-49d5-8e69-da333d8f9d20 req-c3cac3a9-430b-446d-b7f4-d00539ae6960 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:42.769027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db09570a-ba79-49d5-8e69-da333d8f9d20 req-c3cac3a9-430b-446d-b7f4-d00539ae6960 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:42.769685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db09570a-ba79-49d5-8e69-da333d8f9d20 req-c3cac3a9-430b-446d-b7f4-d00539ae6960 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:42.781422 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-db09570a-ba79-49d5-8e69-da333d8f9d20 req-c3cac3a9-430b-446d-b7f4-d00539ae6960 service nova] Creating event network-changed:49f71c07-31f5-425d-8a4b-c0c164091e1e for instance ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 on n-h1-861333-10 Oct 19 07:27:42.787890 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-db09570a-ba79-49d5-8e69-da333d8f9d20 req-c3cac3a9-430b-446d-b7f4-d00539ae6960 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119300 Oct 19 07:27:42.788650 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2787/5725] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:27:42.883582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:42.884581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:42.892002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:42.892583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:42.893266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:42.894159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:42.894820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:42.895432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:42.995465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:43.005777 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1029812e-00b4-4d59-8ca1-755dcebf31e2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.253637 Oct 19 07:27:43.006732 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2939/5726] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:42 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:43.049938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:43.057659 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-456794f7-9cdd-471e-93a3-8f2cfebf885f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1325 microversion: 2.1 time: 0.178630 Oct 19 07:27:43.058440 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2788/5727] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:42 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1325 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:43.746004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:43.746633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:43.754113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:43.754601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:43.755042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:43.755729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:43.756219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:43.756655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:43.890672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:43.898951 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4446d7e3-1aca-417c-8bc9-d0ab8be13b9c tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1314 microversion: 2.1 time: 0.156807 Oct 19 07:27:43.899524 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2940/5728] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:43 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:44.030507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:44.031130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:44.039228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:44.039721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:44.040225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:44.041259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:44.042076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:44.042550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:44.081325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:44.081950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:44.088945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:44.089453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:44.089903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:44.090623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:44.091093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:44.091535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:44.194419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:44.203668 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71a82102-4e75-47de-8877-782fdaf6b4b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.177707 Oct 19 07:27:44.216148 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2789/5729] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:44 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:44.265985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:44.274551 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c472a58a-5891-4016-9dfb-c65cd484eacd tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1325 microversion: 2.1 time: 0.197248 Oct 19 07:27:44.275497 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2941/5730] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:44 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1325 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:44.922191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:44.922825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:44.928790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:44.929295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:44.930119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:44.930806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:44.931259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:44.931682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:45.063942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:45.071683 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35b83d2e-930f-4605-8c02-645ddbf06e07 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1314 microversion: 2.1 time: 0.153959 Oct 19 07:27:45.072266 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2790/5731] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:44 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:45.226828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:45.227467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:45.235076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:45.235565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:45.236008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:45.236755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:45.237214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:45.237644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:45.299329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:45.299943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:45.305993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:45.306477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:45.306914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:45.307661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:45.308140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:45.308607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:45.440299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:45.448032 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70f01984-21a3-420a-afa0-4448d792c5db tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1325 microversion: 2.1 time: 0.153331 Oct 19 07:27:45.448878 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2791/5732] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:45 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1325 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:45.450763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:45.459241 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e213a564-825c-4f06-a668-79c6b5e4e77a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.236298 Oct 19 07:27:45.459797 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2942/5733] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:45 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:46.094233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:46.094831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:46.101604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:46.102078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:46.102507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:46.103188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:46.103639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:46.104061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:46.240184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:46.248563 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d30638c-70d9-4238-aee6-843669da591f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1314 microversion: 2.1 time: 0.158147 Oct 19 07:27:46.249189 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2792/5734] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:46 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:46.471598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:46.472256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:46.480093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:46.480625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:46.481065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:46.481885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:46.482353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:46.482787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:46.549182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7bfbadce-8480-4bc8-9bef-d6bc0e5acc44 req-ee028bc2-c42a-4a90-9e72-c8806590aa57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f3abea-9010-48da-b2ea-bc7d4f42146d", "name": "network-vif-plugged", "status": "completed", "tag": "3942c2ca-0835-46e5-ae2e-eb673e2c6557"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:46.560361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7bfbadce-8480-4bc8-9bef-d6bc0e5acc44 req-ee028bc2-c42a-4a90-9e72-c8806590aa57 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:46.561090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7bfbadce-8480-4bc8-9bef-d6bc0e5acc44 req-ee028bc2-c42a-4a90-9e72-c8806590aa57 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:46.561514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7bfbadce-8480-4bc8-9bef-d6bc0e5acc44 req-ee028bc2-c42a-4a90-9e72-c8806590aa57 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:46.576878 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7bfbadce-8480-4bc8-9bef-d6bc0e5acc44 req-ee028bc2-c42a-4a90-9e72-c8806590aa57 service nova] Creating event network-vif-plugged:3942c2ca-0835-46e5-ae2e-eb673e2c6557 for instance a1f3abea-9010-48da-b2ea-bc7d4f42146d on n-h1-861333-10 Oct 19 07:27:46.583209 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7bfbadce-8480-4bc8-9bef-d6bc0e5acc44 req-ee028bc2-c42a-4a90-9e72-c8806590aa57 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117427 Oct 19 07:27:46.583829 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2943/5735] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:27:46.589333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:46.590039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:46.597516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:46.598019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:46.598649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:46.599936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:46.600422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:46.600858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:46.644606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:46.652983 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e81ce419-a7b6-4d0c-8688-16ed0a335f4a tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1325 microversion: 2.1 time: 0.186162 Oct 19 07:27:46.653576 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2793/5736] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:46 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1325 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:46.805041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:46.814009 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb74ebac-972f-49fc-9159-8fc38f873d4c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.228672 Oct 19 07:27:46.814589 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2944/5737] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:46 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:47.272096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:47.272724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:47.279453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:47.279933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:47.280408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:47.281142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:47.281597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:47.282022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:47.412513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:47.420169 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4cdb04e-0448-4b89-85fc-44a1fec62917 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1314 microversion: 2.1 time: 0.151998 Oct 19 07:27:47.420756 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2794/5738] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:47 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:47.677987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:47.678662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:47.680660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:47.686385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:47.687510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:47.687954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:47.688675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:47.689139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:47.689572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:47.820353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:47.828874 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2640048b-a631-4be8-94f8-e4e2a88f4494 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1325 microversion: 2.1 time: 0.154734 Oct 19 07:27:47.829453 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2945/5739] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:47 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1325 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:47.837226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:47.837871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:47.839932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:47.844977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:47.845456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:47.845892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:47.846661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:47.847118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:47.847560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:47.978346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:47.987025 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa22b474-b8bf-4003-8193-db20fc0eed14 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.153739 Oct 19 07:27:47.987596 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2795/5740] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:47 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:48.442634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:48.443285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:48.449416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:48.449884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:48.450335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:48.451030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:48.451490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:48.451923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:48.580040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:48.587758 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e00e3111-ef4e-4d3f-ae30-fc83ad755139 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1314 microversion: 2.1 time: 0.149093 Oct 19 07:27:48.588360 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2946/5741] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:48 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:48.600731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f896d6d9-750f-435a-838d-7fc34b286017 req-959a402a-5a6e-44d5-8015-b7c604e3f6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad30fb4f-f0fd-4461-aa23-5eaa9b75a111", "name": "network-vif-plugged", "status": "completed", "tag": "49f71c07-31f5-425d-8a4b-c0c164091e1e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:48.605680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:48.611747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f896d6d9-750f-435a-838d-7fc34b286017 req-959a402a-5a6e-44d5-8015-b7c604e3f6d7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:48.612252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f896d6d9-750f-435a-838d-7fc34b286017 req-959a402a-5a6e-44d5-8015-b7c604e3f6d7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:48.612686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f896d6d9-750f-435a-838d-7fc34b286017 req-959a402a-5a6e-44d5-8015-b7c604e3f6d7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:48.623751 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f896d6d9-750f-435a-838d-7fc34b286017 req-959a402a-5a6e-44d5-8015-b7c604e3f6d7 service nova] Creating event network-vif-plugged:49f71c07-31f5-425d-8a4b-c0c164091e1e for instance ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 on n-h1-861333-10 Oct 19 07:27:48.628723 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f896d6d9-750f-435a-838d-7fc34b286017 req-959a402a-5a6e-44d5-8015-b7c604e3f6d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032332 Oct 19 07:27:48.629307 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2796/5742] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:27:48.851067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:48.851672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:48.858616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:48.859105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:48.859542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:48.860255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:48.860710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:48.861137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.010704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:49.011416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:49.019028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.019558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.020009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.020763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.021287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.021724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.161983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:49.170273 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d81d27ec-7522-4953-aea7-a0cec6889731 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.163885 Oct 19 07:27:49.171196 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2797/5743] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:49 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:49.184780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:49.255695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:49.263643 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3afd6c08-c688-4bb4-900a-fe129f413dec tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1523 microversion: 2.1 time: 0.416418 Oct 19 07:27:49.264163 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2947/5744] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:48 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:49.289945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:49.290476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:49.296540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.297099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.297536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.298228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.298680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.299107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.329206 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] HTTP exception thrown: Action 999 not found Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Request method failure captured: Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d/os-instance-actions/999 HTTP/1.1 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6bn1Tth-8PEXlQHJASRI6CgsJZxVc-2Z8n-eRYZ6cMzunbMY7FbN5XnZXZwvZJOISPGkxgIxMUOiqNi5cS2TWITy48TAKIE0_sriEgd1-KschLZk4NcZn564fauNiXiPtv_Ac048c3m0985hAYY81-iMXbvmf4QtkymouO5UoIrjMA Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: defeff04e62a40e1adaf86c7de1d7cf4 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1031951591 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/defeff04e62a40e1adaf86c7de1d7cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/defeff04e62a40e1adaf86c7de1d7cf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/defeff04e62a40e1adaf86c7de1d7cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_defeff04e62a40e1adaf86c7de1d7cf4", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1031951591 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: defeff04e62a40e1adaf86c7de1d7cf4 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1031951591 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-InstanceActionsNegativeTestJSON-1031951591-project Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: f229473afa0c4b3ab1652bac92279e74 Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1031951591-project Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: exception: Action 999 not found Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'server_id': 'a1f3abea-9010-48da-b2ea-bc7d4f42146d', 'id': '999'} Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 19 07:27:49.342748 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:27:49.346418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Returning 404 to user: Action 999 not found {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:27:49.346418 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23448c11-6b88-48e9-abbb-55edc9697a6f tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.058932 Oct 19 07:27:49.346418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2798/5745] 10.222.0.39 () {58 vars in 1308 bytes} [Wed Oct 19 07:27:49 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d/os-instance-actions/999 => generated 66 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:27:49.354897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-969d39cd-1a21-4ccd-b3f6-ef4ee770dff6 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '.version_select at 0x7f6d5f5cfdc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:49.355452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-969d39cd-1a21-4ccd-b3f6-ef4ee770dff6 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: d30e0d16-dfd0-4056-b306-ca496f3f2e10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:49.361417 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-969d39cd-1a21-4ccd-b3f6-ef4ee770dff6 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] HTTP exception thrown: Instance d30e0d16-dfd0-4056-b306-ca496f3f2e10 could not be found. Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-969d39cd-1a21-4ccd-b3f6-ef4ee770dff6 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Request method failure captured: Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d30e0d16-dfd0-4056-b306-ca496f3f2e10/os-instance-actions HTTP/1.1 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6bn1Tth-8PEXlQHJASRI6CgsJZxVc-2Z8n-eRYZ6cMzunbMY7FbN5XnZXZwvZJOISPGkxgIxMUOiqNi5cS2TWITy48TAKIE0_sriEgd1-KschLZk4NcZn564fauNiXiPtv_Ac048c3m0985hAYY81-iMXbvmf4QtkymouO5UoIrjMA Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: defeff04e62a40e1adaf86c7de1d7cf4 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1031951591 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/defeff04e62a40e1adaf86c7de1d7cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/defeff04e62a40e1adaf86c7de1d7cf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/defeff04e62a40e1adaf86c7de1d7cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_defeff04e62a40e1adaf86c7de1d7cf4", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1031951591 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: defeff04e62a40e1adaf86c7de1d7cf4 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1031951591 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsNegativeTestJSON-1031951591-project Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f229473afa0c4b3ab1652bac92279e74 Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1031951591-project Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: method: Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance d30e0d16-dfd0-4056-b306-ca496f3f2e10 could not be found. Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': 'd30e0d16-dfd0-4056-b306-ca496f3f2e10'} Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d30e0d16-dfd0-4056-b306-ca496f3f2e10 could not be found. Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:27:49.363277 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d30e0d16-dfd0-4056-b306-ca496f3f2e10 could not be found. Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d30e0d16-dfd0-4056-b306-ca496f3f2e10 could not be found. Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-969d39cd-1a21-4ccd-b3f6-ef4ee770dff6 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Returning 404 to user: Instance d30e0d16-dfd0-4056-b306-ca496f3f2e10 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-969d39cd-1a21-4ccd-b3f6-ef4ee770dff6 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/d30e0d16-dfd0-4056-b306-ca496f3f2e10/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.014161 Oct 19 07:27:49.368318 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2948/5746] 10.222.0.39 () {58 vars in 1296 bytes} [Wed Oct 19 07:27:49 2022] GET /compute/v2.1/servers/d30e0d16-dfd0-4056-b306-ca496f3f2e10/os-instance-actions => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:27:49.373829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:49.374487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:49.380461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.380968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.381401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.382089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.382546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.382969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.398369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:49.409827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:27:49.610912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:49.611522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:49.618395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.618908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.619350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.620046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.620533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.621038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.634853 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6449f8e4-3484-490c-8a84-eb3a42765420 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 204 len: 0 microversion: 2.1 time: 0.264577 Oct 19 07:27:49.635446 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2799/5747] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:27:49 2022] DELETE /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:27:49.644502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:49.645345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:49.651193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.651662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.652089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.652797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:49.653246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:49.653671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:49.763818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:49.772314 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f777283d-fefc-4dad-bee0-36130315497f tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1314 microversion: 2.1 time: 0.165245 Oct 19 07:27:49.773207 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2949/5748] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:49 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:49.796425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:49.804230 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbbf7b92-f529-40a3-adb1-d1bb30ea23df tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1529 microversion: 2.1 time: 0.164571 Oct 19 07:27:49.804799 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2800/5749] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:49 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1529 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:50.194630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:50.195165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:50.202075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:50.202574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:50.203021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:50.203733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:50.204230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:50.204668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:50.208723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:50.342457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:50.350878 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf596708-df7f-4ada-968b-843f5e4bceee tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.160299 Oct 19 07:27:50.351449 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2950/5750] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:50 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:50.795958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:50.796625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:50.803388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:50.803868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:50.804338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:50.805029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:50.805481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:50.805905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:50.827490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:50.828380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:50.834689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:50.835223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:50.835945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:50.836496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:50.836984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:50.837421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:50.953607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:50.961014 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46f62657-0dd0-4a86-9f73-10ff79da44c9 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1502 microversion: 2.1 time: 0.168933 Oct 19 07:27:50.961597 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2801/5751] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:50 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:50.979180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:50.984985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:50.985804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:50.987837 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d813002-d18f-4af2-9774-dcc51d97f3fb tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1529 microversion: 2.1 time: 0.164906 Oct 19 07:27:50.988432 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2951/5752] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:50 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1529 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:50.992082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:50.992700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:50.993231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:50.993998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:50.994622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:50.995175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:51.128411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:51.136262 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26255f8e-7aad-4ce3-bf81-4148631c5177 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1502 microversion: 2.1 time: 0.155672 Oct 19 07:27:51.136843 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2802/5753] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:50 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:51.159372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:51.160037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:51.166071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:51.166631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:51.167159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:51.167917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:51.168473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:51.168967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:51.192459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lazy-loading 'flavor' on Instance uuid ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:27:51.374461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:51.382319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:51.388698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:51.389232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:51.389662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:51.390403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:51.390853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:51.391274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:51.455965 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-899960ba-0a0e-40b6-87d2-e876dba25bea tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "POST /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111/action" status: 202 len: 0 microversion: 2.1 time: 0.300540 Oct 19 07:27:51.459820 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2952/5754] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:27:51 2022] POST /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:27:51.467417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:51.468226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:51.474718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:51.475302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:51.475752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:51.476499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:51.477555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:51.477555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:51.536459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:51.545186 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a317256-5d10-4b5a-8331-17e180825396 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.174418 Oct 19 07:27:51.545186 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2803/5755] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:51 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:51.673715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:51.682445 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-738cafad-ec14-466c-a400-4024cae2be97 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1510 microversion: 2.1 time: 0.219208 Oct 19 07:27:51.683022 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2953/5756] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:51 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:51.706163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9ce21067-6532-4873-8d03-1ae32ea05faa req-e2569bc0-f28c-43e1-ab3d-2080c5fd55cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f3abea-9010-48da-b2ea-bc7d4f42146d", "name": "network-vif-deleted", "tag": "3942c2ca-0835-46e5-ae2e-eb673e2c6557"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:51.717229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9ce21067-6532-4873-8d03-1ae32ea05faa req-e2569bc0-f28c-43e1-ab3d-2080c5fd55cf service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:51.718292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9ce21067-6532-4873-8d03-1ae32ea05faa req-e2569bc0-f28c-43e1-ab3d-2080c5fd55cf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:51.718734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9ce21067-6532-4873-8d03-1ae32ea05faa req-e2569bc0-f28c-43e1-ab3d-2080c5fd55cf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:51.730330 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9ce21067-6532-4873-8d03-1ae32ea05faa req-e2569bc0-f28c-43e1-ab3d-2080c5fd55cf service nova] Creating event network-vif-deleted:3942c2ca-0835-46e5-ae2e-eb673e2c6557 for instance a1f3abea-9010-48da-b2ea-bc7d4f42146d on n-h1-861333-10 Oct 19 07:27:51.736261 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9ce21067-6532-4873-8d03-1ae32ea05faa req-e2569bc0-f28c-43e1-ab3d-2080c5fd55cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033852 Oct 19 07:27:51.736975 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2804/5757] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:27:52.010656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:52.011265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:52.017326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.017804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.018236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:52.018922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.019375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.019809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:52.054434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.054833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.055376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:52.055834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lazy-loading 'fault' on Instance uuid a1f3abea-9010-48da-b2ea-bc7d4f42146d {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:27:52.102578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f229473afa0c4b3ab1652bac92279e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defeff04e62a40e1adaf86c7de1d7cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:52.111241 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0be3bac2-adfc-455f-bf36-6093e2f8e140 tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 200 len: 1315 microversion: 2.1 time: 0.104481 Oct 19 07:27:52.111821 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2954/5758] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:52 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 1315 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:52.341037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4690ad6f-c664-405b-bda3-7c251f438a7a req-64e75f37-b36c-43ef-a40e-ed0f5ef0b2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd658359-f981-438d-a548-68f0f3778ae5", "name": "network-vif-plugged", "status": "completed", "tag": "d28ef1ca-3f05-4977-ace8-f405165c3c93"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:52.350521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4690ad6f-c664-405b-bda3-7c251f438a7a req-64e75f37-b36c-43ef-a40e-ed0f5ef0b2a6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.350997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4690ad6f-c664-405b-bda3-7c251f438a7a req-64e75f37-b36c-43ef-a40e-ed0f5ef0b2a6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.351570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4690ad6f-c664-405b-bda3-7c251f438a7a req-64e75f37-b36c-43ef-a40e-ed0f5ef0b2a6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:52.362778 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4690ad6f-c664-405b-bda3-7c251f438a7a req-64e75f37-b36c-43ef-a40e-ed0f5ef0b2a6 service nova] Creating event network-vif-plugged:d28ef1ca-3f05-4977-ace8-f405165c3c93 for instance bd658359-f981-438d-a548-68f0f3778ae5 on n-h2-861333-10 Oct 19 07:27:52.367942 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4690ad6f-c664-405b-bda3-7c251f438a7a req-64e75f37-b36c-43ef-a40e-ed0f5ef0b2a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032178 Oct 19 07:27:52.368641 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2805/5759] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:27:52.567661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:52.568217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:52.575007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.575483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.575916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:52.576721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.577162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.577586 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:52.708387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:52.711898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:52.712708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:52.716941 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8954c66e-ef92-4da4-9696-9fce1d969845 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1203 microversion: 2.1 time: 0.153224 Oct 19 07:27:52.718647 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2955/5760] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:52 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:52.720405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.720967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.721482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:52.722262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.722793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.723288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:52.857390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:52.865150 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d855deec-3f04-45d0-b3e1-97f391369818 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1493 microversion: 2.1 time: 0.160918 Oct 19 07:27:52.865747 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2806/5761] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:52 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1493 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:52.892633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72c3c34a-88fa-4036-aff5-0533736a04f5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:52.893179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72c3c34a-88fa-4036-aff5-0533736a04f5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:52.899377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c3c34a-88fa-4036-aff5-0533736a04f5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.899885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c3c34a-88fa-4036-aff5-0533736a04f5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.900346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c3c34a-88fa-4036-aff5-0533736a04f5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:52.901228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c3c34a-88fa-4036-aff5-0533736a04f5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:52.905991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c3c34a-88fa-4036-aff5-0533736a04f5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:52.905991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c3c34a-88fa-4036-aff5-0533736a04f5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:53.094995 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72c3c34a-88fa-4036-aff5-0533736a04f5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "POST /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111/action" status: 202 len: 0 microversion: 2.1 time: 0.206786 Oct 19 07:27:53.095575 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2956/5762] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:27:52 2022] POST /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:27:53.104292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:53.105095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:53.112469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:53.112985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:53.113416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:53.114189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:53.114647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:53.115088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:53.137331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:53.138076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] [instance: a1f3abea-9010-48da-b2ea-bc7d4f42146d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:53.144820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:53.145309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:53.145817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:53.146677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:53.147371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:53.147641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:53.166918 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] HTTP exception thrown: Instance a1f3abea-9010-48da-b2ea-bc7d4f42146d could not be found. Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Request method failure captured: Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d HTTP/1.1 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6bn1Tth-8PEXlQHJASRI6CgsJZxVc-2Z8n-eRYZ6cMzunbMY7FbN5XnZXZwvZJOISPGkxgIxMUOiqNi5cS2TWITy48TAKIE0_sriEgd1-KschLZk4NcZn564fauNiXiPtv_Ac048c3m0985hAYY81-iMXbvmf4QtkymouO5UoIrjMA Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: defeff04e62a40e1adaf86c7de1d7cf4 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1031951591 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/defeff04e62a40e1adaf86c7de1d7cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/defeff04e62a40e1adaf86c7de1d7cf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/defeff04e62a40e1adaf86c7de1d7cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_defeff04e62a40e1adaf86c7de1d7cf4", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1031951591 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: defeff04e62a40e1adaf86c7de1d7cf4 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1031951591 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsNegativeTestJSON-1031951591-project Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: f229473afa0c4b3ab1652bac92279e74 Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1031951591-project Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance a1f3abea-9010-48da-b2ea-bc7d4f42146d could not be found. Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'a1f3abea-9010-48da-b2ea-bc7d4f42146d'} Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f3abea-9010-48da-b2ea-bc7d4f42146d could not be found. Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f3abea-9010-48da-b2ea-bc7d4f42146d could not be found. Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:53.185181 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f3abea-9010-48da-b2ea-bc7d4f42146d could not be found. Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] Returning 404 to user: Instance a1f3abea-9010-48da-b2ea-bc7d4f42146d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15774ddc-8ba8-489c-a034-1bcddc3f3f0c tempest-InstanceActionsNegativeTestJSON-1031951591 tempest-InstanceActionsNegativeTestJSON-1031951591-project] 10.222.0.39 "GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d" status: 404 len: 111 microversion: 2.1 time: 0.037277 Oct 19 07:27:53.191167 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2957/5763] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:53 2022] GET /compute/v2.1/servers/a1f3abea-9010-48da-b2ea-bc7d4f42146d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:27:53.271072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:53.281200 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbb81f32-f294-4d79-949c-ab77b2e6c183 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1499 microversion: 2.1 time: 0.181085 Oct 19 07:27:53.282326 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2807/5764] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:53 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1499 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:53.744591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:53.745303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:53.752883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:53.753377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:53.753823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:53.754530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:53.754987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:53.755590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.055348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:54.063303 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff6bf91f-d1cf-49b6-b097-7be87da1c5a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1389 microversion: 2.1 time: 0.322631 Oct 19 07:27:54.063874 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2958/5765] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:53 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1389 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:54.085769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:54.086373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:54.093506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.093992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.094427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.095118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.095570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.095995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.237091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:54.244822 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2c3ac0c-53d5-4a92-b8a6-29891eccbffc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1389 microversion: 2.1 time: 0.162873 Oct 19 07:27:54.245395 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2808/5766] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:54 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:54.267265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:54.267885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:54.274254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.274748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.275387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.276211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.276614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.277009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.305393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:54.306150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:54.312280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.312773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.313216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.313918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.314385 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.314800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.453791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:54.461752 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8bb09cf8-cff8-47c2-a174-72c0e13956fe tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1499 microversion: 2.1 time: 0.160269 Oct 19 07:27:54.462414 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2809/5767] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:54 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:54.509294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:54.517741 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5a0a10e-2bf8-4637-928c-b9e764d2fddd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1389 microversion: 2.1 time: 0.254368 Oct 19 07:27:54.518250 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2959/5768] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:54 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1389 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:54.598908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:54.599440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:54.605418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.605902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.606344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.607035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.607490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.608054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.637105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:27:54.937730 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb31ea46-2b60-4c7f-bfa2-dd1b7ee7e123 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 204 len: 0 microversion: 2.1 time: 0.342490 Oct 19 07:27:54.938247 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2810/5769] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:27:54 2022] DELETE /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:27:54.946603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:54.947247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:54.954743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.955237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.955675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:54.956440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:54.956936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:54.957375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:55.235627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:55.244264 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ff7ed6c-ce01-4875-ba6d-448357b38c4f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1395 microversion: 2.1 time: 0.301434 Oct 19 07:27:55.246614 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2960/5770] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:54 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1395 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:55.485571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:55.487819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:55.501543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:55.507338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:55.508039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:55.508833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:55.509299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:55.509892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:55.768535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:55.779642 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5b020a97-9b78-4940-9d48-a4d3fb2f4204 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1502 microversion: 2.1 time: 0.298804 Oct 19 07:27:55.797433 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2811/5771] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:55 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:55.804842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:55.805418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:55.812194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:55.815807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:55.815807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:55.815807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:55.815807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:55.815807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:55.845638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lazy-loading 'flavor' on Instance uuid ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:27:56.129926 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43f4ca39-1f7d-4604-baa1-bb17c315b8ba tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "POST /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111/action" status: 202 len: 0 microversion: 2.1 time: 0.329232 Oct 19 07:27:56.131072 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2961/5772] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:27:55 2022] POST /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:27:56.138758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:56.139933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:56.149488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:56.149979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:56.150438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:56.151149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:56.151612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:56.152068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:56.274658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:56.275511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:56.282753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:56.283380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:56.283933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:56.285008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:56.285531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:56.292445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:56.331625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:56.339671 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9ae2ced-61e9-4f93-8116-dfd2325cf131 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1510 microversion: 2.1 time: 0.204781 Oct 19 07:27:56.340456 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2812/5773] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:56 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:27:56.423820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:56.426147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:56.432297 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79b53d82-ed51-4fc6-bdfe-d4709e047762 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1395 microversion: 2.1 time: 0.161854 Oct 19 07:27:56.432804 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2962/5774] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:56 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1395 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:57.366294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:57.367068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:57.374676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:57.385435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:57.386508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:57.387187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:57.388227 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:57.389191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:57.389879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:57.456331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:57.465552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:57.474319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:57.475192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:57.475806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:57.476792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:57.479563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:57.480285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:57.625605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:57.635693 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-202cc74f-bc66-43c1-b80f-305a72c01237 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1353 microversion: 2.1 time: 0.183216 Oct 19 07:27:57.648404 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2963/5775] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:57 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:57.707559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1c49030b-a441-4b19-96e8-ebea500e8405 req-e31812ae-637d-4cf9-a9d7-6662084cab13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd658359-f981-438d-a548-68f0f3778ae5", "name": "network-vif-deleted", "tag": "d28ef1ca-3f05-4977-ace8-f405165c3c93"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:57.718397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c49030b-a441-4b19-96e8-ebea500e8405 req-e31812ae-637d-4cf9-a9d7-6662084cab13 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:57.718397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c49030b-a441-4b19-96e8-ebea500e8405 req-e31812ae-637d-4cf9-a9d7-6662084cab13 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:57.718397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c49030b-a441-4b19-96e8-ebea500e8405 req-e31812ae-637d-4cf9-a9d7-6662084cab13 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:57.729312 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1c49030b-a441-4b19-96e8-ebea500e8405 req-e31812ae-637d-4cf9-a9d7-6662084cab13 service nova] Creating event network-vif-deleted:d28ef1ca-3f05-4977-ace8-f405165c3c93 for instance bd658359-f981-438d-a548-68f0f3778ae5 on n-h2-861333-10 Oct 19 07:27:57.734387 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1c49030b-a441-4b19-96e8-ebea500e8405 req-e31812ae-637d-4cf9-a9d7-6662084cab13 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030640 Oct 19 07:27:57.735159 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2964/5776] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:27:57.773196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:57.781779 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3eb2f274-ec9a-4b55-9506-00c8f5b9a0f1 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1493 microversion: 2.1 time: 0.421191 Oct 19 07:27:57.783086 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2813/5777] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:57 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1493 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:57.810330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80144e8a-880e-4bb7-bfa2-9469e53424b5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:27:57.811999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80144e8a-880e-4bb7-bfa2-9469e53424b5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:57.822321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80144e8a-880e-4bb7-bfa2-9469e53424b5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:57.822821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80144e8a-880e-4bb7-bfa2-9469e53424b5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:57.823442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80144e8a-880e-4bb7-bfa2-9469e53424b5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:57.824380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80144e8a-880e-4bb7-bfa2-9469e53424b5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:57.825129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80144e8a-880e-4bb7-bfa2-9469e53424b5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:57.825618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80144e8a-880e-4bb7-bfa2-9469e53424b5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:58.061150 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80144e8a-880e-4bb7-bfa2-9469e53424b5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "POST /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111/action" status: 202 len: 0 microversion: 2.1 time: 0.258015 Oct 19 07:27:58.070403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:58.071230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:58.074050 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2965/5778] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:27:57 2022] POST /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:27:58.081021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:58.081749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:58.082187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:58.083093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:58.083697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:58.084374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:58.089151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:58.301140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:58.312655 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72cdc878-454c-438e-8a26-33026f3afbc5 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1499 microversion: 2.1 time: 0.245979 Oct 19 07:27:58.313252 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2814/5779] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:58 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1499 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:58.661684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:58.662378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:58.664388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:27:58.670081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:58.670864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:58.671532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:58.672498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:58.673183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:58.673840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:58.762443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:58.773354 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6299bb1-4361-46f8-ac63-3a7b01d5386a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1188 microversion: 2.1 time: 0.116915 Oct 19 07:27:58.774471 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2966/5780] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:58 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1188 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:59.334743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:59.335361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:59.343747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:59.344268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:59.344714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:59.345422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:59.345932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:59.346367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:59.526675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:59.537070 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4725db10-7106-4cf6-83dd-ce1030793978 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1499 microversion: 2.1 time: 0.206107 Oct 19 07:27:59.543417 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2815/5781] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:59 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1499 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:27:59.799600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:27:59.800253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:27:59.807772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:59.808328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:59.808835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:59.809563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:27:59.810030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:27:59.811095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:27:59.881612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:27:59.892029 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-765c2fef-7d47-46fd-ab41-6a35b763fb71 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1188 microversion: 2.1 time: 0.097763 Oct 19 07:27:59.892957 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2967/5782] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:27:59 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:00.570532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:00.572356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:00.580375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:00.581296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:00.582034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:00.583046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:00.583702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:00.584640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:00.790848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:00.799665 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d17d51c5-c1de-4a00-8b4e-b1205e634ac0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1502 microversion: 2.1 time: 0.237114 Oct 19 07:28:00.816224 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2816/5783] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:00 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:00.823445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:00.823981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:00.831758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:00.832350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:00.833022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:00.834194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:00.834866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:00.835525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:00.864160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:28:00.915907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:00.916646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:00.923424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:00.928654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:00.928654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:00.928654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:00.928654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:00.928654 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:01.000339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:01.014370 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-559a2362-1ee3-425e-8bc8-4479b90e43f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1188 microversion: 2.1 time: 0.101601 Oct 19 07:28:01.015579 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2817/5784] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:00 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:01.153486 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a87095b0-2877-4663-b510-e8d3de09d7f8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 204 len: 0 microversion: 2.1 time: 0.333787 Oct 19 07:28:01.154647 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2968/5785] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:28:00 2022] DELETE /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:28:01.163219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:01.163828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:01.169909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:01.170392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:01.171018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:01.171714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:01.172190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:01.172620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:01.331945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:01.339946 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa292471-4801-4db8-a617-93e7132e4ba8 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1508 microversion: 2.1 time: 0.180643 Oct 19 07:28:01.340573 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2818/5786] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:01 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:02.038671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:02.040077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:02.048213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:02.048957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:02.049556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:02.050422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:02.051028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:02.051607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:02.124568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:02.133018 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6a56244-1ac7-4dbd-b7b0-1a542f73fdc5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1188 microversion: 2.1 time: 0.098567 Oct 19 07:28:02.133603 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2969/5787] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:02 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:02.366450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:02.368705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:02.377114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:02.377713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:02.378500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:02.379329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:02.379809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:02.380414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:02.578600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:02.589022 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35c936d1-0e39-4bca-84e3-9128c16be6e3 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1508 microversion: 2.1 time: 0.229281 Oct 19 07:28:02.590874 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2819/5788] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:02 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:03.155966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:03.156972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:03.166802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:03.170934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:03.171621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:03.174402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:03.175152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:03.175807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:03.226039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:03.226667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:03.234479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:03.235659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lazy-loading 'fault' on Instance uuid bd658359-f981-438d-a548-68f0f3778ae5 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:28:03.358183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:03.368130 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-088c981f-50c3-4caf-95ca-bb66de125876 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 200 len: 1193 microversion: 2.1 time: 0.216958 Oct 19 07:28:03.369707 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2970/5789] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:03 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 1193 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:03.614844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:03.616049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:03.630263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:03.631077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:03.631687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:03.632800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:03.633269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:03.635101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:03.928520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:03.946276 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12923840-fb38-453c-8225-b1c74f498125 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1508 microversion: 2.1 time: 0.333241 Oct 19 07:28:03.949577 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2820/5790] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:03 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:03.983369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-772996a2-ec31-42cc-8329-bf38519091ae req-72cd2f34-c350-456d-8b4c-e5a0a056d2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad30fb4f-f0fd-4461-aa23-5eaa9b75a111", "name": "network-vif-deleted", "tag": "49f71c07-31f5-425d-8a4b-c0c164091e1e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:04.004267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-772996a2-ec31-42cc-8329-bf38519091ae req-72cd2f34-c350-456d-8b4c-e5a0a056d2f6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:04.004752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-772996a2-ec31-42cc-8329-bf38519091ae req-72cd2f34-c350-456d-8b4c-e5a0a056d2f6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:04.005182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-772996a2-ec31-42cc-8329-bf38519091ae req-72cd2f34-c350-456d-8b4c-e5a0a056d2f6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:04.026139 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-772996a2-ec31-42cc-8329-bf38519091ae req-72cd2f34-c350-456d-8b4c-e5a0a056d2f6 service nova] Creating event network-vif-deleted:49f71c07-31f5-425d-8a4b-c0c164091e1e for instance ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 on n-h1-861333-10 Oct 19 07:28:04.035647 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-772996a2-ec31-42cc-8329-bf38519091ae req-72cd2f34-c350-456d-8b4c-e5a0a056d2f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055844 Oct 19 07:28:04.040450 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2971/5791] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:28:04.394814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:04.396984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:04.408423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:04.408933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:04.409430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:04.410157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:04.412013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:04.412487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:04.448405 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 HTTP/1.1 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'bd658359-f981-438d-a548-68f0f3778ae5'} Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:04.453959 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:04.458625 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:04.458625 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:04.458625 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:04.458625 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:28:04.458625 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:28:04.458625 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:04.458625 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:04.460200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:28:04.461651 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-efb9c7cc-eaf1-4fd4-85c2-fc62cc7bbf09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 404 len: 111 microversion: 2.1 time: 0.071754 Oct 19 07:28:04.468312 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2821/5792] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:04 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:28:04.975577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:04.977353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:04.984030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:04.984719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:04.985160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:04.985857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:04.987043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:04.987478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:05.020479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:05.020966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:05.021414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:05.021847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lazy-loading 'fault' on Instance uuid ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:28:05.069996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b6833aa7f4c588173ba49bdde2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d9507842446b789682d245dfa7f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:05.077815 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39d65e2c-23bd-4284-910a-70665c7dbdab tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 200 len: 1304 microversion: 2.1 time: 0.107829 Oct 19 07:28:05.078384 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2972/5793] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:04 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:06.101984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:06.102597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] [instance: ad30fb4f-f0fd-4461-aa23-5eaa9b75a111] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:06.114106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:06.120582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:06.121860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:06.124200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:06.124993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:06.125442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:06.152585 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] HTTP exception thrown: Instance ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 could not be found. Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Request method failure captured: Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 HTTP/1.1 Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6blMf4ZeEcRmUcSpxc-3waulyPeBxKpadaeuPmCKNE2jm9zVSLZFXScYXCZhsOc4HH16BheUc5jHuILs967nUxAvV9YbcZtuTG77pdmAmdBje6WmVph3W5qJG3rsQt80fkYlkKgpITDs1KUNHu337kCyGg62mF9vIGsc0A_CqG9PHw Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 726d9507842446b789682d245dfa7f59 Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestServerAdvancedOps-773335242 Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/726d9507842446b789682d245dfa7f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/726d9507842446b789682d245dfa7f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/726d9507842446b789682d245dfa7f59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_726d9507842446b789682d245dfa7f59", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestServerAdvancedOps-773335242 Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 726d9507842446b789682d245dfa7f59 Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestServerAdvancedOps-773335242 Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestServerAdvancedOps-773335242-project Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 418b6833aa7f4c588173ba49bdde2b6e Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestServerAdvancedOps-773335242-project Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 could not be found. Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'ad30fb4f-f0fd-4461-aa23-5eaa9b75a111'} Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 could not be found. Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 could not be found. Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:06.155181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.160179 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:06.160179 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:06.160179 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:06.160179 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:28:06.160179 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:28:06.160179 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 could not be found. Oct 19 07:28:06.160179 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.160179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] Returning 404 to user: Instance ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:28:06.160179 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f6856a9-e225-4bf4-8284-c25bb712c5c0 tempest-TestServerAdvancedOps-773335242 tempest-TestServerAdvancedOps-773335242-project] 10.222.0.39 "GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111" status: 404 len: 111 microversion: 2.1 time: 0.059829 Oct 19 07:28:06.166368 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2822/5794] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:06 2022] GET /compute/v2.1/servers/ad30fb4f-f0fd-4461-aa23-5eaa9b75a111 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:28:06.639765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:06.640304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:06.650948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:06.651836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:06.652592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:06.654162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:06.654993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:06.655590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:06.671214 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 HTTP/1.1 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'bd658359-f981-438d-a548-68f0f3778ae5'} Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:28:06.673900 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.677874 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.680476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:28:06.681691 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-71185ca4-d7ee-4257-9a66-5c9ca6521bc2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 404 len: 111 microversion: 2.1 time: 0.046851 Oct 19 07:28:06.682820 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2973/5795] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:28:06 2022] DELETE /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:28:06.692067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:06.692929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: bd658359-f981-438d-a548-68f0f3778ae5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:06.699618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:06.700807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:06.701485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:06.702268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:06.702936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:06.708169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:06.734758 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 HTTP/1.1 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'bd658359-f981-438d-a548-68f0f3778ae5'} Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:06.742154 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.747932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:06.747932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:06.747932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:06.747932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:28:06.747932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:28:06.747932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. Oct 19 07:28:06.747932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:06.749300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance bd658359-f981-438d-a548-68f0f3778ae5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:28:06.750344 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48d7a0a5-3ad1-4c38-8bec-fb3dc197e7a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5" status: 404 len: 111 microversion: 2.1 time: 0.062703 Oct 19 07:28:06.754898 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2823/5796] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:06 2022] GET /compute/v2.1/servers/bd658359-f981-438d-a548-68f0f3778ae5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:28:07.128588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1035769055", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "ee12124b-c295-4f40-b1d1-a979e5ef0566"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:07.197972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] validate_networks() for [('ee12124b-c295-4f40-b1d1-a979e5ef0566', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:28:07.952080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:28:07.952694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:28:07.953010 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:28:07.953433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:28:07.953851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:28:07.964514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:07.967731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:07.967731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:07.967731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:07.967731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:07.967731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:08.006679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Getting quotas for project 695e04e8b0b24becac55684f7b6852ac. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:28:08.014808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Getting quotas for user 4fdb667f82954c9594812fa8b667f54d and project 695e04e8b0b24becac55684f7b6852ac. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:28:08.033724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:28:08.036854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:28:08.149530 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1ec7f74-6702-47f5-b695-4897441ea285 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187774 Oct 19 07:28:08.150906 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2974/5797] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:28:08.164716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69ce81c9-275e-4517-8355-aec21003c681 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:08.165883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69ce81c9-275e-4517-8355-aec21003c681 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:08.307481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-69ce81c9-275e-4517-8355-aec21003c681 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:08.316262 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69ce81c9-275e-4517-8355-aec21003c681 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1225 microversion: 2.1 time: 0.157076 Oct 19 07:28:08.317602 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2824/5798] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:08 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:09.341766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-211c2d02-cb2a-4c31-a796-b8f8a63eeaa4 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:09.342703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-211c2d02-cb2a-4c31-a796-b8f8a63eeaa4 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:09.406285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-211c2d02-cb2a-4c31-a796-b8f8a63eeaa4 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:09.413403 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-211c2d02-cb2a-4c31-a796-b8f8a63eeaa4 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1225 microversion: 2.1 time: 0.077033 Oct 19 07:28:09.414497 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2975/5799] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:09 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:10.437602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:10.438334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:10.447319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:10.448036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:10.448613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:10.449427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:10.450028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:10.450559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:10.539880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:10.562383 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de71bfd0-b8d5-4d24-9f1e-b43d3ef4ff1d tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1277 microversion: 2.1 time: 0.129417 Oct 19 07:28:10.563358 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2825/5800] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:10 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:11.587228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:11.588695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:11.597313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:11.597816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:11.598265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:11.598978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:11.599467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:11.599903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:11.663054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:11.670752 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b7a62c6a-1f4b-46dd-a02c-87f852093455 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1283 microversion: 2.1 time: 0.087632 Oct 19 07:28:11.671309 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2976/5801] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:11 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:12.695306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:12.696032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:12.702832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:12.706442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:12.707131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:12.708220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:12.709044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:12.709756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:12.894191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:12.905047 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0c4caf1-8a06-4bc5-9b7d-e4a79e2365a1 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1325 microversion: 2.1 time: 0.214843 Oct 19 07:28:12.907140 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2826/5802] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:12 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:13.041935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b3dba6a9-dda4-4d46-942a-968a3eb3c416 req-69edbcc9-6416-4091-8246-af6af3a5201e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f43535-768f-4533-8b49-db356ded48af", "tag": "80c8cf82-6fa4-48f8-abc7-066cc7bbed0f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:13.052624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b3dba6a9-dda4-4d46-942a-968a3eb3c416 req-69edbcc9-6416-4091-8246-af6af3a5201e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:13.053163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b3dba6a9-dda4-4d46-942a-968a3eb3c416 req-69edbcc9-6416-4091-8246-af6af3a5201e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:13.053599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b3dba6a9-dda4-4d46-942a-968a3eb3c416 req-69edbcc9-6416-4091-8246-af6af3a5201e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:13.073863 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b3dba6a9-dda4-4d46-942a-968a3eb3c416 req-69edbcc9-6416-4091-8246-af6af3a5201e service nova] Creating event network-changed:80c8cf82-6fa4-48f8-abc7-066cc7bbed0f for instance e7f43535-768f-4533-8b49-db356ded48af on n-h1-861333-10 Oct 19 07:28:13.088511 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b3dba6a9-dda4-4d46-942a-968a3eb3c416 req-69edbcc9-6416-4091-8246-af6af3a5201e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050130 Oct 19 07:28:13.089271 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2977/5803] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:28:13.928596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:13.929216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:13.936833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:13.937322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:13.937847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:13.938582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:13.939047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:13.939475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:14.081176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:14.089227 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00b820f5-202b-452f-9bda-111c5f8963c6 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1325 microversion: 2.1 time: 0.164896 Oct 19 07:28:14.089797 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2827/5804] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:13 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:15.113641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:15.114388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:15.121625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:15.122322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:15.122766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:15.123480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:15.123943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:15.124417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:15.266726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:15.274877 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ed84235-e82e-4b13-ada2-197a0cda009a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1325 microversion: 2.1 time: 0.166564 Oct 19 07:28:15.275534 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2978/5805] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:15 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1325 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:16.297682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:16.298433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:16.305899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:16.306376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:16.307083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:16.307975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:16.308484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:16.309176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:16.452889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:16.462503 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd4f38ae-1935-4d44-89ee-7ae4fed4669a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1325 microversion: 2.1 time: 0.168566 Oct 19 07:28:16.463081 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2828/5806] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:16 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1325 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:17.486334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:17.486942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:17.495036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:17.495519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:17.495952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:17.496683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:17.497133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:17.497555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:17.648477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:17.656687 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-434c4152-9a64-4ec5-bb75-0ac3cb84abbf tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1325 microversion: 2.1 time: 0.174348 Oct 19 07:28:17.657283 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2979/5807] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:17 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1325 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:18.498025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ec2b791f-b3d9-47dd-8fe9-638199d2cc3a req-0cfbee37-ba8d-4485-9d6b-9c515a349c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f43535-768f-4533-8b49-db356ded48af", "name": "network-vif-plugged", "status": "completed", "tag": "80c8cf82-6fa4-48f8-abc7-066cc7bbed0f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:18.506951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:18.511020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec2b791f-b3d9-47dd-8fe9-638199d2cc3a req-0cfbee37-ba8d-4485-9d6b-9c515a349c01 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:18.511513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec2b791f-b3d9-47dd-8fe9-638199d2cc3a req-0cfbee37-ba8d-4485-9d6b-9c515a349c01 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:18.511948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec2b791f-b3d9-47dd-8fe9-638199d2cc3a req-0cfbee37-ba8d-4485-9d6b-9c515a349c01 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:18.523609 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ec2b791f-b3d9-47dd-8fe9-638199d2cc3a req-0cfbee37-ba8d-4485-9d6b-9c515a349c01 service nova] Creating event network-vif-plugged:80c8cf82-6fa4-48f8-abc7-066cc7bbed0f for instance e7f43535-768f-4533-8b49-db356ded48af on n-h1-861333-10 Oct 19 07:28:18.528655 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ec2b791f-b3d9-47dd-8fe9-638199d2cc3a req-0cfbee37-ba8d-4485-9d6b-9c515a349c01 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034961 Oct 19 07:28:18.529210 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2829/5808] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:28:18.682842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:18.684372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:18.688347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:18.692783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:18.693506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:18.693937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:18.699698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:18.699698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:18.699698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:18.711750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:18.837869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:18.846916 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ae59b8a-c6a3-4c05-9073-870196963bc2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1325 microversion: 2.1 time: 0.167894 Oct 19 07:28:18.847596 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2980/5809] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:18 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1325 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:19.871259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:19.871952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:19.878715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:19.879209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:19.879629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:19.880412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:19.880865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:19.881309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:20.018716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:20.026603 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97776551-508c-4ba6-8d71-19778b2e71b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1325 microversion: 2.1 time: 0.160637 Oct 19 07:28:20.027107 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2830/5810] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:19 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:21.197942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:21.197942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:21.197942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:21.197942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:21.197942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:21.197942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:21.197942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:21.197942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:21.197942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:21.199803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:21.206668 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f2a4beb-456b-48f8-a569-1189c090e6ca tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1521 microversion: 2.1 time: 0.155756 Oct 19 07:28:21.207288 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2981/5811] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:21 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:21.244219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:21.244809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:21.252969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:21.253571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:21.254086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:21.254918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:21.255554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:21.255992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:21.289844 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] HTTP exception thrown: Instance is not a member of specified network Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Request method failure captured: Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af/ips/invalid HTTP/1.1 Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6cGSCRvEh3D2mP17alZLwpw6j_E6GBV2rWH-4fVYTE4EKkEAOiMaoj_TJzhzzFEC0lX0HRmT3sXN-XK6OAIZ9GpHJpfs0OQw_ZcIJ8NwnaKJhnxqKH6TMxe2iWUacx1Lv2tKSx1xetuqRbSoADqx8-d7AKL3ePjiYnpg_F4C-vAX4Q Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 695e04e8b0b24becac55684f7b6852ac Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-197293498 Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/695e04e8b0b24becac55684f7b6852ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/695e04e8b0b24becac55684f7b6852ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/695e04e8b0b24becac55684f7b6852ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_695e04e8b0b24becac55684f7b6852ac", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-197293498 Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 695e04e8b0b24becac55684f7b6852ac Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-197293498 Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServerAddressesNegativeTestJSON-197293498-project Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 4fdb667f82954c9594812fa8b667f54d Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-197293498-project Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance is not a member of specified network Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'server_id': 'e7f43535-768f-4533-8b49-db356ded48af', 'id': 'invalid'} Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 19 07:28:21.565603 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:21.569109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:28:21.569109 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef03fb0a-1cf0-419c-8779-e5183038f39a tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.331317 Oct 19 07:28:21.572026 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2831/5812] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 07:28:21 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af/ips/invalid => generated 91 bytes in 337 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:28:21.577537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61e23913-6761-4733-bfb4-bdaa399ce4c9 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:21.578154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61e23913-6761-4733-bfb4-bdaa399ce4c9 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Failed to fetch instance by id 999 {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 07:28:21.578668 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-61e23913-6761-4733-bfb4-bdaa399ce4c9 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] HTTP exception thrown: Instance 999 could not be found. Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61e23913-6761-4733-bfb4-bdaa399ce4c9 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Request method failure captured: Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6cGSCRvEh3D2mP17alZLwpw6j_E6GBV2rWH-4fVYTE4EKkEAOiMaoj_TJzhzzFEC0lX0HRmT3sXN-XK6OAIZ9GpHJpfs0OQw_ZcIJ8NwnaKJhnxqKH6TMxe2iWUacx1Lv2tKSx1xetuqRbSoADqx8-d7AKL3ePjiYnpg_F4C-vAX4Q Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 695e04e8b0b24becac55684f7b6852ac Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-197293498 Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/695e04e8b0b24becac55684f7b6852ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/695e04e8b0b24becac55684f7b6852ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/695e04e8b0b24becac55684f7b6852ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_695e04e8b0b24becac55684f7b6852ac", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-197293498 Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 695e04e8b0b24becac55684f7b6852ac Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-197293498 Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerAddressesNegativeTestJSON-197293498-project Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 4fdb667f82954c9594812fa8b667f54d Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-197293498-project Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 999 could not be found. Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': '999'} Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 19 07:28:21.580431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:21.585603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61e23913-6761-4733-bfb4-bdaa399ce4c9 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:28:21.585603 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61e23913-6761-4733-bfb4-bdaa399ce4c9 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008773 Oct 19 07:28:21.585603 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2982/5813] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 07:28:21 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:28:21.591150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:21.592333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:21.598903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:21.599483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:21.599929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:21.600702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:21.601209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:21.601643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:21.634347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:28:21.974345 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-908c1e31-9da5-4a4d-b5c3-6bb20024c2ef tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 204 len: 0 microversion: 2.1 time: 0.386775 Oct 19 07:28:21.974992 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2832/5814] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:28:21 2022] DELETE /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:28:21.983475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:21.984230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:21.990502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:21.991002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:21.991424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:21.992232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:21.992688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:21.993116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:22.132349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:22.140833 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a475bc1a-cdc9-4375-970d-ff6dade045b2 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1527 microversion: 2.1 time: 0.161485 Oct 19 07:28:22.141415 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2983/5815] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:21 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1527 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:23.164388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:23.165003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:23.171650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:23.172218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:23.172794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:23.173492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:23.173942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:23.174367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:23.179362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:23.325818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:23.334812 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89dc4bfa-2642-428d-afb7-874b73ef7776 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1527 microversion: 2.1 time: 0.174808 Oct 19 07:28:23.335439 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2833/5816] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:23 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1527 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:24.151992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2f114991-e7b5-4a99-93d1-39853c67df32 req-dfe00330-8202-4162-a66d-38263066ec7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f43535-768f-4533-8b49-db356ded48af", "name": "network-vif-deleted", "tag": "80c8cf82-6fa4-48f8-abc7-066cc7bbed0f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:24.166672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2f114991-e7b5-4a99-93d1-39853c67df32 req-dfe00330-8202-4162-a66d-38263066ec7e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:24.167303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2f114991-e7b5-4a99-93d1-39853c67df32 req-dfe00330-8202-4162-a66d-38263066ec7e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:24.168814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2f114991-e7b5-4a99-93d1-39853c67df32 req-dfe00330-8202-4162-a66d-38263066ec7e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:24.187093 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2f114991-e7b5-4a99-93d1-39853c67df32 req-dfe00330-8202-4162-a66d-38263066ec7e service nova] Creating event network-vif-deleted:80c8cf82-6fa4-48f8-abc7-066cc7bbed0f for instance e7f43535-768f-4533-8b49-db356ded48af on n-h1-861333-10 Oct 19 07:28:24.193134 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2f114991-e7b5-4a99-93d1-39853c67df32 req-dfe00330-8202-4162-a66d-38263066ec7e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048297 Oct 19 07:28:24.194540 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2984/5817] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:28:24.361807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:24.362557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:24.370539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:24.371022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:24.371593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:24.372398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:24.373357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:24.373778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:24.438180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb667f82954c9594812fa8b667f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695e04e8b0b24becac55684f7b6852ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:24.446652 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e16bd70b-6379-4ab3-b0d7-04332e3a3763 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 200 len: 1310 microversion: 2.1 time: 0.090177 Oct 19 07:28:24.452974 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2834/5818] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:24 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:25.471936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:25.472595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] [instance: e7f43535-768f-4533-8b49-db356ded48af] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:25.479738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:25.480275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:25.480717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:25.481415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:25.482463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:25.482899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:25.496782 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] HTTP exception thrown: Instance e7f43535-768f-4533-8b49-db356ded48af could not be found. Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Request method failure captured: Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af HTTP/1.1 Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6cGSCRvEh3D2mP17alZLwpw6j_E6GBV2rWH-4fVYTE4EKkEAOiMaoj_TJzhzzFEC0lX0HRmT3sXN-XK6OAIZ9GpHJpfs0OQw_ZcIJ8NwnaKJhnxqKH6TMxe2iWUacx1Lv2tKSx1xetuqRbSoADqx8-d7AKL3ePjiYnpg_F4C-vAX4Q Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 695e04e8b0b24becac55684f7b6852ac Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-197293498 Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/695e04e8b0b24becac55684f7b6852ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/695e04e8b0b24becac55684f7b6852ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/695e04e8b0b24becac55684f7b6852ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_695e04e8b0b24becac55684f7b6852ac", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-197293498 Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 695e04e8b0b24becac55684f7b6852ac Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-197293498 Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServerAddressesNegativeTestJSON-197293498-project Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 4fdb667f82954c9594812fa8b667f54d Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-197293498-project Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance e7f43535-768f-4533-8b49-db356ded48af could not be found. Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'e7f43535-768f-4533-8b49-db356ded48af'} Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7f43535-768f-4533-8b49-db356ded48af could not be found. Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f43535-768f-4533-8b49-db356ded48af could not be found. Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:25.498339 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f43535-768f-4533-8b49-db356ded48af could not be found. Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] Returning 404 to user: Instance e7f43535-768f-4533-8b49-db356ded48af could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5af97536-3238-42e6-b90e-8a0c03494452 tempest-ServerAddressesNegativeTestJSON-197293498 tempest-ServerAddressesNegativeTestJSON-197293498-project] 10.222.0.39 "GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af" status: 404 len: 111 microversion: 2.1 time: 0.032171 Oct 19 07:28:25.506226 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2985/5819] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:25 2022] GET /compute/v2.1/servers/e7f43535-768f-4533-8b49-db356ded48af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:28:34.877409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2050101223", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "57332fa3-1089-4b23-905a-ffd9459603ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "cedc1025-55fd-4295-a2cd-69fd264b4466"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:34.894258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:34.957259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] validate_networks() for [('cedc1025-55fd-4295-a2cd-69fd264b4466', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:28:35.634895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:28:35.635459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:28:35.636086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:28:35.636736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:28:35.637226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:28:35.647086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:35.647843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:35.648474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:35.649269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:35.649825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:35.650321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:35.668812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:28:35.675127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for user 221b692fdbb3495aa63a686796b02ea8 and project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:28:35.737314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:28:35.739547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57332fa3-1089-4b23-905a-ffd9459603ab',volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:28:36.113010 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0310a23-7505-4cf3-9d44-971bd7a4ae94 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239466 Oct 19 07:28:36.115937 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2835/5820] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:28:36.127177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ee684da-d657-4456-8ffd-0220026f0f0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:36.128670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ee684da-d657-4456-8ffd-0220026f0f0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:36.133629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:36.134870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=19 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:36.201602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ee684da-d657-4456-8ffd-0220026f0f0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:36.219965 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ee684da-d657-4456-8ffd-0220026f0f0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1071 microversion: 2.1 time: 0.098631 Oct 19 07:28:36.221018 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2986/5821] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:36 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1071 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:37.244237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:37.245492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:37.258220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:37.259002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:37.259607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:37.260587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:37.261213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:37.261824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:37.382004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:37.391477 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6cceb220-5619-4432-88cf-601b0a3791e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1121 microversion: 2.1 time: 0.152163 Oct 19 07:28:37.396979 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2836/5822] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:37 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1121 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:37.873830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1846846403", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b334baf1-2061-48ac-b7fa-b6eb014c8c24"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:37.927851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] validate_networks() for [('b334baf1-2061-48ac-b7fa-b6eb014c8c24', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:28:38.419492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:38.420997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:38.432189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:38.432189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:38.432189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:38.432189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:38.432189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:38.432189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:38.446517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:28:38.447056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:28:38.447540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:28:38.448174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:28:38.448604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:28:38.459441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:38.460431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:38.462355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:38.464015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:38.464752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:38.465359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:38.494171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:28:38.501060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for user 83aaeed768e54cf5a7958e85e6dd91a4 and project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:28:38.516501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:28:38.530342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:28:38.569248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:38.578916 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5407dcf-d518-4ecd-89dd-a32bdf73c22e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1177 microversion: 2.1 time: 0.163783 Oct 19 07:28:38.580480 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2837/5823] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:38 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1177 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:38.757949 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e0de17c-1ba9-43a7-b6cf-f31f6609db6f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005972 Oct 19 07:28:38.766950 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2987/5824] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:28:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:28:38.771319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9038e235-fbbd-494f-bc50-a5f25e963f35 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:38.772029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9038e235-fbbd-494f-bc50-a5f25e963f35 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:38.907356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9038e235-fbbd-494f-bc50-a5f25e963f35 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:38.915682 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9038e235-fbbd-494f-bc50-a5f25e963f35 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1193 microversion: 2.1 time: 0.148329 Oct 19 07:28:38.919395 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2838/5825] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:38 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1193 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:39.611614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:39.612970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:39.633256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:39.635600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:39.637032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:39.638687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:39.640823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:39.641516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:39.945564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:39.945790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2eb5b16-0b52-488e-8e1c-84036980193d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:39.946647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2eb5b16-0b52-488e-8e1c-84036980193d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:39.954988 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07584d43-0633-49aa-915b-63a2292a7e6f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1229 microversion: 2.1 time: 0.347291 Oct 19 07:28:39.956493 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2988/5826] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:39 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1229 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:40.074694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2eb5b16-0b52-488e-8e1c-84036980193d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:40.086025 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2eb5b16-0b52-488e-8e1c-84036980193d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1193 microversion: 2.1 time: 0.145555 Oct 19 07:28:40.087275 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2839/5827] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:39 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1193 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:40.893467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a4e42136-8f33-449e-9325-1f33a0ee813b req-bb816c42-38a9-47d2-8911-76bca5f1ed1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a277bbc-99b2-410c-872b-a35b4f39b7d8", "tag": "c8ce0f91-e348-442c-add5-8886b7470772"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:40.910793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a4e42136-8f33-449e-9325-1f33a0ee813b req-bb816c42-38a9-47d2-8911-76bca5f1ed1f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:40.911629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a4e42136-8f33-449e-9325-1f33a0ee813b req-bb816c42-38a9-47d2-8911-76bca5f1ed1f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:40.912345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a4e42136-8f33-449e-9325-1f33a0ee813b req-bb816c42-38a9-47d2-8911-76bca5f1ed1f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:40.928361 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a4e42136-8f33-449e-9325-1f33a0ee813b req-bb816c42-38a9-47d2-8911-76bca5f1ed1f service nova] Creating event network-changed:c8ce0f91-e348-442c-add5-8886b7470772 for instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 on n-h1-861333-10 Oct 19 07:28:40.936988 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a4e42136-8f33-449e-9325-1f33a0ee813b req-bb816c42-38a9-47d2-8911-76bca5f1ed1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049471 Oct 19 07:28:40.942070 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2989/5828] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:28:40.980747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:40.981977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:40.990208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:40.991137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:40.991761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:40.992831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:40.993458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:40.994217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:41.112674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:41.113346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:41.119568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:41.121728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:41.121728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:41.121728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:41.122073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:41.122510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:41.155078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:41.172729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a328abd-6292-4e31-b3a2-3ced25b821cd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1229 microversion: 2.1 time: 0.196685 Oct 19 07:28:41.173331 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2840/5829] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:40 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1229 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:41.220739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:41.229205 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b394505-e3f3-45aa-95eb-471512ce33e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1245 microversion: 2.1 time: 0.121375 Oct 19 07:28:41.230409 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2990/5830] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:41 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:42.196906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:42.197768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:42.205664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:42.206425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:42.206964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:42.208371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:42.209186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:42.209930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:42.255033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:42.256222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:42.267864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:42.268354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:42.269156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:42.275051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:42.275785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:42.276424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:42.439787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:42.457835 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-369f0fc3-6c80-43d8-8fb2-fb9deca8f49d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1229 microversion: 2.1 time: 0.261029 Oct 19 07:28:42.457835 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2841/5831] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:42 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1229 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:42.491625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:42.505892 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a40c7e4c-69e6-4ba9-a65a-e567e29eb6c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1293 microversion: 2.1 time: 0.254978 Oct 19 07:28:42.506877 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2991/5832] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:42 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1293 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:43.284167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9982819b-eb6a-4ae9-a966-3ef7f18c504d req-89aeab8a-d657-4d76-bd19-dc293ec80ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006863a4-ecda-49d4-9d59-166acb463643", "tag": "f3a0a6e0-fd4f-442d-8116-9f6b12dc927f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:43.295306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9982819b-eb6a-4ae9-a966-3ef7f18c504d req-89aeab8a-d657-4d76-bd19-dc293ec80ce7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:43.297080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9982819b-eb6a-4ae9-a966-3ef7f18c504d req-89aeab8a-d657-4d76-bd19-dc293ec80ce7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:43.297080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9982819b-eb6a-4ae9-a966-3ef7f18c504d req-89aeab8a-d657-4d76-bd19-dc293ec80ce7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:43.308576 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9982819b-eb6a-4ae9-a966-3ef7f18c504d req-89aeab8a-d657-4d76-bd19-dc293ec80ce7 service nova] Creating event network-changed:f3a0a6e0-fd4f-442d-8116-9f6b12dc927f for instance 006863a4-ecda-49d4-9d59-166acb463643 on n-h2-861333-10 Oct 19 07:28:43.318467 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9982819b-eb6a-4ae9-a966-3ef7f18c504d req-89aeab8a-d657-4d76-bd19-dc293ec80ce7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038589 Oct 19 07:28:43.319521 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2842/5833] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:28:43.478943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:43.479614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:43.486803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:43.487296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:43.487734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:43.488466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:43.488956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:43.489387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:43.530079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:43.531141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:43.543709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:43.544573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:43.545195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:43.546354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:43.547023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:43.547667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:43.633812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:43.643057 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ef0fc86-a2d5-40f2-a15e-4642636d1f09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1229 microversion: 2.1 time: 0.168257 Oct 19 07:28:43.648269 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2992/5834] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:43 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1229 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:43.748018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:43.757718 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bcaf7a15-e519-429e-80b1-ac160f3ae00c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1293 microversion: 2.1 time: 0.231140 Oct 19 07:28:43.759816 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2843/5835] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:43 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1293 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:44.666743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:44.667264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:44.674089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:44.674579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:44.675025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:44.675721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:44.676216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:44.676646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:44.779492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:44.780161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:44.787123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:44.787610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:44.788047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:44.788768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:44.789224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:44.789650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:44.810557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:44.818229 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a6770ac-e652-4aa2-bd33-398e5586a7ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1229 microversion: 2.1 time: 0.155528 Oct 19 07:28:44.818798 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2993/5836] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:44 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1229 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:44.926013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:44.934206 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45a19739-1cde-4530-9a19-f71f9ab3a3f7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1293 microversion: 2.1 time: 0.158657 Oct 19 07:28:44.934773 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2844/5837] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:44 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1293 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:45.841352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:45.841981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:45.848839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:45.849318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:45.849757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:45.850447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:45.850900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:45.851325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:45.956639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:45.957401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:45.959406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:45.965705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:45.966194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:45.966630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:45.967332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:45.967792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:45.968307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:45.984513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:45.992491 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-435b3327-3c14-4922-a716-6a137d498d21 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.155473 Oct 19 07:28:45.993068 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2994/5838] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:45 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:46.102997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:46.110600 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7411f768-4550-4c8d-80e8-8fea6ebd4ba2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1293 microversion: 2.1 time: 0.157797 Oct 19 07:28:46.111176 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2845/5839] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:45 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:47.015728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:47.016379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:47.023328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:47.023821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:47.024290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:47.024984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:47.025447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:47.029919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:47.133222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:47.133904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:47.140756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:47.141254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:47.141696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:47.142402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:47.147172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:47.147172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:47.154625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:47.162952 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81538b1b-57bd-42d8-8e91-ad4dac8b1c54 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.151176 Oct 19 07:28:47.163861 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2995/5840] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:47 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:47.284963 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:47.292965 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-145aab35-b1b6-49cd-ab28-a49510dbae75 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1293 microversion: 2.1 time: 0.163561 Oct 19 07:28:47.293551 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2846/5841] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:47 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:48.186851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:48.187454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:48.194295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:48.194787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:48.195227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:48.195918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:48.196403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:48.196833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:48.315787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:48.316339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:48.323132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:48.323622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:48.324086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:48.324803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:48.325261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:48.325688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:48.327377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:48.335353 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0af0ffa-6640-430c-abf7-371e2ef0f16f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.152987 Oct 19 07:28:48.335919 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2996/5842] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:48 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:48.456437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:48.464341 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-899fd14c-b8de-4c6f-b97d-4035a4507d34 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1293 microversion: 2.1 time: 0.152522 Oct 19 07:28:48.464966 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2847/5843] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:48 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:49.357436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:49.358052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:49.360014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:49.360853 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:49.366455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:49.366951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:49.367395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:49.368126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:49.368584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:49.372957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:49.486771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:49.487308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:49.494041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:49.494545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:49.494961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:49.496173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:49.496631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:49.497055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:49.499595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:49.507294 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b0590b3-0475-46f4-8db0-aae06adc41d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.153796 Oct 19 07:28:49.507866 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2997/5844] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:49 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:49.624305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:49.631849 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-608078c8-bf3e-4a63-b9fb-d08f545daba9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1293 microversion: 2.1 time: 0.149030 Oct 19 07:28:49.632424 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2848/5845] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:49 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:50.531117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:50.531882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:50.538805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:50.539162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:50.539782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:50.540511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:50.540974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:50.541612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:50.581330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5611fb7f-f069-41a5-9ddd-1ca7aa12307b req-44a62539-c999-40ca-a334-0d3113029944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006863a4-ecda-49d4-9d59-166acb463643", "name": "network-vif-plugged", "status": "completed", "tag": "f3a0a6e0-fd4f-442d-8116-9f6b12dc927f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:50.587388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:50.592146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5611fb7f-f069-41a5-9ddd-1ca7aa12307b req-44a62539-c999-40ca-a334-0d3113029944 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:50.592609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5611fb7f-f069-41a5-9ddd-1ca7aa12307b req-44a62539-c999-40ca-a334-0d3113029944 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:50.593040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5611fb7f-f069-41a5-9ddd-1ca7aa12307b req-44a62539-c999-40ca-a334-0d3113029944 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:50.604808 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5611fb7f-f069-41a5-9ddd-1ca7aa12307b req-44a62539-c999-40ca-a334-0d3113029944 service nova] Creating event network-vif-plugged:f3a0a6e0-fd4f-442d-8116-9f6b12dc927f for instance 006863a4-ecda-49d4-9d59-166acb463643 on n-h2-861333-10 Oct 19 07:28:50.610749 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5611fb7f-f069-41a5-9ddd-1ca7aa12307b req-44a62539-c999-40ca-a334-0d3113029944 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033041 Oct 19 07:28:50.611277 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2849/5846] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:28:50.657280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:50.666049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:50.666519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:50.667017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:50.668155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:50.669216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:50.669835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:50.670425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:50.683985 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:50.695181 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-146c1781-60f9-45db-82da-f73300363fd9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.168189 Oct 19 07:28:50.695780 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2998/5847] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:50 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:50.856574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:50.864411 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3abe4fd4-d055-46c8-aaa2-47fb497d0a18 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1293 microversion: 2.1 time: 0.213096 Oct 19 07:28:50.864929 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2850/5848] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:50 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1293 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:51.718255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:51.718892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:51.725711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:51.726192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:51.726625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:51.727309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:51.727764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:51.728252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:51.854370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:51.862618 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31afce11-5dc1-46a4-8666-8f8695d9b36b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.148744 Oct 19 07:28:51.863180 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2999/5849] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:51 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:51.886652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:51.887263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:51.894164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:51.894649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:51.895088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:51.895785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:51.896274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:51.896704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:52.032796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:52.040730 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-edb959c3-3d78-43b2-b02b-cf4a1d7841a0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1293 microversion: 2.1 time: 0.157979 Oct 19 07:28:52.042394 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2851/5850] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:51 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:52.885295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:52.885948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:52.892812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:52.893298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:52.893739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:52.894435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:52.894894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:52.895323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:53.028444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:53.036173 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-681ccbe7-7e04-442a-bb04-51169410a7bf tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.154854 Oct 19 07:28:53.036753 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3000/5851] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:52 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:53.064293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:53.064901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:53.071292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:53.071773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:53.072243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:53.072929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:53.073379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:53.073801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:53.205934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:53.214114 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ea1631e-1e60-41db-a0c2-85e76078e1e9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1475 microversion: 2.1 time: 0.153749 Oct 19 07:28:53.214707 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2852/5852] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:53 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1475 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:53.279992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-354225865", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:53.333709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] validate_networks() for [('b334baf1-2061-48ac-b7fa-b6eb014c8c24', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:28:53.696743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:28:53.697168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:28:53.697641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:28:53.698049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:28:53.698459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:28:53.708055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:53.708589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:53.709029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:53.709764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:53.710258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:53.710690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:53.728183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:28:53.733631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for user 83aaeed768e54cf5a7958e85e6dd91a4 and project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:28:53.745830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:28:53.748089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 76641aa1-eda9-4002-856d-9bc29acdba45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:28:53.868834 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea49da5e-072b-4db7-937c-00d736b91bb7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593846 Oct 19 07:28:53.869489 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3001/5853] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:28:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:28:53.881517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9bf2b4a8-dfd2-43ed-9489-f02b5b579da5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:53.882009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9bf2b4a8-dfd2-43ed-9489-f02b5b579da5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 76641aa1-eda9-4002-856d-9bc29acdba45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:53.899081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9bf2b4a8-dfd2-43ed-9489-f02b5b579da5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 76641aa1-eda9-4002-856d-9bc29acdba45] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:28:54.061240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:54.062496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:54.068978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:54.069843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:54.070523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:54.071434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:54.071908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:54.072393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:54.209835 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9bf2b4a8-dfd2-43ed-9489-f02b5b579da5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45" status: 204 len: 0 microversion: 2.1 time: 0.332276 Oct 19 07:28:54.210477 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2853/5854] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:28:53 2022] DELETE /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:28:54.218269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:54.218557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f221de3c-400b-4012-b7ab-dc7cc4faa79d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:54.219163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f221de3c-400b-4012-b7ab-dc7cc4faa79d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 76641aa1-eda9-4002-856d-9bc29acdba45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:54.221897 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-061c6151-a1d5-4e89-ba4b-ef43b76cf0b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.167045 Oct 19 07:28:54.222476 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3002/5855] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:54 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:54.233619 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f221de3c-400b-4012-b7ab-dc7cc4faa79d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f221de3c-400b-4012-b7ab-dc7cc4faa79d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45 HTTP/1.1 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '76641aa1-eda9-4002-856d-9bc29acdba45'} Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 76641aa1-eda9-4002-856d-9bc29acdba45 Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:54.252432 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f221de3c-400b-4012-b7ab-dc7cc4faa79d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f221de3c-400b-4012-b7ab-dc7cc4faa79d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45" status: 404 len: 111 microversion: 2.1 time: 0.039328 Oct 19 07:28:54.256730 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2854/5856] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:54 2022] GET /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:28:54.303230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-331917891", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "b334baf1-2061-48ac-b7fa-b6eb014c8c24"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:54.361170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] validate_networks() for [('b334baf1-2061-48ac-b7fa-b6eb014c8c24', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:28:54.745178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:28:54.745612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:28:54.746094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:28:54.747025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:28:54.747452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:28:54.756219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:54.756705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:54.757145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:54.757878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:54.758341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:54.758772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:54.775927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:28:54.781259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for user 83aaeed768e54cf5a7958e85e6dd91a4 and project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:28:54.793409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:28:54.795825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:28:54.927613 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eefcc930-7b0a-406b-b746-f9e028b64234 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628140 Oct 19 07:28:54.928617 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3003/5857] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:28:54.940566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f41127c-e1e1-4e53-a143-5d3f65c6fc8b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:54.941170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f41127c-e1e1-4e53-a143-5d3f65c6fc8b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:55.000347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6f41127c-e1e1-4e53-a143-5d3f65c6fc8b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:55.008717 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f41127c-e1e1-4e53-a143-5d3f65c6fc8b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1220 microversion: 2.1 time: 0.072298 Oct 19 07:28:55.009616 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2855/5858] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:54 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1220 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:55.244573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:55.245190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:55.253423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:55.253887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:55.254325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:55.255011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:55.255739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:55.256208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:55.390788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:55.398637 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b8ace19-89fe-437f-9619-52b8d4df946a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.157962 Oct 19 07:28:55.399207 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3004/5859] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:55 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:56.031668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:56.032419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:56.040999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:56.041491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:56.041933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:56.042674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:56.043136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:56.043568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:56.109039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:56.111456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:56.117671 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab49300b-0fed-4dc6-a215-948ac8a879dc tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1224 microversion: 2.1 time: 0.090761 Oct 19 07:28:56.118239 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2856/5860] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:56 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:56.421263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:56.421869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:56.428675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:56.429159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:56.429595 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:56.430293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:56.430785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:56.431210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:56.561965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:56.570028 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-648bad9e-95be-4792-9879-16f9b80289c7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.152600 Oct 19 07:28:56.570696 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3005/5861] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:56 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:56.581599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-afad631f-019c-4054-a9e8-e3ccadf5cf56 req-5434afb8-1433-492e-9a31-fb6fce0f3095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a277bbc-99b2-410c-872b-a35b4f39b7d8", "name": "network-vif-plugged", "status": "completed", "tag": "c8ce0f91-e348-442c-add5-8886b7470772"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:56.597673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-afad631f-019c-4054-a9e8-e3ccadf5cf56 req-5434afb8-1433-492e-9a31-fb6fce0f3095 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:56.598108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-afad631f-019c-4054-a9e8-e3ccadf5cf56 req-5434afb8-1433-492e-9a31-fb6fce0f3095 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:56.598538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-afad631f-019c-4054-a9e8-e3ccadf5cf56 req-5434afb8-1433-492e-9a31-fb6fce0f3095 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:56.609747 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-afad631f-019c-4054-a9e8-e3ccadf5cf56 req-5434afb8-1433-492e-9a31-fb6fce0f3095 service nova] Creating event network-vif-plugged:c8ce0f91-e348-442c-add5-8886b7470772 for instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 on n-h1-861333-10 Oct 19 07:28:56.614872 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-afad631f-019c-4054-a9e8-e3ccadf5cf56 req-5434afb8-1433-492e-9a31-fb6fce0f3095 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037452 Oct 19 07:28:56.615442 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2857/5862] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:28:57.141884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:57.142641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:57.148847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:57.149345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:57.149795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:57.150538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:57.151002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:57.151434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:57.155869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:28:57.223878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:57.234654 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa29d900-11ce-456c-9466-b304e171e563 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1280 microversion: 2.1 time: 0.097465 Oct 19 07:28:57.237710 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3006/5863] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:57 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1280 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:28:57.593853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:57.594550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:57.601594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:57.602080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:57.602518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:57.603210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:57.603667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:57.604093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:57.745406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:57.756192 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-201e84e0-1a97-4b71-b903-5e4a13c9ab48 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1217 microversion: 2.1 time: 0.166838 Oct 19 07:28:57.759372 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2858/5864] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:57 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:58.260371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:58.261072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:58.268795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:58.269412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:58.269841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:58.270632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:58.271083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:58.271529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:58.445501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:58.453822 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07ad8674-2561-46e3-83cd-b226a43b6b2a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1320 microversion: 2.1 time: 0.197450 Oct 19 07:28:58.454396 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3007/5865] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:58 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:58.783267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:58.784349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:58.797091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:58.797502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:58.798060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:58.798944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:58.799547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:58.801484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:58.819147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b2faed36-cc82-4611-9f4d-4ff36f98c822 req-6805de71-9769-419d-a3f5-05a619d5fc4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c30778-4f67-4240-bf3f-495c15b77012", "tag": "58d707f3-1b41-4ef9-9ccb-6bc6121762a5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:58.829469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b2faed36-cc82-4611-9f4d-4ff36f98c822 req-6805de71-9769-419d-a3f5-05a619d5fc4a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:58.834966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b2faed36-cc82-4611-9f4d-4ff36f98c822 req-6805de71-9769-419d-a3f5-05a619d5fc4a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:58.834966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b2faed36-cc82-4611-9f4d-4ff36f98c822 req-6805de71-9769-419d-a3f5-05a619d5fc4a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:58.853409 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b2faed36-cc82-4611-9f4d-4ff36f98c822 req-6805de71-9769-419d-a3f5-05a619d5fc4a service nova] Creating event network-changed:58d707f3-1b41-4ef9-9ccb-6bc6121762a5 for instance 80c30778-4f67-4240-bf3f-495c15b77012 on n-h1-861333-10 Oct 19 07:28:58.862407 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b2faed36-cc82-4611-9f4d-4ff36f98c822 req-6805de71-9769-419d-a3f5-05a619d5fc4a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047997 Oct 19 07:28:58.867661 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3008/5866] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:28:58.968157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:58.976757 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-641015f9-6dc1-445e-952b-dbfb9e2a15f7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1403 microversion: 2.1 time: 0.200390 Oct 19 07:28:58.977733 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2859/5867] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:58 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1403 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:59.000432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:59.001372 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:59.007619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:59.008342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:59.008933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:59.010964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:59.011597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:59.012261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:59.226466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:59.239337 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8fd6c010-7c91-4208-ba72-7d604932f63a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1403 microversion: 2.1 time: 0.243584 Oct 19 07:28:59.240021 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3009/5868] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:58 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1403 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:28:59.262971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1870921701"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:28:59.269001 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:59.275266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:59.275764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:59.276235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:59.277209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:59.278470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:59.278935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:59.383502 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.compute.api [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Attempting to quiesce instance before volume snapshot. Oct 19 07:28:59.445241 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.compute.api [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 19 07:28:59.482505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:28:59.483769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:28:59.492450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:59.492946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:59.493617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:59.494361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:28:59.494998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:28:59.495471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:28:59.699601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Creating snapshot from volume 57332fa3-1089-4b23-905a-ffd9459603ab. {{(pid=127568) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 19 07:28:59.770577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:28:59.783621 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9431e745-c4ff-467b-922e-feae0d275340 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1320 microversion: 2.1 time: 0.305177 Oct 19 07:28:59.795443 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3010/5869] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:28:59 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:00.809649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:00.810294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:00.817634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:00.818348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:00.818790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:00.819494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:00.819951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:00.820400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:00.974022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:00.983012 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3bffb9e-0a30-4b12-ab33-359160f38ef2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1320 microversion: 2.1 time: 0.177916 Oct 19 07:29:00.983611 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3011/5870] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:00 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:01.159742 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d43daf7c-be46-42d7-b677-bcf7444ad5de tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8/action" status: 202 len: 0 microversion: 2.1 time: 1.900960 Oct 19 07:29:01.160416 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2860/5871] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:28:59 2022] POST /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8/action => generated 0 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 07:29:02.006560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:02.007173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:02.015036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:02.015577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:02.016228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:02.017024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:02.017678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:02.018205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:02.147175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:02.155387 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b46cf28e-03af-468e-b693-5b4fd2be5495 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1320 microversion: 2.1 time: 0.152729 Oct 19 07:29:02.155964 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3012/5872] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:02 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:02.314477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-952360660", "imageRef": "30686b37-7e41-47d2-ade4-d5933679897d", "flavorRef": "452", "networks": [{"uuid": "cedc1025-55fd-4295-a2cd-69fd264b4466"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:02.367218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] validate_networks() for [('cedc1025-55fd-4295-a2cd-69fd264b4466', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:29:02.735165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:29:02.735605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:29:02.736121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:29:02.736589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:29:02.737020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:29:02.745991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:02.746487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:02.746937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:02.747677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:02.748787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:02.749232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:02.766872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:29:02.772143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for user 221b692fdbb3495aa63a686796b02ea8 and project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:29:02.781959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:02.785663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:29:02.788316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='583a7890-df3f-4aef-9ed8-08b2236e1dff',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:29:02.933254 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9013d64e-25a7-4441-8fd2-634677045844 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624230 Oct 19 07:29:02.933913 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2861/5873] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:29:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:29:02.944995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c57c94c-ce34-44fb-a51a-db285c0aa397 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:02.947935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c57c94c-ce34-44fb-a51a-db285c0aa397 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:02.948607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:02.999523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c57c94c-ce34-44fb-a51a-db285c0aa397 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:03.006607 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c57c94c-ce34-44fb-a51a-db285c0aa397 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1229 microversion: 2.1 time: 0.065373 Oct 19 07:29:03.012152 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3013/5874] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:02 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1229 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:03.177912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:03.178532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:03.185056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:03.186200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:03.186653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:03.187355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:03.187824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:03.188298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:03.323241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:03.332067 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b57b4f6-2c7e-49e5-84a8-97321400aea8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1320 microversion: 2.1 time: 0.158027 Oct 19 07:29:03.332764 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2862/5875] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:03 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:04.032269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:04.032917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:04.041305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:04.041798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:04.042241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:04.043209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:04.043673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:04.044130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:04.109029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:04.116916 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4021ab5f-dd84-4a66-918b-8cc861a874e8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1225 microversion: 2.1 time: 0.090311 Oct 19 07:29:04.120245 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3014/5876] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:04 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:04.354788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:04.355445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:04.362364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:04.362865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:04.363315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:04.364024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:04.364520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:04.364960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:04.494946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:04.503200 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23afd7ae-1707-42e3-853a-e34a34f894af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1320 microversion: 2.1 time: 0.152220 Oct 19 07:29:04.503770 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2863/5877] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:04 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:05.139116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:05.139665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:05.141617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:05.147300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:05.147835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:05.152253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:05.152253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:05.152253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:05.152253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:05.227759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:05.239358 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0aed1bbf-06a4-43f1-a55f-e3ade6b8f8d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1299 microversion: 2.1 time: 0.104276 Oct 19 07:29:05.239966 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3015/5878] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:05 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:05.529043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:05.531281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:05.540897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:05.541744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:05.542422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:05.544025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:05.544800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:05.560498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:05.985844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:05.994351 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-047665c7-259d-4bcb-8050-b8dabd879bba tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1320 microversion: 2.1 time: 0.471267 Oct 19 07:29:05.995146 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2864/5879] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:05 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1320 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:06.262995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:06.264886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:06.279709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:06.281452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:06.281907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:06.282619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:06.283090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:06.283524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:06.437975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:06.447921 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74dd27da-d3c6-4747-8a34-61376d993764 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.189072 Oct 19 07:29:06.449112 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3016/5880] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:06 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:06.711318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b2440a22-eb07-436d-85e5-dab474cf3a9f req-bd7a637c-72b8-4624-bf15-e585195cc910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c30778-4f67-4240-bf3f-495c15b77012", "name": "network-vif-plugged", "status": "completed", "tag": "58d707f3-1b41-4ef9-9ccb-6bc6121762a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:06.734761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b2440a22-eb07-436d-85e5-dab474cf3a9f req-bd7a637c-72b8-4624-bf15-e585195cc910 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:06.735334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b2440a22-eb07-436d-85e5-dab474cf3a9f req-bd7a637c-72b8-4624-bf15-e585195cc910 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:06.735855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b2440a22-eb07-436d-85e5-dab474cf3a9f req-bd7a637c-72b8-4624-bf15-e585195cc910 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:06.748546 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b2440a22-eb07-436d-85e5-dab474cf3a9f req-bd7a637c-72b8-4624-bf15-e585195cc910 service nova] Creating event network-vif-plugged:58d707f3-1b41-4ef9-9ccb-6bc6121762a5 for instance 80c30778-4f67-4240-bf3f-495c15b77012 on n-h1-861333-10 Oct 19 07:29:06.754755 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b2440a22-eb07-436d-85e5-dab474cf3a9f req-bd7a637c-72b8-4624-bf15-e585195cc910 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047525 Oct 19 07:29:06.755352 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2865/5881] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:29:06.823310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-561d81f2-6816-41af-a1c3-8cc890d59bd4 req-706b7266-a556-4241-b402-5d9817d8f634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ed87f3-8b0b-4150-a5f7-c3830167d3ea", "tag": "531ac8e5-b33e-4df2-a870-5f8209b99bc7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:06.834698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-561d81f2-6816-41af-a1c3-8cc890d59bd4 req-706b7266-a556-4241-b402-5d9817d8f634 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:06.835671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-561d81f2-6816-41af-a1c3-8cc890d59bd4 req-706b7266-a556-4241-b402-5d9817d8f634 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:06.836325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-561d81f2-6816-41af-a1c3-8cc890d59bd4 req-706b7266-a556-4241-b402-5d9817d8f634 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:06.850447 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-561d81f2-6816-41af-a1c3-8cc890d59bd4 req-706b7266-a556-4241-b402-5d9817d8f634 service nova] Creating event network-changed:531ac8e5-b33e-4df2-a870-5f8209b99bc7 for instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea on n-h2-861333-10 Oct 19 07:29:06.856916 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-561d81f2-6816-41af-a1c3-8cc890d59bd4 req-706b7266-a556-4241-b402-5d9817d8f634 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037349 Oct 19 07:29:06.858125 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3017/5882] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:29:07.022306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:07.023435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:07.033277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:07.034151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:07.034769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:07.035709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:07.036373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:07.036993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:07.290430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:07.304965 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f70778f0-c2ba-42cd-9366-320d6c804b11 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1320 microversion: 2.1 time: 0.289781 Oct 19 07:29:07.305548 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2866/5883] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:07 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1320 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:07.473317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:07.474036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:07.480702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:07.481201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:07.481648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:07.482940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:07.483431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:07.484057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:07.624170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:07.632049 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea2977ac-2b2e-4b0d-8e02-6898d28b7443 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.164168 Oct 19 07:29:07.632656 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3018/5884] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:07 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:08.328673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:08.329445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:08.336510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:08.337148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:08.337613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:08.338413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:08.339035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:08.339479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:08.483326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:08.492964 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d889b8df-bc5e-4b63-b79d-54b73c378b6c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1320 microversion: 2.1 time: 0.168375 Oct 19 07:29:08.494452 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2867/5885] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:08 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:08.655898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:08.656558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:08.663379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:08.663863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:08.664339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:08.665174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:08.665630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:08.666056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:08.795401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:08.803141 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f0f8a51-5136-43b8-aac8-6f3f456ef54c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.152311 Oct 19 07:29:08.803790 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3019/5886] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:08 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:09.517378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:09.518004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:09.526345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:09.526887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:09.527344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:09.528086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:09.539525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:09.539525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:09.675490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:09.683658 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd2dc091-9549-4a54-91b0-1d6d2099dc7e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1502 microversion: 2.1 time: 0.170315 Oct 19 07:29:09.684260 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2868/5887] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:09 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:09.706550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:09.707163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:09.715215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:09.715215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:09.715215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:09.715762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:09.716849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:09.717303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:09.826098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:09.826902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:09.834343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:09.834721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:09.835356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:09.836246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:09.836246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:09.837497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:09.861333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:09.870017 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cdcb59a-f0be-419e-8724-8db637e2ce15 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1502 microversion: 2.1 time: 0.167372 Oct 19 07:29:09.870637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3020/5888] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:09 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:09.896962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:09.897628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:09.906147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:09.910074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:09.910074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:09.910074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:09.910074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:09.910074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:09.941516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:29:09.991745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:10.000185 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-291421da-5d83-44e9-bae8-cd53d610188b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.178139 Oct 19 07:29:10.000752 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2869/5889] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:09 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:10.283649 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bec1ae23-baab-40e6-ba1c-4248f71b3e69 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 204 len: 0 microversion: 2.1 time: 0.392945 Oct 19 07:29:10.284285 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3021/5890] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:29:09 2022] DELETE /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:29:10.292498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:10.293120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:10.299756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:10.300285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:10.300904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:10.301439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:10.301912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:10.302330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:10.452488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:10.461301 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5dacc53e-e7e7-4904-a0c1-7c9dc29630af tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1508 microversion: 2.1 time: 0.172634 Oct 19 07:29:10.462017 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2870/5891] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:10 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:11.027318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:11.028057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:11.035236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:11.035727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:11.036211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:11.036913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:11.037378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:11.037809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:11.180318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:11.188618 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3bfb2881-f964-4334-9239-81fef28f86a9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.166306 Oct 19 07:29:11.189189 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3022/5892] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:11 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:11.485919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:11.486550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:11.493521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:11.494019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:11.494454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:11.495201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:11.495659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:11.496115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:11.631457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:11.639678 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-211e1527-021f-4c9a-8584-db0196c032a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1508 microversion: 2.1 time: 0.158151 Oct 19 07:29:11.640375 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2871/5893] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:11 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:12.219298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:12.220092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:12.237275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:12.238081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:12.238742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:12.239687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:12.240352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:12.240951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:12.266831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:12.284870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1306f8a9-a099-4469-8e31-e8971f717df3 req-1b0b78e6-6694-4721-a9aa-c60f2363c243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c30778-4f67-4240-bf3f-495c15b77012", "name": "network-vif-deleted", "tag": "58d707f3-1b41-4ef9-9ccb-6bc6121762a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:12.302071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1306f8a9-a099-4469-8e31-e8971f717df3 req-1b0b78e6-6694-4721-a9aa-c60f2363c243 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:12.303052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1306f8a9-a099-4469-8e31-e8971f717df3 req-1b0b78e6-6694-4721-a9aa-c60f2363c243 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:12.303679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1306f8a9-a099-4469-8e31-e8971f717df3 req-1b0b78e6-6694-4721-a9aa-c60f2363c243 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:12.324543 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1306f8a9-a099-4469-8e31-e8971f717df3 req-1b0b78e6-6694-4721-a9aa-c60f2363c243 service nova] Creating event network-vif-deleted:58d707f3-1b41-4ef9-9ccb-6bc6121762a5 for instance 80c30778-4f67-4240-bf3f-495c15b77012 on n-h1-861333-10 Oct 19 07:29:12.328728 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1306f8a9-a099-4469-8e31-e8971f717df3 req-1b0b78e6-6694-4721-a9aa-c60f2363c243 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048281 Oct 19 07:29:12.331717 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2872/5894] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:29:12.425976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:12.434369 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc1c785f-9fae-4200-bb85-9ee8c739e09d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.221600 Oct 19 07:29:12.434965 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3023/5895] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:12 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:12.665024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:12.665734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:12.672034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:12.672561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:12.673004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:12.673703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:12.674328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:12.674773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:12.717077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:12.717638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:12.718087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:12.718543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lazy-loading 'fault' on Instance uuid 80c30778-4f67-4240-bf3f-495c15b77012 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:29:12.721588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:12.755461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:12.779293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:12.800839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:12.809857 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-77bdc2f9-3ff3-4a5c-b1c2-74a9e8bbe70c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 200 len: 1310 microversion: 2.1 time: 0.150455 Oct 19 07:29:12.810839 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2873/5896] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:12 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 1310 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:13.464348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:13.465007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:13.466741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:13.473455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:13.473943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:13.474422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:13.475317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:13.475775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:13.476544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:13.617761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:13.626635 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70b0e76c-a252-4bdd-8b7f-6591b16f1729 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.166857 Oct 19 07:29:13.627207 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3024/5897] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:13 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:13.834950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:13.835593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:13.844472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:13.844958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:13.845386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:13.846257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:13.846880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:13.847318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:13.861232 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 HTTP/1.1 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '80c30778-4f67-4240-bf3f-495c15b77012'} Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:29:13.862933 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d2f1828-b60b-41ea-b6d2-812c8a9a192b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 404 len: 111 microversion: 2.1 time: 0.033971 Oct 19 07:29:13.867710 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2874/5898] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:13 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:29:13.879616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fef17465-a498-423b-98fc-c5091a10a59d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'create', calling method: .version_select at 0x7f6d5f5d5b80>, body: {"keypair": {"name": "tempest-key-2062973414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6UC08RPxaByn9S1L2rvp/EtxU5VFsPUjNeTq0kYIAVmxMAzKSGs3onvhsWjM/mhwPHXfs7q+vbGHhX03lE/ip9MPf2UFNausMKZ8uPwxo326l6lIGXvQhNhnE6vbhB1g=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:13.897384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fef17465-a498-423b-98fc-c5091a10a59d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for project c719546d25c84cf399312e12a99644e1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:29:13.902890 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:29:13.903048 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:29:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.39) !!! Oct 19 07:29:13.904571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fef17465-a498-423b-98fc-c5091a10a59d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for user 83aaeed768e54cf5a7958e85e6dd91a4 and project c719546d25c84cf399312e12a99644e1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:29:14.024006 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fef17465-a498-423b-98fc-c5091a10a59d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.149948 Oct 19 07:29:14.024723 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3025/5899] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:29:13 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:29:14.035622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e460da9-a68e-47c7-9dc0-c1363bf55348 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '.version_select at 0x7f6d5f954ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:14.039485 n-d-861333-10 devstack@n-api.service[127568]: WARNING oslo_db.sqlalchemy.utils [None req-3e460da9-a68e-47c7-9dc0-c1363bf55348 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 07:29:14.044689 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e460da9-a68e-47c7-9dc0-c1363bf55348 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.013076 Oct 19 07:29:14.045223 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2875/5900] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 07:29:14 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:29:14.101674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-109091595", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "key_name": "tempest-key-2062973414", "networks": [{"uuid": "b334baf1-2061-48ac-b7fa-b6eb014c8c24"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:14.161821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] validate_networks() for [('b334baf1-2061-48ac-b7fa-b6eb014c8c24', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:29:14.565681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:29:14.566179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:29:14.566662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:29:14.567266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:29:14.567689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:29:14.577126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:14.577614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:14.578046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:14.578764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:14.579216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:14.579641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:14.599625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:29:14.607223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for user 83aaeed768e54cf5a7958e85e6dd91a4 and project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:29:14.619446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:29:14.623299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:29:14.649254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:14.649917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:14.657294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:14.657796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:14.658249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:14.658949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:14.659420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:14.659866 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:14.797453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:14.805241 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9540f712-fb14-49c9-be60-e16a96af8891 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.159805 Oct 19 07:29:14.805982 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2876/5901] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:14 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:15.161562 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6b884b5-4735-4575-a8d9-7de262ae1a30 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063544 Oct 19 07:29:15.163677 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3026/5902] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:29:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:29:15.177085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6158332a-94a7-4798-a9ac-5cac2db090d1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:15.183325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6158332a-94a7-4798-a9ac-5cac2db090d1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:15.241193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6158332a-94a7-4798-a9ac-5cac2db090d1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:15.249773 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6158332a-94a7-4798-a9ac-5cac2db090d1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1228 microversion: 2.1 time: 0.078197 Oct 19 07:29:15.256898 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2877/5903] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:15 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1228 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:15.829268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:15.829957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:15.837082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:15.837569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:15.838009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:15.838714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:15.839174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:15.839602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:15.979316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:15.987073 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c175144f-13bf-4ff6-a0ed-76b26ddeaaf3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.162130 Oct 19 07:29:15.989683 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3027/5904] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:15 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:16.278042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:16.278670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:16.286522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:16.290231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:16.290231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:16.290231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:16.290231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:16.290231 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:16.361122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:16.369872 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad0de2d0-15c8-426b-ab45-a5b85d0811e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1232 microversion: 2.1 time: 0.096022 Oct 19 07:29:16.370476 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2878/5905] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:16 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1232 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:17.014395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:17.015009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:17.021850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:17.022339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:17.022780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:17.023477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:17.023937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:17.024409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:17.178053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:17.186959 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9f5197d-00d1-4c18-8269-0283dfe65739 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.176447 Oct 19 07:29:17.187562 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3028/5906] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:17 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:17.399104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:17.399813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:17.412144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:17.413358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:17.415119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:17.416285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:17.416790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:17.417242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:17.485206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:17.495838 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8973e8cc-1a77-432b-b1d9-1096628934a7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1288 microversion: 2.1 time: 0.100431 Oct 19 07:29:17.508324 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2879/5907] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:17 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:18.212295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:18.213492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:18.222726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:18.223780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:18.224421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:18.225197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:18.225632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:18.226062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:18.439653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:18.447958 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-53bd6aaa-07c7-4d0c-aefb-e427b384f5d9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.241938 Oct 19 07:29:18.463567 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3029/5908] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:18 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:18.520919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:18.521898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:18.531884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:18.532366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:18.532837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:18.533559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:18.534028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:18.534464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:18.686774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:18.696358 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-49dcdaed-d105-4a29-831c-1fe1baa09661 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1328 microversion: 2.1 time: 0.180816 Oct 19 07:29:18.705909 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2880/5909] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:18 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1328 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:19.301396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4b3a4410-05ff-4db2-9c13-99ae35a1377a req-3837b1e3-2c51-498d-964f-6b59ba1bce06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d643f8-6000-4f2b-acb5-b83f2eed4d64", "tag": "32b037a7-0009-4e15-90bf-32e1f753126f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:19.323215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4b3a4410-05ff-4db2-9c13-99ae35a1377a req-3837b1e3-2c51-498d-964f-6b59ba1bce06 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:19.323215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4b3a4410-05ff-4db2-9c13-99ae35a1377a req-3837b1e3-2c51-498d-964f-6b59ba1bce06 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:19.323215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4b3a4410-05ff-4db2-9c13-99ae35a1377a req-3837b1e3-2c51-498d-964f-6b59ba1bce06 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:19.325480 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4b3a4410-05ff-4db2-9c13-99ae35a1377a req-3837b1e3-2c51-498d-964f-6b59ba1bce06 service nova] Creating event network-changed:32b037a7-0009-4e15-90bf-32e1f753126f for instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 on n-h1-861333-10 Oct 19 07:29:19.333110 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4b3a4410-05ff-4db2-9c13-99ae35a1377a req-3837b1e3-2c51-498d-964f-6b59ba1bce06 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035601 Oct 19 07:29:19.333835 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3030/5910] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:29:19.471842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:19.472670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:19.478944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:19.479447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:19.479904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:19.480647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:19.481142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:19.481570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:19.630255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:19.640043 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd2eb386-e025-4fef-97f9-6423ecd7beff tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.172769 Oct 19 07:29:19.640921 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2881/5911] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:19 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:19.719532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:19.720289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:19.726461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:19.726943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:19.727379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:19.728303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:19.729128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:19.730066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:19.943374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:19.952437 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f71b107-3713-4ca8-a665-0eee5feb4882 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1328 microversion: 2.1 time: 0.237104 Oct 19 07:29:19.953209 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3031/5912] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:19 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1328 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:20.664118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:20.664754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:20.672534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:20.673041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:20.673571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:20.674317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:20.674896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:20.675412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:20.810051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:20.818799 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15baf385-b051-4187-8181-f3388e6a0a03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.158650 Oct 19 07:29:20.829645 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2882/5913] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:20 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:20.978001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:20.978531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:20.986178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:20.986665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:20.987107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:20.987795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:20.988292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:20.988804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:21.120747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:21.128474 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-99246270-e2be-4c33-ac60-8af23c9d3990 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1328 microversion: 2.1 time: 0.154570 Oct 19 07:29:21.129085 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3032/5914] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:20 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1328 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:21.842962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:21.843587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:21.850603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:21.851101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:21.851553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:21.852295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:21.852767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:21.853210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:21.992046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:22.000742 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42e703ee-a9ae-4e36-a278-6d9f9c9aa1fb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.161742 Oct 19 07:29:22.001315 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2883/5915] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:21 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:22.152328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:22.152829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:22.162415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:22.163019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:22.178357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:22.178357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:22.178357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:22.178357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:22.304825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:22.312614 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-599b59e1-c7eb-4a3e-99f3-ef5b71904ff2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1328 microversion: 2.1 time: 0.164760 Oct 19 07:29:22.313064 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3033/5916] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:22 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1328 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:23.023874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:23.024525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:23.032878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:23.033390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:23.033848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:23.034671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:23.035236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:23.035803 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:23.175188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:23.182916 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a320cb8a-9adc-4587-afd4-bfbcdbacdb73 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.162996 Oct 19 07:29:23.183511 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2884/5917] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:23 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:23.378802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:23.378802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:23.378802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:23.378802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:23.378802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:23.378802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:23.378802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:23.378802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:23.487213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:23.495827 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17ab2671-723e-4015-9e7f-b85b90343048 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1328 microversion: 2.1 time: 0.161876 Oct 19 07:29:23.496434 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3034/5918] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:23 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:24.207399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:24.208040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:24.215495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:24.215995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:24.216515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:24.217223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:24.218036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:24.218481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:24.357257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:24.365728 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f4184b0-df3e-4e70-ba36-dfcf8f9f1939 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.162835 Oct 19 07:29:24.366298 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2885/5919] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:24 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:24.519351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:24.520264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:24.527068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:24.527561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:24.528007 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:24.528736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:24.529197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:24.529635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:24.590451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:24.617937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:24.666950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:24.674995 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c855d508-8983-43ca-b3d7-eaaaa1c5400a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1328 microversion: 2.1 time: 0.160010 Oct 19 07:29:24.676801 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3035/5920] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:24 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:25.390168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:25.390806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:25.393634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:25.399570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:25.400786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:25.400952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:25.401528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:25.402005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:25.402451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:25.542567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:25.550922 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f1dcfd3-1ada-41a0-b52a-5de190059a69 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.164619 Oct 19 07:29:25.551492 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2886/5921] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:25 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:25.698992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:25.700950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:25.707049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:25.707520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:25.707966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:25.708700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:25.709163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:25.709596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:25.848507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:25.856315 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7fde669-a406-4869-a703-efe2b03abaac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1328 microversion: 2.1 time: 0.161507 Oct 19 07:29:25.862650 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3036/5922] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:25 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1328 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:26.573735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:26.574364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:26.581260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:26.581796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:26.582390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:26.583102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:26.583572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:26.584016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:26.727816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:26.735954 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8781ed9a-ffdc-41f7-be41-1bad4b8e2e1f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.166030 Oct 19 07:29:26.736584 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2887/5923] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:26 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:26.879150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:26.880454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:26.887278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:26.887774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:26.888241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:26.888947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:26.889588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:26.889702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-44e7a1f9-5763-4fae-8edc-cbdebe580642 req-c17bdfe9-69eb-423f-950c-4ca6e6aff7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d643f8-6000-4f2b-acb5-b83f2eed4d64", "name": "network-vif-plugged", "status": "completed", "tag": "32b037a7-0009-4e15-90bf-32e1f753126f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:26.895821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:26.900732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-44e7a1f9-5763-4fae-8edc-cbdebe580642 req-c17bdfe9-69eb-423f-950c-4ca6e6aff7d9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:26.901239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-44e7a1f9-5763-4fae-8edc-cbdebe580642 req-c17bdfe9-69eb-423f-950c-4ca6e6aff7d9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:26.901762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-44e7a1f9-5763-4fae-8edc-cbdebe580642 req-c17bdfe9-69eb-423f-950c-4ca6e6aff7d9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:26.913762 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-44e7a1f9-5763-4fae-8edc-cbdebe580642 req-c17bdfe9-69eb-423f-950c-4ca6e6aff7d9 service nova] Creating event network-vif-plugged:32b037a7-0009-4e15-90bf-32e1f753126f for instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 on n-h1-861333-10 Oct 19 07:29:26.921428 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-44e7a1f9-5763-4fae-8edc-cbdebe580642 req-c17bdfe9-69eb-423f-950c-4ca6e6aff7d9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033209 Oct 19 07:29:26.921428 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2888/5924] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:29:27.069711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:27.078011 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19a6254c-ab73-4dcb-b358-6ccc4cf452ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1328 microversion: 2.1 time: 0.202723 Oct 19 07:29:27.078596 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3037/5925] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:26 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1328 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:27.761338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:27.762051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:27.768249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:27.768748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:27.769198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:27.769894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:27.770366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:27.770816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:27.906121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:27.914502 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b0abe7c-a53f-4f70-be93-78b343b12ccd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.158346 Oct 19 07:29:27.915081 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2889/5926] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:27 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:28.102188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:28.102826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:28.109601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:28.110111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:28.110622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:28.111418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:28.111876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:28.112339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:28.253105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:28.261141 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c112f7d6-eba4-472f-b601-c2ec831e88d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1328 microversion: 2.1 time: 0.163002 Oct 19 07:29:28.261720 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3038/5927] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:28 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1328 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:28.938417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:28.939719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:28.947287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:28.952186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:28.952186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:28.952186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:28.952186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:28.952186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:29.085757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:29.093532 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cca5d16f-6546-4fc5-ac63-fb6322057c6c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.159403 Oct 19 07:29:29.094102 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2890/5928] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:28 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:29.285208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:29.285951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:29.292807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:29.293294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:29.293736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:29.294421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:29.294941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:29.295378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:29.427758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:29.435629 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e96b8d0b-3c14-436c-9d49-cb112bf4b344 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1509 microversion: 2.1 time: 0.155136 Oct 19 07:29:29.436229 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3039/5929] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:29 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:29.457887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:29.458521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:29.464508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:29.465007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:29.465467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:29.466172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:29.466649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:29.467092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:29.599406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:29.607278 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef9a9827-dd52-41ad-9b99-a8bf565a8c53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1509 microversion: 2.1 time: 0.153484 Oct 19 07:29:29.607846 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2891/5930] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:29 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:29.630011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:29.630508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:29.636710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:29.637197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:29.637698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:29.638437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:29.638898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:29.639335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:29.666025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:29:29.852186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:30.075900 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89fc5189-fb5b-4961-86c5-9c3121b7eb53 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 204 len: 0 microversion: 2.1 time: 0.449580 Oct 19 07:29:30.078115 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3040/5931] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:29:29 2022] DELETE /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:29:30.085548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:30.086202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:30.093426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:30.094009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:30.094566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:30.095315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:30.095892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:30.096378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:30.117067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:30.117774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:30.124060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:30.124646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:30.129881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:30.129881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:30.129881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:30.129881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:30.241981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:30.249787 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97c763a3-7afc-4104-8fa9-2c6451e9cd72 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1515 microversion: 2.1 time: 0.168990 Oct 19 07:29:30.250481 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2892/5932] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:30 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:30.277464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:30.285344 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a102c52-1efb-48f7-a2bf-95782a654457 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.173272 Oct 19 07:29:30.285953 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3041/5933] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:30 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:31.273800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:31.274425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:31.281616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:31.282116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:31.282601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:31.283312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:31.283778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:31.284247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:31.304423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:31.308885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:31.316230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:31.318269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:31.318862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:31.319308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:31.320008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:31.320488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:31.320916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:31.431964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:31.441089 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1994bd43-8860-4244-86be-2e542fa0d269 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1515 microversion: 2.1 time: 0.171376 Oct 19 07:29:31.441974 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2893/5934] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:31 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:32.040616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:32.048470 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-549c97c0-34af-4c95-8c45-9212df6679ed tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.743317 Oct 19 07:29:32.049069 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3042/5935] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:31 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:32.427539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b7a87ded-df96-4600-bf92-0de6e0e2e2e1 req-27bd021d-4174-43b9-8075-3a09fd0f7d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d643f8-6000-4f2b-acb5-b83f2eed4d64", "name": "network-vif-deleted", "tag": "32b037a7-0009-4e15-90bf-32e1f753126f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:32.444579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b7a87ded-df96-4600-bf92-0de6e0e2e2e1 req-27bd021d-4174-43b9-8075-3a09fd0f7d24 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:32.445365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b7a87ded-df96-4600-bf92-0de6e0e2e2e1 req-27bd021d-4174-43b9-8075-3a09fd0f7d24 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:32.446048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b7a87ded-df96-4600-bf92-0de6e0e2e2e1 req-27bd021d-4174-43b9-8075-3a09fd0f7d24 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:32.458831 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b7a87ded-df96-4600-bf92-0de6e0e2e2e1 req-27bd021d-4174-43b9-8075-3a09fd0f7d24 service nova] Creating event network-vif-deleted:32b037a7-0009-4e15-90bf-32e1f753126f for instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 on n-h1-861333-10 Oct 19 07:29:32.465382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:32.465982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:32.472694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:32.478995 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b7a87ded-df96-4600-bf92-0de6e0e2e2e1 req-27bd021d-4174-43b9-8075-3a09fd0f7d24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061299 Oct 19 07:29:32.483033 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2894/5936] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:29:32.483550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:32.483550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:32.483872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:32.484809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:32.485439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:32.485887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:32.559672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:32.568267 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18f4e9a3-ac25-4f45-8aa5-def8a010284d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1473 microversion: 2.1 time: 0.107309 Oct 19 07:29:32.568909 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3043/5937] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:32 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1473 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:33.073569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:33.074284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:33.080716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:33.081211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:33.081659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:33.082381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:33.082856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:33.083293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:33.221165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:33.229041 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-feb32c46-5568-46d5-a623-bcdd86c14a08 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.159669 Oct 19 07:29:33.229596 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2895/5938] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:33 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:33.591070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:33.591767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:33.599152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:33.599639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:33.600080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:33.600879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:33.601340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:33.601782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:33.633857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:33.634346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:33.634789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:33.635324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lazy-loading 'fault' on Instance uuid e5d643f8-6000-4f2b-acb5-b83f2eed4d64 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:29:33.676749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:33.685199 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3f43e01-3867-4ee1-8d16-04706e6de309 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 200 len: 1318 microversion: 2.1 time: 0.098190 Oct 19 07:29:33.685772 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3044/5939] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:33 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:34.252544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:34.253258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:34.256430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:34.261339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:34.261843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:34.262299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:34.263008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:34.263486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:34.263933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:34.395161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:34.403634 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e769b98-ed26-4769-94b2-8e311f281c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.155207 Oct 19 07:29:34.404316 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2896/5940] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:34 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:34.709346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:34.709943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:34.716970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:34.717536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:34.717983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:34.718679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:34.719134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:34.719566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:34.732694 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 HTTP/1.1 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'e5d643f8-6000-4f2b-acb5-b83f2eed4d64'} Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:29:34.734354 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-135118e0-dd65-4884-9dfa-63f655cd6f32 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 404 len: 111 microversion: 2.1 time: 0.031486 Oct 19 07:29:34.741138 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3045/5941] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:34 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:29:34.744455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8bad1cdc-a7d0-48d2-8798-ff97ccfa7d2d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '.version_select at 0x7f6d5f9df940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:34.853537 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8bad1cdc-a7d0-48d2-8798-ff97ccfa7d2d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-key-2062973414" status: 202 len: 0 microversion: 2.1 time: 0.112790 Oct 19 07:29:34.854132 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2897/5942] 10.222.0.39 () {58 vars in 1209 bytes} [Wed Oct 19 07:29:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2062973414 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:29:34.905648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-76165702", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b334baf1-2061-48ac-b7fa-b6eb014c8c24"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:34.958084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] validate_networks() for [('b334baf1-2061-48ac-b7fa-b6eb014c8c24', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:29:35.335044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:29:35.335493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:29:35.335975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:29:35.336416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:29:35.336834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:29:35.345798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:35.347761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:35.347761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:35.347761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:35.348215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:35.348319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:35.366091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:29:35.371342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for user 83aaeed768e54cf5a7958e85e6dd91a4 and project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:29:35.383289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:29:35.385613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:29:35.430315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:35.431083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:35.438433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:35.438944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:35.439414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:35.440322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:35.440802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:35.441283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:35.529100 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c612d28-e3aa-4142-88ae-18cee439315f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627309 Oct 19 07:29:35.529860 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3046/5943] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:29:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:29:35.542001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eeb9368c-b52c-44bf-8fd7-8a48af00c50f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:35.542782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eeb9368c-b52c-44bf-8fd7-8a48af00c50f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:35.591054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:35.600323 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8a299f7-36f8-4de6-b05f-bf300d734f26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.175216 Oct 19 07:29:35.600917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eeb9368c-b52c-44bf-8fd7-8a48af00c50f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:35.601982 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2898/5944] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:35 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:35.611474 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eeb9368c-b52c-44bf-8fd7-8a48af00c50f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1207 microversion: 2.1 time: 0.073327 Oct 19 07:29:35.616268 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3047/5945] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:35 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1207 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:36.623864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:36.624632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:36.633890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:36.634617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:36.634833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:36.635380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:36.635961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:36.636265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:36.636911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:36.638166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:36.644221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:36.645005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:36.645505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:36.646904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:36.647366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:36.647808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:36.713316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:36.724094 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5231085-9829-4da3-81aa-6f97ee9c4e37 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1211 microversion: 2.1 time: 0.093247 Oct 19 07:29:36.740535 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3048/5946] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:36 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:36.792799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:36.800765 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76ac3530-bb45-4b62-b9a2-f51bfb609172 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.181163 Oct 19 07:29:36.801349 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2899/5947] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:36 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:37.748361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:37.749082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:37.756608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:37.758289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:37.758289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:37.758289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:37.758654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:37.759077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:37.824899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:37.825545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:37.835230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:37.836222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:37.836895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:37.837522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:37.838453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:37.839077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:37.839682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:37.851141 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d447e56-5f09-40bc-9ca8-926050731047 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1259 microversion: 2.1 time: 0.106621 Oct 19 07:29:37.869825 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3049/5948] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:37 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1259 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:38.011770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:38.021114 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-046a49a9-d295-4125-b8a9-f05779d7e523 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.200257 Oct 19 07:29:38.021840 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2900/5949] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:37 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:38.881875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:38.882487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:38.889705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:38.890204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:38.890650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:38.891363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:38.891826 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:38.892291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:39.046660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:39.047275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:39.055460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:39.056196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:39.056651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:39.057372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:39.057840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:39.058281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:39.195696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:39.203929 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1d5587d-6456-4eec-9422-f66edf0019d0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1307 microversion: 2.1 time: 0.326046 Oct 19 07:29:39.204644 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3050/5950] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:38 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1307 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:39.236515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:39.246367 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f09579b4-63d3-4e2f-bc0f-84f52c11e946 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.203725 Oct 19 07:29:39.246964 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2901/5951] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:39 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:39.921900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-af250eed-7495-47e6-a5dd-4339b378f028 req-49250884-7d2c-4379-9df3-5bd58ef4fa5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9969cb7e-5ad4-4345-b24f-48314c8bc868", "tag": "98284632-7b7e-4618-b793-5aa50cdf6b02"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:39.936380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-af250eed-7495-47e6-a5dd-4339b378f028 req-49250884-7d2c-4379-9df3-5bd58ef4fa5b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:39.937017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-af250eed-7495-47e6-a5dd-4339b378f028 req-49250884-7d2c-4379-9df3-5bd58ef4fa5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:39.937613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-af250eed-7495-47e6-a5dd-4339b378f028 req-49250884-7d2c-4379-9df3-5bd58ef4fa5b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:39.950156 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-af250eed-7495-47e6-a5dd-4339b378f028 req-49250884-7d2c-4379-9df3-5bd58ef4fa5b service nova] Creating event network-changed:98284632-7b7e-4618-b793-5aa50cdf6b02 for instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 on n-h1-861333-10 Oct 19 07:29:39.956142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-af250eed-7495-47e6-a5dd-4339b378f028 req-49250884-7d2c-4379-9df3-5bd58ef4fa5b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038497 Oct 19 07:29:39.958743 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3051/5952] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:29:40.234993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:40.235519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:40.243008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:40.243500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:40.244005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:40.244936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:40.245409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:40.245855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:40.273823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:40.274787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:40.282020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:40.283371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:40.283881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:40.284842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:40.285315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:40.285752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:40.404038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:40.412816 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04477b84-ec34-4b73-9eda-1daf9bcc0ae0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1307 microversion: 2.1 time: 0.189764 Oct 19 07:29:40.414033 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2902/5953] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:40 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1307 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:40.532441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:40.540708 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f236fc22-23e4-4635-a962-40a9e639e805 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.273973 Oct 19 07:29:40.546416 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3052/5954] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:40 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:41.436624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:41.437341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:41.444061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:41.444584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:41.445060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:41.445778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:41.446448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:41.446891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:41.584959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:41.593896 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1dca70ba-7736-4982-9248-2504afd9cf7f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1307 microversion: 2.1 time: 0.161000 Oct 19 07:29:41.594765 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2903/5955] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:41 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1307 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:41.628006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:41.628658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:41.635196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:41.635684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:41.636149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:41.636848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:41.637310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:41.637838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:41.776033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:41.783977 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-627ce663-1e0a-4ec2-bc30-6fcc5d1702fd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1341 microversion: 2.1 time: 0.223581 Oct 19 07:29:41.784523 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3053/5956] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:41 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1341 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:42.619378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:42.620181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:42.627422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:42.627916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:42.628388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:42.629086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:42.629551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:42.629986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:42.758930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:42.766770 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90f6deb5-0b68-4f2d-9056-979b573c54c7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1307 microversion: 2.1 time: 0.151242 Oct 19 07:29:42.767342 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2904/5957] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:42 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:42.806647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:42.807288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:42.814609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:42.815105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:42.815631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:42.816367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:42.816831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:42.817264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:42.946808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:42.954670 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-044a267d-3073-44cb-861a-f641ef6577b3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.151832 Oct 19 07:29:42.955254 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3054/5958] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:42 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:43.790350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:43.790976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:43.797969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:43.798467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:43.798927 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:43.799636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:43.800121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:43.800566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:43.929883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:43.937674 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d208cef5-0d71-49bd-ac1c-9e10e89e9d49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1307 microversion: 2.1 time: 0.151748 Oct 19 07:29:43.938241 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2905/5959] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:43 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:43.984803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:43.985410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:43.992962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:43.993453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:43.993893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:43.994579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:43.995035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:43.995462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:44.129331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:44.137030 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eba6d19a-5240-4b19-be94-f786e81bc54d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.156038 Oct 19 07:29:44.137594 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3055/5960] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:43 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:44.960776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:44.961398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:44.968480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:44.969003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:44.969453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:44.970157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:44.970626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:44.971066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:45.108508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:45.116779 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f353c2ab-a2fd-4db2-914d-36846da5fa0a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1307 microversion: 2.1 time: 0.160035 Oct 19 07:29:45.117442 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2906/5961] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:44 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:45.160381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:45.160944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:45.167656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:45.168176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:45.168679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:45.169382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:45.169846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:45.170278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:45.302628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:45.310352 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2eced1b9-e42a-49c3-8a75-b0253f6b7530 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.154231 Oct 19 07:29:45.310915 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3056/5962] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:45 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:46.141266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:46.142308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:46.150777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:46.151280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:46.151734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:46.152532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:46.153008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:46.153449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:46.285383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:46.295205 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-236cc0e3-7962-4ad6-88e1-7074fa1077f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1307 microversion: 2.1 time: 0.156856 Oct 19 07:29:46.295205 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2907/5963] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:46 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1307 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:46.332152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:46.332696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:46.335255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:46.335948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:46.341952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:46.342438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:46.342877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:46.343560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:46.344019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:46.344471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:46.473611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:46.481673 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67bc455d-cfed-48e2-a721-4a340804a297 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.153478 Oct 19 07:29:46.482242 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3057/5964] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:46 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:46.815796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a276d46e-03a5-4c02-b4c9-2499665e4ad2 req-1a9bd376-ba59-46ac-ba7c-a25eb29f7738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9969cb7e-5ad4-4345-b24f-48314c8bc868", "name": "network-vif-plugged", "status": "completed", "tag": "98284632-7b7e-4618-b793-5aa50cdf6b02"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:46.825365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a276d46e-03a5-4c02-b4c9-2499665e4ad2 req-1a9bd376-ba59-46ac-ba7c-a25eb29f7738 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:46.825859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a276d46e-03a5-4c02-b4c9-2499665e4ad2 req-1a9bd376-ba59-46ac-ba7c-a25eb29f7738 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:46.826316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a276d46e-03a5-4c02-b4c9-2499665e4ad2 req-1a9bd376-ba59-46ac-ba7c-a25eb29f7738 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:46.837118 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a276d46e-03a5-4c02-b4c9-2499665e4ad2 req-1a9bd376-ba59-46ac-ba7c-a25eb29f7738 service nova] Creating event network-vif-plugged:98284632-7b7e-4618-b793-5aa50cdf6b02 for instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 on n-h1-861333-10 Oct 19 07:29:46.841945 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a276d46e-03a5-4c02-b4c9-2499665e4ad2 req-1a9bd376-ba59-46ac-ba7c-a25eb29f7738 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029934 Oct 19 07:29:46.842592 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2908/5965] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:29:47.316261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:47.316879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:47.323076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:47.323615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:47.324050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:47.324766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:47.325228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:47.325699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:47.458758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:47.466617 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e26d27e3-7f20-402c-8176-9edeb974c7b6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1307 microversion: 2.1 time: 0.154457 Oct 19 07:29:47.467192 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3058/5966] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:47 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:47.506351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:47.507059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:47.516752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:47.516752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:47.516752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:47.517113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:47.517512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:47.517960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:47.665967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:47.673862 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79d561d5-f3e5-4489-b062-a21c08a5eb62 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.172630 Oct 19 07:29:47.674473 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2909/5967] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:47 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:48.490105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:48.490677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:48.497620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:48.498112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:48.498552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:48.499250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:48.499712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:48.500162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:48.633115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:48.640885 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-132cd2db-0972-45db-86ab-9efc112954b1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1488 microversion: 2.1 time: 0.154996 Oct 19 07:29:48.641465 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3059/5968] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:48 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1488 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:48.706940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:48.711759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:48.711872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-76165702", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b334baf1-2061-48ac-b7fa-b6eb014c8c24"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:48.715592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:48.716159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:48.716615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:48.717418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:48.717888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:48.718327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:48.762498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] validate_networks() for [('b334baf1-2061-48ac-b7fa-b6eb014c8c24', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:29:48.859298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:48.867189 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-533b7399-c929-4a05-96d7-4e92c4c96f7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.164294 Oct 19 07:29:48.867761 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2910/5969] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:48 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:49.143138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:29:49.143575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:29:49.144065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:29:49.144522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:29:49.144944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:29:49.154725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:49.155216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:49.155660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:49.156446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:49.156966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:49.157496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:49.164323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:49.176502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:29:49.181859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for user 83aaeed768e54cf5a7958e85e6dd91a4 and project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:29:49.195105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:29:49.197423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:29:49.309837 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b03eccb5-13dd-4676-bc62-dce885b210f4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604840 Oct 19 07:29:49.310401 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3060/5970] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:29:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 07:29:49.321865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ee293da-c6c9-4b62-b18f-3818d0f38aa7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:49.322491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ee293da-c6c9-4b62-b18f-3818d0f38aa7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:49.375122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ee293da-c6c9-4b62-b18f-3818d0f38aa7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:49.385850 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ee293da-c6c9-4b62-b18f-3818d0f38aa7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1207 microversion: 2.1 time: 0.065217 Oct 19 07:29:49.385850 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2911/5971] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:49 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1207 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:49.891880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:49.892484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:49.899577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:49.900063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:49.900530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:49.901225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:49.901682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:49.902113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:50.036045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:50.044568 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a580854-4b56-45ef-b60a-a74240a1c7cb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.157768 Oct 19 07:29:50.045140 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3061/5972] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:49 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:50.406043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:50.406670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:50.414936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:50.415450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:50.415918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:50.416653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:50.417125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:50.417571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:50.483294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:50.490997 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec156f46-09ae-412e-8d89-790cfdd5ca99 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1211 microversion: 2.1 time: 0.088871 Oct 19 07:29:50.491562 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2912/5973] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:50 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:51.067678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:51.068313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:51.075879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:51.076409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:51.077987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:51.077987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:51.078392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:51.078482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:51.216085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:51.223936 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f62e51e-1166-4ad4-a820-2ba6eb9fcb16 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.160287 Oct 19 07:29:51.224563 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3062/5974] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:51 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:51.514431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:51.516350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:51.522012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:51.522540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:51.522987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:51.523969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:51.524466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:51.524910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:51.545529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:29:51.589917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:51.597590 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-202a1f38-deb8-494d-9b1c-dae8be88464b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1267 microversion: 2.1 time: 0.087076 Oct 19 07:29:51.598165 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2913/5975] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:51 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:52.254066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:52.256381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:52.266135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:52.266695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:52.267171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:52.272166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:52.272166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:52.272166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:52.483355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:52.492006 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f431a11-512c-4220-acc3-a583568830d1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.243549 Oct 19 07:29:52.495452 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3063/5976] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:52 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:52.621346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:52.622059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:52.629440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:52.630012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:52.630546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:52.632011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:52.632581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:52.633087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:52.774122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:52.782820 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6775af7-dcd4-4ce9-a678-9dc5b049162c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1307 microversion: 2.1 time: 0.165367 Oct 19 07:29:52.783544 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2914/5977] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:52 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1307 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:52.967965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b466f2ce-94ae-4b25-ac42-cc7cfe1a5ed5 req-0eb92238-244b-4ab0-8f3e-744e31da3d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed87f3-8b0b-4150-a5f7-c3830167d3ea", "name": "network-vif-plugged", "status": "completed", "tag": "531ac8e5-b33e-4df2-a870-5f8209b99bc7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:52.978704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b466f2ce-94ae-4b25-ac42-cc7cfe1a5ed5 req-0eb92238-244b-4ab0-8f3e-744e31da3d88 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:52.979375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b466f2ce-94ae-4b25-ac42-cc7cfe1a5ed5 req-0eb92238-244b-4ab0-8f3e-744e31da3d88 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:52.979833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b466f2ce-94ae-4b25-ac42-cc7cfe1a5ed5 req-0eb92238-244b-4ab0-8f3e-744e31da3d88 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:52.991001 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b466f2ce-94ae-4b25-ac42-cc7cfe1a5ed5 req-0eb92238-244b-4ab0-8f3e-744e31da3d88 service nova] Creating event network-vif-plugged:531ac8e5-b33e-4df2-a870-5f8209b99bc7 for instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea on n-h2-861333-10 Oct 19 07:29:52.996548 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b466f2ce-94ae-4b25-ac42-cc7cfe1a5ed5 req-0eb92238-244b-4ab0-8f3e-744e31da3d88 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032311 Oct 19 07:29:52.997183 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3064/5978] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:29:53.500668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-57da804b-818e-4b12-9512-8cbe42e4a2a5 req-0acb3908-9aa9-4a90-96ed-5d982b7fc0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49f184e-9a4f-448e-a7d3-a5bf7999181a", "tag": "60f06d9b-299d-42fb-a77f-ea85fccaae39"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:53.510840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57da804b-818e-4b12-9512-8cbe42e4a2a5 req-0acb3908-9aa9-4a90-96ed-5d982b7fc0bb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:53.511470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57da804b-818e-4b12-9512-8cbe42e4a2a5 req-0acb3908-9aa9-4a90-96ed-5d982b7fc0bb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:53.511916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57da804b-818e-4b12-9512-8cbe42e4a2a5 req-0acb3908-9aa9-4a90-96ed-5d982b7fc0bb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:53.523384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:53.524123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:53.524414 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-57da804b-818e-4b12-9512-8cbe42e4a2a5 req-0acb3908-9aa9-4a90-96ed-5d982b7fc0bb service nova] Creating event network-changed:60f06d9b-299d-42fb-a77f-ea85fccaae39 for instance e49f184e-9a4f-448e-a7d3-a5bf7999181a on n-h1-861333-10 Oct 19 07:29:53.529622 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-57da804b-818e-4b12-9512-8cbe42e4a2a5 req-0acb3908-9aa9-4a90-96ed-5d982b7fc0bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032707 Oct 19 07:29:53.530232 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2915/5979] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:29:53.532817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:53.533420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:53.533865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:53.534579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:53.535038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:53.535498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:53.762081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:53.770413 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72c92cf0-d62e-4ff0-9484-b3a2715b845e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1375 microversion: 2.1 time: 0.256271 Oct 19 07:29:53.771029 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3065/5980] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:53 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:53.807548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:53.808289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:53.814452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:53.814949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:53.815399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:53.817061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:53.817061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:53.817061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:53.951775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:53.959913 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2c64911-27fb-484e-9d1e-9697dfb2c55c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1307 microversion: 2.1 time: 0.157528 Oct 19 07:29:53.960523 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2916/5981] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:53 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:54.797830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:54.798479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:54.806185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:54.806748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:54.807195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:54.807900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:54.808394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:54.808831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:54.939885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:54.948327 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4483e40e-9cc2-4cf4-a18e-d9a6ea09397b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1562 microversion: 2.1 time: 0.154397 Oct 19 07:29:54.949799 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3066/5982] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:54 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:54.970447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:54.972839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:54.978055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:54.978591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:54.979040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:54.979800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:54.980299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:54.980784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:54.982849 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:54.983489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:54.989447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:54.990464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:54.990912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:54.991721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:54.992209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:54.995729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:55.125881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:55.134603 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff08959f-e3ee-4c6c-b3ce-6955cb11ce3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1562 microversion: 2.1 time: 0.167982 Oct 19 07:29:55.142380 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2917/5983] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:54 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:55.143013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:55.151845 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80d8c4e4-238c-4e6b-af9e-15ca66a3b242 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1307 microversion: 2.1 time: 0.172934 Oct 19 07:29:55.152560 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3067/5984] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:54 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:55.219103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:55.219707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:55.226148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:55.235582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:55.235582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:55.235582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:55.235582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:55.235582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:55.257429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:29:55.570678 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7cee8879-5f85-49a4-837a-f6ccebd955fc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 204 len: 0 microversion: 2.1 time: 0.355099 Oct 19 07:29:55.575790 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2918/5985] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:29:55 2022] DELETE /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:29:55.579577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:55.580225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:55.586832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:55.587321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:55.587767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:55.588534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:55.589001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:55.589438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:55.719135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:55.727716 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32d6eabd-fda9-4b2e-9824-fae83a094853 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1568 microversion: 2.1 time: 0.152210 Oct 19 07:29:55.728339 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3068/5986] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:55 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:56.176381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:56.177157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:56.184195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:56.184700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:56.185159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:56.185864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:56.186342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:56.186789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:56.322639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:56.330385 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c36043f-b49f-4108-88aa-e600162405e7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1307 microversion: 2.1 time: 0.158370 Oct 19 07:29:56.330904 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2919/5987] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:56 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:56.751525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:56.752090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:56.759566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:56.760067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:56.760562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:56.761274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:56.761746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:56.762239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:56.902287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:56.910058 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28378f1c-5630-44ab-afb1-f782fdf4e24f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1568 microversion: 2.1 time: 0.163041 Oct 19 07:29:56.912206 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3069/5988] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:56 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:29:57.353863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:57.354489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:57.361330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:57.361862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:57.362314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:57.363030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:57.363499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:57.363939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:57.831028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:57.839354 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a800f0b-c9fa-4086-bfd3-43fa3033ef29 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1307 microversion: 2.1 time: 0.489928 Oct 19 07:29:57.839930 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2920/5989] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:57 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1307 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:57.933404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:57.935246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:57.941977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:57.942486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:57.942953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:57.943658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:57.944134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:57.944568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:58.082019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:58.091919 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-480fcda0-5150-46cd-a1da-9bfd1c13b1c6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1568 microversion: 2.1 time: 0.162346 Oct 19 07:29:58.092541 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3070/5990] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:57 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:58.182031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a3202bb6-66e9-4033-952b-2de39c9e1926 req-b8b9ce18-bfc9-4754-b3f8-51433965a9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed87f3-8b0b-4150-a5f7-c3830167d3ea", "name": "network-vif-deleted", "tag": "531ac8e5-b33e-4df2-a870-5f8209b99bc7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:29:58.193643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a3202bb6-66e9-4033-952b-2de39c9e1926 req-b8b9ce18-bfc9-4754-b3f8-51433965a9c0 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:58.194356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a3202bb6-66e9-4033-952b-2de39c9e1926 req-b8b9ce18-bfc9-4754-b3f8-51433965a9c0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:58.194801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a3202bb6-66e9-4033-952b-2de39c9e1926 req-b8b9ce18-bfc9-4754-b3f8-51433965a9c0 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:58.212340 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a3202bb6-66e9-4033-952b-2de39c9e1926 req-b8b9ce18-bfc9-4754-b3f8-51433965a9c0 service nova] Creating event network-vif-deleted:531ac8e5-b33e-4df2-a870-5f8209b99bc7 for instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea on n-h2-861333-10 Oct 19 07:29:58.219488 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a3202bb6-66e9-4033-952b-2de39c9e1926 req-b8b9ce18-bfc9-4754-b3f8-51433965a9c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039218 Oct 19 07:29:58.219488 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2921/5991] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:29:58.862204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:58.863063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:58.870581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:58.871156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:58.871679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:58.872512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:58.873058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:58.873594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:59.016837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:59.026313 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59f3694d-735f-4a28-9e8c-2c917cc6af4b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1307 microversion: 2.1 time: 0.168192 Oct 19 07:29:59.026896 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3071/5992] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:58 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:29:59.117406 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:29:59.118150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:29:59.124800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:59.125740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:59.126384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:59.127296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:29:59.128524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:29:59.129143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:29:59.206029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:29:59.216295 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79edf48b-9b51-4d25-a3b3-567f3df391dd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1360 microversion: 2.1 time: 0.104991 Oct 19 07:29:59.228257 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2922/5993] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:29:59 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1360 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:00.051633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:00.053342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:00.055153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:00.055846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:00.062316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:00.062868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:00.063309 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:00.064018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:00.064558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:00.068703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:00.203891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:00.211738 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92f5a8b9-3596-433a-85e0-fc93476a3f10 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1307 microversion: 2.1 time: 0.164672 Oct 19 07:30:00.212577 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3072/5994] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:00 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:00.241492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:00.246760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:00.246760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:00.250153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:00.250588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:00.251037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:00.251750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:00.252249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:00.252698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:00.319923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:00.327878 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c34f7d25-b619-43a8-901d-9820ae5a9b1d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1360 microversion: 2.1 time: 0.090772 Oct 19 07:30:00.340153 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2923/5995] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:00 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:00.828219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1c7012fc-2b7b-45dd-9edf-8d623134f98d req-f979f9d3-2a2c-43b8-9fc4-8e6eb60669b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49f184e-9a4f-448e-a7d3-a5bf7999181a", "name": "network-vif-plugged", "status": "completed", "tag": "60f06d9b-299d-42fb-a77f-ea85fccaae39"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:00.839671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c7012fc-2b7b-45dd-9edf-8d623134f98d req-f979f9d3-2a2c-43b8-9fc4-8e6eb60669b6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:00.840183 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c7012fc-2b7b-45dd-9edf-8d623134f98d req-f979f9d3-2a2c-43b8-9fc4-8e6eb60669b6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:00.840619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c7012fc-2b7b-45dd-9edf-8d623134f98d req-f979f9d3-2a2c-43b8-9fc4-8e6eb60669b6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:00.853440 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1c7012fc-2b7b-45dd-9edf-8d623134f98d req-f979f9d3-2a2c-43b8-9fc4-8e6eb60669b6 service nova] Creating event network-vif-plugged:60f06d9b-299d-42fb-a77f-ea85fccaae39 for instance e49f184e-9a4f-448e-a7d3-a5bf7999181a on n-h1-861333-10 Oct 19 07:30:00.858642 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1c7012fc-2b7b-45dd-9edf-8d623134f98d req-f979f9d3-2a2c-43b8-9fc4-8e6eb60669b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034935 Oct 19 07:30:00.859353 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3073/5996] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:01.235217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:01.235853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:01.242620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:01.243204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:01.243576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:01.244353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:01.244828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:01.245272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:01.352170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:01.353050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:01.360251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:01.360751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:01.361195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:01.361913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:01.362398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:01.362835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:01.383587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:01.391894 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b71485b4-2e18-40ab-b57b-77f627f11445 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1307 microversion: 2.1 time: 0.160907 Oct 19 07:30:01.395757 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2924/5997] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:01 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1307 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:01.429791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:01.437955 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-052f5a93-2ada-4743-9f9d-8170d83e8a0b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1360 microversion: 2.1 time: 0.091042 Oct 19 07:30:01.438542 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3074/5998] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:01 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:30:02.415909 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:02.416530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:02.423692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.424223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.424673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.425370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.425834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.426273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.462125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:02.462759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:02.470926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.472182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.472721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.473590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.474634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.475080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.550814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:02.559189 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c925731a-7bd3-41b7-beaa-077beba48e5c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1360 microversion: 2.1 time: 0.101788 Oct 19 07:30:02.576790 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3075/5999] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:02 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1360 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:02.583710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:02.591765 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cea9e9fa-0678-4275-9bd0-74e07d6f8a9d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1488 microversion: 2.1 time: 0.180552 Oct 19 07:30:02.592664 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2925/6000] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:02 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1488 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:02.614250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:02.614868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:02.620922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.621416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.621865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.622567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.623033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.623469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.757546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:02.765179 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5a5e6c2-de36-4341-81ec-bcb42e637e7b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1488 microversion: 2.1 time: 0.154846 Oct 19 07:30:02.765747 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3076/6001] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:02 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1488 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:02.787613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:02.788310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:02.794456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.796285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.796285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.796285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.796643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.797085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.930995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:02.938775 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb531c3d-f4a2-40bb-bd27-29166b50bfd4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1488 microversion: 2.1 time: 0.155060 Oct 19 07:30:02.939345 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2926/6002] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:02 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1488 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:02.962230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:02.962662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:02.965666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:02.969074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.969558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.969996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.970682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:02.971139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:02.971565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:02.998012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:30:03.033632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:03.463190 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fef7eb8-3c91-4436-80e4-a0098a65a961 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 204 len: 0 microversion: 2.1 time: 0.504568 Oct 19 07:30:03.463974 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3077/6003] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:30:02 2022] DELETE /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:30:03.475301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:03.476000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:03.482533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:03.483468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:03.483922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:03.484704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:03.485125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:03.485560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:03.586139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:03.587108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:03.594690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:03.595190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:03.595636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:03.596387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:03.596845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:03.605078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:03.634028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:03.634555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:03.635003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:03.635462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lazy-loading 'fault' on Instance uuid a3ed87f3-8b0b-4150-a5f7-c3830167d3ea {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:30:03.635881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:03.644619 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4c6de6f-22ec-4c13-8980-53e0fab6c75f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1494 microversion: 2.1 time: 0.175761 Oct 19 07:30:03.645283 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2927/6004] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:03 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1494 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:03.685833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:03.693991 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2c5cf17-4aa6-45b3-8167-cedee788efea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 200 len: 1365 microversion: 2.1 time: 0.113238 Oct 19 07:30:03.694664 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3078/6005] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:03 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:30:04.669141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:04.669770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:04.672568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:04.678650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:04.679450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:04.679984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:04.680926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:04.681599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:04.682241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:04.718094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:04.718723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:04.725811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:04.726314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:04.726767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:04.727694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:04.728084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:04.728552 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:04.743200 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea HTTP/1.1 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'a3ed87f3-8b0b-4150-a5f7-c3830167d3ea'} Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:04.745225 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:04.749851 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:04.749851 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:04.749851 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:04.749851 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:30:04.749851 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:30:04.749851 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:04.749851 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:04.751108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:30:04.752180 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd245cd6-c03f-4458-87c9-fb14cfdda4aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 404 len: 111 microversion: 2.1 time: 0.038894 Oct 19 07:30:04.752913 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3079/6006] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:04 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:30:04.829171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:04.837052 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15c2786e-e1a3-43c9-a1ad-32a991f9c21e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1494 microversion: 2.1 time: 0.171875 Oct 19 07:30:04.837629 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2928/6007] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:04 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1494 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:05.456822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-57b949a6-c41c-4c81-8398-867fdc56e0ef req-cd5d6695-9c0d-4948-a928-d20e415e0311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49f184e-9a4f-448e-a7d3-a5bf7999181a", "name": "network-vif-deleted", "tag": "60f06d9b-299d-42fb-a77f-ea85fccaae39"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:05.467489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-57b949a6-c41c-4c81-8398-867fdc56e0ef req-cd5d6695-9c0d-4948-a928-d20e415e0311 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:05.468273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-57b949a6-c41c-4c81-8398-867fdc56e0ef req-cd5d6695-9c0d-4948-a928-d20e415e0311 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:05.468980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-57b949a6-c41c-4c81-8398-867fdc56e0ef req-cd5d6695-9c0d-4948-a928-d20e415e0311 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:05.487163 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-57b949a6-c41c-4c81-8398-867fdc56e0ef req-cd5d6695-9c0d-4948-a928-d20e415e0311 service nova] Creating event network-vif-deleted:60f06d9b-299d-42fb-a77f-ea85fccaae39 for instance e49f184e-9a4f-448e-a7d3-a5bf7999181a on n-h1-861333-10 Oct 19 07:30:05.492620 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-57b949a6-c41c-4c81-8398-867fdc56e0ef req-cd5d6695-9c0d-4948-a928-d20e415e0311 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039415 Oct 19 07:30:05.493898 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3080/6008] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:05.860368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:05.861008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:05.868693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:05.869238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:05.869792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:05.870600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:05.871080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:05.871529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:05.906749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:05.907190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:05.907649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:05.908141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lazy-loading 'fault' on Instance uuid e49f184e-9a4f-448e-a7d3-a5bf7999181a {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:30:05.910904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:05.954339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:05.960982 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e156c0a1-a822-4058-b470-97d10ccc683b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 200 len: 1297 microversion: 2.1 time: 0.104789 Oct 19 07:30:05.961878 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2929/6009] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:05 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:30:06.990841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:06.990841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:06.994674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:06.995275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:06.995913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:06.996644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:06.997110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:06.997545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:07.011604 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a HTTP/1.1 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'e49f184e-9a4f-448e-a7d3-a5bf7999181a'} Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:07.013318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:07.018032 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:07.018032 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:07.018032 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:07.018032 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:30:07.018032 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:30:07.018032 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:30:07.018032 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:07.018032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:30:07.018032 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e102023f-51e6-4bd7-bd3e-224bf2dbbf45 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 404 len: 111 microversion: 2.1 time: 0.033139 Oct 19 07:30:07.018839 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3081/6010] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:06 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:30:07.024925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:07.025428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:07.033375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:07.036303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:07.036303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:07.036303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:07.036303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:07.036303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:07.063248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:30:07.313501 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79ab3770-5f70-4638-a9a4-87b5c7bf98ea tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 204 len: 0 microversion: 2.1 time: 0.293115 Oct 19 07:30:07.314157 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2930/6011] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:30:07 2022] DELETE /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:30:07.322968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:07.323528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:07.329764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:07.330445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:07.331149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:07.331864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:07.332565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:07.333657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:07.476716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:07.484867 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4efd6fed-935d-47b8-8475-2908baf0da6e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1494 microversion: 2.1 time: 0.165791 Oct 19 07:30:07.485445 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3082/6012] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:07 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1494 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:08.510170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:08.511033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:08.518458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:08.519023 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:08.519511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:08.520956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:08.521436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:08.521884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:08.659814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:08.669367 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e70303c8-3256-426d-9392-a9a56fea7b3a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1494 microversion: 2.1 time: 0.163562 Oct 19 07:30:08.670047 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2931/6013] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:08 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1494 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:09.162534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:09.163053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:09.169951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:09.170436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:09.170877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:09.171568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:09.172027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:09.172488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:09.199682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:30:09.385144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2e42ee94-b7e1-47ca-b13c-5789f869085d req-fa348ef9-fd44-41c9-9ede-8a4417857582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9969cb7e-5ad4-4345-b24f-48314c8bc868", "name": "network-vif-deleted", "tag": "98284632-7b7e-4618-b793-5aa50cdf6b02"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:09.405517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2e42ee94-b7e1-47ca-b13c-5789f869085d req-fa348ef9-fd44-41c9-9ede-8a4417857582 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:09.406922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2e42ee94-b7e1-47ca-b13c-5789f869085d req-fa348ef9-fd44-41c9-9ede-8a4417857582 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:09.407306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2e42ee94-b7e1-47ca-b13c-5789f869085d req-fa348ef9-fd44-41c9-9ede-8a4417857582 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:09.421508 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2e42ee94-b7e1-47ca-b13c-5789f869085d req-fa348ef9-fd44-41c9-9ede-8a4417857582 service nova] Creating event network-vif-deleted:98284632-7b7e-4618-b793-5aa50cdf6b02 for instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 on n-h1-861333-10 Oct 19 07:30:09.429583 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2e42ee94-b7e1-47ca-b13c-5789f869085d req-fa348ef9-fd44-41c9-9ede-8a4417857582 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047901 Oct 19 07:30:09.435417 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2932/6014] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:09.512600 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f927e15-900d-4e00-be6d-e0a3d60963d7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 204 len: 0 microversion: 2.1 time: 0.353744 Oct 19 07:30:09.516647 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3083/6015] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:30:09 2022] DELETE /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:30:09.523975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:09.524984 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:09.531869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:09.532587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:09.533147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:09.533943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:09.534480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:09.534987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:09.675872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:09.683749 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ddeb25f-8b5a-4342-9f6f-0e080369aa0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1409 microversion: 2.1 time: 0.165710 Oct 19 07:30:09.684353 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2933/6016] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:09 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:09.695322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:09.696085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:09.702032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:09.702518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:09.702961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:09.703789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:09.704289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:09.704817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:09.767519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:09.776607 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c9c397b-c8fd-4a96-8c66-beb1212777c4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1292 microversion: 2.1 time: 0.085294 Oct 19 07:30:09.777483 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3084/6017] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:09 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:10.706841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:10.707977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:10.714873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:10.715373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:10.716543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:10.716543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:10.717011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:10.717453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:10.799689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:10.800355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:10.808290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:10.808794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:10.809236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:10.809957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:10.810419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:10.810861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:10.844182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:10.844674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:10.845120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:10.845575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lazy-loading 'fault' on Instance uuid 9969cb7e-5ad4-4345-b24f-48314c8bc868 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:30:10.851563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:10.860396 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ee44f29-c38b-4941-b418-95109295e7c0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1409 microversion: 2.1 time: 0.157326 Oct 19 07:30:10.861069 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2934/6018] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:10 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:10.894441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:10.902919 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dac7f051-c0c0-42ad-88c4-6fe37ed2f844 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 200 len: 1297 microversion: 2.1 time: 0.107366 Oct 19 07:30:10.903491 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3085/6019] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:10 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:30:11.883241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:11.883921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:11.891394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:11.891758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:11.892232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:11.893135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:11.893831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:11.894334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:11.927077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:11.927758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:11.939213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:11.939717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:11.940187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:11.940913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:11.941377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:11.941809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:11.960714 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 HTTP/1.1 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '9969cb7e-5ad4-4345-b24f-48314c8bc868'} Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:11.962415 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:11.966049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:11.966049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:11.966049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:11.966049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:30:11.966049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:30:11.966049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:30:11.966049 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:11.966049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:30:11.966049 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a074b86-9072-46d4-b6c7-7d3b6a593387 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 404 len: 111 microversion: 2.1 time: 0.042001 Oct 19 07:30:11.967719 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3086/6020] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:11 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:30:11.972827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:11.986898 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4223508e-1968-42d9-a6a2-16bce3ddfcba tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1367 microversion: 2.1 time: 0.107852 Oct 19 07:30:11.987566 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2935/6021] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:11 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1367 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:11.988420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0005044f-ef4b-407d-8aeb-24e921ca0afa req-145f1d4d-d257-4bb0-9e89-12e9c7d25aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a277bbc-99b2-410c-872b-a35b4f39b7d8", "name": "network-vif-deleted", "tag": "c8ce0f91-e348-442c-add5-8886b7470772"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:11.997708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0005044f-ef4b-407d-8aeb-24e921ca0afa req-145f1d4d-d257-4bb0-9e89-12e9c7d25aeb service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:11.998192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0005044f-ef4b-407d-8aeb-24e921ca0afa req-145f1d4d-d257-4bb0-9e89-12e9c7d25aeb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:11.998628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0005044f-ef4b-407d-8aeb-24e921ca0afa req-145f1d4d-d257-4bb0-9e89-12e9c7d25aeb service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:12.009985 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0005044f-ef4b-407d-8aeb-24e921ca0afa req-145f1d4d-d257-4bb0-9e89-12e9c7d25aeb service nova] Creating event network-vif-deleted:c8ce0f91-e348-442c-add5-8886b7470772 for instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 on n-h1-861333-10 Oct 19 07:30:12.015235 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0005044f-ef4b-407d-8aeb-24e921ca0afa req-145f1d4d-d257-4bb0-9e89-12e9c7d25aeb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046025 Oct 19 07:30:12.015813 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3087/6022] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:12.019659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-824346071", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b334baf1-2061-48ac-b7fa-b6eb014c8c24"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:12.073725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] validate_networks() for [('b334baf1-2061-48ac-b7fa-b6eb014c8c24', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:30:12.471739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:30:12.472470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:30:12.473182 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:30:12.473848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:30:12.474542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:30:12.485041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:12.485811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:12.486447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:12.487366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:12.488060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:12.488771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:12.511234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:30:12.517444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for user 83aaeed768e54cf5a7958e85e6dd91a4 and project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:30:12.531882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:30:12.534758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:30:12.681675 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e62be7c9-feb3-4dea-b5bc-da14a6b8c3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665476 Oct 19 07:30:12.683295 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2936/6023] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:30:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 07:30:12.694969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ec21474-610c-41de-9ad0-65531a033be9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:12.695938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ec21474-610c-41de-9ad0-65531a033be9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:12.750678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ec21474-610c-41de-9ad0-65531a033be9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:12.758255 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ec21474-610c-41de-9ad0-65531a033be9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1208 microversion: 2.1 time: 0.068075 Oct 19 07:30:12.769873 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3088/6024] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:12 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1208 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:13.010660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:13.011290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:13.017752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:13.018250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:13.018783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:13.019495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:13.020154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:13.020599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:13.089400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:13.098292 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13cf21d8-0efd-45eb-a2f0-fc96f32f5c77 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1202 microversion: 2.1 time: 0.092365 Oct 19 07:30:13.099385 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2937/6025] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:13 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:13.781311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:13.781983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:13.790361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:13.790864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:13.791526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:13.792300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:13.792771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:13.793212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:13.860187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:13.871471 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61b5608e-5f4d-4e1b-9dd8-2b236d8416b9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1212 microversion: 2.1 time: 0.094228 Oct 19 07:30:13.872051 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3089/6026] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:13 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:14.121675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:14.122340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:14.129518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:14.130111 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:14.131093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:14.131814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:14.132329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:14.132779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:14.201435 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:14.209788 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-771edace-c346-4311-8c6c-e64a76169dc7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1202 microversion: 2.1 time: 0.092109 Oct 19 07:30:14.221807 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2938/6027] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:14 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:14.896593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:14.897532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:14.906531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:14.907267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:14.909243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:14.910237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:14.910937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:14.912292 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:14.993423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:15.001932 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0645438-ba38-47e5-b8b2-4f1fe99332e5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1278 microversion: 2.1 time: 0.110364 Oct 19 07:30:15.002664 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3090/6028] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:14 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:15.238664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:15.239825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:15.247045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:15.247678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:15.248173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:15.248902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:15.249380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:15.249834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:15.338042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:15.346036 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-efe1ff5f-a999-4eda-90f6-6a0d1f12191d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1202 microversion: 2.1 time: 0.116007 Oct 19 07:30:15.346632 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2939/6029] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:15 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1202 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:16.030173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:16.031619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:16.039971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:16.041180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:16.042016 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:16.044283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:16.044864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:16.045420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:16.191018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:16.200296 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-055332c5-a299-4791-925f-64bef192cdac tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1308 microversion: 2.1 time: 0.175103 Oct 19 07:30:16.201941 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3091/6030] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:16 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:16.368403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:16.369209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:16.376735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:16.377235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:16.377681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:16.378587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:16.379073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:16.379512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:16.464540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:16.474067 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5ba082d-66f0-43e2-acfa-2e097117955f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 200 len: 1202 microversion: 2.1 time: 0.110156 Oct 19 07:30:16.474793 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2940/6031] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:16 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 1202 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:16.748307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4f5dea89-c3be-4ca1-a96a-f111af653760 req-60da6031-bbf3-4432-89aa-9d22a625bcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae37f9a-eb55-47ca-8485-a980814fdc20", "tag": "add29373-9b5b-4c94-b928-def644e2070a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:16.760318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4f5dea89-c3be-4ca1-a96a-f111af653760 req-60da6031-bbf3-4432-89aa-9d22a625bcd2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:16.768738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4f5dea89-c3be-4ca1-a96a-f111af653760 req-60da6031-bbf3-4432-89aa-9d22a625bcd2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:16.768738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4f5dea89-c3be-4ca1-a96a-f111af653760 req-60da6031-bbf3-4432-89aa-9d22a625bcd2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:16.776134 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4f5dea89-c3be-4ca1-a96a-f111af653760 req-60da6031-bbf3-4432-89aa-9d22a625bcd2 service nova] Creating event network-changed:add29373-9b5b-4c94-b928-def644e2070a for instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 on n-h2-861333-10 Oct 19 07:30:16.783510 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4f5dea89-c3be-4ca1-a96a-f111af653760 req-60da6031-bbf3-4432-89aa-9d22a625bcd2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041342 Oct 19 07:30:16.784144 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3092/6032] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:17.224034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:17.224804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:17.231025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:17.231523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:17.231969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:17.232708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:17.233194 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:17.233630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:17.401024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:17.410353 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13f5b19e-e05b-4f9c-a381-30c86610b1ec tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1308 microversion: 2.1 time: 0.190204 Oct 19 07:30:17.412206 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2941/6033] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:17 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:17.497794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:17.498875 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:17.505960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:17.506499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:17.506956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:17.507679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:17.508166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:17.508991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:17.523391 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 HTTP/1.1 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '6a277bbc-99b2-410c-872b-a35b4f39b7d8'} Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:17.525134 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-298f8a25-0b89-4dd6-bc0a-f6fd2556d01f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 404 len: 111 microversion: 2.1 time: 0.033325 Oct 19 07:30:17.529749 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3093/6034] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:17 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:30:18.435550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:18.436081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:18.443531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:18.444028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:18.444509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:18.445234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:18.445704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:18.446144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:18.580242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:18.588544 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bc28e14f-9938-4ce3-be5f-23fc0f9bf3a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1308 microversion: 2.1 time: 0.156971 Oct 19 07:30:18.589121 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2942/6035] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:18 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:19.610975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:19.611674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:19.619067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:19.619577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:19.620006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:19.620752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:19.621225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:19.621660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:19.675953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:19.676993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:19.688081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:19.688809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:19.689256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:19.690647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:19.691354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:19.691969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:19.710347 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea HTTP/1.1 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'a3ed87f3-8b0b-4150-a5f7-c3830167d3ea'} Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:30:19.712033 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:30:19.715693 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f897d5a1-d43e-4f7b-ae2a-0cd225f80749 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 404 len: 111 microversion: 2.1 time: 0.041425 Oct 19 07:30:19.720253 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2943/6036] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:30:19 2022] DELETE /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:30:19.726551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:19.727092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: a3ed87f3-8b0b-4150-a5f7-c3830167d3ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:19.733705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:19.734834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:19.735288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:19.736003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:19.736559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:19.736999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:19.752063 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea HTTP/1.1 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'a3ed87f3-8b0b-4150-a5f7-c3830167d3ea'} Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:19.753763 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance a3ed87f3-8b0b-4150-a5f7-c3830167d3ea could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34983875-9a4f-4cef-9cd6-128c4785e09e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea" status: 404 len: 111 microversion: 2.1 time: 0.033704 Oct 19 07:30:19.757786 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2944/6037] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:19 2022] GET /compute/v2.1/servers/a3ed87f3-8b0b-4150-a5f7-c3830167d3ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:30:19.765137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:19.774163 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-033ae2bc-2fe6-4aad-b924-0c6e92cf8f59 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1308 microversion: 2.1 time: 0.167215 Oct 19 07:30:19.774876 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3094/6038] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:19 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:20.434918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:20.435421 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:20.442029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:20.442522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:20.442973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:20.443670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:20.444158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:20.444596 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:20.460584 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 HTTP/1.1 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '6a277bbc-99b2-410c-872b-a35b4f39b7d8'} Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:30:20.462151 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-772ff089-8063-473b-8dec-9cb4665d7b66 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 404 len: 111 microversion: 2.1 time: 0.032743 Oct 19 07:30:20.469847 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2945/6039] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:30:20 2022] DELETE /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:30:20.472567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:20.473833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 6a277bbc-99b2-410c-872b-a35b4f39b7d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:20.480217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:20.480700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:20.481145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:20.481838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:20.482295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:20.482721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:20.496581 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 HTTP/1.1 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '6a277bbc-99b2-410c-872b-a35b4f39b7d8'} Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:20.498167 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance 6a277bbc-99b2-410c-872b-a35b4f39b7d8 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d49d809d-1602-4eaf-b96a-c25322bf03e6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8" status: 404 len: 111 microversion: 2.1 time: 0.031234 Oct 19 07:30:20.502584 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3095/6040] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:20 2022] GET /compute/v2.1/servers/6a277bbc-99b2-410c-872b-a35b4f39b7d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:30:20.581372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b59cdaab-643f-412c-8c0e-09a260c09ca8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'create', calling method: .version_select at 0x7f6d5c4bcaf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1510903324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw3CBnqmNG06t2vOKZE4T6lC5Z7YpDbgRBX/c+IWteCjOmoGqZVZgzYctm9A5FNQhvaGgIgIYSze444sb+dzX83o5MJj77UM/ZO+fBWj8LcWJ76iIbqmFXfHEbNOjnwLQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:20.597740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b59cdaab-643f-412c-8c0e-09a260c09ca8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:30:20.603044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b59cdaab-643f-412c-8c0e-09a260c09ca8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for user 221b692fdbb3495aa63a686796b02ea8 and project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:30:20.688875 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b59cdaab-643f-412c-8c0e-09a260c09ca8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.111304 Oct 19 07:30:20.689508 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2946/6041] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:30:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:20.798003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:20.799148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:20.807357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:20.808181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:20.809102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:20.810153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:20.810820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:20.811424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:20.957282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:20.969805 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93a3e8ce-abdc-4a3a-842f-cce30b7ab9cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1308 microversion: 2.1 time: 0.175926 Oct 19 07:30:20.970496 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3096/6042] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:20 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:21.994347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:21.995013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:22.002785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:22.003279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:22.003726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:22.004524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:22.004990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:22.005425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:22.433600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:22.441196 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7075aaa-8cf8-496b-b227-2fb6c1bbb609 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1308 microversion: 2.1 time: 0.450754 Oct 19 07:30:22.441794 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2947/6043] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:21 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:23.071433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0d25c8b2-4566-4682-bfb6-1bc94c7d8600 req-1b5020ec-374d-41dc-81f3-95e04f1d242e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae37f9a-eb55-47ca-8485-a980814fdc20", "name": "network-vif-plugged", "status": "completed", "tag": "add29373-9b5b-4c94-b928-def644e2070a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:23.078768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:23.084933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d25c8b2-4566-4682-bfb6-1bc94c7d8600 req-1b5020ec-374d-41dc-81f3-95e04f1d242e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:23.085495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d25c8b2-4566-4682-bfb6-1bc94c7d8600 req-1b5020ec-374d-41dc-81f3-95e04f1d242e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:23.086153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d25c8b2-4566-4682-bfb6-1bc94c7d8600 req-1b5020ec-374d-41dc-81f3-95e04f1d242e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:23.098224 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0d25c8b2-4566-4682-bfb6-1bc94c7d8600 req-1b5020ec-374d-41dc-81f3-95e04f1d242e service nova] Creating event network-vif-plugged:add29373-9b5b-4c94-b928-def644e2070a for instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 on n-h2-861333-10 Oct 19 07:30:23.103158 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0d25c8b2-4566-4682-bfb6-1bc94c7d8600 req-1b5020ec-374d-41dc-81f3-95e04f1d242e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038250 Oct 19 07:30:23.103755 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3097/6044] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:23.465884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:23.466627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:23.468794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:23.474861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:23.475366 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:23.475890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:23.476552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:23.477028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:23.477467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:23.613848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:23.618088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:23.622674 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-253a0166-96de-4a16-a058-389b90a8dcb1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1308 microversion: 2.1 time: 0.160756 Oct 19 07:30:23.623240 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2948/6045] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:23 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:24.647966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:24.648622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:24.656077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:24.656594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:24.657035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:24.657743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:24.658205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:24.658639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:24.677598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:24.804164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:24.811815 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20bb9077-a23f-4184-b5b3-4240fca9dc14 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1490 microversion: 2.1 time: 0.169777 Oct 19 07:30:24.812429 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3098/6046] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:24 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1490 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:24.834889 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-daab2c2b-eb00-4820-a1b9-155b010ff3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:24.837572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-daab2c2b-eb00-4820-a1b9-155b010ff3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:24.844888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daab2c2b-eb00-4820-a1b9-155b010ff3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:24.845469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daab2c2b-eb00-4820-a1b9-155b010ff3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:24.846043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daab2c2b-eb00-4820-a1b9-155b010ff3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:24.846766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daab2c2b-eb00-4820-a1b9-155b010ff3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:24.847240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daab2c2b-eb00-4820-a1b9-155b010ff3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:24.847687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daab2c2b-eb00-4820-a1b9-155b010ff3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:25.017206 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-daab2c2b-eb00-4820-a1b9-155b010ff3d3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "PUT /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1085 microversion: 2.1 time: 0.169389 Oct 19 07:30:25.017206 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2949/6047] 10.222.0.39 () {60 vars in 1256 bytes} [Wed Oct 19 07:30:24 2022] PUT /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1085 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:25.025847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:25.026469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:25.033360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:25.033921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:25.034553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:25.035271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:25.035763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:25.036705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:25.179577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:25.187350 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ddbe6331-12db-4c89-aa15-298e06036caf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1511 microversion: 2.1 time: 0.166044 Oct 19 07:30:25.187915 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3099/6048] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:25 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:25.209120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:25.210034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:25.216156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:25.216658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:25.217102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:25.217809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:25.218271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:25.218703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:25.361432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:25.369932 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a53a1ae-41e6-4523-a07f-21bc5e55d4d8 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1511 microversion: 2.1 time: 0.164771 Oct 19 07:30:25.370500 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2950/6049] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:25 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:25.391897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:25.392428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:25.399204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:25.399707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:25.400181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:25.400884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:25.401355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:25.401795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:25.430386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:30:25.722970 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7dc53dfb-2aeb-4da2-a4aa-4e411e7c3668 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 204 len: 0 microversion: 2.1 time: 0.334580 Oct 19 07:30:25.723823 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3100/6050] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:30:25 2022] DELETE /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:30:25.731788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:25.732706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:25.738746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:25.739237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:25.739858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:25.740750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:25.741387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:25.741867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:26.140095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:26.149758 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47a463e8-e24f-46df-bc86-181c51f1e410 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1517 microversion: 2.1 time: 0.421886 Oct 19 07:30:26.150411 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2951/6051] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:25 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1517 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:27.174285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:27.174993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:27.183529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:27.184027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:27.184536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:27.188186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:27.188186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:27.188186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:27.346313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:27.356378 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d539348-1fdd-4e7c-ac23-e133d1b2b1c2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1517 microversion: 2.1 time: 0.186274 Oct 19 07:30:27.357388 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3101/6052] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:27 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:27.824013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0833c6f6-8114-46c0-a1b5-873eab878943 req-c74cb179-8f1e-4274-b4f5-fb88781d9be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae37f9a-eb55-47ca-8485-a980814fdc20", "name": "network-vif-deleted", "tag": "add29373-9b5b-4c94-b928-def644e2070a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:27.839858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0833c6f6-8114-46c0-a1b5-873eab878943 req-c74cb179-8f1e-4274-b4f5-fb88781d9be3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:27.840632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0833c6f6-8114-46c0-a1b5-873eab878943 req-c74cb179-8f1e-4274-b4f5-fb88781d9be3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:27.841267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0833c6f6-8114-46c0-a1b5-873eab878943 req-c74cb179-8f1e-4274-b4f5-fb88781d9be3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:27.853590 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0833c6f6-8114-46c0-a1b5-873eab878943 req-c74cb179-8f1e-4274-b4f5-fb88781d9be3 service nova] Creating event network-vif-deleted:add29373-9b5b-4c94-b928-def644e2070a for instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 on n-h2-861333-10 Oct 19 07:30:27.859688 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0833c6f6-8114-46c0-a1b5-873eab878943 req-c74cb179-8f1e-4274-b4f5-fb88781d9be3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039225 Oct 19 07:30:27.861657 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2952/6053] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:28.379338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:28.380448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:28.388471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:28.391590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:28.391590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:28.391590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:28.391590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:28.391590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:28.427999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:28.428689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:28.429256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:28.429829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lazy-loading 'fault' on Instance uuid 5ae37f9a-eb55-47ca-8485-a980814fdc20 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:30:28.488958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:28.498570 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae134cef-3dc5-477b-974d-2ab6681b05a6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 200 len: 1319 microversion: 2.1 time: 0.123515 Oct 19 07:30:28.499310 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3102/6054] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:28 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 1319 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:29.523820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:29.524616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:29.531209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:29.531736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:29.532214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:29.532931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:29.533403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:29.533849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:29.547996 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 HTTP/1.1 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '5ae37f9a-eb55-47ca-8485-a980814fdc20'} Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:30:29.549709 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-004b4021-6290-4ee8-81b5-5d3e50108561 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 404 len: 111 microversion: 2.1 time: 0.033058 Oct 19 07:30:29.554952 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2953/6055] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:29 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:30:29.682861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1302673588", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "b334baf1-2061-48ac-b7fa-b6eb014c8c24"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:29.738709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] validate_networks() for [('b334baf1-2061-48ac-b7fa-b6eb014c8c24', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:30:30.128423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:30:30.128948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:30:30.129526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:30:30.130032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:30:30.130528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:30:30.139678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:30.140207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:30.140656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:30.141549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:30.142025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:30.142505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:30.161543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:30:30.167128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Getting quotas for user 83aaeed768e54cf5a7958e85e6dd91a4 and project c719546d25c84cf399312e12a99644e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:30:30.180077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:30:30.182485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:30:30.295629 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59c4a886-d4e8-44a7-a0c4-f84ce91d01bf tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616593 Oct 19 07:30:30.296326 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3103/6056] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:30:30.307677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9be0ad98-29bf-4b4c-a1e2-5729b9cccea6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:30.308327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9be0ad98-29bf-4b4c-a1e2-5729b9cccea6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:30.363171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9be0ad98-29bf-4b4c-a1e2-5729b9cccea6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:30.374529 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9be0ad98-29bf-4b4c-a1e2-5729b9cccea6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1209 microversion: 2.1 time: 0.070584 Oct 19 07:30:30.387525 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2954/6057] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:30 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:31.400330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:31.400959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:31.408175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:31.408672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:31.409120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:31.409869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:31.410304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:31.411411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:31.478354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:31.487000 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-516e467d-3866-46ea-afcf-5571aaf2f0bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1213 microversion: 2.1 time: 0.092459 Oct 19 07:30:31.487510 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3104/6058] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:31 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:32.509415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:32.510311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:32.518352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:32.519169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:32.519663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:32.521241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:32.521895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:32.522351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:32.597956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:32.608600 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec9c63c5-8b96-4f49-a4ef-1383fceba593 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1269 microversion: 2.1 time: 0.101805 Oct 19 07:30:32.608600 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2955/6059] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:32 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1269 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:33.631955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:33.633340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:33.638563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:33.658048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:33.658048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:33.658048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:33.661330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:33.662023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:33.662874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:33.887084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:33.896154 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-679086ec-49e8-440c-ae49-9fb9230aefef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1309 microversion: 2.1 time: 0.268481 Oct 19 07:30:33.897191 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3105/6060] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:33 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1309 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:34.920042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:34.920623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:34.924641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:34.928733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:34.929239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:34.929700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:34.930412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:34.930881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:34.931321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:35.084670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:35.092714 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6aef2eaf-be6a-48ac-8b70-70c08d3560fd tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1309 microversion: 2.1 time: 0.176683 Oct 19 07:30:35.093408 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2956/6061] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:34 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1309 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:35.229582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e4bec751-3fd9-4e60-8664-77310715cda9 req-2f95b939-c982-47f0-b7a3-2efddf314589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b9167b-4634-4210-aa1a-79ec28b65cd4", "tag": "c0bfc97d-753a-4b42-ba15-af05dae84218"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:35.249848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e4bec751-3fd9-4e60-8664-77310715cda9 req-2f95b939-c982-47f0-b7a3-2efddf314589 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:35.250337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e4bec751-3fd9-4e60-8664-77310715cda9 req-2f95b939-c982-47f0-b7a3-2efddf314589 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:35.250776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e4bec751-3fd9-4e60-8664-77310715cda9 req-2f95b939-c982-47f0-b7a3-2efddf314589 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:35.272837 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e4bec751-3fd9-4e60-8664-77310715cda9 req-2f95b939-c982-47f0-b7a3-2efddf314589 service nova] Creating event network-changed:c0bfc97d-753a-4b42-ba15-af05dae84218 for instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 on n-h1-861333-10 Oct 19 07:30:35.277896 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e4bec751-3fd9-4e60-8664-77310715cda9 req-2f95b939-c982-47f0-b7a3-2efddf314589 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053358 Oct 19 07:30:35.278515 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3106/6062] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:36.116991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:36.117616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:36.124775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:36.128039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:36.128039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:36.128039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:36.128039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:36.128039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:36.264906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:36.272937 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c6bb11b-5ce7-4e0c-823d-ad81026291c0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1309 microversion: 2.1 time: 0.160825 Oct 19 07:30:36.273506 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2957/6063] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:36 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:37.298538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:37.299253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:37.305446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:37.306321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:37.306759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:37.307448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:37.307905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:37.308358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:37.448798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:37.456485 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ecd8d6ef-c06f-491a-afe2-fbc07c4f25cb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1309 microversion: 2.1 time: 0.163124 Oct 19 07:30:37.457085 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3107/6064] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:37 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:38.479094 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:38.479674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:38.486571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:38.487075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:38.487525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:38.488326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:38.488797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:38.489233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:38.626722 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:38.635022 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10a3863d-48ec-4eda-9525-b54301cd57e6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1309 microversion: 2.1 time: 0.160014 Oct 19 07:30:38.635612 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2958/6065] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:38 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:39.658504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:39.659110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:39.669793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:39.669793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:39.669793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:39.669793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:39.669793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:39.669793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:39.804411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:39.813766 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce461012-ee0f-4723-a4ed-672ae36bcc81 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1309 microversion: 2.1 time: 0.159043 Oct 19 07:30:39.814381 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3108/6066] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:39 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:40.837638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:40.838362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:40.841666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:40.846719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:40.847211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:40.848180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:40.848893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:40.849358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:40.849795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:41.004403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f32c5c68-3c1a-493d-93e3-3c4c59a1ec0b req-c4a65fb6-0207-4d39-8de4-3033b200182d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9167b-4634-4210-aa1a-79ec28b65cd4", "name": "network-vif-plugged", "status": "completed", "tag": "c0bfc97d-753a-4b42-ba15-af05dae84218"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:41.010941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:41.013082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:41.014300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:41.017269 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06e78aa7-f4f2-4809-8c3d-87bd093528b5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1309 microversion: 2.1 time: 0.184415 Oct 19 07:30:41.018370 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2959/6067] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:40 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1309 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:41.022723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f32c5c68-3c1a-493d-93e3-3c4c59a1ec0b req-c4a65fb6-0207-4d39-8de4-3033b200182d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:41.023735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f32c5c68-3c1a-493d-93e3-3c4c59a1ec0b req-c4a65fb6-0207-4d39-8de4-3033b200182d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:41.024613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f32c5c68-3c1a-493d-93e3-3c4c59a1ec0b req-c4a65fb6-0207-4d39-8de4-3033b200182d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:41.038596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f32c5c68-3c1a-493d-93e3-3c4c59a1ec0b req-c4a65fb6-0207-4d39-8de4-3033b200182d service nova] Creating event network-vif-plugged:c0bfc97d-753a-4b42-ba15-af05dae84218 for instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 on n-h1-861333-10 Oct 19 07:30:41.043533 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f32c5c68-3c1a-493d-93e3-3c4c59a1ec0b req-c4a65fb6-0207-4d39-8de4-3033b200182d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043686 Oct 19 07:30:41.044494 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3109/6068] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:42.042419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:42.043044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:42.050074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:42.050544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:42.050999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:42.051719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:42.052242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:42.052687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:42.182018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:42.189688 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ee259fda-240b-4050-9cfe-c5189e41d472 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1309 microversion: 2.1 time: 0.152428 Oct 19 07:30:42.190256 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2960/6069] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:42 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1309 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:30:43.215151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:43.215881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:43.222843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:43.223845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:43.224315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:43.225020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:43.225482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:43.225915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:43.365310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:43.373539 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a959e21-60f8-4f0f-bb5d-be2910b7df2f tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1490 microversion: 2.1 time: 0.164431 Oct 19 07:30:43.374134 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3110/6070] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:43 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1490 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:43.396775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ccddb92-06d3-4cda-b043-f78c30c01039 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-597550567"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:43.399782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ccddb92-06d3-4cda-b043-f78c30c01039 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:43.407908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ccddb92-06d3-4cda-b043-f78c30c01039 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:43.408444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ccddb92-06d3-4cda-b043-f78c30c01039 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:43.409253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ccddb92-06d3-4cda-b043-f78c30c01039 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:43.409978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ccddb92-06d3-4cda-b043-f78c30c01039 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:43.411110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ccddb92-06d3-4cda-b043-f78c30c01039 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:43.411587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ccddb92-06d3-4cda-b043-f78c30c01039 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:43.570506 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ccddb92-06d3-4cda-b043-f78c30c01039 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "PUT /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1074 microversion: 2.1 time: 0.178262 Oct 19 07:30:43.571184 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2961/6071] 10.222.0.39 () {60 vars in 1256 bytes} [Wed Oct 19 07:30:43 2022] PUT /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1074 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:43.590573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:43.591190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:43.597397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:43.598459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:43.598922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:43.599626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:43.600088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:43.600544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:43.739242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:43.748522 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-593f8f26-be2d-479e-8af7-ea9dad9cbd1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1500 microversion: 2.1 time: 0.161850 Oct 19 07:30:43.749110 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3111/6072] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:43 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:43.772244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:43.772857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:43.778897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:43.779388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:43.779834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:43.780664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:43.781329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:43.781776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:43.924602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:43.933635 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c5afb0c-2e6d-4f09-aaca-01be095d17a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1500 microversion: 2.1 time: 0.166590 Oct 19 07:30:43.934313 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2962/6073] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:43 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:43.956946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d228ac13-d7ae-48e9-a9d5-3ce38de85001 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:43.963562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d228ac13-d7ae-48e9-a9d5-3ce38de85001 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:43.964057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d228ac13-d7ae-48e9-a9d5-3ce38de85001 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:43.964555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d228ac13-d7ae-48e9-a9d5-3ce38de85001 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:43.987172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d228ac13-d7ae-48e9-a9d5-3ce38de85001 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Going to try to stop instance {{(pid=127567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 07:30:44.165262 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d228ac13-d7ae-48e9-a9d5-3ce38de85001 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "POST /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4/action" status: 202 len: 0 microversion: 2.1 time: 0.212176 Oct 19 07:30:44.166176 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3112/6074] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:30:43 2022] POST /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:30:44.182505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:44.182505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:44.182953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:44.183391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:44.183931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:44.185041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:44.185133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:44.185674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:44.329942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:44.338382 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e0d61ed-de05-4470-ba0a-a82d4fa8f3a4 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.167612 Oct 19 07:30:44.338967 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2963/6075] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:44 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:45.336702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-662044671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1510903324", "security_groups": [{"name": "tempest-secgroup-smoke-110936054"}], "block_device_mapping_v2": [{"uuid": "2000674d-6cb1-4e89-bdf9-32c23f1fed81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cedc1025-55fd-4295-a2cd-69fd264b4466"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:45.361716 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:45.362369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:45.369882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:45.370402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:45.370847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:45.371550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:45.372088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:45.372558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:45.461158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] validate_networks() for [('cedc1025-55fd-4295-a2cd-69fd264b4466', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:30:45.507836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:45.515650 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecf731b3-7f2c-4db5-95f2-34dacc27461c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.157824 Oct 19 07:30:45.516246 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2964/6076] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:45 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:30:45.825420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:30:45.825845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:30:45.826353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:30:45.826769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:30:45.827185 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:30:45.836433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:45.836916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:45.837352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:45.838075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:45.838529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:45.838956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:45.856012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:30:45.861247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for user 221b692fdbb3495aa63a686796b02ea8 and project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:30:45.918978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:30:45.921311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2000674d-6cb1-4e89-bdf9-32c23f1fed81',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:30:46.361783 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c6500e9-20e2-4c92-9cf3-c6b4914e2ebc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.030026 Oct 19 07:30:46.362443 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3113/6077] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:30:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:30:46.374928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14ac88f4-e316-48f4-aef8-d081c98eb4f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:46.375629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14ac88f4-e316-48f4-aef8-d081c98eb4f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:46.431308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14ac88f4-e316-48f4-aef8-d081c98eb4f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:46.438716 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14ac88f4-e316-48f4-aef8-d081c98eb4f1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1094 microversion: 2.1 time: 0.068083 Oct 19 07:30:46.439285 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2965/6078] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:46 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:46.538979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:46.539598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:46.545883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:46.546363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:46.546799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:46.547484 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:46.547939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:46.548407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:46.682842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:46.686491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:46.691240 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36e6cbd4-557d-44f8-8479-d3432531c257 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.156122 Oct 19 07:30:46.691919 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3114/6079] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:46 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:47.461516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:47.462142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:47.471144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:47.471655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:47.472126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:47.472900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:47.473377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:47.473827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:47.534640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:47.542511 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-321acc74-bfa8-4c3a-8094-a7564b45afbe tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1136 microversion: 2.1 time: 0.085619 Oct 19 07:30:47.543087 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2966/6080] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:47 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:47.715004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:47.715681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:47.723017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:47.723503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:47.723993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:47.724713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:47.725173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:47.725602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:47.868247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:47.876160 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c0db461-759d-48be-adef-593be6a4ffe6 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.165498 Oct 19 07:30:47.876729 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3115/6081] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:47 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:48.565669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:48.566312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:48.573500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:48.573932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:48.574393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:48.575120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:48.575598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:48.576046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:48.596709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:48.639758 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:48.649184 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2bf5cae9-3bac-4419-b5e1-812816f3a3a8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1210 microversion: 2.1 time: 0.087421 Oct 19 07:30:48.649951 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2967/6082] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:48 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:48.900001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:48.900672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:48.907718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:48.908936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:48.909458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:48.911141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:48.911679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:48.912389 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:49.053589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:49.061675 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b300b883-31dc-4799-a4a1-aa0e51d11aa0 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.165852 Oct 19 07:30:49.062471 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3116/6083] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:48 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:49.673107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:49.674178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:49.682799 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:49.683448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:49.683996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:49.684857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:49.685524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:49.686177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:49.913989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:49.922601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbcd8cca-06a3-471e-9b44-1c079de14936 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1277 microversion: 2.1 time: 0.253798 Oct 19 07:30:49.923370 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2968/6084] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:49 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:50.086184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:50.086943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:50.093975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:50.094535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:50.095177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:50.095939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:50.096497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:50.096995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:50.130021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4f1db837-42dd-424f-8677-780430cfec6d req-4370c370-4f6d-44ce-9e23-f7a60137a196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c62fd9-b571-436e-a5ba-2eda08e8c2ca", "tag": "5f50861c-a418-4186-ad83-b17d06d9f032"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:30:50.149719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f1db837-42dd-424f-8677-780430cfec6d req-4370c370-4f6d-44ce-9e23-f7a60137a196 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:50.150218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f1db837-42dd-424f-8677-780430cfec6d req-4370c370-4f6d-44ce-9e23-f7a60137a196 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:50.150703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f1db837-42dd-424f-8677-780430cfec6d req-4370c370-4f6d-44ce-9e23-f7a60137a196 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:50.167438 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4f1db837-42dd-424f-8677-780430cfec6d req-4370c370-4f6d-44ce-9e23-f7a60137a196 service nova] Creating event network-changed:5f50861c-a418-4186-ad83-b17d06d9f032 for instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca on n-h2-861333-10 Oct 19 07:30:50.173180 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4f1db837-42dd-424f-8677-780430cfec6d req-4370c370-4f6d-44ce-9e23-f7a60137a196 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046884 Oct 19 07:30:50.174162 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2969/6085] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:30:50.289656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:50.298244 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad5379da-8309-4d96-8ce2-3efc42620eef tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.216668 Oct 19 07:30:50.299020 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3117/6086] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:50 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:50.948453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:50.949210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:50.955536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:50.956038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:50.956515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:50.957278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:50.957789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:50.958278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:51.101141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:51.109229 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-571725f7-167d-4a46-b4ba-9f61a7a41068 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1277 microversion: 2.1 time: 0.166026 Oct 19 07:30:51.109811 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2970/6087] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:50 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:51.322320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:51.322953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:51.329969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:51.330461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:51.330906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:51.332219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:51.332697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:51.333131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:51.467736 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:51.475678 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d906e541-e60b-408b-8112-4d72320d3a8d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.157241 Oct 19 07:30:51.476568 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3118/6088] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:51 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:52.132902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:52.133549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:52.140452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:52.140948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:52.141396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:52.142098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:52.142564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:52.143003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:52.357676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:52.362900 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e74292d-3d55-4694-866c-7688d98dcb8a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1277 microversion: 2.1 time: 0.233805 Oct 19 07:30:52.363527 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2971/6089] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:52 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:52.498864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:52.499481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:52.506471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:52.506955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:52.507393 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:52.508082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:52.508564 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:52.508993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:52.642260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:52.652611 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fef9d303-70e3-4a7b-b82f-98e938588189 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.156229 Oct 19 07:30:52.652611 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3119/6090] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:52 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:53.386279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:53.386910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:53.393666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:53.399029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:53.399029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:53.399029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:53.399029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:53.399029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:53.535489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:53.543841 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2572b751-189b-45f2-8436-db18e6af7b7e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1277 microversion: 2.1 time: 0.161522 Oct 19 07:30:53.544465 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2972/6091] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:53 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:53.675860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:53.676624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:53.683447 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:53.683931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:53.684403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:53.685092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:53.685546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:53.685977 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:53.820043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:53.828202 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76c97122-f2cb-4ff2-bf94-a4d86a75c4fa tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.157005 Oct 19 07:30:53.828782 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3120/6092] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:53 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:54.568358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:54.568982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:54.575423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:54.575914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:54.576401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:54.577097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:54.577564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:54.578000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:54.709802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:54.717433 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb3e84e6-5ba5-4861-9bac-e48cb9eaa2f6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.153748 Oct 19 07:30:54.717990 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2973/6093] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:54 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:54.851186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:54.851755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:54.859288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:54.859775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:54.860236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:54.860940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:54.861398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:54.861831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:54.990999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:54.998657 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9cdbd016-c78b-43ad-ad35-165ba8766130 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.151523 Oct 19 07:30:54.999230 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3121/6094] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:54 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:55.740838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:55.741480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:55.748957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:55.749454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:55.749902 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:55.750599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:55.751065 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:55.751501 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:55.883819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:55.891821 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d01f08b-824d-438c-8751-9db1b5a3c461 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.155485 Oct 19 07:30:55.892439 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2974/6095] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:55 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:56.022794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:56.023409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:56.025362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:56.026836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:56.031626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:56.032141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:56.032593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:56.033291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:56.033756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:56.034191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:56.167423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:56.175129 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e0073ad-7282-4c1c-81a6-fef67e285631 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.157026 Oct 19 07:30:56.175702 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3122/6096] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:56 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:56.914666 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:56.915293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:56.917314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:30:56.922975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:56.923476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:56.923932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:56.924671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:56.925145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:56.930129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:57.064305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:57.072610 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-505de454-dec4-4fd8-9d9e-4698544379aa tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.161787 Oct 19 07:30:57.073106 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2975/6097] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:56 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:57.199231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:57.199843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:57.206730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:57.207215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:57.207981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:57.208705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:57.209164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:57.209592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:57.404147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:57.411876 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc6e8a73-14bd-4e48-8c90-5fbfe86d0ad5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.217244 Oct 19 07:30:57.412472 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3123/6098] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:57 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:58.096010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:58.096590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:58.103916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:58.104442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:58.104891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:58.105587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:58.106059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:58.106493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:58.236892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:58.244740 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ed38aea-d927-4ed5-a748-bdccc0df453a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.152733 Oct 19 07:30:58.245308 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2976/6099] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:58 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:58.435193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:58.435803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:58.443449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:58.443935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:58.444397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:58.445090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:58.445551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:58.445979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:58.577111 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:58.585572 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45b01bec-6e35-44c0-8eba-a4bf35ab27b2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.154406 Oct 19 07:30:58.586193 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3124/6100] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:58 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:59.267367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:59.267999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:59.275187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:59.275693 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:59.276175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:59.276913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:59.277374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:59.277821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:59.416270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:59.424610 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6c6bcc3-6439-477a-b22a-47c1f108526a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.161141 Oct 19 07:30:59.425115 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2977/6101] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:59 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:30:59.608827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:30:59.609345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:30:59.617196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:59.617690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:59.618130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:59.618950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:30:59.619413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:30:59.619900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:30:59.749091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:30:59.757565 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ec99b6d-3da1-4c12-891c-b767806d0086 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.152717 Oct 19 07:30:59.758135 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3125/6102] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:30:59 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:00.447910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:00.448533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:00.455349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:00.455849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:00.456335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:00.457608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:00.458085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:00.458526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:00.590849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:00.598503 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-485c85b3-a8a0-405b-85c6-042e31b028da tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.154572 Oct 19 07:31:00.599064 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2978/6103] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:00 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:00.781244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:00.781860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:00.788429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:00.788920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:00.789362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:00.790057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:00.790518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:00.790950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:00.919599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:00.927908 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9f1c5c9-677c-4366-9c52-a64bef769d89 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.150760 Oct 19 07:31:00.928525 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3126/6104] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:00 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:01.620620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:01.621295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:01.628280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:01.629279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:01.629735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:01.630439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:01.630913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:01.631356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:01.763148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:01.771273 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d53ac783-fb6c-4a26-90ca-74a775bc36dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.154614 Oct 19 07:31:01.771856 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2979/6105] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:01 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:01.951812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:01.952424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:01.959302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:01.959776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:01.967983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:01.967983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:01.967983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:01.967983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:02.092631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:02.101083 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-de90e716-e19e-47a7-a05b-30059567be95 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.153241 Oct 19 07:31:02.101645 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3127/6106] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:01 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:02.794007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:02.794625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:02.801483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:02.801976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:02.802424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:02.803119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:02.803586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:02.804026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:02.936878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:02.945094 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f2e587f-f8ea-4ba4-9661-4bcfd5497d75 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.155049 Oct 19 07:31:02.945658 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2980/6107] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:02 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:03.124860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:03.125546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:03.132867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:03.133359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:03.133811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:03.134503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:03.134966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:03.135397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:03.267390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:03.275623 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-598bff1b-960d-4458-a288-db5bc2e1c6ab tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.154575 Oct 19 07:31:03.276214 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3128/6108] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:03 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:03.969192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:03.969737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:03.977238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:03.977734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:03.978180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:03.978890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:03.979357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:03.979795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:04.110857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:04.118537 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba9716f8-0ce2-449d-b292-72d03ea91bdd tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.153400 Oct 19 07:31:04.119106 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2981/6109] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:03 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:04.298858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:04.299488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:04.302260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:04.307001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:04.307473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:04.307913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:04.308631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:04.309089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:04.309517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:04.440134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:04.448452 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70ee5aa8-2f76-456e-a1aa-bcbf47200ae7 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.153456 Oct 19 07:31:04.449029 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3129/6110] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:04 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:05.140724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:05.141348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:05.148539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:05.149042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:05.149495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:05.150201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:05.150673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:05.151116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:05.289127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:05.296986 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fef4fdb-fe52-49c3-9ed8-23ffccff32d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.160153 Oct 19 07:31:05.297907 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2982/6111] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:05 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:05.319129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-04878249-352f-4ba6-b574-eb6baa2d24c7 req-31dc6491-3b6b-4155-a8a8-c6c73d346071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c62fd9-b571-436e-a5ba-2eda08e8c2ca", "name": "network-vif-plugged", "status": "completed", "tag": "5f50861c-a418-4186-ad83-b17d06d9f032"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:05.329610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-04878249-352f-4ba6-b574-eb6baa2d24c7 req-31dc6491-3b6b-4155-a8a8-c6c73d346071 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:05.330097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-04878249-352f-4ba6-b574-eb6baa2d24c7 req-31dc6491-3b6b-4155-a8a8-c6c73d346071 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:05.330543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-04878249-352f-4ba6-b574-eb6baa2d24c7 req-31dc6491-3b6b-4155-a8a8-c6c73d346071 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:05.341495 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-04878249-352f-4ba6-b574-eb6baa2d24c7 req-31dc6491-3b6b-4155-a8a8-c6c73d346071 service nova] Creating event network-vif-plugged:5f50861c-a418-4186-ad83-b17d06d9f032 for instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca on n-h2-861333-10 Oct 19 07:31:05.346864 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-04878249-352f-4ba6-b574-eb6baa2d24c7 req-31dc6491-3b6b-4155-a8a8-c6c73d346071 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031428 Oct 19 07:31:05.347527 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3130/6112] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:31:05.472775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:05.473694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:05.480554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:05.481153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:05.481676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:05.482460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:05.483007 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:05.483522 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:05.611002 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:05.618770 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1cf7e9c-0a6f-40fe-bcc9-57150e1dde1b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.150737 Oct 19 07:31:05.619347 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2983/6113] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:05 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:06.321741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:06.322483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:06.329190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:06.329680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:06.330123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:06.330820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:06.331282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:06.331717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:06.461824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:06.469933 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40ea28f1-dbe2-4f85-afc5-109e6598276d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1265 microversion: 2.1 time: 0.153272 Oct 19 07:31:06.470507 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3131/6114] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:06 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:06.640738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:06.641370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:06.644472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=58 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:06.649863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:06.650371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:06.650825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:06.651534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:06.652011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:06.652483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:06.789637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:06.793143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:06.797863 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8b41045-87d9-4f06-bddd-68766e5a2817 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.161090 Oct 19 07:31:06.798428 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2984/6115] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:06 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:07.493840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:07.494402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:07.501274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:07.501768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:07.502225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:07.502912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:07.503374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:07.503809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:07.507861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:07.635163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:07.642888 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65f4df96-01b0-4152-88fd-7022a4c65263 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1451 microversion: 2.1 time: 0.153769 Oct 19 07:31:07.643465 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3132/6116] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:07 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:31:07.667344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:07.667969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:07.675197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:07.675694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:07.676170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:07.676877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:07.677344 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:07.677781 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:07.813248 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:07.820699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:07.821325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:07.821450 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45d42d2b-bdfe-4a7e-b385-d11a8d8af483 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1451 microversion: 2.1 time: 0.158442 Oct 19 07:31:07.821907 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2985/6117] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:07 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:07.827356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:07.827843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:07.828328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:07.829031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:07.829494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:07.829924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:07.991980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:08.000892 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d277d6e1-eaf7-42ae-acaa-2b2c55772a7a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.184029 Oct 19 07:31:08.004328 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3133/6118] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:07 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:31:09.027301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:09.028125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:09.035484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:09.035990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:09.036467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:09.037195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:09.037672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:09.038159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:09.188091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:09.206123 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00698411-de26-4c0b-a0cb-04fcd669769d tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1510 microversion: 2.1 time: 0.174510 Oct 19 07:31:09.206123 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2986/6119] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:09 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:10.221526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:10.223854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:10.229234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:10.229724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:10.230186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:10.231037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:10.231501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:10.231986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:10.387631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8614d58d-8f4b-44bd-9047-9bee6b77a48f req-49b4ab8f-0aab-45e5-865c-860e887625ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c62fd9-b571-436e-a5ba-2eda08e8c2ca", "tag": "5f50861c-a418-4186-ad83-b17d06d9f032"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:10.398403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8614d58d-8f4b-44bd-9047-9bee6b77a48f req-49b4ab8f-0aab-45e5-865c-860e887625ec service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:10.398898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8614d58d-8f4b-44bd-9047-9bee6b77a48f req-49b4ab8f-0aab-45e5-865c-860e887625ec service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:10.399345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8614d58d-8f4b-44bd-9047-9bee6b77a48f req-49b4ab8f-0aab-45e5-865c-860e887625ec service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:10.400375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:10.408084 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4df481c-ed23-4d40-8ac4-29be99f35300 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1487 microversion: 2.1 time: 0.190547 Oct 19 07:31:10.408800 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3134/6120] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:10 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1487 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:10.418333 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8614d58d-8f4b-44bd-9047-9bee6b77a48f req-49b4ab8f-0aab-45e5-865c-860e887625ec service nova] Creating event network-changed:5f50861c-a418-4186-ad83-b17d06d9f032 for instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca on n-h2-861333-10 Oct 19 07:31:10.418333 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8614d58d-8f4b-44bd-9047-9bee6b77a48f req-49b4ab8f-0aab-45e5-865c-860e887625ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032580 Oct 19 07:31:10.418333 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2987/6121] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:31:10.435295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-104f2337-0503-4550-93ef-3c8c16ab0466 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-947289406"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:10.438233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-104f2337-0503-4550-93ef-3c8c16ab0466 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:10.445281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104f2337-0503-4550-93ef-3c8c16ab0466 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:10.445780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104f2337-0503-4550-93ef-3c8c16ab0466 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:10.446240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104f2337-0503-4550-93ef-3c8c16ab0466 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:10.446959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104f2337-0503-4550-93ef-3c8c16ab0466 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:10.447425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104f2337-0503-4550-93ef-3c8c16ab0466 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:10.447860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104f2337-0503-4550-93ef-3c8c16ab0466 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:10.569839 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-104f2337-0503-4550-93ef-3c8c16ab0466 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "PUT /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1060 microversion: 2.1 time: 0.139457 Oct 19 07:31:10.570627 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2988/6122] 10.222.0.39 () {60 vars in 1256 bytes} [Wed Oct 19 07:31:10 2022] PUT /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1060 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:10.589863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:10.590480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:10.596464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:10.599346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:10.599346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:10.599346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:10.599346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:10.599346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:10.749124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:10.758249 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-71ea57f8-7f05-4e78-b06e-d5f1dc6de611 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1487 microversion: 2.1 time: 0.172296 Oct 19 07:31:10.758833 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3135/6123] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:10 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1487 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:10.780733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:10.781359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:10.787935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:10.788486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:10.788937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:10.789655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:10.790118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:10.790553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:11.006749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:11.015275 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2b23cab-19b7-4426-b66f-c14d79ff164a tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1487 microversion: 2.1 time: 0.238378 Oct 19 07:31:11.015854 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2989/6124] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:10 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1487 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:11.040048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:11.040582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:11.046811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:11.047304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:11.047750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:11.048492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:11.048958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:11.049396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:11.076165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:31:11.375098 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c327bb7-d777-4526-aac2-79923df956f9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 204 len: 0 microversion: 2.1 time: 0.339244 Oct 19 07:31:11.380643 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3136/6125] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:11 2022] DELETE /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:31:11.384005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:11.384659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:11.390874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:11.391474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:11.391809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:11.392569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:11.393040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:11.393484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:11.529326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:11.536990 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2198264b-6830-4590-bfe8-65294ffe15d5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1493 microversion: 2.1 time: 0.156899 Oct 19 07:31:11.537551 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2990/6126] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:11 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:31:12.561272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:12.561970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:12.570261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:12.570751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:12.571209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:12.571873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:12.572363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:12.572793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:12.700519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:12.708186 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47b0e241-d9ac-40e8-a1ed-50fe3dd8f5bb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1493 microversion: 2.1 time: 0.151256 Oct 19 07:31:12.708748 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3137/6127] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:12 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1493 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:13.290019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6aafa831-1de1-419b-b943-b18beec8f42c req-d8e9fca9-25f5-434e-a1d5-4207c0b3b41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9167b-4634-4210-aa1a-79ec28b65cd4", "name": "network-vif-deleted", "tag": "c0bfc97d-753a-4b42-ba15-af05dae84218"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:13.306058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6aafa831-1de1-419b-b943-b18beec8f42c req-d8e9fca9-25f5-434e-a1d5-4207c0b3b41f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:13.306661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6aafa831-1de1-419b-b943-b18beec8f42c req-d8e9fca9-25f5-434e-a1d5-4207c0b3b41f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:13.307188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6aafa831-1de1-419b-b943-b18beec8f42c req-d8e9fca9-25f5-434e-a1d5-4207c0b3b41f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:13.320433 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6aafa831-1de1-419b-b943-b18beec8f42c req-d8e9fca9-25f5-434e-a1d5-4207c0b3b41f service nova] Creating event network-vif-deleted:c0bfc97d-753a-4b42-ba15-af05dae84218 for instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 on n-h1-861333-10 Oct 19 07:31:13.327151 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6aafa831-1de1-419b-b943-b18beec8f42c req-d8e9fca9-25f5-434e-a1d5-4207c0b3b41f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040785 Oct 19 07:31:13.328125 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2991/6128] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:31:13.732619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:13.733246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:13.740118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:13.740620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:13.741059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:13.741778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:13.742240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:13.742667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:13.775407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:13.775899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:13.776375 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:13.776825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lazy-loading 'fault' on Instance uuid 58b9167b-4634-4210-aa1a-79ec28b65cd4 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:31:13.829573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:13.837940 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e9cdbb2-8e40-45c0-9414-2ff272b7dd2b tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 200 len: 1309 microversion: 2.1 time: 0.109345 Oct 19 07:31:13.838516 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3138/6129] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:13 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:14.862587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:14.863511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:14.870560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:14.871061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:14.871515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:14.872269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:14.873082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:14.873553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:14.888165 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 HTTP/1.1 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '58b9167b-4634-4210-aa1a-79ec28b65cd4'} Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:14.889978 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d02e689f-b2df-4834-ac21-879cf0923100 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 404 len: 111 microversion: 2.1 time: 0.033948 Oct 19 07:31:14.895051 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2992/6130] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:14 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:14.904958 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:14.905615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:14.913591 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:14.914085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:14.914524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:14.915391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:14.915851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:14.916317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:14.931491 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 HTTP/1.1 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '58b9167b-4634-4210-aa1a-79ec28b65cd4'} Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:14.933380 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:14.938082 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da91caa3-df55-4223-979d-5608fb36d848 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 404 len: 111 microversion: 2.1 time: 0.033760 Oct 19 07:31:14.939019 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3139/6131] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:14 2022] DELETE /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:14.945043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:14.945740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 58b9167b-4634-4210-aa1a-79ec28b65cd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:14.952499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:14.953000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:14.953447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:14.954162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:14.954629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:14.955080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:14.973072 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 HTTP/1.1 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '58b9167b-4634-4210-aa1a-79ec28b65cd4'} Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:14.974561 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 58b9167b-4634-4210-aa1a-79ec28b65cd4 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58518416-019d-4b76-948b-9cd6cbad0eeb tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4" status: 404 len: 111 microversion: 2.1 time: 0.035650 Oct 19 07:31:14.982774 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2993/6132] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:14 2022] GET /compute/v2.1/servers/58b9167b-4634-4210-aa1a-79ec28b65cd4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:14.985636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:14.986139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:14.993250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.000852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.000852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.000852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.000852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.000852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.011171 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 HTTP/1.1 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '5ae37f9a-eb55-47ca-8485-a980814fdc20'} Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.012993 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.017394 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2c6d108-63ab-43a2-8d20-af3a8afcd7c1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 404 len: 111 microversion: 2.1 time: 0.034740 Oct 19 07:31:15.018767 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3140/6133] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:14 2022] DELETE /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.028149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.028771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 5ae37f9a-eb55-47ca-8485-a980814fdc20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.035390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.035885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.036362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.037078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.038100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.038757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.052603 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 HTTP/1.1 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '5ae37f9a-eb55-47ca-8485-a980814fdc20'} Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.054844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 5ae37f9a-eb55-47ca-8485-a980814fdc20 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26c60c50-630d-4b15-a0e0-cab66c323ef5 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20" status: 404 len: 111 microversion: 2.1 time: 0.032934 Oct 19 07:31:15.062545 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2994/6134] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:15 2022] GET /compute/v2.1/servers/5ae37f9a-eb55-47ca-8485-a980814fdc20 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.065597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.066103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.072589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.075808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.075808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.075808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.075808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.075808 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.092888 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a HTTP/1.1 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'e49f184e-9a4f-448e-a7d3-a5bf7999181a'} Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.094485 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e560779-6108-4699-b5c9-0cd68a98bf49 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 404 len: 111 microversion: 2.1 time: 0.034755 Oct 19 07:31:15.099077 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3141/6135] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:15 2022] DELETE /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.105199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.105820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e49f184e-9a4f-448e-a7d3-a5bf7999181a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.111734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.112566 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.113020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.113887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.114526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.115050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.128983 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a HTTP/1.1 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'e49f184e-9a4f-448e-a7d3-a5bf7999181a'} Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.130542 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance e49f184e-9a4f-448e-a7d3-a5bf7999181a could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b69a5f4d-701b-4991-b5eb-f1797280b556 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a" status: 404 len: 111 microversion: 2.1 time: 0.030756 Oct 19 07:31:15.134399 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2995/6136] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:15 2022] GET /compute/v2.1/servers/e49f184e-9a4f-448e-a7d3-a5bf7999181a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:31:15.140796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.141521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.148498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.148988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.149431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.150132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.150746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.151215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.166426 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 HTTP/1.1 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '9969cb7e-5ad4-4345-b24f-48314c8bc868'} Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.173599 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39c0dea4-ec0f-49cf-b395-66a18f6c7fa3 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 404 len: 111 microversion: 2.1 time: 0.032734 Oct 19 07:31:15.178283 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3142/6137] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:15 2022] DELETE /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.179509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.179509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 9969cb7e-5ad4-4345-b24f-48314c8bc868] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.185320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.185717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.186175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.186887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.187356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.187990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.201880 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 HTTP/1.1 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9969cb7e-5ad4-4345-b24f-48314c8bc868'} Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.203447 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.208215 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.208215 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.208215 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.208215 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.208215 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.208215 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. Oct 19 07:31:15.208215 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.208215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 9969cb7e-5ad4-4345-b24f-48314c8bc868 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.208215 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27e983d3-c7a6-45cc-aae6-45af911534a1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868" status: 404 len: 111 microversion: 2.1 time: 0.030151 Oct 19 07:31:15.208909 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2996/6138] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:15 2022] GET /compute/v2.1/servers/9969cb7e-5ad4-4345-b24f-48314c8bc868 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.214923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.215653 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.222448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.223199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.223805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.224781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.226953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.227572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.249552 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 HTTP/1.1 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'e5d643f8-6000-4f2b-acb5-b83f2eed4d64'} Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.251142 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ef55ac2-9b54-4b07-8594-bb556ae9b825 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 404 len: 111 microversion: 2.1 time: 0.041496 Oct 19 07:31:15.255814 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3143/6139] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:15 2022] DELETE /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.261179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.261808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: e5d643f8-6000-4f2b-acb5-b83f2eed4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.268424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.269201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.269659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.270387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.270860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.271306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.286369 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 HTTP/1.1 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'e5d643f8-6000-4f2b-acb5-b83f2eed4d64'} Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.288750 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance e5d643f8-6000-4f2b-acb5-b83f2eed4d64 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46b61b19-1041-4755-bfbb-c1506bee1c3e tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64" status: 404 len: 111 microversion: 2.1 time: 0.033382 Oct 19 07:31:15.293181 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2997/6140] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:15 2022] GET /compute/v2.1/servers/e5d643f8-6000-4f2b-acb5-b83f2eed4d64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.299478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.300057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.306353 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.306918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.307423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.308280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.308740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.309237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.323096 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 HTTP/1.1 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '80c30778-4f67-4240-bf3f-495c15b77012'} Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.324806 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7aa5fb43-fdfc-45c3-91f3-d4bc8f0f612c tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 404 len: 111 microversion: 2.1 time: 0.031759 Oct 19 07:31:15.334058 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3144/6141] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:15 2022] DELETE /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.336559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.337205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 80c30778-4f67-4240-bf3f-495c15b77012] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.343163 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.343660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.344133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.344876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.345294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.345767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.359599 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 HTTP/1.1 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '80c30778-4f67-4240-bf3f-495c15b77012'} Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.361174 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 80c30778-4f67-4240-bf3f-495c15b77012 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6b9ef54-4ed6-4009-b6c9-88f454f1d761 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012" status: 404 len: 111 microversion: 2.1 time: 0.030428 Oct 19 07:31:15.365341 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2998/6142] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:15 2022] GET /compute/v2.1/servers/80c30778-4f67-4240-bf3f-495c15b77012 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.371565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a8e0c9a-9f0e-485d-ba92-f63e63b7cef9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.372163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a8e0c9a-9f0e-485d-ba92-f63e63b7cef9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 76641aa1-eda9-4002-856d-9bc29acdba45] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.377656 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0a8e0c9a-9f0e-485d-ba92-f63e63b7cef9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a8e0c9a-9f0e-485d-ba92-f63e63b7cef9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45 HTTP/1.1 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '76641aa1-eda9-4002-856d-9bc29acdba45'} Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.379145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a8e0c9a-9f0e-485d-ba92-f63e63b7cef9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a8e0c9a-9f0e-485d-ba92-f63e63b7cef9 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45" status: 404 len: 111 microversion: 2.1 time: 0.012755 Oct 19 07:31:15.383782 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3145/6143] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:15 2022] DELETE /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.388709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cea76ed1-4ce1-4a0e-997e-a09fd61941a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.389325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cea76ed1-4ce1-4a0e-997e-a09fd61941a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 76641aa1-eda9-4002-856d-9bc29acdba45] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.394986 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-cea76ed1-4ce1-4a0e-997e-a09fd61941a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cea76ed1-4ce1-4a0e-997e-a09fd61941a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45 HTTP/1.1 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '76641aa1-eda9-4002-856d-9bc29acdba45'} Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:15.396487 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:15.401573 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:15.401573 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:15.401573 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:15.401573 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. Oct 19 07:31:15.401573 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:15.401573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cea76ed1-4ce1-4a0e-997e-a09fd61941a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 76641aa1-eda9-4002-856d-9bc29acdba45 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:15.401573 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cea76ed1-4ce1-4a0e-997e-a09fd61941a2 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45" status: 404 len: 111 microversion: 2.1 time: 0.013411 Oct 19 07:31:15.401573 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2999/6144] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:15 2022] GET /compute/v2.1/servers/76641aa1-eda9-4002-856d-9bc29acdba45 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:15.406287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.406777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.414165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.414649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.415087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.415779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.416404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.416841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.441226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:31:15.701685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4fabece-1ac1-4835-807d-c5d7c9078e26 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 204 len: 0 microversion: 2.1 time: 0.298687 Oct 19 07:31:15.702203 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3146/6145] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:15 2022] DELETE /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:31:15.710730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:15.712594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:15.718335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.718830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.719282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.719983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:15.720491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:15.720933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:15.850552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:15.858347 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0364b8ad-9558-4a5c-afb9-bc7cc5cba9f1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1481 microversion: 2.1 time: 0.152067 Oct 19 07:31:15.858917 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3000/6146] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:15 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1481 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:16.883861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:16.885054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:16.892054 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:16.892575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:16.893015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:16.893970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:16.894426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:16.894854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:17.035671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:17.044599 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aeef0095-c630-4b71-9ff7-fa09a7d67021 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1481 microversion: 2.1 time: 0.166369 Oct 19 07:31:17.045234 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3147/6147] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:16 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1481 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:17.918975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f8c1a4cc-e146-4164-9233-3bf8634ce64b req-8c53444b-3163-4427-bc89-a3dc9c8b6c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006863a4-ecda-49d4-9d59-166acb463643", "name": "network-vif-deleted", "tag": "f3a0a6e0-fd4f-442d-8116-9f6b12dc927f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:17.931171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f8c1a4cc-e146-4164-9233-3bf8634ce64b req-8c53444b-3163-4427-bc89-a3dc9c8b6c4c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:17.931671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f8c1a4cc-e146-4164-9233-3bf8634ce64b req-8c53444b-3163-4427-bc89-a3dc9c8b6c4c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:17.932139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f8c1a4cc-e146-4164-9233-3bf8634ce64b req-8c53444b-3163-4427-bc89-a3dc9c8b6c4c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:17.944417 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f8c1a4cc-e146-4164-9233-3bf8634ce64b req-8c53444b-3163-4427-bc89-a3dc9c8b6c4c service nova] Creating event network-vif-deleted:f3a0a6e0-fd4f-442d-8116-9f6b12dc927f for instance 006863a4-ecda-49d4-9d59-166acb463643 on n-h2-861333-10 Oct 19 07:31:17.949872 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f8c1a4cc-e146-4164-9233-3bf8634ce64b req-8c53444b-3163-4427-bc89-a3dc9c8b6c4c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034585 Oct 19 07:31:17.950527 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3001/6148] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:31:18.068424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:18.068967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:18.075872 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:18.076391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:18.076834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:18.077529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:18.077993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:18.078428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:18.147709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83aaeed768e54cf5a7958e85e6dd91a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719546d25c84cf399312e12a99644e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:18.156362 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da92e8e5-d663-4bb0-8bab-7b0d4bf05571 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 200 len: 1278 microversion: 2.1 time: 0.092033 Oct 19 07:31:18.156945 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3148/6149] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:18 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:31:19.181187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:19.181892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] [instance: 006863a4-ecda-49d4-9d59-166acb463643] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:19.188926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:19.189444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:19.189895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:19.190593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:19.191057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:19.191534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:19.204601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] HTTP exception thrown: Instance 006863a4-ecda-49d4-9d59-166acb463643 could not be found. Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Request method failure captured: Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 HTTP/1.1 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6clXogB-C9c4yZGBnQAO--DM7-5LGoQXiGNurlEK_5gCKFouHIzu4jE2oPzwNf28WZIr2XYSQBLW-g821dDug05kW5gK8D8H8u0TAGAOuBCsqoV6t6T67fGleouXa5ZHDVv3HyBnRL4Wk40BPx7I8x8YhAt73qiUU9kJPP6Fnp44PY Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c719546d25c84cf399312e12a99644e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c719546d25c84cf399312e12a99644e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c719546d25c84cf399312e12a99644e1", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-1392618842 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: c719546d25c84cf399312e12a99644e1 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-1392618842 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 83aaeed768e54cf5a7958e85e6dd91a4 Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-1392618842-project Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 006863a4-ecda-49d4-9d59-166acb463643 could not be found. Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '006863a4-ecda-49d4-9d59-166acb463643'} Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006863a4-ecda-49d4-9d59-166acb463643 could not be found. Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006863a4-ecda-49d4-9d59-166acb463643 could not be found. Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:19.206236 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006863a4-ecda-49d4-9d59-166acb463643 could not be found. Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] Returning 404 to user: Instance 006863a4-ecda-49d4-9d59-166acb463643 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2107da7-440c-44d6-94e1-2e23b6474fd1 tempest-ServersTestJSON-1392618842 tempest-ServersTestJSON-1392618842-project] 10.222.0.39 "GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643" status: 404 len: 111 microversion: 2.1 time: 0.031570 Oct 19 07:31:19.210628 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3002/6150] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:19 2022] GET /compute/v2.1/servers/006863a4-ecda-49d4-9d59-166acb463643 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:29.812388 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:29.813440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:29.948356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-144171494", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:30.002847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] validate_networks() for [('84e622d1-7959-45bc-8252-bb2774b0becf', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:31:30.383919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:31:30.384450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:31:30.385466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:31:30.385879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:31:30.386291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:31:30.395448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:30.395929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:30.396407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:30.397139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:30.397593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:30.398021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:30.416538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Getting quotas for project 8f77b2486a1b4678a6e207cc3dda0e5e. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:31:30.421865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Getting quotas for user c34501b1477c4afa83c688a75e2dd01e and project 8f77b2486a1b4678a6e207cc3dda0e5e. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:31:30.435065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:31:30.437775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:31:30.571242 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fb7eb52-b408-4de9-89c1-d84e269b50b4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765165 Oct 19 07:31:30.572881 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3149/6151] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:31:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:31:30.583995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29c3df98-8165-4ebf-93c4-39aa9adccdc1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:30.586305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29c3df98-8165-4ebf-93c4-39aa9adccdc1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:30.589319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=37 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:30.594206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:30.646514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29c3df98-8165-4ebf-93c4-39aa9adccdc1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:30.654016 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29c3df98-8165-4ebf-93c4-39aa9adccdc1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1216 microversion: 2.1 time: 0.074306 Oct 19 07:31:30.654572 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3003/6152] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:30 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:31.677489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:31.678142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:31.688046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:31.688575 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:31.689027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:31.689744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:31.690367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:31.690805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:31.773225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:31.781459 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-578b6bbd-8a8d-4a09-a492-b738b1129fd3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1220 microversion: 2.1 time: 0.109100 Oct 19 07:31:31.782030 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3150/6153] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:31 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:32.805354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:32.805987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:32.815569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:32.815569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:32.815967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:32.816575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:32.817053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:32.817498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:32.888235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:32.896963 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e70e453-0768-4984-bdbe-2ef03dd0875b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1268 microversion: 2.1 time: 0.095776 Oct 19 07:31:32.897624 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3004/6154] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:32 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1268 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:33.922154 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:33.923390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:33.930915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:33.931431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:33.931880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:33.932623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:33.933088 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:33.933526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:34.087133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:34.095766 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6ce37b0-50e5-438a-a511-1b39c7ff77c4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1316 microversion: 2.1 time: 0.177865 Oct 19 07:31:34.096390 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3151/6155] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:33 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:34.860567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e0d2d6fc-f406-4405-9a78-27f371417d59 req-c746d757-6270-4048-b3b3-16047c7a9986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72f57cde-270a-4d24-95f6-012fae9901a0", "tag": "648e01af-202b-4711-b821-4d75e1316cad"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:34.872651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0d2d6fc-f406-4405-9a78-27f371417d59 req-c746d757-6270-4048-b3b3-16047c7a9986 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:34.877691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0d2d6fc-f406-4405-9a78-27f371417d59 req-c746d757-6270-4048-b3b3-16047c7a9986 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:34.877691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0d2d6fc-f406-4405-9a78-27f371417d59 req-c746d757-6270-4048-b3b3-16047c7a9986 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:34.885940 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e0d2d6fc-f406-4405-9a78-27f371417d59 req-c746d757-6270-4048-b3b3-16047c7a9986 service nova] Creating event network-changed:648e01af-202b-4711-b821-4d75e1316cad for instance 72f57cde-270a-4d24-95f6-012fae9901a0 on n-h1-861333-10 Oct 19 07:31:34.891112 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e0d2d6fc-f406-4405-9a78-27f371417d59 req-c746d757-6270-4048-b3b3-16047c7a9986 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034569 Oct 19 07:31:34.892030 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3005/6156] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:31:35.122406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:35.123195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:35.130337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:35.130934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:35.131435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:35.132291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:35.132802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:35.133236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:35.307181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:35.315408 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c01873ce-20f0-4c85-8e99-e0aed0694e40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1316 microversion: 2.1 time: 0.198980 Oct 19 07:31:35.315998 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3152/6157] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:35 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:36.339707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:36.340434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:36.346770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:36.347264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:36.347710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:36.348443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:36.348907 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:36.349342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:36.484515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:36.492237 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08d60e53-800c-4737-a7c5-0cfeb30f5f05 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1316 microversion: 2.1 time: 0.157793 Oct 19 07:31:36.492809 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3006/6158] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:36 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:37.516436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:37.517055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:37.524289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:37.524773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:37.525212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:37.525901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:37.526358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:37.526783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:37.654117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:37.661867 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3ed8444-6b30-4fc3-9f09-ad0893efb6a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1316 microversion: 2.1 time: 0.149570 Oct 19 07:31:37.662443 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3153/6159] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:37 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:38.689852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:38.690482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:38.697497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:38.697999 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:38.698459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:38.699331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:38.700345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:38.700798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:38.830995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:38.838757 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a42a9c3c-ec80-4f8f-ae27-e508781083aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1316 microversion: 2.1 time: 0.152929 Oct 19 07:31:38.839327 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3007/6160] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:38 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:39.862349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:39.862996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:39.869918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:39.870401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:39.870835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:39.871534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:39.871996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:39.872452 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:40.005093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:40.013513 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-994451f4-b2f5-4e2b-b4d0-be755ab54492 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1316 microversion: 2.1 time: 0.155132 Oct 19 07:31:40.014372 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3154/6161] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:39 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:41.038420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:41.039407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:41.042423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:41.048388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:41.053232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:41.053232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:41.053232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:41.053232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:41.053232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:41.187015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:41.194833 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3caae0a2-e3a9-44f8-9a25-04a07e3fd851 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1316 microversion: 2.1 time: 0.160725 Oct 19 07:31:41.199500 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3008/6162] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:41 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:41.325059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2375ad4f-2fb2-4a4c-a701-ba8e05e0b947 req-f43b4dbf-4b5d-4c35-bf8a-b75481612f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f57cde-270a-4d24-95f6-012fae9901a0", "name": "network-vif-plugged", "status": "completed", "tag": "648e01af-202b-4711-b821-4d75e1316cad"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:41.330560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:41.331483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:41.337882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2375ad4f-2fb2-4a4c-a701-ba8e05e0b947 req-f43b4dbf-4b5d-4c35-bf8a-b75481612f14 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:41.338411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2375ad4f-2fb2-4a4c-a701-ba8e05e0b947 req-f43b4dbf-4b5d-4c35-bf8a-b75481612f14 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:41.338889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2375ad4f-2fb2-4a4c-a701-ba8e05e0b947 req-f43b4dbf-4b5d-4c35-bf8a-b75481612f14 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:41.353344 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2375ad4f-2fb2-4a4c-a701-ba8e05e0b947 req-f43b4dbf-4b5d-4c35-bf8a-b75481612f14 service nova] Creating event network-vif-plugged:648e01af-202b-4711-b821-4d75e1316cad for instance 72f57cde-270a-4d24-95f6-012fae9901a0 on n-h1-861333-10 Oct 19 07:31:41.360126 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2375ad4f-2fb2-4a4c-a701-ba8e05e0b947 req-f43b4dbf-4b5d-4c35-bf8a-b75481612f14 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039000 Oct 19 07:31:41.360740 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3155/6163] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:31:42.217964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:42.218616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:42.226038 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:42.226563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:42.227013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:42.227717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:42.228215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:42.228748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:42.363073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:42.370732 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87ae5ad3-675f-4c8d-b149-d48da5ae335d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1316 microversion: 2.1 time: 0.156890 Oct 19 07:31:42.371289 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3009/6164] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:42 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:43.394312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:43.395020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:43.404900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:43.409431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:43.409431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:43.409431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:43.409431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:43.409431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:43.561955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:43.569698 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa595353-6306-4d0d-86ee-9350f37b6eec tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.180363 Oct 19 07:31:43.570281 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3156/6165] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:43 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:43.633917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1210717686", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:43.689408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] validate_networks() for [('84e622d1-7959-45bc-8252-bb2774b0becf', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:31:44.073032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:31:44.073497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:31:44.073988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:31:44.074417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:31:44.074849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:31:44.084414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:44.084956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:44.085415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:44.086159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:44.086629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:44.087071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:44.106274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Getting quotas for project 8f77b2486a1b4678a6e207cc3dda0e5e. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:31:44.111616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Getting quotas for user c34501b1477c4afa83c688a75e2dd01e and project 8f77b2486a1b4678a6e207cc3dda0e5e. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:31:44.124637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:31:44.127022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:31:44.261021 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab74546a-09a2-4112-bba7-951b9e718042 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630779 Oct 19 07:31:44.261677 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3010/6166] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:31:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:31:44.273816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ffbf228-f44e-4225-bd46-b655e99f36ae tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:44.281381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ffbf228-f44e-4225-bd46-b655e99f36ae tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:44.328942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ffbf228-f44e-4225-bd46-b655e99f36ae tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:44.336370 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ffbf228-f44e-4225-bd46-b655e99f36ae tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1217 microversion: 2.1 time: 0.066522 Oct 19 07:31:44.336987 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3157/6167] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:44 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:45.362334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:45.362958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:45.371500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:45.374708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:45.374708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:45.374708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:45.374708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:45.375101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:45.441491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:45.449252 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2094fec3-6123-4f90-a86d-1f265c4a93aa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1221 microversion: 2.1 time: 0.091280 Oct 19 07:31:45.449764 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3011/6168] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:45 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:46.472518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:46.473175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:46.481315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:46.481820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:46.482284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:46.482998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:46.483464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:46.483951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:46.549125 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:46.557495 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d83e2140-85a3-460c-acba-54b808f611c9 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1277 microversion: 2.1 time: 0.088966 Oct 19 07:31:46.572168 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3158/6169] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:46 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:47.582611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:47.583364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:47.590475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:47.590908 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:47.591364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:47.592071 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:47.592585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:47.593026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:47.808277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:47.816921 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6386328-1e5f-46db-bc55-1e673822c032 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1317 microversion: 2.1 time: 0.238746 Oct 19 07:31:47.817773 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3012/6170] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:47 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:48.323640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c9731829-079f-4aaf-a663-2b74d92a5b32 req-76072fb1-7118-459a-9cfd-041ad3c3ab77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7", "tag": "bfb324d5-172a-4760-9f4f-4785118e26f1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:48.333362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c9731829-079f-4aaf-a663-2b74d92a5b32 req-76072fb1-7118-459a-9cfd-041ad3c3ab77 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:48.333833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c9731829-079f-4aaf-a663-2b74d92a5b32 req-76072fb1-7118-459a-9cfd-041ad3c3ab77 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:48.334307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c9731829-079f-4aaf-a663-2b74d92a5b32 req-76072fb1-7118-459a-9cfd-041ad3c3ab77 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:48.345495 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c9731829-079f-4aaf-a663-2b74d92a5b32 req-76072fb1-7118-459a-9cfd-041ad3c3ab77 service nova] Creating event network-changed:bfb324d5-172a-4760-9f4f-4785118e26f1 for instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 on n-h2-861333-10 Oct 19 07:31:48.350394 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c9731829-079f-4aaf-a663-2b74d92a5b32 req-76072fb1-7118-459a-9cfd-041ad3c3ab77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097654 Oct 19 07:31:48.352831 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3159/6171] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:31:48.844137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:48.844974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:48.851715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:48.852244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:48.852696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:48.853394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:48.853859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:48.854294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:48.988703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:48.996475 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fedfe96-818b-46f3-ac5b-544adcbe8586 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1317 microversion: 2.1 time: 0.157470 Oct 19 07:31:48.997039 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3013/6172] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:48 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:50.020658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:50.021359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:50.027680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:50.028196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:50.028638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:50.029335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:50.029874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:50.030306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:50.169587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:50.178407 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88efecd1-340d-4a74-a618-89806f0ceb80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1317 microversion: 2.1 time: 0.163196 Oct 19 07:31:50.181905 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3160/6173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:50 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:51.201224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:51.201853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:51.208871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:51.209375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:51.209828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:51.210542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:51.211015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:51.211461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:51.348149 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:51.356209 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32770169-d2ff-4dda-a3a0-ab408cf09a88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1317 microversion: 2.1 time: 0.158967 Oct 19 07:31:51.356799 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3014/6174] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:51 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:52.379904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:52.380587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:52.387498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:52.387933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:52.388415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:52.389123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:52.389584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:52.390096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:52.522602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:52.530331 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6a407b6-c34d-4516-944d-7c4ba554818f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1317 microversion: 2.1 time: 0.154381 Oct 19 07:31:52.530927 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3161/6175] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:52 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:53.525532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5a783ada-885d-4e82-8ad7-5515bb2ec737 req-e7e8d6aa-066d-480a-a631-e071dc9b1570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7", "name": "network-vif-plugged", "status": "completed", "tag": "bfb324d5-172a-4760-9f4f-4785118e26f1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:53.536867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5a783ada-885d-4e82-8ad7-5515bb2ec737 req-e7e8d6aa-066d-480a-a631-e071dc9b1570 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:53.540042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5a783ada-885d-4e82-8ad7-5515bb2ec737 req-e7e8d6aa-066d-480a-a631-e071dc9b1570 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:53.540042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5a783ada-885d-4e82-8ad7-5515bb2ec737 req-e7e8d6aa-066d-480a-a631-e071dc9b1570 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:53.549045 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5a783ada-885d-4e82-8ad7-5515bb2ec737 req-e7e8d6aa-066d-480a-a631-e071dc9b1570 service nova] Creating event network-vif-plugged:bfb324d5-172a-4760-9f4f-4785118e26f1 for instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 on n-h2-861333-10 Oct 19 07:31:53.554791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:53.555409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:53.558537 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5a783ada-885d-4e82-8ad7-5515bb2ec737 req-e7e8d6aa-066d-480a-a631-e071dc9b1570 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036671 Oct 19 07:31:53.559161 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3015/6176] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:31:53.565120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:53.565580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:53.566013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:53.566717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:53.567170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:53.567601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:53.710118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:53.717821 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5290e215-9daf-47d3-80a1-4345eab426c3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1317 microversion: 2.1 time: 0.168361 Oct 19 07:31:53.718496 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3162/6177] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:53 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:54.738633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:54.739412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:54.744407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:54.745121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:54.751756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:54.754587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:54.754587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:54.754587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:54.754587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:54.754587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:54.891036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:54.899142 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da20be7f-140a-4aaf-8207-4f2318d94451 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1317 microversion: 2.1 time: 0.161567 Oct 19 07:31:54.899719 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3016/6178] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:54 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:55.922020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:55.922576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:55.924556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:31:55.930554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:55.931129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:55.931522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:55.932282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:55.932740 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:55.933168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:56.070721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:56.079333 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb0073a3-a905-4998-bbb3-86718f046e48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1507 microversion: 2.1 time: 0.161736 Oct 19 07:31:56.079947 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3163/6179] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:55 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:56.101935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:56.102443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:56.109391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:56.109886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:56.110336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:56.111039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:56.111505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:56.111947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:56.137561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:31:56.464543 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95b0d8be-8047-4d46-847c-964169bf2707 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 204 len: 0 microversion: 2.1 time: 0.366704 Oct 19 07:31:56.465130 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3017/6180] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:31:56 2022] DELETE /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:31:56.473209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:56.473823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:56.479912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:56.480425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:56.480864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:56.481556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:56.482012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:56.482465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:56.615376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:56.623209 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46eaa00a-3201-4841-a76a-b254b4bc5ba8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1513 microversion: 2.1 time: 0.153884 Oct 19 07:31:56.623798 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3164/6181] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:56 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:57.648643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:57.649354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:57.656210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:57.656711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:57.657239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:57.657898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:57.658368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:57.658809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:57.790326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:57.798520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99d4a552-282c-4a35-a2f8-c799887e9881 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1513 microversion: 2.1 time: 0.154207 Oct 19 07:31:57.799095 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3018/6182] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:57 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:58.494235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1a51362e-5e07-4cc9-bf90-498e51e58670 req-f2b20a28-ee08-41dd-9f26-8cfd44ae118e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7", "name": "network-vif-deleted", "tag": "bfb324d5-172a-4760-9f4f-4785118e26f1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:31:58.504594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1a51362e-5e07-4cc9-bf90-498e51e58670 req-f2b20a28-ee08-41dd-9f26-8cfd44ae118e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:58.505087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1a51362e-5e07-4cc9-bf90-498e51e58670 req-f2b20a28-ee08-41dd-9f26-8cfd44ae118e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:58.505529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1a51362e-5e07-4cc9-bf90-498e51e58670 req-f2b20a28-ee08-41dd-9f26-8cfd44ae118e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:58.518345 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1a51362e-5e07-4cc9-bf90-498e51e58670 req-f2b20a28-ee08-41dd-9f26-8cfd44ae118e service nova] Creating event network-vif-deleted:bfb324d5-172a-4760-9f4f-4785118e26f1 for instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 on n-h2-861333-10 Oct 19 07:31:58.523869 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1a51362e-5e07-4cc9-bf90-498e51e58670 req-f2b20a28-ee08-41dd-9f26-8cfd44ae118e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043529 Oct 19 07:31:58.525085 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3165/6183] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:31:58.822225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:58.822998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:58.830691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:58.831232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:58.831692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:58.832438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:58.833043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:58.833483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:58.867478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:58.868351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:58.868806 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:58.869280 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lazy-loading 'fault' on Instance uuid 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:31:58.911925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:31:58.920486 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f15c416-c30b-401b-ac66-dd390e17890f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 200 len: 1307 microversion: 2.1 time: 0.102175 Oct 19 07:31:58.921067 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3019/6184] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:58 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:31:59.945363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:59.946080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:59.952760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:59.953251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:59.953697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:59.954396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:59.954856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:59.955285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:59.968684 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 HTTP/1.1 Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7'} Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:31:59.970886 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ccfb8987-43eb-4ccf-86ac-ac88d4b57b8d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 404 len: 111 microversion: 2.1 time: 0.032369 Oct 19 07:31:59.975751 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3166/6185] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:59 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:31:59.981567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:31:59.982196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:31:59.990106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:59.990618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:59.991080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:31:59.991833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:31:59.992354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:31:59.992852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:00.013882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:00.126073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:00.133872 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-190eb8da-be74-4d79-8ab9-c5724b8c42ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.156281 Oct 19 07:32:00.134449 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3020/6186] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:31:59 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:00.195409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58dd08f9-c1cf-418c-af4e-b5a23a552647 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58dd08f9-c1cf-418c-af4e-b5a23a552647 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 163 Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": 12345, "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 12345 Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:32:00.212888 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58dd08f9-c1cf-418c-af4e-b5a23a552647 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58dd08f9-c1cf-418c-af4e-b5a23a552647 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.023129 Oct 19 07:32:00.225656 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3167/6187] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:00 2022] POST /compute/v2.1/servers => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:32:00.232832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:00.233961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:00.239724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:00.240258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:00.240707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:00.241411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:00.241913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:00.242514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:00.383918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:00.392227 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9dbfca98-52d1-4bb9-a141-0805528f72e1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.162984 Oct 19 07:32:00.392780 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3021/6188] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:00 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:00.415666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:00.421092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:00.421092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:00.424829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:00.425313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:00.425750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:00.426440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:00.426898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:00.427491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:00.431570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=83 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:00.562622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:00.571555 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47e08e18-351d-4a85-a4a2-6964b30bd0e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.160073 Oct 19 07:32:00.572186 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3168/6189] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:00 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:03.560441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-752e4de5-2462-46c3-87c5-537ab2add24b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1359418922", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8bf2774d-a0eb-440b-b996-9520cda13efd", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:03.572297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:03.627095 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-752e4de5-2462-46c3-87c5-537ab2add24b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Block Device 8bf2774d-a0eb-440b-b996-9520cda13efd is not bootable. Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-752e4de5-2462-46c3-87c5-537ab2add24b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 358 Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1359418922", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8bf2774d-a0eb-440b-b996-9520cda13efd", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: exception: Block Device 8bf2774d-a0eb-440b-b996-9520cda13efd is not bootable. Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1359418922', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '8bf2774d-a0eb-440b-b996-9520cda13efd'}], 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 8bf2774d-a0eb-440b-b996-9520cda13efd is not bootable. Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:03.647706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 8bf2774d-a0eb-440b-b996-9520cda13efd is not bootable. Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 8bf2774d-a0eb-440b-b996-9520cda13efd is not bootable. Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-752e4de5-2462-46c3-87c5-537ab2add24b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Block Device 8bf2774d-a0eb-440b-b996-9520cda13efd is not bootable. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-752e4de5-2462-46c3-87c5-537ab2add24b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.093046 Oct 19 07:32:03.652063 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3022/6190] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 07:32:03.658610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:03.659310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:03.666881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:03.667376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:03.667873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:03.668609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:03.669072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:03.669534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:03.802699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:03.810421 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8e274c7-c438-4ffd-b039-1d509ffa3a7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.155814 Oct 19 07:32:03.810997 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3169/6191] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:03 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:03.833837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:03.834464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:03.841017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:03.841520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:03.841989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:03.842689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:03.843162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:03.843604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:03.975068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:03.983022 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48c4853c-b4eb-43db-962f-71356a475546 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.153586 Oct 19 07:32:03.983664 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3023/6192] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:03 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:06.777717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fed9679c-6c14-484a-8c7b-933a2b67366c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-755265999", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "bf91402f-43c2-455b-ba41-1073b9eae084", "destination_type": "local"}, {"source_type": "volume", "uuid": "cc0d451d-7f57-40b5-9aa0-1fd622c06cd2", "destination_type": "invalid"}], "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fed9679c-6c14-484a-8c7b-933a2b67366c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 494 Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-755265999", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "bf91402f-43c2-455b-ba41-1073b9eae084", "destination_type": "local"}, {"source_type": "volume", "uuid": "cc0d451d-7f57-40b5-9aa0-1fd622c06cd2", "destination_type": "invalid"}], "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-755265999', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'cc0d451d-7f57-40b5-9aa0-1fd622c06cd2', 'destination_type': 'invalid'}], 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:06.782105 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fed9679c-6c14-484a-8c7b-933a2b67366c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fed9679c-6c14-484a-8c7b-933a2b67366c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009657 Oct 19 07:32:06.786708 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3170/6193] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:06 2022] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:32:06.792559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:06.793185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:06.800335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:06.800838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:06.801291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:06.802008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:06.802480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:06.802925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:06.940093 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:06.949187 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b8273ef-86f8-4bcf-bcc8-e35504e33204 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.160508 Oct 19 07:32:06.949770 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3024/6194] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:06 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:06.973756 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:06.974523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:06.981365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:06.981930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:06.982370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:06.983141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:06.983667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:06.984097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:07.115104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:07.123264 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0c61ca8-e533-4930-8f8d-1c8dbd10efb6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.154773 Oct 19 07:32:07.123850 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3171/6195] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:06 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:07.184884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33a476c3-a45f-4027-ab89-4be8f014601c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1319095640", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33a476c3-a45f-4027-ab89-4be8f014601c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 492 Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1319095640", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1319095640', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.189106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33a476c3-a45f-4027-ab89-4be8f014601c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33a476c3-a45f-4027-ab89-4be8f014601c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.009717 Oct 19 07:32:07.193170 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3025/6196] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:07 2022] POST /compute/v2.1/servers => generated 624 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:32:07.199650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:07.200298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:07.206288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:07.206775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:07.207813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:07.208559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:07.209024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:07.209462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:07.343500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:07.351969 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-879b5d81-a1a1-4b2d-94f6-830a0979948d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.156198 Oct 19 07:32:07.352628 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3172/6197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:07 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:07.375316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:07.375941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:07.382793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:07.383300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:07.387857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:07.387857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:07.387857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:07.387857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:07.513657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:07.522354 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0046dde-e444-4714-973d-debc3e8317c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.150841 Oct 19 07:32:07.522927 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3026/6198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:07 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:07.585262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b7a9c90-04ea-4379-a2f9-0c0d2d399e66 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b7a9c90-04ea-4379-a2f9-0c0d2d399e66 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 416 Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.589083 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b7a9c90-04ea-4379-a2f9-0c0d2d399e66 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b7a9c90-04ea-4379-a2f9-0c0d2d399e66 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009753 Oct 19 07:32:07.593087 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3173/6199] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:07 2022] POST /compute/v2.1/servers => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:32:07.599570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:07.600324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:07.606701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:07.607196 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:07.607645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:07.611333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:07.611333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:07.611333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:07.745051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:07.752889 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a69f83f-30d4-4742-ad34-7feb6aaea0a5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.157984 Oct 19 07:32:07.753454 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3027/6200] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:07 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:07.776757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:07.777368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:07.784644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:07.785299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:07.785651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:07.786337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:07.786793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:07.787221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:07.916336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:07.924535 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2ffe7fb-7091-4e78-baec-5a8841c6f095 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151446 Oct 19 07:32:07.925107 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3174/6201] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:07 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:07.985394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9afeb54d-bbc8-4546-be3f-0a54173abc89 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-588079033", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": -1, "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:07.999470 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9afeb54d-bbc8-4546-be3f-0a54173abc89 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Flavor -1 could not be found. Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9afeb54d-bbc8-4546-be3f-0a54173abc89 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 205 Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-588079033", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": -1, "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: exception: Flavor -1 could not be found. Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-588079033', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': -1, 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:08.005609 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9afeb54d-bbc8-4546-be3f-0a54173abc89 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9afeb54d-bbc8-4546-be3f-0a54173abc89 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.025582 Oct 19 07:32:08.011350 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3028/6202] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:07 2022] POST /compute/v2.1/servers => generated 73 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 07:32:08.016296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:08.016923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:08.024446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.024964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.025413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.026120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.026589 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.027022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.162998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:08.171488 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29e49cde-6055-48f1-a573-ba8853e4443c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.159424 Oct 19 07:32:08.172056 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3175/6203] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:08 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:08.194834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:08.195465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:08.201584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.202083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.202539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.203245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.203720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.204199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.336687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:08.344535 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6383117d-c020-45d1-95f3-f92c4a0c2215 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.153612 Oct 19 07:32:08.345098 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3029/6204] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:08 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:08.407018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f6ef27f-642d-437a-8300-7b37b9840a78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1520543424", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f6ef27f-642d-437a-8300-7b37b9840a78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 173 Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1520543424", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1520543424', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi -1 Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:32:08.411671 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f6ef27f-642d-437a-8300-7b37b9840a78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f6ef27f-642d-437a-8300-7b37b9840a78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010045 Oct 19 07:32:08.416881 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3176/6205] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:08 2022] POST /compute/v2.1/servers => generated 145 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:32:08.421728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:08.422360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:08.428874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.429384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.430286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.431348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.431835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.432337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.562399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:08.570676 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-858c1fc5-a5f4-4e9b-8f33-e60fae87e8c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.153050 Oct 19 07:32:08.571245 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3030/6206] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:08 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:32:08.593598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:08.594148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:08.601049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.601536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.601983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.602677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.603137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.603569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.730798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:08.738556 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2e84e36-c13c-4029-8e25-8545b9cf1e44 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.148885 Oct 19 07:32:08.739125 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3177/6207] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:08 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:08.800661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc97a303-3817-41fa-9ed5-d677d12bf067 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1036507362", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:08.806082 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bc97a303-3817-41fa-9ed5-d677d12bf067 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc97a303-3817-41fa-9ed5-d677d12bf067 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 216 Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1036507362", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1036507362', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.807635 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc97a303-3817-41fa-9ed5-d677d12bf067 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bc97a303-3817-41fa-9ed5-d677d12bf067 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012302 Oct 19 07:32:08.811726 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3031/6208] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:08 2022] POST /compute/v2.1/servers => generated 123 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:32:08.817548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:08.818163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:08.824095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.824757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.825194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.825883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.826342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.826767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.953382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:08.962044 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a73d744-6e49-4222-a4af-4e23a0e2da49 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.148148 Oct 19 07:32:08.962612 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3178/6209] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:08 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:08.987906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:08.988567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:08.997137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.997636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.998089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:08.998793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:08.999273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:08.999709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:09.134219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:09.142376 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e98b9472-6e57-4ae9-86f8-2dcea41eda60 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.158372 Oct 19 07:32:09.142940 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3032/6210] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:08 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:09.203121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6b967c2-5b84-424c-9bc7-347cf8e676fc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-855063114", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "key_name": "tempest-key-50092958", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:09.257998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c6b967c2-5b84-424c-9bc7-347cf8e676fc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] validate_networks() for [('84e622d1-7959-45bc-8252-bb2774b0becf', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:32:09.444658 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c6b967c2-5b84-424c-9bc7-347cf8e676fc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Invalid key_name provided. Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6b967c2-5b84-424c-9bc7-347cf8e676fc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 244 Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-855063114", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "key_name": "tempest-key-50092958", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid key_name provided. Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-855063114', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'key_name': 'tempest-key-50092958', 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-50092958 not found for user c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:09.446782 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6b967c2-5b84-424c-9bc7-347cf8e676fc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid key_name provided. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6b967c2-5b84-424c-9bc7-347cf8e676fc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.249119 Oct 19 07:32:09.450818 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3179/6211] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:09 2022] POST /compute/v2.1/servers => generated 70 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 07:32:09.457269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:09.458745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:09.464714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:09.465208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:09.465656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:09.466356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:09.467198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:09.467642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:09.598564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:09.606460 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c8a0e68-b8c2-400d-9855-5969ce1725db tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.153176 Oct 19 07:32:09.607028 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3033/6212] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:09 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:32:09.629264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:09.630337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:09.636555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:09.637046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:09.637495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:09.638198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:09.638662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:09.639101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:09.773407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:09.781195 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-310285aa-64a0-48d1-9dc3-565bb83f4d97 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.155893 Oct 19 07:32:09.781767 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3180/6213] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:09 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:09.841198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-259a2af6-a419-44d1-95ab-725a721a18fa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-434560261", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:09.931762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-259a2af6-a419-44d1-95ab-725a721a18fa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Neutron security group does_not_exist not found {{(pid=127568) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 19 07:32:09.932413 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-259a2af6-a419-44d1-95ab-725a721a18fa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-259a2af6-a419-44d1-95ab-725a721a18fa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 257 Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-434560261", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-434560261', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 19 07:32:10.032341 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.038862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-259a2af6-a419-44d1-95ab-725a721a18fa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:10.053890 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-259a2af6-a419-44d1-95ab-725a721a18fa tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.196786 Oct 19 07:32:10.053890 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3034/6214] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:09 2022] POST /compute/v2.1/servers => generated 106 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:32:10.054071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:10.054071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:10.058277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.058764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.059205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.059907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.060472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.060818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.199408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:10.207368 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-199497ce-389d-4dc4-8f09-6db89d4c4030 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.165249 Oct 19 07:32:10.208133 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3181/6215] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:10 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:10.232930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:10.233913 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:10.241646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.242279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.242807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.243550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.244029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.248450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.387067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:10.397559 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b026fc0f-6e35-461f-82c4-cad7f5da2feb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.168272 Oct 19 07:32:10.397559 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3035/6216] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:10 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:10.418681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0acabc88-1a48-462b-8920-05546441c7eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:10.419188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0acabc88-1a48-462b-8920-05546441c7eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 76e446fa-6598-4623-a939-b427c41efefd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:10.425728 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0acabc88-1a48-462b-8920-05546441c7eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 76e446fa-6598-4623-a939-b427c41efefd could not be found. Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0acabc88-1a48-462b-8920-05546441c7eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/76e446fa-6598-4623-a939-b427c41efefd HTTP/1.1 Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 76e446fa-6598-4623-a939-b427c41efefd could not be found. Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '76e446fa-6598-4623-a939-b427c41efefd'} Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76e446fa-6598-4623-a939-b427c41efefd could not be found. Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76e446fa-6598-4623-a939-b427c41efefd could not be found. Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.427991 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76e446fa-6598-4623-a939-b427c41efefd could not be found. Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0acabc88-1a48-462b-8920-05546441c7eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 76e446fa-6598-4623-a939-b427c41efefd could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0acabc88-1a48-462b-8920-05546441c7eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "DELETE /compute/v2.1/servers/76e446fa-6598-4623-a939-b427c41efefd" status: 404 len: 111 microversion: 2.1 time: 0.014844 Oct 19 07:32:10.432757 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3182/6217] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:32:10 2022] DELETE /compute/v2.1/servers/76e446fa-6598-4623-a939-b427c41efefd => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:10.438327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:10.438951 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:10.445217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.445714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.446162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.446872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.447337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.447773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.576689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:10.585082 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-886d489b-1303-439b-8091-ce0018b33ed7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.150761 Oct 19 07:32:10.585655 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3036/6218] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:10 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:10.608246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:10.608855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:10.615913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.616443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.616877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.617570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.618035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.618469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.751722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:10.760008 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52470faa-87b2-46d7-af92-78197a99200f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.155585 Oct 19 07:32:10.760599 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3183/6219] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:10 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:10.782140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12d99500-7d3d-43e8-afe3-d09022bf4831 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:10.782635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12d99500-7d3d-43e8-afe3-d09022bf4831 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 07:32:10.783169 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-12d99500-7d3d-43e8-afe3-d09022bf4831 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12d99500-7d3d-43e8-afe3-d09022bf4831 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 9223372036854775808 could not be found. Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9223372036854775808'} Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:10.784706 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:10.789640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:10.789640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:10.789640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:10.789640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 19 07:32:10.789640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:10.789640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12d99500-7d3d-43e8-afe3-d09022bf4831 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:10.789640 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12d99500-7d3d-43e8-afe3-d09022bf4831 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.007849 Oct 19 07:32:10.789640 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3037/6220] 10.222.0.39 () {58 vars in 1188 bytes} [Wed Oct 19 07:32:10 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:32:10.794020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:10.794627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:10.800550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.801031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.801955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.802665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.803120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.803548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.930961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:10.938789 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f4a29ba-9f69-46d3-8d7d-a8c39d173250 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.148432 Oct 19 07:32:10.939365 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3184/6221] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:10 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:10.969132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:10.969132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:10.971012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.971510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.971967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:10.972763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:10.973267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:10.974288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:11.108483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:11.118050 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd33fe35-308f-40e6-91ae-1e20b392acf0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.158970 Oct 19 07:32:11.118621 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3038/6222] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:10 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:11.140288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a0c9ba5-ed84-41b1-930a-ac01015c972c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:11.140776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a0c9ba5-ed84-41b1-930a-ac01015c972c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Failed to fetch instance by id -1 {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 07:32:11.141541 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3a0c9ba5-ed84-41b1-930a-ac01015c972c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance -1 could not be found. Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a0c9ba5-ed84-41b1-930a-ac01015c972c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance -1 could not be found. Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '-1'} Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:11.143026 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:11.147835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:11.147835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:11.147835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 19 07:32:11.147835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.147835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a0c9ba5-ed84-41b1-930a-ac01015c972c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:11.147835 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a0c9ba5-ed84-41b1-930a-ac01015c972c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008079 Oct 19 07:32:11.147835 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3185/6223] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 07:32:11 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:32:11.152787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:11.153408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:11.160750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:11.162255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:11.162805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:11.163552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:11.164024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:11.164489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:11.295428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:11.303268 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c98e6919-f586-4f59-b919-bef1e14c8bd1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.154344 Oct 19 07:32:11.306898 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3039/6224] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:11 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:11.326000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:11.326610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:11.333835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:11.334326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:11.334848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:11.335561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:11.336017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:11.336467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:11.473933 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:11.482173 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f659d40f-c3a1-4ff2-8892-3a84a7a93b54 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.160049 Oct 19 07:32:11.482734 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3186/6225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:11 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:11.504337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4eced2d-b912-485b-9ffb-f45788238aa6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:11.504829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4eced2d-b912-485b-9ffb-f45788238aa6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 207569c0-2e89-4253-9f1f-15cfa35cce71] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:11.510318 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a4eced2d-b912-485b-9ffb-f45788238aa6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 207569c0-2e89-4253-9f1f-15cfa35cce71 could not be found. Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4eced2d-b912-485b-9ffb-f45788238aa6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/207569c0-2e89-4253-9f1f-15cfa35cce71/action HTTP/1.1 Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 19 Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: {"forceDelete": {}} Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 207569c0-2e89-4253-9f1f-15cfa35cce71 could not be found. Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '207569c0-2e89-4253-9f1f-15cfa35cce71', 'body': {'forceDelete': {}}} Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207569c0-2e89-4253-9f1f-15cfa35cce71 could not be found. Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207569c0-2e89-4253-9f1f-15cfa35cce71 could not be found. Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:11.514844 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:11.521049 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:11.521049 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:11.521049 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207569c0-2e89-4253-9f1f-15cfa35cce71 could not be found. Oct 19 07:32:11.521049 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:11.521049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4eced2d-b912-485b-9ffb-f45788238aa6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 207569c0-2e89-4253-9f1f-15cfa35cce71 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:11.521049 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4eced2d-b912-485b-9ffb-f45788238aa6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/207569c0-2e89-4253-9f1f-15cfa35cce71/action" status: 404 len: 111 microversion: 2.1 time: 0.016483 Oct 19 07:32:11.521049 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3040/6226] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:11 2022] POST /compute/v2.1/servers/207569c0-2e89-4253-9f1f-15cfa35cce71/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:11.525515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:11.526130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:11.532089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:11.532729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:11.533108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:11.533802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:11.534260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:11.534691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:11.932929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:11.940781 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3ce190e-a8fa-461d-9138-799cdfcbb9bb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.419146 Oct 19 07:32:11.941353 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3187/6227] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:11 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:32:11.964859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:11.967067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:11.972656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:11.973160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:11.973619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:11.974374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:11.974849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:11.975297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.103513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:12.111113 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ce9ef20-4cb0-4f3e-9349-f659a88c8c2d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.150135 Oct 19 07:32:12.111682 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3041/6228] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:11 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:12.134346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3df0512-a0d5-4434-b7a5-986b76801aed tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:12.136668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e3df0512-a0d5-4434-b7a5-986b76801aed tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:12.142347 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e3df0512-a0d5-4434-b7a5-986b76801aed tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc could not be found. Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3df0512-a0d5-4434-b7a5-986b76801aed tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc/action HTTP/1.1 Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 39 Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: {"os-getConsoleOutput": {"length": 10}} Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc could not be found. Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc could not be found. Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc could not be found. Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.149043 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.153776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:12.153776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:12.153776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:12.153776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:12.153776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc could not be found. Oct 19 07:32:12.153776 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.153776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3df0512-a0d5-4434-b7a5-986b76801aed tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:12.153776 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3df0512-a0d5-4434-b7a5-986b76801aed tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc/action" status: 404 len: 111 microversion: 2.1 time: 0.020901 Oct 19 07:32:12.153776 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3188/6229] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:12 2022] POST /compute/v2.1/servers/3cbf6cde-4c4a-4a5b-b5e2-7fd142a940cc/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:12.159150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:12.159774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:12.165849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.166343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.166789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.167491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.167955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.168422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.302580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:12.310289 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e60cbf5-016b-4773-a9d7-d94000162999 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.154972 Oct 19 07:32:12.310855 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3042/6230] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:12 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:12.333563 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:12.334708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:12.341505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.342001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.342446 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.343148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.343611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.344046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.473102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:12.481058 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad35b410-c813-4696-bd04-57408995588c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151431 Oct 19 07:32:12.481629 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3189/6231] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:12 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:12.502869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e31c9b5a-1bb2-4287-b577-cb78c907eee6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:12.503493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e31c9b5a-1bb2-4287-b577-cb78c907eee6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 4575a54b-db9d-4bfc-be16-b4e9276c1417] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:12.509451 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e31c9b5a-1bb2-4287-b577-cb78c907eee6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 4575a54b-db9d-4bfc-be16-b4e9276c1417 could not be found. Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e31c9b5a-1bb2-4287-b577-cb78c907eee6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/4575a54b-db9d-4bfc-be16-b4e9276c1417 HTTP/1.1 Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 4575a54b-db9d-4bfc-be16-b4e9276c1417 could not be found. Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '4575a54b-db9d-4bfc-be16-b4e9276c1417'} Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4575a54b-db9d-4bfc-be16-b4e9276c1417 could not be found. Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4575a54b-db9d-4bfc-be16-b4e9276c1417 could not be found. Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.510932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:12.516027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:12.516027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:12.516027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:12.516027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4575a54b-db9d-4bfc-be16-b4e9276c1417 could not be found. Oct 19 07:32:12.516027 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.516027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e31c9b5a-1bb2-4287-b577-cb78c907eee6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 4575a54b-db9d-4bfc-be16-b4e9276c1417 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:12.516027 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e31c9b5a-1bb2-4287-b577-cb78c907eee6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/4575a54b-db9d-4bfc-be16-b4e9276c1417" status: 404 len: 111 microversion: 2.1 time: 0.013323 Oct 19 07:32:12.516027 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3043/6232] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:12 2022] GET /compute/v2.1/servers/4575a54b-db9d-4bfc-be16-b4e9276c1417 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:12.520921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:12.522158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:12.528061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.528584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.529032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.529732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.530206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.530641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.661627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:12.669925 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bec58dac-5ddf-4fcf-87ab-14807d6fe427 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.152897 Oct 19 07:32:12.670504 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3190/6233] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:12 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:32:12.693530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:12.694162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:12.701289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.701798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.702261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.702979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.703459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.703906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.830373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:12.838814 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21129052-6140-4ccb-b164-6a704b5b8f4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.149135 Oct 19 07:32:12.839373 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3044/6234] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:12 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:12.900550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba1db366-a6d0-41a2-8597-c3528a9dc479 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-934580262", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba1db366-a6d0-41a2-8597-c3528a9dc479 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 237 Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-934580262", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-934580262', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.919784 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba1db366-a6d0-41a2-8597-c3528a9dc479 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba1db366-a6d0-41a2-8597-c3528a9dc479 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025123 Oct 19 07:32:12.924680 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3191/6235] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:32:12.930592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:12.931220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:12.937449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.937948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.938403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.939109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:12.939581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:12.940033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:12.944639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:13.076138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:13.083730 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a771e56f-c909-4d51-ab44-27f20b6a5767 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.157516 Oct 19 07:32:13.084330 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3045/6236] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:12 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:13.106856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:13.107471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:13.114343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.114833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.115878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:13.116605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.117068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.117501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:13.245642 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:13.247925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:13.254100 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96fb4e04-9bb6-414b-a2a1-fb451e6e44a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151081 Oct 19 07:32:13.254666 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3192/6237] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:13 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:13.315144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-036131ff-3ea2-41f6-a18c-1d46faa3e8d8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1788667640", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-036131ff-3ea2-41f6-a18c-1d46faa3e8d8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 235 Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1788667640", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1788667640', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.321106 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-036131ff-3ea2-41f6-a18c-1d46faa3e8d8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-036131ff-3ea2-41f6-a18c-1d46faa3e8d8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011390 Oct 19 07:32:13.331048 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3046/6238] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:13 2022] POST /compute/v2.1/servers => generated 133 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:32:13.333094 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:13.333570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:13.340659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.341151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.341594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:13.342294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.342758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.343192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:13.477175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:13.485070 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe3ec0b4-9e9d-408f-b9e3-9c84062b1e4a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.155974 Oct 19 07:32:13.485637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3193/6239] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:13 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:13.509831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:13.510459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:13.518369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.518868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.519328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:13.520059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.520554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.521110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:13.661498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:13.669833 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f413a5cc-267a-444e-9e75-e50ee2f913f1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.165445 Oct 19 07:32:13.673209 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3047/6240] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:13 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:13.691926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04872b7b-3ee6-48b0-814b-a57312913e39 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:13.692496 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04872b7b-3ee6-48b0-814b-a57312913e39 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: a1e91f7a-22ef-439c-80be-6be130a938b4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:13.698082 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-04872b7b-3ee6-48b0-814b-a57312913e39 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance a1e91f7a-22ef-439c-80be-6be130a938b4 could not be found. Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04872b7b-3ee6-48b0-814b-a57312913e39 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/a1e91f7a-22ef-439c-80be-6be130a938b4/action HTTP/1.1 Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 13 Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: {"pause": {}} Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance a1e91f7a-22ef-439c-80be-6be130a938b4 could not be found. Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'a1e91f7a-22ef-439c-80be-6be130a938b4', 'body': {'pause': {}}} Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1e91f7a-22ef-439c-80be-6be130a938b4 could not be found. Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1e91f7a-22ef-439c-80be-6be130a938b4 could not be found. Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:13.708252 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:13.713458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:13.713458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:13.713458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1e91f7a-22ef-439c-80be-6be130a938b4 could not be found. Oct 19 07:32:13.713458 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:13.713458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04872b7b-3ee6-48b0-814b-a57312913e39 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance a1e91f7a-22ef-439c-80be-6be130a938b4 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:13.713458 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04872b7b-3ee6-48b0-814b-a57312913e39 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/a1e91f7a-22ef-439c-80be-6be130a938b4/action" status: 404 len: 111 microversion: 2.1 time: 0.022267 Oct 19 07:32:13.713458 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3194/6241] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:13 2022] POST /compute/v2.1/servers/a1e91f7a-22ef-439c-80be-6be130a938b4/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:13.718316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:13.718935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:13.725864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.726301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.726754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:13.727450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.727918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.728455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:13.857445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:13.866551 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-556f3ee0-8053-4d1a-8995-5e57b3caedc7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151962 Oct 19 07:32:13.867254 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3048/6242] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:13 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:13.891302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:13.891954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:13.902436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.902931 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.903379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:13.904086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:13.904579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:13.905018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:14.034405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:14.042722 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33cd43a6-1127-4fdc-ae64-629c4118490a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.155656 Oct 19 07:32:14.043291 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3195/6243] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:13 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:14.065567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-356db363-ef71-4481-9a1c-d1c5d5ea0eb3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:14.066128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-356db363-ef71-4481-9a1c-d1c5d5ea0eb3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:14.072434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-356db363-ef71-4481-9a1c-d1c5d5ea0eb3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:14.072938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-356db363-ef71-4481-9a1c-d1c5d5ea0eb3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:14.073392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-356db363-ef71-4481-9a1c-d1c5d5ea0eb3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:14.074102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-356db363-ef71-4481-9a1c-d1c5d5ea0eb3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:14.074572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-356db363-ef71-4481-9a1c-d1c5d5ea0eb3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:14.075014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-356db363-ef71-4481-9a1c-d1c5d5ea0eb3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:14.284353 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-356db363-ef71-4481-9a1c-d1c5d5ea0eb3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 202 len: 0 microversion: 2.1 time: 0.222520 Oct 19 07:32:14.285123 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3049/6244] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:14 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:32:14.293278 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:14.293903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:14.299878 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:14.300400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:14.300842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:14.301560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:14.302023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:14.302951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:14.436729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:14.445155 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d63ef7b-2268-41e5-a9fa-f5fdcb90ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1510 microversion: 2.1 time: 0.155905 Oct 19 07:32:14.445727 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3196/6245] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:14 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:15.470125 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:15.470892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:15.477148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:15.477649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:15.478098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:15.478810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:15.479279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:15.479718 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:15.616791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:15.624936 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e9b3963f-d32f-4706-a8bc-364776ac8f6e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1490 microversion: 2.1 time: 0.160084 Oct 19 07:32:15.625511 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3050/6246] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:15 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1490 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:15.658160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:15.658705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:15.666465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:15.666959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:15.667408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:15.668119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:15.668584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:15.669015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:15.692466 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Cannot 'pause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state paused Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action HTTP/1.1 Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 13 Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: {"pause": {}} Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'pause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state paused Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0', 'body': {'pause': {}}} Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 in vm_state paused. Cannot pause while the instance is in this state. Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state paused Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:15.694013 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:15.698405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:15.698405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:15.698405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:15.698405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state paused Oct 19 07:32:15.698405 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:15.698405 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 409 to user: Cannot 'pause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state paused {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:15.698405 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a96f9b0b-9c51-4c56-a7e3-4135e4c70671 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 409 len: 143 microversion: 2.1 time: 0.041503 Oct 19 07:32:15.698405 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3197/6247] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:15 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 143 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:32:15.704424 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-179014e7-512a-4991-9fe2-c4f80fbddd4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:15.704973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-179014e7-512a-4991-9fe2-c4f80fbddd4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:15.711755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-179014e7-512a-4991-9fe2-c4f80fbddd4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:15.712362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-179014e7-512a-4991-9fe2-c4f80fbddd4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:15.712865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-179014e7-512a-4991-9fe2-c4f80fbddd4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:15.713567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-179014e7-512a-4991-9fe2-c4f80fbddd4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:15.714145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-179014e7-512a-4991-9fe2-c4f80fbddd4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:15.714617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-179014e7-512a-4991-9fe2-c4f80fbddd4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:15.933153 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-179014e7-512a-4991-9fe2-c4f80fbddd4f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 202 len: 0 microversion: 2.1 time: 0.232449 Oct 19 07:32:15.933715 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3051/6248] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:15 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:32:15.941788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:15.942407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:15.949348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:15.949846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:15.950493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:15.951204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:15.951675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:15.952124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:16.091963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:16.100914 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48894ea0-8cc9-4171-b375-7c82f4b52822 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1497 microversion: 2.1 time: 0.163080 Oct 19 07:32:16.101575 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3198/6249] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:15 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:17.126061 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:17.126900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:17.134110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.134595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.135047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.135821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.136259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.136702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.278696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:17.286752 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc3dd2eb-c043-4d64-bedc-f45ca4e5f053 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.165123 Oct 19 07:32:17.292541 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3052/6250] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:17 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:32:17.311067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:17.311845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:17.319410 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.319895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.320369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.321090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.321542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.321962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.469641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:17.478629 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18868a1f-1077-4216-9219-d3f00d9a7f0d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.171407 Oct 19 07:32:17.479199 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3199/6251] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:17 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:17.500905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:17.503695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:17.509997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.510511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.510973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.511689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.512211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.519489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.530122 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7/action HTTP/1.1 Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 28 Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: {"reboot": {"type": "SOFT"}} Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7', 'body': {'reboot': {'type': 'SOFT'}}} Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:17.531843 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b41781e8-e4db-43e4-a9b3-1b2be6bbb2eb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7/action" status: 404 len: 111 microversion: 2.1 time: 0.036597 Oct 19 07:32:17.536680 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3053/6252] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:17 2022] POST /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:17.543033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:17.543685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:17.549765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.550253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.550692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.551386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.551851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.552502 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.685214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:17.693110 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18dfbb0e-a129-4bed-b39d-d5c5e630af88 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.153885 Oct 19 07:32:17.694206 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3200/6253] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:17 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:32:17.717154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:17.717796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:17.723852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.724391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.724851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.725570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.726044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.726544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.856967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:17.864929 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ac779b8-2664-471e-9376-288cfa0e355f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151675 Oct 19 07:32:17.865552 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3054/6254] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:17 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:17.887673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cc4c351-2644-4f28-a65a-77294e3c5f21 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:17.890003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1cc4c351-2644-4f28-a65a-77294e3c5f21 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: f9267aef-0620-417f-b2a6-0dcd98d29fc5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:17.895792 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1cc4c351-2644-4f28-a65a-77294e3c5f21 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance f9267aef-0620-417f-b2a6-0dcd98d29fc5 could not be found. Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cc4c351-2644-4f28-a65a-77294e3c5f21 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/f9267aef-0620-417f-b2a6-0dcd98d29fc5/action HTTP/1.1 Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 28 Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: {"reboot": {"type": "SOFT"}} Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance f9267aef-0620-417f-b2a6-0dcd98d29fc5 could not be found. Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'f9267aef-0620-417f-b2a6-0dcd98d29fc5', 'body': {'reboot': {'type': 'SOFT'}}} Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9267aef-0620-417f-b2a6-0dcd98d29fc5 could not be found. Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9267aef-0620-417f-b2a6-0dcd98d29fc5 could not be found. Oct 19 07:32:17.898051 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9267aef-0620-417f-b2a6-0dcd98d29fc5 could not be found. Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cc4c351-2644-4f28-a65a-77294e3c5f21 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance f9267aef-0620-417f-b2a6-0dcd98d29fc5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cc4c351-2644-4f28-a65a-77294e3c5f21 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/f9267aef-0620-417f-b2a6-0dcd98d29fc5/action" status: 404 len: 111 microversion: 2.1 time: 0.015823 Oct 19 07:32:17.902747 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3201/6255] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:17 2022] POST /compute/v2.1/servers/f9267aef-0620-417f-b2a6-0dcd98d29fc5/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:17.908010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:17.908685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:17.914853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.915356 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.915811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:17.916564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:17.917042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:17.917489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.047317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:18.055889 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5729d78-197b-49f4-9f9f-b0e737217534 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151808 Oct 19 07:32:18.056494 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3055/6256] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:17 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:18.085237 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:18.085863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:18.093116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.093611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.094105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.094859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.095323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.095758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.222557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:18.230585 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3fd465db-0813-4d99-9b93-2b31fd00b545 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.154982 Oct 19 07:32:18.231166 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3202/6257] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:18 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:18.254160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:18.257760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:18.264798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.265297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.266009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.266724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.267198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.267639 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.282510 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7/action HTTP/1.1 Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 65 Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7', 'body': {'rebuild': {'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084'}}} Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 19 07:32:18.284211 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e662dd76-fc7a-4274-969c-d822e8df1d62 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7/action" status: 404 len: 111 microversion: 2.1 time: 0.035838 Oct 19 07:32:18.289268 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3056/6258] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:18 2022] POST /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:18.294481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:18.295112 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:18.301348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.301842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.302288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.303505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.303974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.304503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.440482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:18.448457 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0192c165-5ea2-43a7-8867-b062a4bfc4ce tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.157808 Oct 19 07:32:18.449030 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3203/6259] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:18 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:18.471432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:18.472062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:18.478661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.479165 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.479619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.480367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.480850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.481298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.613521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:18.621771 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb6ee895-d330-40de-b852-259deb18dab5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.154413 Oct 19 07:32:18.622337 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3057/6260] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:18 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:18.644578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-280967a7-0ba1-42df-a4de-b4073e457226 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:18.647301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-280967a7-0ba1-42df-a4de-b4073e457226 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 6f9ce8df-a513-4b89-928a-26a7adda2ae3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:18.652922 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-280967a7-0ba1-42df-a4de-b4073e457226 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 6f9ce8df-a513-4b89-928a-26a7adda2ae3 could not be found. Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-280967a7-0ba1-42df-a4de-b4073e457226 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/6f9ce8df-a513-4b89-928a-26a7adda2ae3/action HTTP/1.1 Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 65 Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 6f9ce8df-a513-4b89-928a-26a7adda2ae3 could not be found. Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '6f9ce8df-a513-4b89-928a-26a7adda2ae3', 'body': {'rebuild': {'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084'}}} Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9ce8df-a513-4b89-928a-26a7adda2ae3 could not be found. Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 07:32:18.654529 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9ce8df-a513-4b89-928a-26a7adda2ae3 could not be found. Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9ce8df-a513-4b89-928a-26a7adda2ae3 could not be found. Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-280967a7-0ba1-42df-a4de-b4073e457226 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 6f9ce8df-a513-4b89-928a-26a7adda2ae3 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-280967a7-0ba1-42df-a4de-b4073e457226 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/6f9ce8df-a513-4b89-928a-26a7adda2ae3/action" status: 404 len: 111 microversion: 2.1 time: 0.015791 Oct 19 07:32:18.659059 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3204/6261] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:18 2022] POST /compute/v2.1/servers/6f9ce8df-a513-4b89-928a-26a7adda2ae3/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:18.665437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:18.665629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:18.671524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.672045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.672521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.673235 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.673714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.674161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.803024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:18.810906 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59c06023-fb49-4d49-9a4f-4b5843390ad1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.150352 Oct 19 07:32:18.811474 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3058/6262] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:18 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:18.833580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:18.834644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:18.841397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.841885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.842326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.843021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:18.843486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:18.843921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:18.972216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:18.980833 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea4153fe-86bc-494d-9cec-80e77d91d20f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151150 Oct 19 07:32:18.981400 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3205/6263] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:18 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:19.003474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-254ada82-468f-4f28-af04-055b8d90d9a8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:19.004025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-254ada82-468f-4f28-af04-055b8d90d9a8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 1cade9b1-5e9a-4a35-9650-740e889d898a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:19.009824 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-254ada82-468f-4f28-af04-055b8d90d9a8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 1cade9b1-5e9a-4a35-9650-740e889d898a could not be found. Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-254ada82-468f-4f28-af04-055b8d90d9a8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/1cade9b1-5e9a-4a35-9650-740e889d898a/action HTTP/1.1 Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 15 Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: {"restore": {}} Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 1cade9b1-5e9a-4a35-9650-740e889d898a could not be found. Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '1cade9b1-5e9a-4a35-9650-740e889d898a', 'body': {'restore': {}}} Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cade9b1-5e9a-4a35-9650-740e889d898a could not be found. Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cade9b1-5e9a-4a35-9650-740e889d898a could not be found. Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:19.011362 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:19.016778 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:19.016778 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:19.016778 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cade9b1-5e9a-4a35-9650-740e889d898a could not be found. Oct 19 07:32:19.016778 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.016778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-254ada82-468f-4f28-af04-055b8d90d9a8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 1cade9b1-5e9a-4a35-9650-740e889d898a could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:19.016778 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-254ada82-468f-4f28-af04-055b8d90d9a8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/1cade9b1-5e9a-4a35-9650-740e889d898a/action" status: 404 len: 111 microversion: 2.1 time: 0.013837 Oct 19 07:32:19.016778 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3059/6264] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:18 2022] POST /compute/v2.1/servers/1cade9b1-5e9a-4a35-9650-740e889d898a/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:19.021421 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:19.024096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:19.028583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.029069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.029561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.030324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.030778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.031206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.165179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:19.172913 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ebe3d7b8-6c64-4da2-ac7d-9f6486c33320 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.155372 Oct 19 07:32:19.173484 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3206/6265] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:19 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:19.197081 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:19.197709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:19.205313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.205812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.206261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.207018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.207485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.207962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.343287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:19.351408 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ee6ba541-c01b-4ef7-a8e5-168fbe67d7e7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.158883 Oct 19 07:32:19.354888 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3060/6266] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:19 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:19.375487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:19.375961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:19.383383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.383868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.384338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.385068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.385524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.385951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.410143 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Cannot 'restore' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action HTTP/1.1 Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 15 Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: {"restore": {}} Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'restore' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0', 'body': {'restore': {}}} Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 in vm_state active. Cannot restore while the instance is in this state. Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:19.411858 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:19.416434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:19.416434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:19.416434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:19.416434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:32:19.416434 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.416434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 409 to user: Cannot 'restore' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:19.416434 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f3f6d3e-2ee3-491e-b0e3-35935d8289af tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 409 len: 145 microversion: 2.1 time: 0.042100 Oct 19 07:32:19.416434 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3207/6267] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:19 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 145 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:32:19.422430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:19.423049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:19.429267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.429760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.430209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.430938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.431405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.431843 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.561834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:19.570866 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2e566b0-51a6-4637-95c5-b1deda7ae906 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.152632 Oct 19 07:32:19.571443 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3061/6268] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:19 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:19.593280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:19.593893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:19.600217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.600705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.601171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.601864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.602324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.602755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.735649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:19.743923 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a6aa6d8-cd36-4d96-89d8-fdba6a0e1f9d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.154502 Oct 19 07:32:19.744521 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3208/6269] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:19 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:19.767219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73b909ac-b4f1-4c6b-b6f1-b9d5f76f8315 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:19.767790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73b909ac-b4f1-4c6b-b6f1-b9d5f76f8315 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 404c6614-181f-4d1f-a4c9-68f7136805c7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:19.773406 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-73b909ac-b4f1-4c6b-b6f1-b9d5f76f8315 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 404c6614-181f-4d1f-a4c9-68f7136805c7 could not be found. Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73b909ac-b4f1-4c6b-b6f1-b9d5f76f8315 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/404c6614-181f-4d1f-a4c9-68f7136805c7/action HTTP/1.1 Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 14 Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: {"resume": {}} Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 404c6614-181f-4d1f-a4c9-68f7136805c7 could not be found. Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '404c6614-181f-4d1f-a4c9-68f7136805c7', 'body': {'resume': {}}} Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404c6614-181f-4d1f-a4c9-68f7136805c7 could not be found. Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404c6614-181f-4d1f-a4c9-68f7136805c7 could not be found. Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:19.783589 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:19.788384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:19.788384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:19.788384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404c6614-181f-4d1f-a4c9-68f7136805c7 could not be found. Oct 19 07:32:19.788384 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:19.788384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73b909ac-b4f1-4c6b-b6f1-b9d5f76f8315 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 404c6614-181f-4d1f-a4c9-68f7136805c7 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:19.788384 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73b909ac-b4f1-4c6b-b6f1-b9d5f76f8315 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/404c6614-181f-4d1f-a4c9-68f7136805c7/action" status: 404 len: 111 microversion: 2.1 time: 0.022296 Oct 19 07:32:19.788384 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3062/6270] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:19 2022] POST /compute/v2.1/servers/404c6614-181f-4d1f-a4c9-68f7136805c7/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:32:19.793773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:19.794383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:19.800438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.802091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.802091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.802091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.802598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.803536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.938033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:19.946068 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f58bcb2a-c8a5-47f1-8534-735a68d82936 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.156048 Oct 19 07:32:19.946643 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3209/6271] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:19 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:19.970521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:19.971142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:19.978611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.980880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.980880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:19.980880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:19.980880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:19.981211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.112019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:20.120523 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e09ea0ba-c9d7-484f-b39c-ed4182d596a6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.153893 Oct 19 07:32:20.121092 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3063/6272] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:19 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:20.143124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:20.143659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:20.149690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.152311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.152311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.152311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.152311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.152311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.175837 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Cannot 'resume' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action HTTP/1.1 Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 14 Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: {"resume": {}} Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'resume' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0', 'body': {'resume': {}}} Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 in vm_state active. Cannot resume while the instance is in this state. Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:20.177584 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 409 to user: Cannot 'resume' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7aa2a6e-521e-4ff7-b6af-8d0b8da78cc0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 409 len: 144 microversion: 2.1 time: 0.040791 Oct 19 07:32:20.182419 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3210/6273] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:20 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 144 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:32:20.188786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:20.189353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:20.195276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.195774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.196253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.196975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.197445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.197891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.201972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:20.338647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:20.346337 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d87774a-0db4-4047-aa5e-e0073803e80a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.161477 Oct 19 07:32:20.346982 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3064/6274] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:20 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:20.369729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:20.370334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:20.376407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.376897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.377338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.378029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.378490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.378921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.509463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:20.517918 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c300a8cf-e4a1-4d9c-be19-274e51f9e4a0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.152120 Oct 19 07:32:20.518565 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3211/6275] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:20 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:20.581234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8e5343c-898f-4c7d-be7e-17418af79303 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8e5343c-898f-4c7d-be7e-17418af79303 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 160 Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "84e622d1-7959-45bc-8252-bb2774b0becf"}]}} Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': '', 'imageRef': 'bf91402f-43c2-455b-ba41-1073b9eae084', 'flavorRef': '452', 'networks': [{'uuid': '84e622d1-7959-45bc-8252-bb2774b0becf'}]}}} Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '' Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:32:20.585335 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8e5343c-898f-4c7d-be7e-17418af79303 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8e5343c-898f-4c7d-be7e-17418af79303 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.009713 Oct 19 07:32:20.590307 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3065/6276] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:32:20 2022] POST /compute/v2.1/servers => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:32:20.595240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:20.595846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:20.602779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.603289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.603729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.604508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.604970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.605399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.734035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:20.741917 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58392f26-d42c-4c71-b3ad-c7cfb804df56 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.150763 Oct 19 07:32:20.742493 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3212/6277] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:20 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:20.766766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:20.767386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:20.775249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.775782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.776260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.776971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.777443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.777886 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.906878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:20.914721 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-901a2572-572b-4dc1-a359-1e4517060a53 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.152855 Oct 19 07:32:20.915281 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3066/6278] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:20 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:20.936829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7e83e03-d4ba-406d-9592-1855e9c4d12d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:20.937371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7e83e03-d4ba-406d-9592-1855e9c4d12d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 51dab315-81b3-4d29-b805-44735caf0bfc] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:20.942950 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c7e83e03-d4ba-406d-9592-1855e9c4d12d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 51dab315-81b3-4d29-b805-44735caf0bfc could not be found. Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7e83e03-d4ba-406d-9592-1855e9c4d12d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/51dab315-81b3-4d29-b805-44735caf0bfc/action HTTP/1.1 Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 14 Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: {"shelve": {}} Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 51dab315-81b3-4d29-b805-44735caf0bfc could not be found. Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '51dab315-81b3-4d29-b805-44735caf0bfc', 'body': {'shelve': {}}} Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51dab315-81b3-4d29-b805-44735caf0bfc could not be found. Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51dab315-81b3-4d29-b805-44735caf0bfc could not be found. Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:20.949215 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:20.954303 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:20.954303 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:20.954303 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51dab315-81b3-4d29-b805-44735caf0bfc could not be found. Oct 19 07:32:20.954303 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:32:20.954303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7e83e03-d4ba-406d-9592-1855e9c4d12d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 51dab315-81b3-4d29-b805-44735caf0bfc could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:20.954303 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7e83e03-d4ba-406d-9592-1855e9c4d12d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/51dab315-81b3-4d29-b805-44735caf0bfc/action" status: 404 len: 111 microversion: 2.1 time: 0.017903 Oct 19 07:32:20.954303 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3213/6279] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:20 2022] POST /compute/v2.1/servers/51dab315-81b3-4d29-b805-44735caf0bfc/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:32:20.959736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:20.960486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:20.966511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.967013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.967473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:20.968209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:20.968687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:20.969133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:21.103720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:21.111966 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4520a92a-110a-445f-81fd-2a05c0854593 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.156657 Oct 19 07:32:21.112649 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3067/6280] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:20 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:21.136771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:21.137385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:21.146655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:21.147145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:21.147587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:21.148327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:21.148788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:21.149220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:21.163568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:21.281946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:21.289764 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-883199d6-2b62-4319-b22d-d44cf9186f29 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.156850 Oct 19 07:32:21.290326 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3214/6281] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:21 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:21.313668 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:21.314278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:21.322017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:21.325589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:21.325589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:21.325589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:21.325589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:21.325589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:21.347849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lazy-loading 'flavor' on Instance uuid 72f57cde-270a-4d24-95f6-012fae9901a0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:32:21.845099 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b55d22ed-3331-48ae-9970-17b2895be3f5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 202 len: 0 microversion: 2.1 time: 0.535579 Oct 19 07:32:21.845688 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3068/6282] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:21 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:32:21.854670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:21.855279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:21.862451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:21.862939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:21.863376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:21.864133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:21.864582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:21.865089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:21.995961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:22.003795 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94bf66e0-b18c-45bd-a0f8-f6247a4811d2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.153021 Oct 19 07:32:22.004393 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3215/6283] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:21 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:23.029025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:23.029740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:23.036009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:23.036539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:23.036991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:23.037787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:23.038763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:23.039276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:23.171996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:23.179834 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b93fd39d-d607-43f1-b369-36ef6b5a7e69 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.156173 Oct 19 07:32:23.180441 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3069/6284] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:23 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:24.203171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:24.203818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:24.211167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:24.211654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:24.212097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:24.213333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:24.213820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:24.214322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:24.350710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:24.358611 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-313ccd47-1cbf-48b9-9f0d-a8699552fe48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.159360 Oct 19 07:32:24.359182 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3216/6285] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:24 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:25.382851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:25.383390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:25.391331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:25.391795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:25.392285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:25.393021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:25.393487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:25.393957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:25.525880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:25.533950 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89e080fb-958b-4c47-8ecc-062c1b6394cf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.155082 Oct 19 07:32:25.534520 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3070/6286] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:25 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:26.557147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:26.557874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:26.564697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:26.565187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:26.565635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:26.566331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:26.566790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:26.567223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:26.694256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:26.702361 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6436acd-f3b7-45f3-8ecc-3d642e9a5be1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.149217 Oct 19 07:32:26.702938 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3217/6287] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:26 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:27.726153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:27.726785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:27.734590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:27.735092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:27.735546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:27.736295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:27.736770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:27.737234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:27.866347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:27.874833 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a1ccc3c-09a0-4083-8aef-dae5dd4e73e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.152617 Oct 19 07:32:27.875406 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3071/6288] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:27 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:28.898863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:28.899511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:28.906877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:28.907366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:28.907801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:28.908526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:28.908981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:28.909408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:29.035915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:29.043722 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8a38310-3883-45d1-9b0b-ab507e7d9575 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.148939 Oct 19 07:32:29.044333 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3218/6289] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:28 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:30.067381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:30.068010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:30.075603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:30.076117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:30.076583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:30.077295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:30.077770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:30.078217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:30.208517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:30.216479 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-696d84ea-c9b7-4f11-99af-dc7faf4c1567 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.152947 Oct 19 07:32:30.217054 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3072/6290] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:30 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:31.239795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:31.240466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:31.247187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:31.247678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:31.248138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:31.248838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:31.249301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:31.249739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:31.382178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:31.390750 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fba6f4c3-56b2-4ef1-a32d-522e689a4253 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.155016 Oct 19 07:32:31.391315 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3219/6291] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:31 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:32.414244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:32.414872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:32.422482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:32.422987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:32.423448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:32.424188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:32.424669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:32.425117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:32.560015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:32.567729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81744dc3-5bf4-4855-b50c-71ca247b0421 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.157634 Oct 19 07:32:32.568341 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3073/6292] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:32 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:33.592230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:33.592843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:33.599791 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:33.600308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:33.600749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:33.601439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:33.601928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:33.602324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:33.734072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:33.741858 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b5b8071-4054-42a4-98f3-1470b629b038 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1532 microversion: 2.1 time: 0.154092 Oct 19 07:32:33.742442 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3220/6293] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:33 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1532 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:32:34.765449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:34.774397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:34.774397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:34.774397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:34.774397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:34.774742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:34.775379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:34.775849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:34.776398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:34.908466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:34.916093 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7460f38b-e5a5-4319-bfc3-4bfd483c4ffb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.155001 Oct 19 07:32:34.917540 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3074/6294] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:34 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:35.941201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:35.942398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:35.946898 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:32:35.956683 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:32:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 (ip 10.222.0.39) !!! Oct 19 07:32:35.956683 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:35.957176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:35.957684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:35.958144 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:35.958870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:35.959332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:35.959764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:36.113837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:36.122702 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3d5a1b2-8d5f-41f1-a04b-4afe6bb9a304 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.185314 Oct 19 07:32:36.123424 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3221/6295] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:35 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:37.146862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:37.148360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:37.156979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:37.157489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:37.158080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:37.158812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:37.159278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:37.159717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:37.343060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d152da23-b2ca-4de5-a63b-d04d4e056b64 req-7e82ddb3-e756-489b-86c2-0d6847999834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f57cde-270a-4d24-95f6-012fae9901a0", "name": "network-vif-plugged", "status": "completed", "tag": "648e01af-202b-4711-b821-4d75e1316cad"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:37.363305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:37.370850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d152da23-b2ca-4de5-a63b-d04d4e056b64 req-7e82ddb3-e756-489b-86c2-0d6847999834 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:37.371326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d152da23-b2ca-4de5-a63b-d04d4e056b64 req-7e82ddb3-e756-489b-86c2-0d6847999834 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:37.372692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d152da23-b2ca-4de5-a63b-d04d4e056b64 req-7e82ddb3-e756-489b-86c2-0d6847999834 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:37.377830 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7f70ef2-df31-490e-b9ec-f7b121188b40 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.230393 Oct 19 07:32:37.386381 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3075/6296] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:37 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:37.402460 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d152da23-b2ca-4de5-a63b-d04d4e056b64 req-7e82ddb3-e756-489b-86c2-0d6847999834 service nova] Creating event network-vif-plugged:648e01af-202b-4711-b821-4d75e1316cad for instance 72f57cde-270a-4d24-95f6-012fae9901a0 on n-h1-861333-10 Oct 19 07:32:37.408510 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d152da23-b2ca-4de5-a63b-d04d4e056b64 req-7e82ddb3-e756-489b-86c2-0d6847999834 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074963 Oct 19 07:32:37.409152 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3222/6297] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:32:38.398249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:38.399000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:38.407476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:38.412036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:38.412712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:38.413703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:38.414387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:38.414941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:38.574199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:38.583621 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f92c9f67-2256-4082-8a9c-f2fa3144ba3b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.189665 Oct 19 07:32:38.584224 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3076/6298] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:38 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:39.607751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:39.609245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:39.621034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:39.621643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:39.622155 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:39.622940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:39.623469 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:39.623968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:39.788213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:39.796716 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a8ba41a-c6d0-4811-9fbb-436055be0f38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.193851 Oct 19 07:32:39.797292 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3223/6299] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:39 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:40.826215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:40.826892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:40.834109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:40.834610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:40.835060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:40.835761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:40.836258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:40.836702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:40.966785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:40.974478 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65d3b874-e08a-49aa-9713-e122852cfea0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.152315 Oct 19 07:32:40.975049 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3077/6300] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:40 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:41.999532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:42.000158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:42.008004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:42.008638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:42.009109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:42.010434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:42.011342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:42.011789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:42.167783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:42.181467 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27c54b9b-00a1-4227-bd0d-bf0267071d7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.186070 Oct 19 07:32:42.182309 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3224/6301] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:41 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:43.216307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:43.216307 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:43.224819 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:43.227245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:43.227245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:43.227245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:43.227245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:43.227585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:43.419741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:43.428592 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-569c60a9-6355-4958-a618-2bc54fcc241d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.223165 Oct 19 07:32:43.432375 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3078/6302] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:43 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:44.453533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:44.454417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:44.465221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:44.466055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:44.466747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:44.467636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:44.468380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:44.468894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:44.606941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:44.615077 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-481166fe-6e3e-4c87-90df-5fb9fbd87e78 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.165762 Oct 19 07:32:44.623986 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3225/6303] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:44 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:45.638507 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:45.639137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:45.646586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:45.647084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:45.647535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:45.648285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:45.648754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:45.649189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:45.789410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:45.792915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:45.797584 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad0d38d9-1b97-4047-9a19-8e429a3b3c25 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1527 microversion: 2.1 time: 0.163002 Oct 19 07:32:45.798170 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3079/6304] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:45 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1527 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:46.821486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:46.822726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:46.829699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:46.830188 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:46.830635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:46.831357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:46.831823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:46.832290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:46.960415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:46.969010 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70400829-c0a8-456e-9efa-9261fb66c404 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1509 microversion: 2.1 time: 0.151460 Oct 19 07:32:46.979358 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3226/6305] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:46 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:48.002113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:48.002764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:48.010787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:48.012046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:48.012610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:48.013375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:48.013858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:48.014567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:48.149465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:48.157202 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ada40115-da7b-42af-84fc-6b438575a221 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1509 microversion: 2.1 time: 0.159502 Oct 19 07:32:48.157771 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3080/6306] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:47 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:49.179974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:49.180620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:49.187743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:49.188266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:49.188708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:49.189403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:49.189856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:49.190288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:49.332851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:49.340886 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b052e50b-760c-44d5-b2ab-6315071b04f8 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1452 microversion: 2.1 time: 0.164799 Oct 19 07:32:49.341495 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3227/6307] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:49 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:49.368290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:49.369439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:49.375368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:49.375928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:49.376413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:49.377127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:49.377592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:49.378028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:49.378648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-00dec4cc-6eae-47a1-93e2-8c2b0a6e2390 req-72aa4ee0-71e1-46b4-8312-b8e50dc938b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f57cde-270a-4d24-95f6-012fae9901a0", "name": "network-vif-unplugged", "status": "completed", "tag": "648e01af-202b-4711-b821-4d75e1316cad"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:49.390219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-00dec4cc-6eae-47a1-93e2-8c2b0a6e2390 req-72aa4ee0-71e1-46b4-8312-b8e50dc938b7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:49.390719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-00dec4cc-6eae-47a1-93e2-8c2b0a6e2390 req-72aa4ee0-71e1-46b4-8312-b8e50dc938b7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:49.391199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-00dec4cc-6eae-47a1-93e2-8c2b0a6e2390 req-72aa4ee0-71e1-46b4-8312-b8e50dc938b7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:49.403152 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.server_external_events [req-00dec4cc-6eae-47a1-93e2-8c2b0a6e2390 req-72aa4ee0-71e1-46b4-8312-b8e50dc938b7 service nova] Unable to find a host for instance 72f57cde-270a-4d24-95f6-012fae9901a0. Dropping event network-vif-unplugged {{(pid=127568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 07:32:49.406303 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-00dec4cc-6eae-47a1-93e2-8c2b0a6e2390 req-72aa4ee0-71e1-46b4-8312-b8e50dc938b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.099336 Oct 19 07:32:49.406303 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3081/6308] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 101 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 19 07:32:49.508962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:49.517652 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d60bfd0-1b0e-4692-93a6-21f6de9c5955 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1452 microversion: 2.1 time: 0.154614 Oct 19 07:32:49.518234 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3228/6309] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:49 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:32:49.566412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:49.566972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:49.573429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:49.573933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:49.574386 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:49.575090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:49.575564 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:49.576008 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:49.598312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lazy-loading 'flavor' on Instance uuid 72f57cde-270a-4d24-95f6-012fae9901a0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:32:49.609615 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Cannot 'shelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state shelved_offloaded Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action HTTP/1.1 Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 14 Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: {"shelve": {}} Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: exception: Cannot 'shelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state shelved_offloaded Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0', 'body': {'shelve': {}}} Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:32:49.611534 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state shelved_offloaded Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state shelved_offloaded Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 409 to user: Cannot 'shelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state shelved_offloaded {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b38ed2d5-df3f-4294-a10a-180a3c3075a2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 409 len: 155 microversion: 2.1 time: 0.050597 Oct 19 07:32:49.616079 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3082/6310] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:49 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 155 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:32:49.622374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:32:49.623009 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:49.629048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:49.629547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:49.629997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:49.630696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:49.631163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:49.631596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:49.722387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 07:32:49.985708 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5bb5d87-93ae-42dc-bfc7-872524c4fcc4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 202 len: 0 microversion: 2.1 time: 0.367701 Oct 19 07:32:49.986253 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3229/6311] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:32:49 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:32:49.994488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:49.995783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:50.001753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:50.002264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:50.002717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:50.003425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:50.003900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:50.004374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:50.137120 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:50.145531 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75138098-3d58-48ae-91d3-f38f39b17540 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1460 microversion: 2.1 time: 0.155053 Oct 19 07:32:50.146104 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3083/6312] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:49 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1460 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:51.169588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:51.170206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:51.176340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:51.176832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:51.177275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:51.177972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:51.178434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:51.178871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:51.314588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:51.316965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:32:51.323183 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-386bbd5d-fb23-4601-b797-5eeaa2613f34 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1460 microversion: 2.1 time: 0.159041 Oct 19 07:32:51.323844 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3230/6313] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:51 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:52.346634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:52.347251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:52.354434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:52.354919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:52.355370 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:52.356078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:52.356578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:52.357020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:52.488440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:52.497065 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6eefcbfa-b3c3-4af0-9e9e-53739524bb2e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.154449 Oct 19 07:32:52.497647 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3084/6314] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:52 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:53.522336 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:53.523844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:53.534187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:53.538590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:53.538590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:53.538590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:53.538590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:53.538590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:53.694449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:53.704466 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6f5deaf-2230-4633-abb8-93626118f918 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.186229 Oct 19 07:32:53.705470 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3231/6315] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:53 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:54.728563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:54.729313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:54.737479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:54.738452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:54.739298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:54.740782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:54.741577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:54.742533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:54.884787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:54.893503 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7151f33-ebee-4ef9-b208-aed349b7af2a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.169191 Oct 19 07:32:54.900724 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3085/6316] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:54 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:55.918540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:55.919752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:55.927239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:55.927769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:55.928247 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:55.928973 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:55.929487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:55.929923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:56.071053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:56.079972 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7648766f-383b-4d04-a99c-aef9684af305 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.165432 Oct 19 07:32:56.080621 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3232/6317] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:55 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:57.103674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:57.105175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:57.111982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:57.112521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:57.112975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:57.113688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:57.114160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:57.114604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:57.277101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:57.285076 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5716dd1-125e-4f12-bf86-3d4f69137c48 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.185551 Oct 19 07:32:57.292298 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3086/6318] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:57 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:58.309203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:58.309814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:58.317067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:58.317749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:58.318200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:58.318923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:58.319386 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:58.319822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:58.471722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:58.480923 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2106012-dd30-443b-9ebd-071532f321c6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.175683 Oct 19 07:32:58.497555 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3233/6319] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:58 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:32:59.505667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:32:59.506236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:32:59.514663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:59.515262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:59.515788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:59.516622 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:32:59.517186 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:32:59.517756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:32:59.676935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:32:59.687520 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d46b35b0-a538-4480-a6ad-c2968efcd9e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.185541 Oct 19 07:32:59.688449 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3087/6320] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:32:59 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:33:00.711212 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:00.711831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:00.718672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:00.719157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:00.719597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:00.720318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:00.720779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:00.721214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:00.857200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:00.864901 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05494873-c58d-4e49-b3fa-fe0623182506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.157765 Oct 19 07:33:00.865475 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3234/6321] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:00 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:01.891631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:01.892624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:01.901626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:01.902223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:01.902712 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:01.903467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:01.904013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:01.904572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:02.110960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:02.110960 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab8e62a6-5bcc-49a2-b381-cc803861bddc tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.185478 Oct 19 07:33:02.110960 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3088/6322] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:01 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:33:03.098612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:03.099139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:03.105976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:03.106453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:03.106887 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:03.107572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:03.108027 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:03.108481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:03.242536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:03.251086 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a49930ed-4d0b-4873-a7c4-7ccd31ce1626 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.156458 Oct 19 07:33:03.251886 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3235/6323] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:03 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:04.274869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:04.277316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:04.293018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:04.293527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:04.293989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:04.294747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:04.295228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:04.295675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:04.424812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:04.432640 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7189bd5a-68ac-4d0a-ad2a-c2fe560ca52f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.161746 Oct 19 07:33:04.433590 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3089/6324] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:04 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:05.405574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e22f8fc6-f725-42c0-858e-369f01a7ef49 req-76e4599d-e1a0-45db-91ef-c540e55ae789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f57cde-270a-4d24-95f6-012fae9901a0", "name": "network-vif-plugged", "status": "completed", "tag": "648e01af-202b-4711-b821-4d75e1316cad"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:05.417551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e22f8fc6-f725-42c0-858e-369f01a7ef49 req-76e4599d-e1a0-45db-91ef-c540e55ae789 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:05.418120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e22f8fc6-f725-42c0-858e-369f01a7ef49 req-76e4599d-e1a0-45db-91ef-c540e55ae789 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:05.418646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e22f8fc6-f725-42c0-858e-369f01a7ef49 req-76e4599d-e1a0-45db-91ef-c540e55ae789 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:05.429947 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e22f8fc6-f725-42c0-858e-369f01a7ef49 req-76e4599d-e1a0-45db-91ef-c540e55ae789 service nova] Creating event network-vif-plugged:648e01af-202b-4711-b821-4d75e1316cad for instance 72f57cde-270a-4d24-95f6-012fae9901a0 on n-h1-861333-10 Oct 19 07:33:05.435834 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e22f8fc6-f725-42c0-858e-369f01a7ef49 req-76e4599d-e1a0-45db-91ef-c540e55ae789 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034331 Oct 19 07:33:05.436524 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3236/6325] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:33:05.454789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:05.455420 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:05.458199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=32 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:05.463425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:05.463955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:05.464438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:05.465210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:05.466268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:05.466731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:05.613662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:05.622445 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6cb1765a-0d73-44dd-bcf5-299a3188ffe5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.171561 Oct 19 07:33:05.623047 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3090/6326] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:05 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:06.647324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:06.648046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:06.650092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:06.655050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:06.655543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:06.655991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:06.656776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:06.657439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:06.657774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:06.786689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:06.794506 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa816ff2-a49d-42e1-9263-65902ba88372 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.152521 Oct 19 07:33:06.795125 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3237/6327] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:06 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:07.818191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:07.818879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:07.826559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:07.833383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:07.833383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:07.833383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:07.833383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:07.833383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:07.965184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:07.971660 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca14b3de-2ba7-4138-b960-cf1cac7b161d tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1518 microversion: 2.1 time: 0.157415 Oct 19 07:33:07.972269 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3091/6328] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:07 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:08.995200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:08.995798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:09.002829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.003314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.003752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.004477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.004961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.005394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.132752 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:09.141400 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee1e1cfb-85e8-4cf2-a0e5-42926ae01e1f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.150748 Oct 19 07:33:09.141975 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3238/6329] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:08 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:09.163557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:09.164242 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:09.171521 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.172028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.172530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.173245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.173725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.174173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.305110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:09.313083 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31de2fd5-c46d-4847-8a52-c3a38cd2c130 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.153413 Oct 19 07:33:09.313670 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3092/6330] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:09 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:09.344045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:09.344699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:09.350707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.351264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.351716 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.352451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.352950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.353404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.485896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:09.493647 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b70269c-0f0c-4004-b34e-4566157e6f19 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.153553 Oct 19 07:33:09.494218 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3239/6331] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:09 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:09.516325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d55eb63-333e-4c30-94f0-90eebd13ff38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:09.521960 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1d55eb63-333e-4c30-94f0-90eebd13ff38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd has no mapping to a cell. Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d55eb63-333e-4c30-94f0-90eebd13ff38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd/action HTTP/1.1 Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 15 Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: {"os-stop": {}} Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd has no mapping to a cell. Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd', 'body': {'os-stop': {}}} Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd has no mapping to a cell. Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:33:09.524734 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd has no mapping to a cell. Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd has no mapping to a cell. Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d55eb63-333e-4c30-94f0-90eebd13ff38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd has no mapping to a cell. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d55eb63-333e-4c30-94f0-90eebd13ff38 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd/action" status: 404 len: 117 microversion: 2.1 time: 0.014647 Oct 19 07:33:09.530606 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3093/6332] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:33:09 2022] POST /compute/v2.1/servers/5ad2c7e5-ec8c-41e3-b64d-289ace2ef9cd/action => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:33:09.535028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:09.535687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:09.541619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.542108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.542557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.543258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.543723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.544184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.670067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:09.677887 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d381719-8fcd-4a89-935c-79997024782a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.146734 Oct 19 07:33:09.678466 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3240/6333] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:09 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:09.701514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:09.702167 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:09.708857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.709351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.709800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.710494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.710967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.711404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.840740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:09.848399 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7bdff29-c684-4baf-9159-6d1c88f074e2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151349 Oct 19 07:33:09.848971 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3094/6334] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:09 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:09.871485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37a634c0-3bf8-4814-9907-9cc864d6e2cb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:09.872022 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37a634c0-3bf8-4814-9907-9cc864d6e2cb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 158d1cd0-03b2-4b84-bd0a-7b1c57645a72] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:09.877524 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-37a634c0-3bf8-4814-9907-9cc864d6e2cb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 158d1cd0-03b2-4b84-bd0a-7b1c57645a72 could not be found. Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37a634c0-3bf8-4814-9907-9cc864d6e2cb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/158d1cd0-03b2-4b84-bd0a-7b1c57645a72/action HTTP/1.1 Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 15 Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: {"suspend": {}} Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 158d1cd0-03b2-4b84-bd0a-7b1c57645a72 could not be found. Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '158d1cd0-03b2-4b84-bd0a-7b1c57645a72', 'body': {'suspend': {}}} Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158d1cd0-03b2-4b84-bd0a-7b1c57645a72 could not be found. Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158d1cd0-03b2-4b84-bd0a-7b1c57645a72 could not be found. Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:09.879153 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:09.884238 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:09.884238 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:09.884238 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158d1cd0-03b2-4b84-bd0a-7b1c57645a72 could not be found. Oct 19 07:33:09.884238 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:09.884238 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37a634c0-3bf8-4814-9907-9cc864d6e2cb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 158d1cd0-03b2-4b84-bd0a-7b1c57645a72 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:09.884238 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37a634c0-3bf8-4814-9907-9cc864d6e2cb tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/158d1cd0-03b2-4b84-bd0a-7b1c57645a72/action" status: 404 len: 111 microversion: 2.1 time: 0.013608 Oct 19 07:33:09.884238 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3241/6335] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:33:09 2022] POST /compute/v2.1/servers/158d1cd0-03b2-4b84-bd0a-7b1c57645a72/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:33:09.890428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:09.891052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:09.896950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.897447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.897897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:09.898599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:09.899095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:09.899538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:10.028032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:10.035927 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb57d9d3-5073-43f0-8e14-e7514ab60e01 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.149750 Oct 19 07:33:10.038374 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3095/6336] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:09 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:33:10.059874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:10.060472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:10.068455 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:10.068979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:10.069457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:10.070162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:10.070627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:10.071068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:10.202766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:10.211482 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2e0be87-6981-490c-966f-9214261f5ae5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.156130 Oct 19 07:33:10.212425 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3242/6337] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:10 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:10.236234 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:10.236828 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:10.245489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:10.245995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:10.246457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:10.247212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:10.247691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:10.248263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:10.271807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lazy-loading 'flavor' on Instance uuid 72f57cde-270a-4d24-95f6-012fae9901a0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:33:10.403975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:10.589794 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-513ba441-c7f9-4a5b-b14f-855013a88a86 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 202 len: 0 microversion: 2.1 time: 0.358695 Oct 19 07:33:10.590537 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3096/6338] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:33:10 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:33:10.598847 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:10.599472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:10.606216 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:10.606713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:10.607159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:10.607863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:10.608360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:10.608793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:10.741075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:10.748931 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad9c7298-70fb-44f7-ba8f-4838d2680e4e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1513 microversion: 2.1 time: 0.154141 Oct 19 07:33:10.749505 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3243/6339] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:10 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:11.773847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:11.774557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:11.780950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:11.781454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:11.781912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:11.782625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:11.783104 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:11.783553 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:11.917696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:11.925426 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd2dcfb0-226a-4f54-b1b7-9431a51c2f03 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1496 microversion: 2.1 time: 0.156794 Oct 19 07:33:11.926006 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3097/6340] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:11 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:11.948231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:11.948810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:11.955601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:11.956093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:11.956572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:11.957303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:11.957768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:11.958204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:11.981944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lazy-loading 'flavor' on Instance uuid 72f57cde-270a-4d24-95f6-012fae9901a0 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:33:11.993601 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Cannot 'suspend' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state suspended Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action HTTP/1.1 Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 15 Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: {"suspend": {}} Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: exception: Cannot 'suspend' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state suspended Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0', 'body': {'suspend': {}}} Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 19 07:33:11.995243 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state suspended Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state suspended Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 409 to user: Cannot 'suspend' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state suspended {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12253fb3-db10-4830-b2db-be04de0f3323 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 409 len: 148 microversion: 2.1 time: 0.053079 Oct 19 07:33:12.002259 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3244/6341] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:33:11 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 148 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:33:12.006286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b135842e-2ae5-4cc4-b0d1-8e6952965077 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:12.006848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b135842e-2ae5-4cc4-b0d1-8e6952965077 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:12.012993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b135842e-2ae5-4cc4-b0d1-8e6952965077 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:12.013815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b135842e-2ae5-4cc4-b0d1-8e6952965077 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:12.014276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b135842e-2ae5-4cc4-b0d1-8e6952965077 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:12.014987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b135842e-2ae5-4cc4-b0d1-8e6952965077 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:12.015469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b135842e-2ae5-4cc4-b0d1-8e6952965077 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:12.015917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b135842e-2ae5-4cc4-b0d1-8e6952965077 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:12.225699 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b135842e-2ae5-4cc4-b0d1-8e6952965077 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 202 len: 0 microversion: 2.1 time: 0.223224 Oct 19 07:33:12.229434 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3098/6342] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:33:12 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:33:12.235133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:12.235760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:12.242222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:12.242413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:12.242855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:12.243561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:12.244025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:12.244488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:12.386583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:12.394738 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e2c84ea-6e41-415f-b5e4-99d711dc591a tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1502 microversion: 2.1 time: 0.163554 Oct 19 07:33:12.395312 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3245/6343] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:12 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:13.419308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:13.419946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:13.427009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:13.427502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:13.427950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:13.428678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:13.429144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:13.429581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:13.564078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:13.573271 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31751bc8-3eb2-40ff-8f6b-8779e2019edf tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1502 microversion: 2.1 time: 0.158879 Oct 19 07:33:13.573960 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3099/6344] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:13 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:14.597930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:14.598542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:14.605408 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:14.605891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:14.606337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:14.607024 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:14.607483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:14.607908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:14.737731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:14.745982 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c54f833-026c-465b-930a-d4fdebb1406f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151354 Oct 19 07:33:14.746558 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3246/6345] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:14 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:14.770279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:14.770917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:14.777793 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:14.778296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:14.778751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:14.779465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:14.779942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:14.780417 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:14.906543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:14.914362 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a20ef2a-6d37-4e77-99e3-19240fbfd921 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.147987 Oct 19 07:33:14.914943 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3100/6346] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:14 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:14.937395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f07a7aba-813a-4f55-823b-cc024ae2f3e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:14.937934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f07a7aba-813a-4f55-823b-cc024ae2f3e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: db4f8e92-ee83-4028-bd5e-541287a59dc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:14.943466 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f07a7aba-813a-4f55-823b-cc024ae2f3e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance db4f8e92-ee83-4028-bd5e-541287a59dc4 could not be found. Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f07a7aba-813a-4f55-823b-cc024ae2f3e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/db4f8e92-ee83-4028-bd5e-541287a59dc4/action HTTP/1.1 Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 15 Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: {"unpause": {}} Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance db4f8e92-ee83-4028-bd5e-541287a59dc4 could not be found. Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'db4f8e92-ee83-4028-bd5e-541287a59dc4', 'body': {'unpause': {}}} Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db4f8e92-ee83-4028-bd5e-541287a59dc4 could not be found. Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db4f8e92-ee83-4028-bd5e-541287a59dc4 could not be found. Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:14.944988 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:14.949669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:14.949669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:14.949669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db4f8e92-ee83-4028-bd5e-541287a59dc4 could not be found. Oct 19 07:33:14.949669 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:14.949669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f07a7aba-813a-4f55-823b-cc024ae2f3e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance db4f8e92-ee83-4028-bd5e-541287a59dc4 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:14.949669 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f07a7aba-813a-4f55-823b-cc024ae2f3e5 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/db4f8e92-ee83-4028-bd5e-541287a59dc4/action" status: 404 len: 111 microversion: 2.1 time: 0.013584 Oct 19 07:33:14.949669 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3247/6347] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:33:14 2022] POST /compute/v2.1/servers/db4f8e92-ee83-4028-bd5e-541287a59dc4/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:33:14.954608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:14.955233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:14.961062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:14.961556 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:14.962004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:14.962703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:14.963169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:14.963607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.094050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:15.101715 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4232662-0d09-4e08-9ce6-8ed4825390e3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.150819 Oct 19 07:33:15.102279 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3101/6348] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:14 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:15.125451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:15.126069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:15.132691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.133181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.133623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.134317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.134777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.135208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.270669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:15.279430 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c62beac-2faa-414a-bc30-315d0b93a066 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.157707 Oct 19 07:33:15.280021 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3248/6349] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:15 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:15.302694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:15.303364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:15.309439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.309947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.310403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.311119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.311590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.312032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.335967 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Cannot 'unpause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action HTTP/1.1 Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 15 Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: {"unpause": {}} Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: exception: Cannot 'unpause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0', 'body': {'unpause': {}}} Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 in vm_state active. Cannot unpause while the instance is in this state. Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:15.337932 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:15.342966 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:15.342966 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:15.342966 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:15.342966 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:33:15.342966 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.342966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 409 to user: Cannot 'unpause' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:15.342966 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69111e7c-cf80-49fc-9f79-e60214067713 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 409 len: 145 microversion: 2.1 time: 0.041300 Oct 19 07:33:15.342966 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3102/6350] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:33:15 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 145 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:33:15.348579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:15.349202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:15.355795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.356322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.356776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.357477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.357937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.358369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.488755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:15.496494 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01c93b2a-0ed9-4a89-8710-9a1fbba983e0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151791 Oct 19 07:33:15.497065 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3249/6351] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:15 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:15.520201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:15.520977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:15.527672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.528197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.528650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.529358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.529826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.530265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.657967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:15.665771 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a65b8f92-39d4-4c40-9e6f-13e9762772a3 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.149573 Oct 19 07:33:15.668719 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3103/6352] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:15 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:15.688639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf29f07e-cd2e-41aa-b609-a6a4c8c59d8e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:15.689196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf29f07e-cd2e-41aa-b609-a6a4c8c59d8e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3795c747-94bd-42e4-ab33-15dff25bdc87] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:15.695917 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cf29f07e-cd2e-41aa-b609-a6a4c8c59d8e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 3795c747-94bd-42e4-ab33-15dff25bdc87 could not be found. Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf29f07e-cd2e-41aa-b609-a6a4c8c59d8e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/3795c747-94bd-42e4-ab33-15dff25bdc87/action HTTP/1.1 Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 18 Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: {"unshelve": null} Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3795c747-94bd-42e4-ab33-15dff25bdc87 could not be found. Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3795c747-94bd-42e4-ab33-15dff25bdc87', 'body': {'unshelve': None}} Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3795c747-94bd-42e4-ab33-15dff25bdc87 could not be found. Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3795c747-94bd-42e4-ab33-15dff25bdc87 could not be found. Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.697684 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3795c747-94bd-42e4-ab33-15dff25bdc87 could not be found. Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf29f07e-cd2e-41aa-b609-a6a4c8c59d8e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 3795c747-94bd-42e4-ab33-15dff25bdc87 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf29f07e-cd2e-41aa-b609-a6a4c8c59d8e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/3795c747-94bd-42e4-ab33-15dff25bdc87/action" status: 404 len: 111 microversion: 2.1 time: 0.015157 Oct 19 07:33:15.703056 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3250/6353] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:33:15 2022] POST /compute/v2.1/servers/3795c747-94bd-42e4-ab33-15dff25bdc87/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:33:15.708891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:15.709520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:15.716087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.716616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.717069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.717778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.718252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.718697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.851432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:15.859317 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff719b03-7cb6-4e89-951c-c2fe4e2c0e80 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.154220 Oct 19 07:33:15.859917 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3104/6354] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:15 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:15.888458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:15.889071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:15.896310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.896799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.897286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.897991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:15.898451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:15.898884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:15.903549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:16.026713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:16.034772 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d81b4376-52c0-44b0-8ec3-06b8b8fb0db6 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.150963 Oct 19 07:33:16.035353 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3251/6355] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:15 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:16.056691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:16.057399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:16.063784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.064409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.064863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.065574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.066053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.066498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.152335 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Cannot 'unshelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action HTTP/1.1 Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 18 Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: {"unshelve": null} Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: exception: Cannot 'unshelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0', 'body': {'unshelve': None}} Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 in vm_state active. Cannot unshelve while the instance is in this state. Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 07:33:16.153969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 409 to user: Cannot 'unshelve' instance 72f57cde-270a-4d24-95f6-012fae9901a0 while it is in vm_state active {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54b25a3f-d2eb-49f8-aab5-aa6a8d870cef tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action" status: 409 len: 146 microversion: 2.1 time: 0.102674 Oct 19 07:33:16.159059 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3105/6356] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:33:16 2022] POST /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0/action => generated 146 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 07:33:16.163955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:16.164607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:16.170774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.171256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.171692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.172417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.172873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.173301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.303422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:16.311947 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0bdfdd04-601a-4546-8e87-285cf693c2b7 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151728 Oct 19 07:33:16.312534 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3252/6357] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:16 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:16.334751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:16.335400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:16.341772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.342260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.342713 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.343414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.343876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.344371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.473457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:16.481711 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8edcb331-259e-4bdd-8923-e9ccf900362e tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.150901 Oct 19 07:33:16.482270 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3106/6358] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:16 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:16.504378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7c986ce-450c-4e08-8302-18713777abbe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-971247112_updated"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:16.506842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7c986ce-450c-4e08-8302-18713777abbe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 97f801c6-bb4a-41e3-ab80-2a3105b91ac2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:16.512469 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d7c986ce-450c-4e08-8302-18713777abbe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 97f801c6-bb4a-41e3-ab80-2a3105b91ac2 could not be found. Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7c986ce-450c-4e08-8302-18713777abbe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/servers/97f801c6-bb4a-41e3-ab80-2a3105b91ac2 HTTP/1.1 Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 80 Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-971247112_updated"}} Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 97f801c6-bb4a-41e3-ab80-2a3105b91ac2 could not be found. Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '97f801c6-bb4a-41e3-ab80-2a3105b91ac2', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-971247112_updated'}}} Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f801c6-bb4a-41e3-ab80-2a3105b91ac2 could not be found. Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 19 07:33:16.514322 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f801c6-bb4a-41e3-ab80-2a3105b91ac2 could not be found. Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f801c6-bb4a-41e3-ab80-2a3105b91ac2 could not be found. Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7c986ce-450c-4e08-8302-18713777abbe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 97f801c6-bb4a-41e3-ab80-2a3105b91ac2 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7c986ce-450c-4e08-8302-18713777abbe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "PUT /compute/v2.1/servers/97f801c6-bb4a-41e3-ab80-2a3105b91ac2" status: 404 len: 111 microversion: 2.1 time: 0.015300 Oct 19 07:33:16.518749 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3253/6359] 10.222.0.39 () {60 vars in 1256 bytes} [Wed Oct 19 07:33:16 2022] PUT /compute/v2.1/servers/97f801c6-bb4a-41e3-ab80-2a3105b91ac2 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:33:16.524847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:16.525473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:16.531736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.532273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.532725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.533425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.533890 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.534330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.664688 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:16.672944 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-660e3635-a4b3-448f-b5fb-2e533ec961e4 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.151990 Oct 19 07:33:16.673506 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3107/6360] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:16 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:16.695254 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:16.695867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:16.706021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.706631 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.707076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.707767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.708258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.708694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.838014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:16.846428 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cc636dd-6b2f-48fc-a44c-91416cebd927 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.154951 Oct 19 07:33:16.847006 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3254/6361] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:16 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:16.869147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbfd390e-7faa-4fc6-88ba-1c7bc96585c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbfd390e-7faa-4fc6-88ba-1c7bc96585c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: request: PUT /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 HTTP/1.1 Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 280 Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.872997 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbfd390e-7faa-4fc6-88ba-1c7bc96585c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bbfd390e-7faa-4fc6-88ba-1c7bc96585c0 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "PUT /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 400 len: 619 microversion: 2.1 time: 0.009472 Oct 19 07:33:16.876833 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3108/6362] 10.222.0.39 () {60 vars in 1257 bytes} [Wed Oct 19 07:33:16 2022] PUT /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:33:16.883012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:16.883713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:16.890020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.890512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.890957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:16.891657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:16.892141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:16.892580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:17.342934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:17.350914 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb253a9e-fedf-4cab-b34f-d40129424506 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.471753 Oct 19 07:33:17.351441 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3255/6363] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:16 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:17.375350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:17.375981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:17.385397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:17.386419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:17.386880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:17.387605 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:17.388354 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:17.388800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:17.518405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:17.526358 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb8d92ca-0c6f-4d73-a82d-e5451be11574 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.155926 Oct 19 07:33:17.526933 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3109/6364] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:17 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:17.548325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd06dcd4-8448-4cdd-8cc0-57e70a47f4c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd06dcd4-8448-4cdd-8cc0-57e70a47f4c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: request: PUT /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 HTTP/1.1 Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 24 Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: {"server": {"name": ""}} Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0', 'body': {'server': {'name': ''}}} Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '' Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 07:33:17.551870 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd06dcd4-8448-4cdd-8cc0-57e70a47f4c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd06dcd4-8448-4cdd-8cc0-57e70a47f4c2 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "PUT /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 400 len: 108 microversion: 2.1 time: 0.009123 Oct 19 07:33:17.557224 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3256/6365] 10.222.0.39 () {60 vars in 1256 bytes} [Wed Oct 19 07:33:17 2022] PUT /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:33:17.562282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:17.562911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:17.568926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:17.569429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:17.569877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:17.570585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:17.571050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:17.571488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:17.703892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:17.711601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7239e76d-38d7-4548-9850-132c08c3c5ea tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1505 microversion: 2.1 time: 0.153113 Oct 19 07:33:17.712192 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3110/6366] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:17 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:33:24.534960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:24.535492 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:24.542842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:24.543332 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:24.543776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:24.544503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:24.544965 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:24.545399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:24.558527 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 HTTP/1.1 Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7'} Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:33:24.560145 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85670e8f-e350-4c3e-85ac-e0c698bac18f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 404 len: 111 microversion: 2.1 time: 0.031759 Oct 19 07:33:24.564148 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3257/6367] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:33:24 2022] DELETE /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:33:24.570225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:24.570858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:24.577947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:24.578450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:24.578906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:24.579616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:24.580089 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:24.580559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:24.594923 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 HTTP/1.1 Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7'} Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:24.596512 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2cae84c0-dd8a-481c-ae47-58b52cfa9d7f tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7" status: 404 len: 111 microversion: 2.1 time: 0.031806 Oct 19 07:33:24.600659 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3111/6368] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:24 2022] GET /compute/v2.1/servers/3e935c19-3f2b-4080-b01f-ec8f2a2f5ea7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:33:24.606735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:24.607242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:24.613422 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:24.613908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:24.614358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:24.615069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:24.615519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:24.615955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:24.642017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:33:24.902610 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78bd6267-f36f-4deb-a066-134d462fcf7b tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "DELETE /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 204 len: 0 microversion: 2.1 time: 0.299366 Oct 19 07:33:24.903228 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3258/6369] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:33:24 2022] DELETE /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:33:24.911271 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:24.911920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:24.918132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:24.918625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:24.919073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:24.919774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:24.920274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:24.920715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:25.048939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:25.056710 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d38133d9-d4ba-4abd-9728-703dec9f34c1 tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.149378 Oct 19 07:33:25.057931 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3112/6370] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:24 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:26.082637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:26.183968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:26.183968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:26.183968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:26.183968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:26.183968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:26.183968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:26.183968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:26.224658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:26.232439 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8cf3a3bc-2a76-48aa-96dd-7b6b16d6f77c tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1511 microversion: 2.1 time: 0.154385 Oct 19 07:33:26.233009 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3259/6371] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:26 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:27.259015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:27.259015 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:27.263897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:27.264585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:27.265049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:27.265777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:27.266419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:27.267026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:27.281796 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3bf2f8a9-9cb4-4fc1-a7e9-2a1f2d3e97ea req-480e074b-f874-4196-8ac5-67d0d73c7732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f57cde-270a-4d24-95f6-012fae9901a0", "name": "network-vif-deleted", "tag": "648e01af-202b-4711-b821-4d75e1316cad"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:27.294148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3bf2f8a9-9cb4-4fc1-a7e9-2a1f2d3e97ea req-480e074b-f874-4196-8ac5-67d0d73c7732 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:27.294663 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3bf2f8a9-9cb4-4fc1-a7e9-2a1f2d3e97ea req-480e074b-f874-4196-8ac5-67d0d73c7732 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:27.295102 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3bf2f8a9-9cb4-4fc1-a7e9-2a1f2d3e97ea req-480e074b-f874-4196-8ac5-67d0d73c7732 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:27.307670 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3bf2f8a9-9cb4-4fc1-a7e9-2a1f2d3e97ea req-480e074b-f874-4196-8ac5-67d0d73c7732 service nova] Creating event network-vif-deleted:648e01af-202b-4711-b821-4d75e1316cad for instance 72f57cde-270a-4d24-95f6-012fae9901a0 on n-h1-861333-10 Oct 19 07:33:27.313016 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3bf2f8a9-9cb4-4fc1-a7e9-2a1f2d3e97ea req-480e074b-f874-4196-8ac5-67d0d73c7732 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115752 Oct 19 07:33:27.314504 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3113/6372] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:33:27.342527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34501b1477c4afa83c688a75e2dd01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f77b2486a1b4678a6e207cc3dda0e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:27.350513 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc4f827b-445e-45e9-831b-727797c3d4fe tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 200 len: 1469 microversion: 2.1 time: 0.099453 Oct 19 07:33:27.351087 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3260/6373] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:27 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 1469 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:28.375968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:28.376726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] [instance: 72f57cde-270a-4d24-95f6-012fae9901a0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:28.383127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:28.383640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:28.384090 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:28.384852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:28.385324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:28.386274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:28.401036 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] HTTP exception thrown: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 could not be found. Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Request method failure captured: Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 HTTP/1.1 Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6fRxzpsBNapARkXMWa_neAyKzHrxGO1_vOJgPoSBIUFNugSxbrVdTK9RQN0vyV4NYRBqk3ZvtVUWY91jIsGNaOnKySl5AgYu85zroA15WFPS-6VRPivTJ8M0i_JKy_-FuYg5FLjyImrbHXX6N4en4zdzDTLEy6eXQHyJuivq4B_NR0 Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8f77b2486a1b4678a6e207cc3dda0e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8f77b2486a1b4678a6e207cc3dda0e5e", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8f77b2486a1b4678a6e207cc3dda0e5e Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1929659205 Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: c34501b1477c4afa83c688a75e2dd01e Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1929659205-project Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 could not be found. Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '72f57cde-270a-4d24-95f6-012fae9901a0'} Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 could not be found. Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 could not be found. Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:28.403865 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 could not be found. Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] Returning 404 to user: Instance 72f57cde-270a-4d24-95f6-012fae9901a0 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ccb008ea-6f5f-45aa-9a04-a313a43ba7df tempest-ServersNegativeTestJSON-1929659205 tempest-ServersNegativeTestJSON-1929659205-project] 10.222.0.39 "GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0" status: 404 len: 111 microversion: 2.1 time: 0.034128 Oct 19 07:33:28.408548 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3114/6374] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:28 2022] GET /compute/v2.1/servers/72f57cde-270a-4d24-95f6-012fae9901a0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:33:34.091121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c043db71-8684-48d8-a66c-3591e795e37f tempest-ExtensionsTest-435287560 tempest-ExtensionsTest-435287560-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:34.092761 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c043db71-8684-48d8-a66c-3591e795e37f tempest-ExtensionsTest-435287560 tempest-ExtensionsTest-435287560-project] 10.222.0.39 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.119388 Oct 19 07:33:34.093360 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3261/6375] 10.222.0.39 () {58 vars in 1170 bytes} [Wed Oct 19 07:33:33 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:33:34.102735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0ea2e2b-38b7-4eca-986c-a69b73322b10 tempest-ExtensionsTest-435287560 tempest-ExtensionsTest-435287560-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:34.104873 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0ea2e2b-38b7-4eca-986c-a69b73322b10 tempest-ExtensionsTest-435287560 tempest-ExtensionsTest-435287560-project] 10.222.0.39 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006197 Oct 19 07:33:34.105395 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3115/6376] 10.222.0.39 () {58 vars in 1134 bytes} [Wed Oct 19 07:33:34 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:33:37.552998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:37.552998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:37.556345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:37.556860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:37.566924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:37.567424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:37.567871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:37.568650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:37.569124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:37.569561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:37.594018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:33:38.015312 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a94e65f-0b81-4f5b-b3c8-bb5e9fcd297f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 204 len: 0 microversion: 2.1 time: 0.465276 Oct 19 07:33:38.022072 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3262/6377] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:33:37 2022] DELETE /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:33:38.030130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:38.030774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:38.032981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=48 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:38.039057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:38.041284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:38.041284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:38.041284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:38.041571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:38.042707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:38.178795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:38.183109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:38.187884 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-98f23694-c079-47e7-844c-2da448ebfe34 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1575 microversion: 2.1 time: 0.163898 Oct 19 07:33:38.188720 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3116/6378] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:38 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:39.211680 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:39.212427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:39.221831 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:39.222342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:39.222795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:39.223526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:39.224230 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:39.224834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:39.379165 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:39.388957 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b0018a0-e37d-4a5d-a744-eef0e95ee97b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1575 microversion: 2.1 time: 0.181475 Oct 19 07:33:39.389560 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3263/6379] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:39 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:40.414986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:40.417755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:40.427798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:40.428797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:40.429472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:40.430414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:40.431099 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:40.431776 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:40.618199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:40.642146 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22b78b69-2afd-4a92-9fe1-7f0e396da36c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1575 microversion: 2.1 time: 0.229979 Oct 19 07:33:40.643983 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3117/6380] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:40 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:41.269800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ac4fcb1e-2c7c-4713-b10b-a75828c84705 req-2b25ccd4-f3ff-49dd-b78f-748e18a85b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c62fd9-b571-436e-a5ba-2eda08e8c2ca", "name": "network-vif-deleted", "tag": "5f50861c-a418-4186-ad83-b17d06d9f032"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:41.296373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ac4fcb1e-2c7c-4713-b10b-a75828c84705 req-2b25ccd4-f3ff-49dd-b78f-748e18a85b4d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:41.297080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ac4fcb1e-2c7c-4713-b10b-a75828c84705 req-2b25ccd4-f3ff-49dd-b78f-748e18a85b4d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:41.301456 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ac4fcb1e-2c7c-4713-b10b-a75828c84705 req-2b25ccd4-f3ff-49dd-b78f-748e18a85b4d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:41.335582 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ac4fcb1e-2c7c-4713-b10b-a75828c84705 req-2b25ccd4-f3ff-49dd-b78f-748e18a85b4d service nova] Creating event network-vif-deleted:5f50861c-a418-4186-ad83-b17d06d9f032 for instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca on n-h2-861333-10 Oct 19 07:33:41.345908 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ac4fcb1e-2c7c-4713-b10b-a75828c84705 req-2b25ccd4-f3ff-49dd-b78f-748e18a85b4d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084410 Oct 19 07:33:41.347475 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3264/6381] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:33:41.667588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:41.668782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:41.679773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:41.680343 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:41.680798 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:41.681526 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:41.682540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:41.690302 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:41.796315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:41.818980 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ad95abb-b4c2-4711-8c64-a636219285c2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1225 microversion: 2.1 time: 0.146822 Oct 19 07:33:41.818980 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3118/6382] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:41 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1225 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:42.546307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-490fcc83-1015-410e-942e-bdf3c75c6789 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'create', calling method: .version_select at 0x7f6d641f6700>, body: {"keypair": {"name": "tempest-keypair-1990500748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFDthBLZMrr5YVOFxTFfT1521XGs63WIQzQEtyGWDXl5zZvSX85Px/JKTROn5Hdn9QrjGYvyj0qgqqyBq3zCglXatD6X32CF7Z1MPa6vg+rArQZuCWFVezj5eYIlJi2WA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:42.563818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-490fcc83-1015-410e-942e-bdf3c75c6789 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Getting quotas for project 35f47d27c9eb471384aedcdbbe129fdf. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:33:42.571677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-490fcc83-1015-410e-942e-bdf3c75c6789 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Getting quotas for user fc6091612896435786aa0a2e0175ca50 and project 35f47d27c9eb471384aedcdbbe129fdf. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:33:42.674193 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-490fcc83-1015-410e-942e-bdf3c75c6789 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.280479 Oct 19 07:33:42.675076 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3265/6383] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:33:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:33:42.834949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:42.836316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:42.846867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:42.847753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:42.848609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:42.849643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:42.850316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:42.851068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:42.931916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:42.962080 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0534a7a-09cc-44b7-984f-0110bc089978 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1225 microversion: 2.1 time: 0.131629 Oct 19 07:33:42.992515 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3119/6384] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:42 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1225 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:43.990245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:43.991729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:43.999474 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:43.999974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:44.001302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:44.002038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:44.002503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:44.003097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:44.077734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:44.087260 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63881c0e-f0ef-4b3e-946b-32a132b396bb tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1225 microversion: 2.1 time: 0.101117 Oct 19 07:33:44.089026 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3266/6385] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:43 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:45.118478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:45.119396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:45.128055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:45.128591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:45.129626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:45.130399 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:45.130891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:45.131346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:45.210333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:45.220848 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53ff9a55-da5a-4a2f-a5f9-da2a7638b8a5 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1225 microversion: 2.1 time: 0.105939 Oct 19 07:33:45.221866 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3120/6386] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:45 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:45.240672 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1305406749", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72a9a37b-edb1-43fd-bcab-a05affed03b4"}], "security_groups": [{"name": "tempest-securitygroup--1986104620"}], "key_name": "tempest-keypair-1990500748", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:45.359932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] validate_networks() for [('72a9a37b-edb1-43fd-bcab-a05affed03b4', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:33:45.780123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:33:45.780561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:33:45.781041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:33:45.781461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:33:45.781896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:33:45.791355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:45.792225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:45.792846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:45.793747 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:45.794373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:45.794982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:45.814346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Getting quotas for project 35f47d27c9eb471384aedcdbbe129fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:33:45.820465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Getting quotas for user fc6091612896435786aa0a2e0175ca50 and project 35f47d27c9eb471384aedcdbbe129fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:33:45.835074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:33:45.837607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:33:45.969179 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf18e65e-d51a-41d0-9f4f-f7afa88587e5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.732947 Oct 19 07:33:45.970111 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3267/6387] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:33:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:33:45.981855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c95a8d6-8667-4a3a-a4df-6ae834dca532 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:45.982492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c95a8d6-8667-4a3a-a4df-6ae834dca532 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:46.062768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c95a8d6-8667-4a3a-a4df-6ae834dca532 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:46.074126 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c95a8d6-8667-4a3a-a4df-6ae834dca532 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1238 microversion: 2.1 time: 0.095106 Oct 19 07:33:46.091600 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3121/6388] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:45 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1238 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:46.257046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:46.257823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:46.267044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:46.267548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:46.268012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:46.268818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:46.269291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:46.269731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:46.363819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:46.374807 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65d52901-47a6-4a8f-97a9-48b818627ce7 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 200 len: 1225 microversion: 2.1 time: 0.131343 Oct 19 07:33:46.376174 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3268/6389] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:46 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:47.098643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2604181-ab06-4623-b38f-d993cf0ee0ca tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:47.099274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2604181-ab06-4623-b38f-d993cf0ee0ca tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:47.153845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d2604181-ab06-4623-b38f-d993cf0ee0ca tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:47.161030 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2604181-ab06-4623-b38f-d993cf0ee0ca tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1238 microversion: 2.1 time: 0.066240 Oct 19 07:33:47.161599 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3122/6390] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:47 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:47.399178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:47.399790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:47.407194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:47.407679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:47.408134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:47.408823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:47.409277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:47.409699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:47.424027 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca HTTP/1.1 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '24c62fd9-b571-436e-a5ba-2eda08e8c2ca'} Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:33:47.425859 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a283a51d-955e-4332-b1ca-01708a493030 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 404 len: 111 microversion: 2.1 time: 0.032028 Oct 19 07:33:47.431673 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3269/6391] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:47 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:33:47.522648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1158013212", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1510903324", "security_groups": [{"name": "tempest-secgroup-smoke-110936054"}], "block_device_mapping_v2": [{"uuid": "2000674d-6cb1-4e89-bdf9-32c23f1fed81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cedc1025-55fd-4295-a2cd-69fd264b4466"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:47.651512 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] validate_networks() for [('cedc1025-55fd-4295-a2cd-69fd264b4466', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:33:48.045216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:33:48.045652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:33:48.046138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:33:48.046643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:33:48.047066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:33:48.056055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:48.056578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:48.057723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:48.058459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:48.058926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:48.059379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:48.076214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:33:48.081559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for user 221b692fdbb3495aa63a686796b02ea8 and project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:33:48.140544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:33:48.142687 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2000674d-6cb1-4e89-bdf9-32c23f1fed81',volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:33:48.183744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:48.184390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:48.190373 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:48.197659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:48.197659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:48.197659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:48.197659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:48.197659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:48.267246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:48.277989 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-34d5f95d-4e13-4c4a-8f7a-8992fc4c2ab3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1290 microversion: 2.1 time: 0.097443 Oct 19 07:33:48.292399 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3270/6392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:48 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1290 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:48.560639 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b7458f8-590e-44a7-a395-47230b47de41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.041869 Oct 19 07:33:48.561305 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3123/6393] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:33:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:33:48.573171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-384daede-efa0-42e7-881d-488bfeaac43a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:48.573881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-384daede-efa0-42e7-881d-488bfeaac43a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:48.642681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-384daede-efa0-42e7-881d-488bfeaac43a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:48.649748 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-384daede-efa0-42e7-881d-488bfeaac43a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1095 microversion: 2.1 time: 0.081089 Oct 19 07:33:48.650499 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3271/6394] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:48 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:49.305648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:49.306311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:49.313972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:49.314485 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:49.314946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:49.315682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:49.316190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:49.316641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:49.455939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:49.464898 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e0c1e0c-b25f-41c4-8ad5-a12e4161eda2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1364 microversion: 2.1 time: 0.163345 Oct 19 07:33:49.465493 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3124/6395] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:49 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:33:49.673123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:49.673906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:49.682727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:49.683236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:49.683691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:49.684445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:49.684924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:49.685441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:49.765201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:49.773655 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76bc36f9-487c-48f2-a0c4-8fdccce08a0e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1145 microversion: 2.1 time: 0.104717 Oct 19 07:33:49.774238 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3272/6396] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:49 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:50.489197 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:50.489834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:50.496982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:50.497481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:50.497929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:50.498642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:50.499112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:50.499549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:50.547995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-979746e5-3843-446b-bba9-0be673dbab49 req-22af55ea-87d4-467b-890e-40532daa0237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cee2a4-025b-4d83-8581-a4dc2c081418", "tag": "77dbc1a6-f194-4723-91d5-53abcf6a97b8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:50.558581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-979746e5-3843-446b-bba9-0be673dbab49 req-22af55ea-87d4-467b-890e-40532daa0237 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:50.559062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-979746e5-3843-446b-bba9-0be673dbab49 req-22af55ea-87d4-467b-890e-40532daa0237 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:50.559693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-979746e5-3843-446b-bba9-0be673dbab49 req-22af55ea-87d4-467b-890e-40532daa0237 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:50.574638 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-979746e5-3843-446b-bba9-0be673dbab49 req-22af55ea-87d4-467b-890e-40532daa0237 service nova] Creating event network-changed:77dbc1a6-f194-4723-91d5-53abcf6a97b8 for instance 34cee2a4-025b-4d83-8581-a4dc2c081418 on n-h1-861333-10 Oct 19 07:33:50.582727 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-979746e5-3843-446b-bba9-0be673dbab49 req-22af55ea-87d4-467b-890e-40532daa0237 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041496 Oct 19 07:33:50.584288 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3273/6397] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:33:50.668520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:50.676563 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d998b5a5-c903-4bda-8ebb-3d5084f04432 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1364 microversion: 2.1 time: 0.191365 Oct 19 07:33:50.678098 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3125/6398] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:50 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:50.799062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:50.799886 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:50.807619 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:50.808159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:50.808579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:50.809319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:50.809781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:50.810348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:50.890572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:50.899024 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3730f1b3-9eb8-4d3f-ab8d-d6f1ed2b1b70 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1201 microversion: 2.1 time: 0.104386 Oct 19 07:33:50.899770 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3274/6399] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:50 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:51.703856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:51.705756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:51.715475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:51.716183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:51.716660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:51.717382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:51.717849 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:51.718285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:51.926810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:51.928179 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:51.937276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:51.938107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:51.938707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:51.940457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:51.941438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:51.942048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:52.002016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:52.019319 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0794bb8-5c2f-43e2-af6c-f0d6a67c9811 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1364 microversion: 2.1 time: 0.320332 Oct 19 07:33:52.019938 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3126/6400] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:51 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:52.109478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:52.117933 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87d2e484-70a9-4427-ac61-d7dd82b3bb6e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1278 microversion: 2.1 time: 0.197129 Oct 19 07:33:52.118676 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3275/6401] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:51 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:52.588388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6897fa43-92e0-493a-805a-739846565e02 req-697df0f5-4858-4f7d-a950-d55bc6b39d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c569e8ed-b0d2-45c2-acf2-90e6ade778f2", "tag": "f5ae13a7-1dae-4772-9d50-b07494b02bc8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:52.607005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6897fa43-92e0-493a-805a-739846565e02 req-697df0f5-4858-4f7d-a950-d55bc6b39d3c service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:52.607597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6897fa43-92e0-493a-805a-739846565e02 req-697df0f5-4858-4f7d-a950-d55bc6b39d3c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:52.608287 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6897fa43-92e0-493a-805a-739846565e02 req-697df0f5-4858-4f7d-a950-d55bc6b39d3c service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:52.622169 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6897fa43-92e0-493a-805a-739846565e02 req-697df0f5-4858-4f7d-a950-d55bc6b39d3c service nova] Creating event network-changed:f5ae13a7-1dae-4772-9d50-b07494b02bc8 for instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 on n-h2-861333-10 Oct 19 07:33:52.627362 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6897fa43-92e0-493a-805a-739846565e02 req-697df0f5-4858-4f7d-a950-d55bc6b39d3c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042759 Oct 19 07:33:52.628045 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3127/6402] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:33:53.043532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:53.044796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:53.051721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:53.052253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:53.052715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:53.053433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:53.053901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:53.054378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:53.146750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:53.148048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:53.160372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:53.161981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:53.162445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:53.163342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:53.164256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:53.171550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:53.222573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:53.235385 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-645e6ac7-051d-44b2-b7fb-e4d6bc0567f5 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1364 microversion: 2.1 time: 0.196415 Oct 19 07:33:53.235937 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3276/6403] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:53 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:53.417534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:53.426242 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9e58c34-e84f-4fa5-a6c1-3dd4e733290e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1278 microversion: 2.1 time: 0.285999 Oct 19 07:33:53.427164 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3128/6404] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:53 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1278 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:54.258943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:54.260202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:54.267391 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:54.267882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:54.268369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:54.269070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:54.269531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:54.269964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:54.404503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:54.412436 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-076493ce-5473-495d-8659-fa8b28a947d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1364 microversion: 2.1 time: 0.157543 Oct 19 07:33:54.412932 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3277/6405] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:54 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:54.449867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:54.450535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:54.457077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:54.457574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:54.458030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:54.458740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:54.459209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:54.459653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:54.601405 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:54.609236 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92a95b09-2f52-4f96-a96f-6c3426a7c7a6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1278 microversion: 2.1 time: 0.163424 Oct 19 07:33:54.609815 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3129/6406] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:54 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:55.435486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:55.436585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:55.443148 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:55.443641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:55.444366 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:55.445074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:55.445743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:55.446176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:55.583466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:55.592341 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22c57c04-9a55-4842-ad00-a42c2dee2ee1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1364 microversion: 2.1 time: 0.160853 Oct 19 07:33:55.596180 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3278/6407] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:55 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:55.631282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:55.631941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:55.642949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:55.643876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:55.644202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:55.645103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:55.645780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:55.646228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:55.662200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-df77a440-07f8-4635-ade4-e529f92a49cd req-cd5130c9-8f2b-43cd-9209-3b1056476b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cee2a4-025b-4d83-8581-a4dc2c081418", "name": "network-vif-plugged", "status": "completed", "tag": "77dbc1a6-f194-4723-91d5-53abcf6a97b8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:55.676951 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-df77a440-07f8-4635-ade4-e529f92a49cd req-cd5130c9-8f2b-43cd-9209-3b1056476b19 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:55.677889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-df77a440-07f8-4635-ade4-e529f92a49cd req-cd5130c9-8f2b-43cd-9209-3b1056476b19 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:55.678512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-df77a440-07f8-4635-ade4-e529f92a49cd req-cd5130c9-8f2b-43cd-9209-3b1056476b19 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:55.691551 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-df77a440-07f8-4635-ade4-e529f92a49cd req-cd5130c9-8f2b-43cd-9209-3b1056476b19 service nova] Creating event network-vif-plugged:77dbc1a6-f194-4723-91d5-53abcf6a97b8 for instance 34cee2a4-025b-4d83-8581-a4dc2c081418 on n-h1-861333-10 Oct 19 07:33:55.697063 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-df77a440-07f8-4635-ade4-e529f92a49cd req-cd5130c9-8f2b-43cd-9209-3b1056476b19 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042092 Oct 19 07:33:55.697976 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3279/6408] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:33:55.796602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:55.805430 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b29212f-c591-4142-bab9-7baebfe8ced0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1278 microversion: 2.1 time: 0.178284 Oct 19 07:33:55.806052 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3130/6409] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:55 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:56.612929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:56.617984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:56.618694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:56.624798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:56.625286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:56.625729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:56.626425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:56.626884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:56.627316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:56.761376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:56.769417 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8c9bcd0-9c0d-46ee-9b5c-061a4f0849b2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1364 microversion: 2.1 time: 0.157524 Oct 19 07:33:56.769991 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3280/6410] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:56 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:56.827892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:56.828552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:56.835472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:56.835974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:56.836463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:56.837201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:56.838232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:56.838677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:56.975368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:56.983707 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48c7f683-ca74-4a02-8a4d-dcde88f4f70f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1266 microversion: 2.1 time: 0.159762 Oct 19 07:33:56.984303 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3131/6411] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:56 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:57.793398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:57.794041 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:57.800613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:57.801107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:57.801546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:57.802236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:57.802691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:57.803121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:57.941979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:57.950906 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86cbf507-1e50-4d49-9e62-2b55f4bd65e7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1550 microversion: 2.1 time: 0.161801 Oct 19 07:33:57.951510 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3281/6412] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:57 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:57.973630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d0191ea-9668-4daf-b0a8-61178faeab20 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:57.975045 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d0191ea-9668-4daf-b0a8-61178faeab20 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:57.981470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0191ea-9668-4daf-b0a8-61178faeab20 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:57.981979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0191ea-9668-4daf-b0a8-61178faeab20 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:57.982544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0191ea-9668-4daf-b0a8-61178faeab20 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:57.983407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0191ea-9668-4daf-b0a8-61178faeab20 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:57.983887 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0191ea-9668-4daf-b0a8-61178faeab20 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:57.984377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0191ea-9668-4daf-b0a8-61178faeab20 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:58.012214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:58.012861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:58.018956 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:58.019451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:58.020076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:58.020807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:58.021273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:58.021708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:58.026343 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:58.065550 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d0191ea-9668-4daf-b0a8-61178faeab20 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095313 Oct 19 07:33:58.066115 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3132/6413] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:33:57 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:33:58.162097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:58.169879 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b853146b-d143-4c05-8bd6-f0f3636d9a09 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1266 microversion: 2.1 time: 0.162492 Oct 19 07:33:58.170452 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3282/6414] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:58 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:59.191092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:59.191992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:59.198204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:33:59.203802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:33:59.205741 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:59.206328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:59.207020 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:59.207850 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:59.208614 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:59.209286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:59.457175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:33:59.465424 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b031f5fd-be93-404d-81e9-d83fc3a83e9d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1266 microversion: 2.1 time: 0.275141 Oct 19 07:33:59.466275 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3133/6415] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:33:59 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:33:59.556834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-eb0aae1c-d2b9-446e-998b-8c8ceeb79838 req-4cbfd213-7bc6-4053-943b-514d6c2b46d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cee2a4-025b-4d83-8581-a4dc2c081418", "tag": "77dbc1a6-f194-4723-91d5-53abcf6a97b8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:33:59.565176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:33:59.568152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eb0aae1c-d2b9-446e-998b-8c8ceeb79838 req-4cbfd213-7bc6-4053-943b-514d6c2b46d6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:33:59.568641 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eb0aae1c-d2b9-446e-998b-8c8ceeb79838 req-4cbfd213-7bc6-4053-943b-514d6c2b46d6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:33:59.569079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eb0aae1c-d2b9-446e-998b-8c8ceeb79838 req-4cbfd213-7bc6-4053-943b-514d6c2b46d6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:33:59.584742 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-eb0aae1c-d2b9-446e-998b-8c8ceeb79838 req-4cbfd213-7bc6-4053-943b-514d6c2b46d6 service nova] Creating event network-changed:77dbc1a6-f194-4723-91d5-53abcf6a97b8 for instance 34cee2a4-025b-4d83-8581-a4dc2c081418 on n-h1-861333-10 Oct 19 07:33:59.590170 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-eb0aae1c-d2b9-446e-998b-8c8ceeb79838 req-4cbfd213-7bc6-4053-943b-514d6c2b46d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037510 Oct 19 07:33:59.590792 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3283/6416] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:34:00.488816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:00.489445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:00.497011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:00.499157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:00.499157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:00.499157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:00.499157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:00.499642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:00.634961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:00.643352 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3baed107-be8c-4a0c-a4f0-66eb9b5ffe99 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1266 microversion: 2.1 time: 0.158659 Oct 19 07:34:00.643929 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3134/6417] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:00 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:01.668425 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:01.669115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:01.675361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:01.675842 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:01.676312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:01.677001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:01.677462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:01.677890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:01.809350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:01.817045 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8bc9ec91-7a2f-4720-b0d2-e70e2a419f7a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1266 microversion: 2.1 time: 0.154905 Oct 19 07:34:01.817611 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3284/6418] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:01 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:02.840509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:02.841066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:02.847917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:02.848516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:02.848971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:02.849679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:02.850148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:02.850595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:02.980822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:02.988739 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4590180e-bfdf-4a39-9f74-bd81315b5716 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1266 microversion: 2.1 time: 0.152901 Oct 19 07:34:02.989318 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3135/6419] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:02 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:04.012895 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:04.013517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:04.020403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:04.020900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:04.021376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:04.022220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:04.022689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:04.023126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:04.159454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:04.167900 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9859ec65-c9e2-42b2-b74a-64f4a7dc087a tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1266 microversion: 2.1 time: 0.159842 Oct 19 07:34:04.168504 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3285/6420] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:04 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:05.190752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:05.191376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:05.198870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:05.199369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:05.199818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:05.200543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:05.201027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:05.201461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:05.336852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:05.344475 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d86164dd-00d4-4ff6-a83d-cfd7fbf1616c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1266 microversion: 2.1 time: 0.157898 Oct 19 07:34:05.345037 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3136/6421] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:05 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:06.023855 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-29e3f5b6-1efd-4b03-8293-2299d138fc42 req-ffc91712-510a-4d1d-9910-885ba69c9c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c569e8ed-b0d2-45c2-acf2-90e6ade778f2", "name": "network-vif-plugged", "status": "completed", "tag": "f5ae13a7-1dae-4772-9d50-b07494b02bc8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:34:06.034633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-29e3f5b6-1efd-4b03-8293-2299d138fc42 req-ffc91712-510a-4d1d-9910-885ba69c9c0a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:06.035115 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-29e3f5b6-1efd-4b03-8293-2299d138fc42 req-ffc91712-510a-4d1d-9910-885ba69c9c0a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:06.035558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-29e3f5b6-1efd-4b03-8293-2299d138fc42 req-ffc91712-510a-4d1d-9910-885ba69c9c0a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:06.046477 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-29e3f5b6-1efd-4b03-8293-2299d138fc42 req-ffc91712-510a-4d1d-9910-885ba69c9c0a service nova] Creating event network-vif-plugged:f5ae13a7-1dae-4772-9d50-b07494b02bc8 for instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 on n-h2-861333-10 Oct 19 07:34:06.053368 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-29e3f5b6-1efd-4b03-8293-2299d138fc42 req-ffc91712-510a-4d1d-9910-885ba69c9c0a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031730 Oct 19 07:34:06.053368 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3286/6422] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:34:06.367012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:06.371820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:06.374558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:06.375058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:06.375515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:06.376274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:06.376749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:06.377192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:06.381273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:34:06.513238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:06.521005 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d33538a7-edc0-411e-93e1-09269289ac43 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1266 microversion: 2.1 time: 0.157876 Oct 19 07:34:06.521577 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3137/6423] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:06 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:07.545609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:07.546328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:07.552625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:07.553123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:07.553574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:07.554274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:07.554742 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:07.555197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:07.689955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:07.698392 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72192cf8-a76c-431f-84f9-686f4d09a888 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1452 microversion: 2.1 time: 0.158091 Oct 19 07:34:07.698969 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3287/6424] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:07 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:07.720757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:07.721393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:07.728910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:07.729422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:07.729874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:07.730585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:07.731062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:07.731510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:07.860862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:07.869103 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08ebb430-59e3-4bc6-a3d9-39323d9bb73f tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1452 microversion: 2.1 time: 0.152214 Oct 19 07:34:07.869669 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3138/6425] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:07 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:09.793066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-839ad86f-195f-44b0-b83c-709d0e593446 req-75406dd6-3950-4c68-823a-96326b38e820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c569e8ed-b0d2-45c2-acf2-90e6ade778f2", "tag": "f5ae13a7-1dae-4772-9d50-b07494b02bc8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:34:09.798876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:34:09.804038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-839ad86f-195f-44b0-b83c-709d0e593446 req-75406dd6-3950-4c68-823a-96326b38e820 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:09.804559 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-839ad86f-195f-44b0-b83c-709d0e593446 req-75406dd6-3950-4c68-823a-96326b38e820 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:09.805000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-839ad86f-195f-44b0-b83c-709d0e593446 req-75406dd6-3950-4c68-823a-96326b38e820 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:09.816076 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-839ad86f-195f-44b0-b83c-709d0e593446 req-75406dd6-3950-4c68-823a-96326b38e820 service nova] Creating event network-changed:f5ae13a7-1dae-4772-9d50-b07494b02bc8 for instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 on n-h2-861333-10 Oct 19 07:34:09.821584 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-839ad86f-195f-44b0-b83c-709d0e593446 req-75406dd6-3950-4c68-823a-96326b38e820 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031775 Oct 19 07:34:09.822197 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3288/6426] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:34:35.403809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7dcc9c0f-6a7a-4e66-92fc-521c7a4dd1e3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:35.404434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7dcc9c0f-6a7a-4e66-92fc-521c7a4dd1e3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:35.407220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:34:35.407957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:34:35.412673 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9c0f-6a7a-4e66-92fc-521c7a4dd1e3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:35.418602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9c0f-6a7a-4e66-92fc-521c7a4dd1e3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:35.418602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9c0f-6a7a-4e66-92fc-521c7a4dd1e3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:35.418602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9c0f-6a7a-4e66-92fc-521c7a4dd1e3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:35.418602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9c0f-6a7a-4e66-92fc-521c7a4dd1e3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:35.418602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9c0f-6a7a-4e66-92fc-521c7a4dd1e3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:35.442241 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7dcc9c0f-6a7a-4e66-92fc-521c7a4dd1e3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/ips" status: 200 len: 145 microversion: 2.1 time: 0.042697 Oct 19 07:34:35.442824 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3139/6427] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:34:35 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:34:39.105244 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=28 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:34:39.110039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27787e52-8dd8-4e31-88a1-14b8640b844b tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1513ada-780a-488b-b2f4-a33141d28f96"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:34:39.113001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27787e52-8dd8-4e31-88a1-14b8640b844b tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:39.120403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27787e52-8dd8-4e31-88a1-14b8640b844b tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:39.120893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27787e52-8dd8-4e31-88a1-14b8640b844b tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:39.121334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27787e52-8dd8-4e31-88a1-14b8640b844b tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:39.122032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27787e52-8dd8-4e31-88a1-14b8640b844b tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:39.122531 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27787e52-8dd8-4e31-88a1-14b8640b844b tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:39.122964 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27787e52-8dd8-4e31-88a1-14b8640b844b tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:40.014736 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27787e52-8dd8-4e31-88a1-14b8640b844b tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912004 Oct 19 07:34:40.015368 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3289/6428] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:34:39 2022] POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-volume_attachments => generated 194 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:34:51.783085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47e565c2-4078-4b09-b3e3-84cd56934d95 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:34:51.791103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47e565c2-4078-4b09-b3e3-84cd56934d95 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:51.791610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47e565c2-4078-4b09-b3e3-84cd56934d95 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:51.792076 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47e565c2-4078-4b09-b3e3-84cd56934d95 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:51.814445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47e565c2-4078-4b09-b3e3-84cd56934d95 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 07:34:52.000306 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47e565c2-4078-4b09-b3e3-84cd56934d95 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/action" status: 202 len: 0 microversion: 2.1 time: 0.222095 Oct 19 07:34:52.001637 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3140/6429] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:34:51 2022] POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:34:52.011493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:52.012409 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:52.015193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:34:52.015880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:34:52.021467 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:52.021960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:52.022402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:52.023095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:52.023555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:52.023986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:52.161392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:52.169765 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92a83ae7-466c-4da4-9ae8-5c69b6faeed7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.163919 Oct 19 07:34:52.170359 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3290/6430] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:52 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:53.194818 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:53.195592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:53.201815 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:53.202346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:53.202797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:53.203499 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:53.204497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:53.204942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:53.341263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:53.350124 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04c7eb27-7a62-4359-8cd0-c67c8b83f6b3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.160685 Oct 19 07:34:53.350701 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3141/6431] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:53 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:54.373520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:54.374163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:54.381814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:54.382303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:54.382753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:54.383449 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:54.383929 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:54.384364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:54.510979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:54.519436 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8da4f37e-5dcf-44d4-903c-84dfabec5d14 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.149817 Oct 19 07:34:54.520004 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3291/6432] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:54 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:55.543554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:55.544263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:55.551372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:55.551865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:55.552345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:55.553044 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:55.553586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:55.554025 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:55.683517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:55.692418 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3bdda780-ff3e-4cc7-9c2c-08278b634794 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.152921 Oct 19 07:34:55.692991 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3142/6433] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:55 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:56.715607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:56.716240 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:56.723514 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:56.723991 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:56.724481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:56.725167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:56.725655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:56.726085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:56.852974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:56.861733 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13a6d475-24d9-481f-a37d-f8c81a1a4ea2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.150035 Oct 19 07:34:56.862306 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3292/6434] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:56 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:57.885400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:57.886024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:57.893363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:57.893862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:57.894313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:57.895016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:57.895486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:57.895926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:58.023621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:58.031841 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-acba3c50-d9c4-4fb8-bdb4-9d2e046ebd66 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.150690 Oct 19 07:34:58.032466 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3143/6435] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:57 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:34:59.054959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:34:59.055523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:34:59.062377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:59.062861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:59.063338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:59.064033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:34:59.064515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:34:59.064945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:34:59.197633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:34:59.206433 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08776430-4199-4d3a-b9f8-a1b91b6a1978 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.155530 Oct 19 07:34:59.207013 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3293/6436] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:34:59 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:00.230760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:00.231358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:00.238928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:00.239188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:00.239660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:00.240392 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:00.240876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:00.241288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:00.374560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:00.382662 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-138d9a0c-9ab7-425e-89a3-6bfa8fb1970c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.156035 Oct 19 07:35:00.383230 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3144/6437] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:00 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:01.406119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:01.406737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:01.413970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:01.414460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:01.414904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:01.415599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:01.416058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:01.416516 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:01.543029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:01.551352 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe7d92c7-b497-486c-976b-937c228285a7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.149325 Oct 19 07:35:01.551930 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3294/6438] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:01 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:02.574678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:02.575304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:02.582333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:02.582831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:02.583285 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:02.584016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:02.584518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:02.584962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:02.718031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:02.727012 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8677ba1-08e5-487f-b7ca-3f51bb06604c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.156296 Oct 19 07:35:02.733996 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3145/6439] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:02 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:03.751688 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:03.752398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:03.759384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:03.760164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:03.760609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:03.761367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:03.761888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:03.762326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:03.893784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:03.901979 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2434a2c-a164-4f11-82b9-98312ae391aa tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.154910 Oct 19 07:35:03.902552 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3295/6440] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:03 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:04.925514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:04.926135 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:04.933141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:04.933717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:04.934169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:04.934949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:04.935418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:04.935855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:05.071946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:05.081769 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a49f9c50-6ebc-4276-81f7-03723520fada tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.160201 Oct 19 07:35:05.082355 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3146/6441] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:04 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:06.105235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:06.105848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:06.113387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:06.113876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:06.114321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:06.115018 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:06.115481 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:06.115914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:06.248782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:06.257197 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-935ca62c-c25e-4e7a-8df7-a1b4084b1911 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.155863 Oct 19 07:35:06.257771 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3296/6442] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:06 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:07.291530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:07.292456 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:07.299582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:07.300384 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:07.300838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:07.301539 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:07.302004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:07.302442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:07.435216 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:07.444510 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52fee7a5-ba27-4cda-a64f-9f2900425902 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1724 microversion: 2.1 time: 0.157073 Oct 19 07:35:07.445239 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3147/6443] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:07 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:08.467674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:08.468325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:08.475159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:08.475643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:08.476080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:08.476793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:08.477248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:08.477678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:08.608448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:08.616725 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2fb6c93-f4ab-4689-a29f-3efe4e8c6221 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1701 microversion: 2.1 time: 0.152993 Oct 19 07:35:08.617298 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3297/6444] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:08 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:08.640348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e97b427e-bc25-45aa-81e9-b1ce2b6fef42 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:35:08.647874 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e97b427e-bc25-45aa-81e9-b1ce2b6fef42 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:08.648437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e97b427e-bc25-45aa-81e9-b1ce2b6fef42 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:08.652477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e97b427e-bc25-45aa-81e9-b1ce2b6fef42 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:08.671024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e97b427e-bc25-45aa-81e9-b1ce2b6fef42 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Going to try to start instance {{(pid=127568) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 07:35:08.846251 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e97b427e-bc25-45aa-81e9-b1ce2b6fef42 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/action" status: 202 len: 0 microversion: 2.1 time: 0.209683 Oct 19 07:35:08.846779 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3148/6445] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:35:08 2022] POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:35:08.854932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:08.855545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:08.861694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:08.862191 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:08.862637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:08.863955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:08.864448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:08.864879 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:09.002587 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:09.012098 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff2cced2-0ca4-49af-b165-2a11d608e58e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1710 microversion: 2.1 time: 0.161056 Oct 19 07:35:09.012842 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3298/6446] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:08 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:10.037397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:10.038187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:10.046308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:10.046823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:10.047283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:10.048012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:10.048691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:10.049144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:10.184543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:10.194658 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9eba759-e7c3-4331-bc77-6cd6ff0afe6e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1710 microversion: 2.1 time: 0.162488 Oct 19 07:35:10.195231 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3149/6447] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:10 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:11.218832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:11.219374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:11.226882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:11.227379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:11.227828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:11.228570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:11.229034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:11.229546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:11.359993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:11.369277 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa5941cc-24a4-455f-8b1f-def60b0867b9 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1714 microversion: 2.1 time: 0.154472 Oct 19 07:35:11.369867 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3299/6448] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:11 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:43.659351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:43.660011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:43.662375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=22 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:35:43.663603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:35:43.668380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:43.676985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:43.676985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:43.676985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:43.676985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:43.676985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:43.751810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lazy-loading 'services' on Instance uuid 34cee2a4-025b-4d83-8581-a4dc2c081418 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:35:44.015868 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f34856a-8cd8-437d-9b81-620e045e8dd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-volume_attachments/a1513ada-780a-488b-b2f4-a33141d28f96" status: 202 len: 0 microversion: 2.1 time: 0.360421 Oct 19 07:35:44.016526 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3150/6449] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:35:43 2022] DELETE /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-volume_attachments/a1513ada-780a-488b-b2f4-a33141d28f96 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:35:49.393588 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cff7bd5b-b603-4334-b014-724d60984781 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:35:49.395844 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=20 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:35:49.396614 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=60 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:35:49.401428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cff7bd5b-b603-4334-b014-724d60984781 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:49.401944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cff7bd5b-b603-4334-b014-724d60984781 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:49.402390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cff7bd5b-b603-4334-b014-724d60984781 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:49.424511 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cff7bd5b-b603-4334-b014-724d60984781 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Going to try to stop instance {{(pid=127567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 07:35:49.597835 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cff7bd5b-b603-4334-b014-724d60984781 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/action" status: 202 len: 0 microversion: 2.1 time: 0.208111 Oct 19 07:35:49.598467 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3300/6450] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:35:49 2022] POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:35:49.608574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:49.609291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:49.616158 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:49.616665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:49.617113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:49.617821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:49.618290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:49.618731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:49.752400 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:49.761491 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ecb7f57-7786-4b7a-8960-e05e1e736be3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1678 microversion: 2.1 time: 0.158155 Oct 19 07:35:49.762281 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3151/6451] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:49 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:50.786280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:50.786980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:50.793239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:50.793728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:50.794173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:50.794865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:50.795325 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:50.795758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:50.924195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:50.932427 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33b10562-4ba7-44eb-877e-e2f7b6b7f9c8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1678 microversion: 2.1 time: 0.151355 Oct 19 07:35:50.932996 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3301/6452] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:50 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:51.956084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:51.956748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:51.963528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:51.964021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:51.964502 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:51.965205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:51.965671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:51.966109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:52.466652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:52.474342 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db8aee22-5459-40c8-97f2-ed225986fad2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1678 microversion: 2.1 time: 0.522201 Oct 19 07:35:52.475542 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3152/6453] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:51 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1678 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:53.497351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:53.497908 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:53.504714 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:53.505193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:53.505630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:53.506318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:53.506769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:53.507199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:53.643128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:53.651080 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f681e72-2123-417f-a050-021856d56328 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1678 microversion: 2.1 time: 0.157719 Oct 19 07:35:53.651649 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3302/6454] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:53 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:54.674260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:54.674916 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:54.681892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:54.682464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:54.682922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:54.683631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:54.684122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:54.684567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:54.810228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:54.817958 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2970874-4dbf-43be-8a6a-918d34518770 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1678 microversion: 2.1 time: 0.147658 Oct 19 07:35:54.819147 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3153/6455] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:54 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:55.840890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:55.841499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:55.848301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:55.848785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:55.849220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:55.849906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:55.850360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:55.850787 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:55.978695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:55.986491 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd1fcbae-c526-4f52-839f-92c5818d3a68 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1678 microversion: 2.1 time: 0.149535 Oct 19 07:35:55.987062 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3303/6456] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:55 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:57.011124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:57.017494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:57.018751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:57.019232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:57.019680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:57.020415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:57.020881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:57.021318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:57.152915 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:57.160741 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4713ab67-4c26-488c-967a-cc56aa85dcb6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1678 microversion: 2.1 time: 0.153805 Oct 19 07:35:57.161307 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3154/6457] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:57 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:35:58.184639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:58.185251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:58.191843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:58.192362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:58.192796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:58.193997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:58.194451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:58.194876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:58.427739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:58.446424 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8daa4a14-a6c0-4961-98d5-67c0a9a40312 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1678 microversion: 2.1 time: 0.255225 Oct 19 07:35:58.446424 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3304/6458] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:58 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:35:59.468070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:35:59.468721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:35:59.476062 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:59.476604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:59.477056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:59.477757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:35:59.478223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:35:59.478661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:35:59.608749 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:35:59.617285 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc0f6a8f-fbf6-48e6-9a1a-3b60ce6fda32 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1678 microversion: 2.1 time: 0.153169 Oct 19 07:35:59.617857 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3155/6459] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:35:59 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:00.641416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:00.642030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:00.648890 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:00.651026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:00.651026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:00.651026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:00.651026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:00.651398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:00.784305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:00.792003 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67d9b53d-f0d6-4b62-acb0-28c249e08a54 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1655 microversion: 2.1 time: 0.154777 Oct 19 07:36:00.792599 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3305/6460] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:00 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:00.815326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22af3642-f6cd-4277-aba7-dcf51ea0be0f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:36:00.822919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22af3642-f6cd-4277-aba7-dcf51ea0be0f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:00.823427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22af3642-f6cd-4277-aba7-dcf51ea0be0f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:00.823894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22af3642-f6cd-4277-aba7-dcf51ea0be0f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:00.845550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22af3642-f6cd-4277-aba7-dcf51ea0be0f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Going to try to start instance {{(pid=127568) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 07:36:00.968493 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22af3642-f6cd-4277-aba7-dcf51ea0be0f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/action" status: 202 len: 0 microversion: 2.1 time: 0.156781 Oct 19 07:36:00.969029 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3156/6461] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:36:00 2022] POST /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:36:00.977667 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:00.982426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:00.984383 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:00.984884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:00.985333 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:00.986039 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:00.986506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:00.986944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:01.117925 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:01.125843 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd9b75f0-4ebf-44eb-81d8-68542b596ba3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1664 microversion: 2.1 time: 0.152602 Oct 19 07:36:01.126429 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3306/6462] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:00 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:02.150929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:02.151681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:02.157940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:02.158440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:02.158922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:02.159627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:02.160121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:02.160601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:02.290861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:02.298865 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e287186-332d-48d8-b234-e0289226cf2a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1664 microversion: 2.1 time: 0.153017 Oct 19 07:36:02.299443 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3157/6463] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:02 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:03.323348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:03.323957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:03.330904 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:03.331394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:03.331838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:03.332576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:03.333045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:03.334116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:03.463949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:03.471794 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4152e3e1-51ca-43de-a51e-cbc2bf38d3ba tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1668 microversion: 2.1 time: 0.152344 Oct 19 07:36:03.472395 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3307/6464] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:03 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:36.028865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-438c7ef1-c5dc-4987-bfde-97a739ccdbc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:36.031340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-438c7ef1-c5dc-4987-bfde-97a739ccdbc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:36.034154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:36:36.035193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:36:36.036376 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:36:36.036770 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-volume_attachments (ip 10.222.0.39) !!! Oct 19 07:36:36.038769 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:36:36.038887 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-volume_attachments (ip 10.222.0.39) !!! Oct 19 07:36:36.054747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438c7ef1-c5dc-4987-bfde-97a739ccdbc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:36.055254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438c7ef1-c5dc-4987-bfde-97a739ccdbc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:36.055711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438c7ef1-c5dc-4987-bfde-97a739ccdbc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:36.056461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438c7ef1-c5dc-4987-bfde-97a739ccdbc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:36.056934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438c7ef1-c5dc-4987-bfde-97a739ccdbc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:36.057379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-438c7ef1-c5dc-4987-bfde-97a739ccdbc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:36.093603 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-438c7ef1-c5dc-4987-bfde-97a739ccdbc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069241 Oct 19 07:36:36.094196 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3158/6465] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:36:36 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:36:36.159031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:36.159550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:36.161955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=16 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:36:36.162678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:36:36.163700 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:36:36.163846 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 (ip 10.222.0.39) !!! Oct 19 07:36:36.165775 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:36:36.165913 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 (ip 10.222.0.39) !!! Oct 19 07:36:36.182390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:36.182822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:36.183275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:36.184161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:36.184822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:36.185433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:36.212666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:36:36.536378 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ccbc3d0f-ff44-41c3-8eb7-89963cd9a5cd tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 204 len: 0 microversion: 2.1 time: 0.381062 Oct 19 07:36:36.537048 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3308/6466] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:36:36 2022] DELETE /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:36:36.546661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:36.547289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:36.553744 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:36.554246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:36.554699 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:36.555459 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:36.556274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:36.562482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:36.687331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:36.695206 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da525271-c9e3-4c74-8271-0f94cee0dfc1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1674 microversion: 2.1 time: 0.153684 Oct 19 07:36:36.695987 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3159/6467] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:36 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:37.720629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:37.721354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:37.728164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:37.728655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:37.729097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:37.729823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:37.730283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:37.730779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:37.862324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:37.870144 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d0092b6-ab94-43eb-b603-a4f35f047cd6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1674 microversion: 2.1 time: 0.153884 Oct 19 07:36:37.871232 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3309/6468] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:37 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:38.341892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-669663636", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1510903324", "security_groups": [{"name": "tempest-secgroup-smoke-110936054"}], "block_device_mapping_v2": [{"uuid": "940feefe-f437-413b-bea4-c321e821bcea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cedc1025-55fd-4295-a2cd-69fd264b4466"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:36:38.453529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] validate_networks() for [('cedc1025-55fd-4295-a2cd-69fd264b4466', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:36:38.836993 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:36:38.837431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:36:38.837971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:36:38.838393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:36:38.838847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:36:38.847904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:38.848484 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:38.848935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:38.849704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:38.850168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:38.850604 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:38.867975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:36:38.873748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Getting quotas for user 221b692fdbb3495aa63a686796b02ea8 and project f1c707325eff4d6fb7b29c1cb2d53831. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:36:38.895001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:38.896267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:38.905193 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:38.905765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:38.906284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:38.907074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:38.907629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:38.908150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:38.937628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:36:38.939785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='940feefe-f437-413b-bea4-c321e821bcea',volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:36:39.199060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:39.206840 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-258117c3-deb1-44b5-8260-5c43bdea32d8 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1674 microversion: 2.1 time: 0.315900 Oct 19 07:36:39.207439 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3310/6469] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:38 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1674 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:36:39.287479 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32a4d4e2-6a9b-4998-8b87-6d7977db54e1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.950183 Oct 19 07:36:39.288309 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3160/6470] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:36:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:36:39.301078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-881b3439-c5ff-4178-b3cf-bb12126f4c9b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:39.301706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-881b3439-c5ff-4178-b3cf-bb12126f4c9b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:39.369139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-881b3439-c5ff-4178-b3cf-bb12126f4c9b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:39.376032 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-881b3439-c5ff-4178-b3cf-bb12126f4c9b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1094 microversion: 2.1 time: 0.080203 Oct 19 07:36:39.376844 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3311/6471] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:39 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:39.706555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3c59d3b8-ee32-4038-aaa6-bb155f4cdbcc req-75e7a451-2308-44c1-8d70-059eeb0b1d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cee2a4-025b-4d83-8581-a4dc2c081418", "name": "network-vif-deleted", "tag": "77dbc1a6-f194-4723-91d5-53abcf6a97b8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:36:39.718585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3c59d3b8-ee32-4038-aaa6-bb155f4cdbcc req-75e7a451-2308-44c1-8d70-059eeb0b1d98 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:39.719088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3c59d3b8-ee32-4038-aaa6-bb155f4cdbcc req-75e7a451-2308-44c1-8d70-059eeb0b1d98 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:39.719573 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3c59d3b8-ee32-4038-aaa6-bb155f4cdbcc req-75e7a451-2308-44c1-8d70-059eeb0b1d98 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:39.731148 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3c59d3b8-ee32-4038-aaa6-bb155f4cdbcc req-75e7a451-2308-44c1-8d70-059eeb0b1d98 service nova] Creating event network-vif-deleted:77dbc1a6-f194-4723-91d5-53abcf6a97b8 for instance 34cee2a4-025b-4d83-8581-a4dc2c081418 on n-h1-861333-10 Oct 19 07:36:39.736385 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3c59d3b8-ee32-4038-aaa6-bb155f4cdbcc req-75e7a451-2308-44c1-8d70-059eeb0b1d98 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034590 Oct 19 07:36:39.736983 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3161/6472] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:36:40.231080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:40.231981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:40.244640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:40.245143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:40.246105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:40.246827 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:40.247296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:40.247737 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:40.279839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:40.280371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:40.280822 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:40.281277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lazy-loading 'fault' on Instance uuid 34cee2a4-025b-4d83-8581-a4dc2c081418 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:36:40.326488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:40.334746 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f8359d1-73e3-44cc-bf2b-65bdb27928a4 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 200 len: 1328 microversion: 2.1 time: 0.107676 Oct 19 07:36:40.335245 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3312/6473] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:40 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:40.407845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7544fa10-87cf-4f59-af48-ada272a593c8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:40.409138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7544fa10-87cf-4f59-af48-ada272a593c8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:40.481832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7544fa10-87cf-4f59-af48-ada272a593c8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:40.489061 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7544fa10-87cf-4f59-af48-ada272a593c8 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1094 microversion: 2.1 time: 0.093490 Oct 19 07:36:40.489633 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3162/6474] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:40 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:41.358331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:41.358938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:41.365949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:41.366431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:41.366868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:41.367557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:41.368014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:41.368470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:41.381967 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] HTTP exception thrown: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Request method failure captured: Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 HTTP/1.1 Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6hWIjfPKFW5wwKzlFBuFSeYvSqdLsc0FWDcq-IyaWX5-LiuTR-jQiwqXiSp3l8MfWCejcGfbsz0E8DGpV3jiPaaIolRc7_0VCuGh23D5-7X9QyXZ-jVpe2Lb0tQklQLJcC9TUCXWcdDTN24yYZ692KxFeHu02DZkWDZdPj7NNmc2ns Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35f47d27c9eb471384aedcdbbe129fdf", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc6091612896435786aa0a2e0175ca50 Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '34cee2a4-025b-4d83-8581-a4dc2c081418'} Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:36:41.383876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Returning 404 to user: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e0e897a-1e17-4505-bf16-f63e36661305 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 404 len: 111 microversion: 2.1 time: 0.031007 Oct 19 07:36:41.389192 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3313/6475] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:41 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:36:41.394861 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94b02cb6-c8ad-4e66-bf79-ed14abb0a164 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '.version_select at 0x7f6d64729f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:41.512810 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7dcb5539-3387-4347-b571-d6c94720c129 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:41.513420 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7dcb5539-3387-4347-b571-d6c94720c129 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:41.518650 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94b02cb6-c8ad-4e66-bf79-ed14abb0a164 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990500748" status: 202 len: 0 microversion: 2.1 time: 0.127622 Oct 19 07:36:41.524076 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3163/6476] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:36:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990500748 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:36:41.568783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7dcb5539-3387-4347-b571-d6c94720c129 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:41.576751 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7dcb5539-3387-4347-b571-d6c94720c129 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1094 microversion: 2.1 time: 0.068304 Oct 19 07:36:41.577463 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3314/6477] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:41 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:36:42.313827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46dd66c6-8cb8-42dd-80ce-ac2e44d0c155 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'create', calling method: .version_select at 0x7f6d64fe9430>, body: {"keypair": {"name": "tempest-keypair-255657377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/ug6duBWcL0p8csX8TYXthLo+2YwqSSXxnhXYfN9lA5V+PRg8/cPc6Od4LynH3BMBFnHaau/QkBdowMi0IIZWJREg8hjaqZNbDVSStc++OJ7WWxbYeFoW2QDHQWTNlrg=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:36:42.329179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-46dd66c6-8cb8-42dd-80ce-ac2e44d0c155 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Getting quotas for project 35f47d27c9eb471384aedcdbbe129fdf. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:36:42.334221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-46dd66c6-8cb8-42dd-80ce-ac2e44d0c155 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Getting quotas for user fc6091612896435786aa0a2e0175ca50 and project 35f47d27c9eb471384aedcdbbe129fdf. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:36:42.455817 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46dd66c6-8cb8-42dd-80ce-ac2e44d0c155 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146081 Oct 19 07:36:42.456521 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3164/6478] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:36:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:36:42.599560 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:42.600211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:42.608436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:42.608928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:42.610794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:42.610794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:42.610794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:42.611180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:42.673709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:42.681813 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7fec052-de82-4f1f-93ee-b22100a94d76 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1136 microversion: 2.1 time: 0.086524 Oct 19 07:36:42.682387 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3315/6479] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:42 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:36:43.706532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:43.708084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:43.722009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:43.722896 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:43.724335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:43.726619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:43.727359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:43.728246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:43.821117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:43.833391 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2e06414-c7fd-409a-96cb-e413fa8c8d1b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1210 microversion: 2.1 time: 0.131701 Oct 19 07:36:43.834686 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3165/6480] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:43 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:44.858835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:44.859448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:44.867348 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:44.867994 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:44.871924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:44.871924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:44.871924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:44.871924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:44.990412 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1687429693", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72a9a37b-edb1-43fd-bcab-a05affed03b4"}], "security_groups": [{"name": "tempest-securitygroup--1905545560"}], "key_name": "tempest-keypair-255657377", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:36:45.082569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:45.093134 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90c5f34b-761f-4926-9a79-4b91a9cb638d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1277 microversion: 2.1 time: 0.238704 Oct 19 07:36:45.104630 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3316/6481] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:44 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:45.110249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] validate_networks() for [('72a9a37b-edb1-43fd-bcab-a05affed03b4', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:36:45.525611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:36:45.526088 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:36:45.526730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:36:45.527155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:36:45.527583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:36:45.537732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:45.538331 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:45.538791 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:45.539575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:45.540082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:45.540555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:45.558021 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Getting quotas for project 35f47d27c9eb471384aedcdbbe129fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:36:45.564483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Getting quotas for user fc6091612896435786aa0a2e0175ca50 and project 35f47d27c9eb471384aedcdbbe129fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:36:45.578077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:36:45.580527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:36:45.617457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6576a09d-181c-4fcd-b643-b06293505343 req-fa580661-e6ad-4dd8-bbd0-7b38a186641f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f99749-30d5-42e6-81ea-98f6ca0886fd", "tag": "9c7adcb6-4759-4b96-97d6-0aa74283cf11"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:36:45.627824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6576a09d-181c-4fcd-b643-b06293505343 req-fa580661-e6ad-4dd8-bbd0-7b38a186641f service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:45.628427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6576a09d-181c-4fcd-b643-b06293505343 req-fa580661-e6ad-4dd8-bbd0-7b38a186641f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:45.629035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6576a09d-181c-4fcd-b643-b06293505343 req-fa580661-e6ad-4dd8-bbd0-7b38a186641f service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:45.643966 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6576a09d-181c-4fcd-b643-b06293505343 req-fa580661-e6ad-4dd8-bbd0-7b38a186641f service nova] Creating event network-changed:9c7adcb6-4759-4b96-97d6-0aa74283cf11 for instance 16f99749-30d5-42e6-81ea-98f6ca0886fd on n-h1-861333-10 Oct 19 07:36:45.649222 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6576a09d-181c-4fcd-b643-b06293505343 req-fa580661-e6ad-4dd8-bbd0-7b38a186641f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035581 Oct 19 07:36:45.650315 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3317/6482] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:36:45.707898 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3fd1bd20-aefa-4f6c-b531-73fc637bd416 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.721820 Oct 19 07:36:45.709549 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3166/6483] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:36:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 07:36:45.722804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f6b9571-f88c-401d-9802-459390eaa97a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:45.724392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f6b9571-f88c-401d-9802-459390eaa97a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:45.854463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f6b9571-f88c-401d-9802-459390eaa97a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:45.865318 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f6b9571-f88c-401d-9802-459390eaa97a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1237 microversion: 2.1 time: 0.148727 Oct 19 07:36:45.867155 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3318/6484] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:45 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1237 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:46.120778 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:46.121411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:46.128601 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:46.129112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:46.129706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:46.130438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:46.130917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:46.131362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:46.290201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:46.298875 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f78801e5-a578-4ddd-866e-c1bc391fd202 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1277 microversion: 2.1 time: 0.183470 Oct 19 07:36:46.311286 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3167/6485] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:46 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:46.888661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:46.889283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:46.897068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:46.897554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:46.897992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:46.898697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:46.899161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:46.899592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:46.963916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:46.972718 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee9ca29c-56d9-4bcb-9a7f-fe48b33617f1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1241 microversion: 2.1 time: 0.087970 Oct 19 07:36:46.975416 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3319/6486] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:46 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:47.323000 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:47.323637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:47.331410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:47.331977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:47.335253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:47.337517 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:47.338265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:47.348279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:47.498018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:47.506159 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd67a7bc-cb48-4e6a-bfe7-0aa3afb7086b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1277 microversion: 2.1 time: 0.187379 Oct 19 07:36:47.506846 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3168/6487] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:47 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:48.001066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:48.002279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:48.012202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:48.013114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:48.014632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:48.015605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:48.016813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:48.017726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:48.090698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:48.100713 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7be3f64-57fb-485a-8489-c434a3d76b4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1297 microversion: 2.1 time: 0.104231 Oct 19 07:36:48.101595 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3320/6488] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:47 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:48.531785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:48.532706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:48.539653 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:48.540189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:48.540669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:48.541397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:48.541881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:48.542359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:48.743383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:48.760889 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-986242e0-7635-4fc6-89bd-e2784968df46 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1277 microversion: 2.1 time: 0.234470 Oct 19 07:36:48.761483 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3169/6489] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:48 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1277 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:49.125623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:49.126159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:49.133392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:49.133884 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:49.134331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:49.135034 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:49.135494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:49.135928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:49.283731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:49.291596 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1dad3b1-0d71-4e8f-ab1c-204798ed0258 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1363 microversion: 2.1 time: 0.170554 Oct 19 07:36:49.292200 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3321/6490] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:49 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:49.785655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:49.786281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:49.793143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:49.793143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:49.796646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:49.796646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:49.796646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:49.796646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:49.859733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b13c97c0-04a0-47a8-a146-44519d717f35 req-4ae12ab7-ed6e-4d34-bb53-eb38e9cd1f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da91278-1062-478f-ba11-aec4f51d7812", "tag": "138cd786-e4a5-4f6c-b368-f13d3e17955f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:36:49.869581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b13c97c0-04a0-47a8-a146-44519d717f35 req-4ae12ab7-ed6e-4d34-bb53-eb38e9cd1f90 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:49.870079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b13c97c0-04a0-47a8-a146-44519d717f35 req-4ae12ab7-ed6e-4d34-bb53-eb38e9cd1f90 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:49.870525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b13c97c0-04a0-47a8-a146-44519d717f35 req-4ae12ab7-ed6e-4d34-bb53-eb38e9cd1f90 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:49.882668 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b13c97c0-04a0-47a8-a146-44519d717f35 req-4ae12ab7-ed6e-4d34-bb53-eb38e9cd1f90 service nova] Creating event network-changed:138cd786-e4a5-4f6c-b368-f13d3e17955f for instance 5da91278-1062-478f-ba11-aec4f51d7812 on n-h2-861333-10 Oct 19 07:36:49.892844 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b13c97c0-04a0-47a8-a146-44519d717f35 req-4ae12ab7-ed6e-4d34-bb53-eb38e9cd1f90 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117029 Oct 19 07:36:49.892844 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3170/6491] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:36:49.943776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:49.951829 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df8fed92-0e1e-459a-99a0-fd65f11aa6ea tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.170684 Oct 19 07:36:49.952451 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3322/6492] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:49 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:50.315565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:50.316316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:50.322717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:50.323213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:50.323667 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:50.324496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:50.324982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:50.325432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:50.461357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:50.469894 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-751f5efd-9a3b-45ac-881e-a5f7f053c0d2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1363 microversion: 2.1 time: 0.158838 Oct 19 07:36:50.470473 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3171/6493] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:50 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:50.975293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:50.975914 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:50.983544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:50.985159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:50.985159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:50.985359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:50.985721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:50.986162 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:51.116858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:51.125333 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab18d08d-25ac-4def-a550-173e13e1ea78 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.154033 Oct 19 07:36:51.125905 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3323/6494] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:50 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:51.492708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:51.493275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:51.500611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:51.501119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:51.501569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:51.502282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:51.502753 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:51.503193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:51.733680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:51.741602 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91d2c440-3161-40d3-a726-38c3fa9726c7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1363 microversion: 2.1 time: 0.253096 Oct 19 07:36:51.742177 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3172/6495] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:51 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:52.148473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:52.149136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:52.156182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:52.156681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:52.157133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:52.157845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:52.158313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:52.158750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:52.297800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:52.305514 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1158c2e-99cd-4a66-9c9e-22528ec70967 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.161064 Oct 19 07:36:52.306060 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3324/6496] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:52 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:52.765897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:52.766523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:52.773101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:52.773599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:52.774053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:52.774757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:52.775229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:52.775671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:52.907835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:52.915794 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4fcf7b73-fd76-4b08-ad91-a93dc790a360 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1363 microversion: 2.1 time: 0.154622 Oct 19 07:36:52.916399 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3173/6497] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:52 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:53.328593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:53.329339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:53.336314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:53.336840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:53.337335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:53.338040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:53.338567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:53.339003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:53.474160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:53.482694 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da75e5f7-c1f7-4902-b431-efe64079823e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.157554 Oct 19 07:36:53.483287 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3325/6498] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:53 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:53.938369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:53.938992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:53.945497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:53.945986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:53.946432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:53.947128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:53.947593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:53.948033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:54.078615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:54.086257 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12075170-780f-48f9-a4ec-e6f04db74f4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1363 microversion: 2.1 time: 0.151991 Oct 19 07:36:54.086825 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3174/6499] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:53 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:54.504860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:54.505423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:54.512617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:54.513138 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:54.513577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:54.514274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:54.514729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:54.515160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:54.654507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:54.658561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:36:54.663178 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-871051c6-6dae-4c24-83cc-75ad139c06d2 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.162296 Oct 19 07:36:54.663949 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3326/6500] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:54 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:36:55.109461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:55.110087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:55.117315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:55.119431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:55.119431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:55.119431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:55.119717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:55.119904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:55.250845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:55.258674 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65b87f43-0193-43fb-8ea1-72383656ddf1 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1363 microversion: 2.1 time: 0.153301 Oct 19 07:36:55.259230 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3175/6501] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:55 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:55.686861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:55.687600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:55.695158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:55.695650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:55.696095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:55.696832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:55.697281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:55.697715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:55.829527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:55.837370 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e125702-6533-49a8-9d3c-5cfcc27265b1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.155193 Oct 19 07:36:55.837946 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3327/6502] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:55 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:56.283024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:56.283646 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:56.285769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:36:56.286445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:36:56.292477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:56.292980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:56.293440 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:56.294577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:56.294795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:56.295250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:56.431928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:56.440283 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6e7ca68-2ac0-41a5-8ef8-16a727b25fc6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1363 microversion: 2.1 time: 0.161861 Oct 19 07:36:56.440874 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3176/6503] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:56 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:56.604095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f53d184b-b644-4687-95db-342d9cd6bcf8 req-9c6c6935-1fcf-4159-92c6-9fc5a6980aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da91278-1062-478f-ba11-aec4f51d7812", "name": "network-vif-plugged", "status": "completed", "tag": "138cd786-e4a5-4f6c-b368-f13d3e17955f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:36:56.610201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:36:56.615461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f53d184b-b644-4687-95db-342d9cd6bcf8 req-9c6c6935-1fcf-4159-92c6-9fc5a6980aa3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:56.615950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f53d184b-b644-4687-95db-342d9cd6bcf8 req-9c6c6935-1fcf-4159-92c6-9fc5a6980aa3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:56.616426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f53d184b-b644-4687-95db-342d9cd6bcf8 req-9c6c6935-1fcf-4159-92c6-9fc5a6980aa3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:56.627587 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f53d184b-b644-4687-95db-342d9cd6bcf8 req-9c6c6935-1fcf-4159-92c6-9fc5a6980aa3 service nova] Creating event network-vif-plugged:138cd786-e4a5-4f6c-b368-f13d3e17955f for instance 5da91278-1062-478f-ba11-aec4f51d7812 on n-h2-861333-10 Oct 19 07:36:56.633052 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f53d184b-b644-4687-95db-342d9cd6bcf8 req-9c6c6935-1fcf-4159-92c6-9fc5a6980aa3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Oct 19 07:36:56.634183 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3328/6504] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:36:56.861168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:56.861789 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:56.867738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:56.869948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:56.869948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:56.869948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:56.870241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:56.870613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:57.003244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:57.011375 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0e44d47-5a5e-4656-92e3-7e2bf8063ec6 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.154703 Oct 19 07:36:57.011952 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3177/6505] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:56 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:57.465571 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:57.466284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:57.473370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:57.473866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:57.474412 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:57.475067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:57.475534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:57.475969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:57.605624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:57.613500 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ea179cc-2096-435e-b3ff-7fba182c0253 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1363 microversion: 2.1 time: 0.153620 Oct 19 07:36:57.614079 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3329/6506] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:57 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:58.035402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:58.036337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:58.043705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:58.044225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:58.044676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:58.046115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:58.046626 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:58.047067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:58.179785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:58.188804 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed2969fb-ad0d-4c9b-b22c-c90dedc2e563 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.157904 Oct 19 07:36:58.189667 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3178/6507] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:58 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:58.636784 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:58.637350 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:58.644766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:58.645275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:58.645720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:58.646435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:58.646930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:58.647362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:58.786941 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:58.804320 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7726e21-4c76-49fe-ad72-d57c66811541 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1549 microversion: 2.1 time: 0.171535 Oct 19 07:36:58.805646 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3330/6508] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:58 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:58.828977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6fcfae2-10f8-41b9-9146-403938d7a37e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:58.829588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6fcfae2-10f8-41b9-9146-403938d7a37e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:58.836697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fcfae2-10f8-41b9-9146-403938d7a37e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:58.837270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fcfae2-10f8-41b9-9146-403938d7a37e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:58.837940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fcfae2-10f8-41b9-9146-403938d7a37e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:58.838972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fcfae2-10f8-41b9-9146-403938d7a37e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:58.839816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fcfae2-10f8-41b9-9146-403938d7a37e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:58.840577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fcfae2-10f8-41b9-9146-403938d7a37e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:58.923855 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6fcfae2-10f8-41b9-9146-403938d7a37e tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099724 Oct 19 07:36:58.924494 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3179/6509] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:36:58 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:36:59.212043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:36:59.213272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:36:59.220239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:59.220809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:59.221377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:59.222150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:59.222746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:59.223355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:59.378597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:36:59.387179 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f8552f1-d619-48be-ab31-72c11250c8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.178966 Oct 19 07:36:59.387775 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3331/6510] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:36:59 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:36:59.965525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1d30d67b-43ed-4b7d-94b1-9f79c88a4003 req-f65cd5b6-1806-4292-895d-f2207b5fe747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da91278-1062-478f-ba11-aec4f51d7812", "tag": "138cd786-e4a5-4f6c-b368-f13d3e17955f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:36:59.977016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1d30d67b-43ed-4b7d-94b1-9f79c88a4003 req-f65cd5b6-1806-4292-895d-f2207b5fe747 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:36:59.977525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1d30d67b-43ed-4b7d-94b1-9f79c88a4003 req-f65cd5b6-1806-4292-895d-f2207b5fe747 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:36:59.978160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1d30d67b-43ed-4b7d-94b1-9f79c88a4003 req-f65cd5b6-1806-4292-895d-f2207b5fe747 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:36:59.990479 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1d30d67b-43ed-4b7d-94b1-9f79c88a4003 req-f65cd5b6-1806-4292-895d-f2207b5fe747 service nova] Creating event network-changed:138cd786-e4a5-4f6c-b368-f13d3e17955f for instance 5da91278-1062-478f-ba11-aec4f51d7812 on n-h2-861333-10 Oct 19 07:36:59.995613 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1d30d67b-43ed-4b7d-94b1-9f79c88a4003 req-f65cd5b6-1806-4292-895d-f2207b5fe747 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035217 Oct 19 07:36:59.999647 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3180/6511] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:37:00.410295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:37:00.410907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:37:00.417675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:00.418170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:00.418798 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:00.419675 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:00.420249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:00.425728 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:00.578233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:37:00.586372 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6aec0bf9-28a2-4397-98ba-21a2cf71d8d3 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.180013 Oct 19 07:37:00.587081 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3332/6512] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:37:00 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:37:00.634171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6cfb1c2d-b984-4970-9835-76f60dc61971 req-88f92e38-3da3-453a-8572-77e22495ed0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f99749-30d5-42e6-81ea-98f6ca0886fd", "name": "network-vif-plugged", "status": "completed", "tag": "9c7adcb6-4759-4b96-97d6-0aa74283cf11"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:37:00.644063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6cfb1c2d-b984-4970-9835-76f60dc61971 req-88f92e38-3da3-453a-8572-77e22495ed0e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:00.644585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6cfb1c2d-b984-4970-9835-76f60dc61971 req-88f92e38-3da3-453a-8572-77e22495ed0e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:00.645032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6cfb1c2d-b984-4970-9835-76f60dc61971 req-88f92e38-3da3-453a-8572-77e22495ed0e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:00.649055 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:37:00.656673 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6cfb1c2d-b984-4970-9835-76f60dc61971 req-88f92e38-3da3-453a-8572-77e22495ed0e service nova] Creating event network-vif-plugged:9c7adcb6-4759-4b96-97d6-0aa74283cf11 for instance 16f99749-30d5-42e6-81ea-98f6ca0886fd on n-h1-861333-10 Oct 19 07:37:00.661886 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6cfb1c2d-b984-4970-9835-76f60dc61971 req-88f92e38-3da3-453a-8572-77e22495ed0e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Oct 19 07:37:00.662488 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3181/6513] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:37:01.616417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:37:01.617068 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:37:01.624067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:01.624599 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:01.625020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:01.625712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:01.626170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:01.626600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:01.764547 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:37:01.772415 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7efc2b0f-2cde-4f1c-abf8-c1e80f12d66e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1265 microversion: 2.1 time: 0.159994 Oct 19 07:37:01.773099 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3333/6514] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:37:01 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:37:02.799402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:37:02.800293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:37:02.807858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:02.808455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:02.808936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:02.809729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:02.810277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:02.810846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:02.961571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:37:02.969983 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e9e19e49-9657-4fc4-adf3-653c7c40e50c tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1452 microversion: 2.1 time: 0.178028 Oct 19 07:37:02.970559 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3182/6515] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:37:02 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:37:02.991988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:37:02.992648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:37:03.000319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:03.000821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:03.001269 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:03.001987 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:03.002487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:03.002932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:03.148899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:37:03.158160 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e26302cc-7614-4ad7-af75-7f681b569738 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1452 microversion: 2.1 time: 0.169464 Oct 19 07:37:03.158160 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3334/6516] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:37:02 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:37:05.438546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5959d96d-e901-4343-b2a8-c0429001a7d7 req-7b2cd910-12b1-4543-8472-6c7244154ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f99749-30d5-42e6-81ea-98f6ca0886fd", "tag": "9c7adcb6-4759-4b96-97d6-0aa74283cf11"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:37:05.449056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5959d96d-e901-4343-b2a8-c0429001a7d7 req-7b2cd910-12b1-4543-8472-6c7244154ead service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:37:05.449652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5959d96d-e901-4343-b2a8-c0429001a7d7 req-7b2cd910-12b1-4543-8472-6c7244154ead service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:37:05.450100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5959d96d-e901-4343-b2a8-c0429001a7d7 req-7b2cd910-12b1-4543-8472-6c7244154ead service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:37:05.461882 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5959d96d-e901-4343-b2a8-c0429001a7d7 req-7b2cd910-12b1-4543-8472-6c7244154ead service nova] Creating event network-changed:9c7adcb6-4759-4b96-97d6-0aa74283cf11 for instance 16f99749-30d5-42e6-81ea-98f6ca0886fd on n-h1-861333-10 Oct 19 07:37:05.467250 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5959d96d-e901-4343-b2a8-c0429001a7d7 req-7b2cd910-12b1-4543-8472-6c7244154ead service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032975 Oct 19 07:37:05.470860 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3183/6517] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:02.719562 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bca04a53-c8ea-4f59-a487-3dcf4f1196ca] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 07:38:02.723176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-029eb9e4-5bd1-4bdd-9d6d-3b768a44a58c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:02.723665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-029eb9e4-5bd1-4bdd-9d6d-3b768a44a58c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:02.725764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:38:02.726418 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=44 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:38:02.731936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029eb9e4-5bd1-4bdd-9d6d-3b768a44a58c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:02.732471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029eb9e4-5bd1-4bdd-9d6d-3b768a44a58c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:02.732919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029eb9e4-5bd1-4bdd-9d6d-3b768a44a58c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:02.733648 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029eb9e4-5bd1-4bdd-9d6d-3b768a44a58c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:02.734110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029eb9e4-5bd1-4bdd-9d6d-3b768a44a58c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:02.734543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029eb9e4-5bd1-4bdd-9d6d-3b768a44a58c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:02.759116 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-029eb9e4-5bd1-4bdd-9d6d-3b768a44a58c tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/ips" status: 200 len: 146 microversion: 2.1 time: 0.041279 Oct 19 07:38:02.759698 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3335/6518] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:38:02 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:05.392619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:38:05.393372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:38:05.397735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4dcc12a-0707-44eb-b7de-e7cf7783ca99 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87997a2d-5c18-4a34-aa4e-997eb72c98fd"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:38:05.400192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4dcc12a-0707-44eb-b7de-e7cf7783ca99 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:05.406677 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4dcc12a-0707-44eb-b7de-e7cf7783ca99 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:05.407172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4dcc12a-0707-44eb-b7de-e7cf7783ca99 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:05.407621 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4dcc12a-0707-44eb-b7de-e7cf7783ca99 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:05.408358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4dcc12a-0707-44eb-b7de-e7cf7783ca99 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:05.408821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4dcc12a-0707-44eb-b7de-e7cf7783ca99 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:05.409260 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4dcc12a-0707-44eb-b7de-e7cf7783ca99 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:06.089863 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4dcc12a-0707-44eb-b7de-e7cf7783ca99 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698673 Oct 19 07:38:06.090502 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3184/6519] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:38:05 2022] POST /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:17.881766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa74326e-e8bf-41cb-9f04-d9fe3a52f4c2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:17.883976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa74326e-e8bf-41cb-9f04-d9fe3a52f4c2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:17.897213 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa74326e-e8bf-41cb-9f04-d9fe3a52f4c2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:17.897743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa74326e-e8bf-41cb-9f04-d9fe3a52f4c2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:17.898232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa74326e-e8bf-41cb-9f04-d9fe3a52f4c2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:17.898935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa74326e-e8bf-41cb-9f04-d9fe3a52f4c2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:17.899403 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa74326e-e8bf-41cb-9f04-d9fe3a52f4c2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:17.899907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa74326e-e8bf-41cb-9f04-d9fe3a52f4c2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:17.905044 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [bca04a53-c8ea-4f59-a487-3dcf4f1196ca] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 33738. Oct 19 07:38:17.931394 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa74326e-e8bf-41cb-9f04-d9fe3a52f4c2 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053799 Oct 19 07:38:17.931971 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3336/6520] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:38:17 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:17.943649 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4bc9726-ef00-49d5-aea8-cbd3ce475315 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:17.944332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4bc9726-ef00-49d5-aea8-cbd3ce475315 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:17.947204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:38:17.947905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:38:17.954096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4bc9726-ef00-49d5-aea8-cbd3ce475315 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:17.954631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4bc9726-ef00-49d5-aea8-cbd3ce475315 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:17.955114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4bc9726-ef00-49d5-aea8-cbd3ce475315 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:17.955834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4bc9726-ef00-49d5-aea8-cbd3ce475315 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:17.956338 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4bc9726-ef00-49d5-aea8-cbd3ce475315 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:17.956835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4bc9726-ef00-49d5-aea8-cbd3ce475315 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:17.986807 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4bc9726-ef00-49d5-aea8-cbd3ce475315 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/87997a2d-5c18-4a34-aa4e-997eb72c98fd" status: 200 len: 194 microversion: 2.1 time: 0.047444 Oct 19 07:38:17.987479 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3185/6521] 10.222.0.39 () {58 vars in 1413 bytes} [Wed Oct 19 07:38:17 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/87997a2d-5c18-4a34-aa4e-997eb72c98fd => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:20.677263 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01e76614-b5c1-43b7-9880-05459af48bb7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4b53a9f-c32c-4227-ab51-a503330edf40"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:38:20.679717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01e76614-b5c1-43b7-9880-05459af48bb7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:20.686995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01e76614-b5c1-43b7-9880-05459af48bb7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:20.687487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01e76614-b5c1-43b7-9880-05459af48bb7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:20.688621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01e76614-b5c1-43b7-9880-05459af48bb7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:20.689354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01e76614-b5c1-43b7-9880-05459af48bb7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:20.689800 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01e76614-b5c1-43b7-9880-05459af48bb7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:20.690235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01e76614-b5c1-43b7-9880-05459af48bb7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:21.373656 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01e76614-b5c1-43b7-9880-05459af48bb7 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "POST /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700088 Oct 19 07:38:21.374401 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3337/6522] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:38:20 2022] POST /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:33.160449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a8cbafa-07f4-4b2b-b1ba-29f44e556e18 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:33.162852 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a8cbafa-07f4-4b2b-b1ba-29f44e556e18 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:33.170708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a8cbafa-07f4-4b2b-b1ba-29f44e556e18 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:33.172592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a8cbafa-07f4-4b2b-b1ba-29f44e556e18 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:33.172592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a8cbafa-07f4-4b2b-b1ba-29f44e556e18 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:33.172592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a8cbafa-07f4-4b2b-b1ba-29f44e556e18 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:33.173046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a8cbafa-07f4-4b2b-b1ba-29f44e556e18 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:33.173295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a8cbafa-07f4-4b2b-b1ba-29f44e556e18 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:33.203853 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a8cbafa-07f4-4b2b-b1ba-29f44e556e18 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048767 Oct 19 07:38:33.204452 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3186/6523] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:38:33 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:33.374654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:38:33.375356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:38:33.379679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6102637d-d973-4580-8d95-2e4c864bd204 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:33.383727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6102637d-d973-4580-8d95-2e4c864bd204 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:33.386644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6102637d-d973-4580-8d95-2e4c864bd204 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:33.387136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6102637d-d973-4580-8d95-2e4c864bd204 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:33.387580 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6102637d-d973-4580-8d95-2e4c864bd204 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:33.388308 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6102637d-d973-4580-8d95-2e4c864bd204 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:33.388781 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6102637d-d973-4580-8d95-2e4c864bd204 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:33.389217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6102637d-d973-4580-8d95-2e4c864bd204 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:33.422113 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6102637d-d973-4580-8d95-2e4c864bd204 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/87997a2d-5c18-4a34-aa4e-997eb72c98fd" status: 200 len: 194 microversion: 2.1 time: 0.049402 Oct 19 07:38:33.422728 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3338/6524] 10.222.0.39 () {58 vars in 1413 bytes} [Wed Oct 19 07:38:33 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/87997a2d-5c18-4a34-aa4e-997eb72c98fd => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:33.433241 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:33.438049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:33.440388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:33.440922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:33.441374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:33.442067 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:33.442531 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:33.442967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:33.524039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lazy-loading 'services' on Instance uuid 5da91278-1062-478f-ba11-aec4f51d7812 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:38:33.750117 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e84d12e7-90f6-4aff-a3dc-f6d60e5ddd4f tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/87997a2d-5c18-4a34-aa4e-997eb72c98fd" status: 202 len: 0 microversion: 2.1 time: 0.320695 Oct 19 07:38:33.750711 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3187/6525] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:38:33 2022] DELETE /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/87997a2d-5c18-4a34-aa4e-997eb72c98fd => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:38:39.118304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50ef9746-f983-4d2d-adf2-2f768a4c2921 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:39.118816 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-50ef9746-f983-4d2d-adf2-2f768a4c2921 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:39.126282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ef9746-f983-4d2d-adf2-2f768a4c2921 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:39.126770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ef9746-f983-4d2d-adf2-2f768a4c2921 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:39.127214 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ef9746-f983-4d2d-adf2-2f768a4c2921 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:39.127907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ef9746-f983-4d2d-adf2-2f768a4c2921 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:39.128396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ef9746-f983-4d2d-adf2-2f768a4c2921 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:39.128828 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50ef9746-f983-4d2d-adf2-2f768a4c2921 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:39.159192 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50ef9746-f983-4d2d-adf2-2f768a4c2921 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/b4b53a9f-c32c-4227-ab51-a503330edf40" status: 200 len: 194 microversion: 2.1 time: 0.045475 Oct 19 07:38:39.159789 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3339/6526] 10.222.0.39 () {58 vars in 1413 bytes} [Wed Oct 19 07:38:39 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/b4b53a9f-c32c-4227-ab51-a503330edf40 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:39.171704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:39.172334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:39.178493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:39.178989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:39.179447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:39.180171 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:39.180641 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:39.181082 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:39.265912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lazy-loading 'services' on Instance uuid 5da91278-1062-478f-ba11-aec4f51d7812 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:38:39.488587 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f9dabf0-9ac7-4da6-a2e7-b9696916542a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/b4b53a9f-c32c-4227-ab51-a503330edf40" status: 202 len: 0 microversion: 2.1 time: 0.321781 Oct 19 07:38:39.489194 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3188/6527] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:38:39 2022] DELETE /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments/b4b53a9f-c32c-4227-ab51-a503330edf40 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 07:38:44.962999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed544f18-d0e1-46a8-b2c7-8a4225d032ed tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:44.965314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed544f18-d0e1-46a8-b2c7-8a4225d032ed tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:44.972376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed544f18-d0e1-46a8-b2c7-8a4225d032ed tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:44.972898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed544f18-d0e1-46a8-b2c7-8a4225d032ed tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:44.973906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed544f18-d0e1-46a8-b2c7-8a4225d032ed tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:44.974603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed544f18-d0e1-46a8-b2c7-8a4225d032ed tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:44.975066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed544f18-d0e1-46a8-b2c7-8a4225d032ed tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:44.975501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed544f18-d0e1-46a8-b2c7-8a4225d032ed tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:45.004535 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed544f18-d0e1-46a8-b2c7-8a4225d032ed tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045868 Oct 19 07:38:45.005335 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3340/6528] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:38:44 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:38:45.124014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbc18475-acf7-4441-8d0a-197b5b089e43 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:45.126413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbc18475-acf7-4441-8d0a-197b5b089e43 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:45.134036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc18475-acf7-4441-8d0a-197b5b089e43 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:45.134537 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc18475-acf7-4441-8d0a-197b5b089e43 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:45.134992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc18475-acf7-4441-8d0a-197b5b089e43 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:45.135697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc18475-acf7-4441-8d0a-197b5b089e43 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:45.136198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc18475-acf7-4441-8d0a-197b5b089e43 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:45.136642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc18475-acf7-4441-8d0a-197b5b089e43 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:45.167511 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbc18475-acf7-4441-8d0a-197b5b089e43 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047989 Oct 19 07:38:45.168067 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3189/6529] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:38:45 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:38:45.231530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:45.232152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:45.238487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:45.239578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:45.240020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:45.240745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:45.241210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:45.241644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:45.266918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:38:45.530108 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-052bde79-e9fb-4171-a1f0-57da12e55179 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 204 len: 0 microversion: 2.1 time: 0.302316 Oct 19 07:38:45.530712 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3341/6530] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:38:45 2022] DELETE /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:38:45.539574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:45.540226 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:45.546322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:45.546820 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:45.547275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:45.547980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:45.548483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:45.548929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:45.683300 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:38:45.691111 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eab97755-fb5b-4f6b-ad34-79cd289fc706 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1674 microversion: 2.1 time: 0.156106 Oct 19 07:38:45.691687 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3190/6531] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:38:45 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:38:46.716592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:46.717302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:46.725164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:46.725660 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:46.726107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:46.726811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:46.727273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:46.727708 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:46.856337 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:38:46.866446 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4f7963e-e2f2-498c-9c1c-b476b6f12e72 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1674 microversion: 2.1 time: 0.151901 Oct 19 07:38:46.867047 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3342/6532] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:38:46 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:38:47.891018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:47.891643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:47.898974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:47.899476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:47.899936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:47.900678 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:47.901148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:47.901587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:48.078782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:38:48.088674 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59bcb300-de46-49dd-83f7-3ccc1459566d tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1674 microversion: 2.1 time: 0.201484 Oct 19 07:38:48.103336 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3191/6533] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:38:47 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:38:48.374407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6dc699dd-d415-4a18-8c38-8074aa72cbdd req-ccde22ef-8c61-4b3b-901a-e96ecab78776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da91278-1062-478f-ba11-aec4f51d7812", "name": "network-vif-deleted", "tag": "138cd786-e4a5-4f6c-b368-f13d3e17955f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:38:48.384494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6dc699dd-d415-4a18-8c38-8074aa72cbdd req-ccde22ef-8c61-4b3b-901a-e96ecab78776 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:48.384975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6dc699dd-d415-4a18-8c38-8074aa72cbdd req-ccde22ef-8c61-4b3b-901a-e96ecab78776 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:48.385411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6dc699dd-d415-4a18-8c38-8074aa72cbdd req-ccde22ef-8c61-4b3b-901a-e96ecab78776 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:48.397257 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6dc699dd-d415-4a18-8c38-8074aa72cbdd req-ccde22ef-8c61-4b3b-901a-e96ecab78776 service nova] Creating event network-vif-deleted:138cd786-e4a5-4f6c-b368-f13d3e17955f for instance 5da91278-1062-478f-ba11-aec4f51d7812 on n-h2-861333-10 Oct 19 07:38:48.402230 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6dc699dd-d415-4a18-8c38-8074aa72cbdd req-ccde22ef-8c61-4b3b-901a-e96ecab78776 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031765 Oct 19 07:38:48.402825 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3343/6534] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:38:49.114676 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:49.115327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:49.122294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:49.122795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:49.123270 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:49.124144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:49.124479 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:49.124922 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:49.156864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:49.157377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:49.157833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:49.158480 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lazy-loading 'fault' on Instance uuid 5da91278-1062-478f-ba11-aec4f51d7812 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:38:49.202647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6091612896435786aa0a2e0175ca50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f47d27c9eb471384aedcdbbe129fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:38:49.211599 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8735d3da-5f1f-4f0e-a7a3-20257cec882a tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 200 len: 1327 microversion: 2.1 time: 0.100847 Oct 19 07:38:49.212220 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3192/6535] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:38:49 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:38:50.236450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:50.237151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:50.243435 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:50.243946 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:50.244417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:50.245105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:50.245561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:50.245992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:50.259948 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] HTTP exception thrown: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Request method failure captured: Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 HTTP/1.1 Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6hWIjfPKFW5wwKzlFBuFSeYvSqdLsc0FWDcq-IyaWX5-LiuTR-jQiwqXiSp3l8MfWCejcGfbsz0E8DGpV3jiPaaIolRc7_0VCuGh23D5-7X9QyXZ-jVpe2Lb0tQklQLJcC9TUCXWcdDTN24yYZ692KxFeHu02DZkWDZdPj7NNmc2ns Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35f47d27c9eb471384aedcdbbe129fdf", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc6091612896435786aa0a2e0175ca50 Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '5da91278-1062-478f-ba11-aec4f51d7812'} Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:38:50.261655 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Returning 404 to user: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-192df5e0-c5d5-417c-ae58-71da86f06c33 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 404 len: 111 microversion: 2.1 time: 0.031831 Oct 19 07:38:50.266845 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3344/6536] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:38:50 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:38:50.273669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-582db478-c5aa-490a-aa6a-2595b62d2ad3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '.version_select at 0x7f6d647b9670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:50.346196 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-582db478-c5aa-490a-aa6a-2595b62d2ad3 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-255657377" status: 202 len: 0 microversion: 2.1 time: 0.077198 Oct 19 07:38:50.346768 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3193/6537] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 07:38:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-255657377 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:38:57.890864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:57.891458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:57.899075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:57.899632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:57.900170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:57.900930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:57.901460 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:57.901955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:57.915367 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] HTTP exception thrown: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Request method failure captured: Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 HTTP/1.1 Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6hWIjfPKFW5wwKzlFBuFSeYvSqdLsc0FWDcq-IyaWX5-LiuTR-jQiwqXiSp3l8MfWCejcGfbsz0E8DGpV3jiPaaIolRc7_0VCuGh23D5-7X9QyXZ-jVpe2Lb0tQklQLJcC9TUCXWcdDTN24yYZ692KxFeHu02DZkWDZdPj7NNmc2ns Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35f47d27c9eb471384aedcdbbe129fdf", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc6091612896435786aa0a2e0175ca50 Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '5da91278-1062-478f-ba11-aec4f51d7812'} Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:38:57.916891 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Returning 404 to user: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07d1314b-8c5a-47bb-8b7d-d86991207861 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 404 len: 111 microversion: 2.1 time: 0.031513 Oct 19 07:38:57.921149 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3345/6538] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:38:57 2022] DELETE /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:38:57.927895 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:38:57.928540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 5da91278-1062-478f-ba11-aec4f51d7812] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:38:57.935430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:57.935924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:57.936423 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:57.937127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:38:57.937623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:38:57.938057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:38:57.952609 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] HTTP exception thrown: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Request method failure captured: Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 HTTP/1.1 Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6hWIjfPKFW5wwKzlFBuFSeYvSqdLsc0FWDcq-IyaWX5-LiuTR-jQiwqXiSp3l8MfWCejcGfbsz0E8DGpV3jiPaaIolRc7_0VCuGh23D5-7X9QyXZ-jVpe2Lb0tQklQLJcC9TUCXWcdDTN24yYZ692KxFeHu02DZkWDZdPj7NNmc2ns Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35f47d27c9eb471384aedcdbbe129fdf", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: fc6091612896435786aa0a2e0175ca50 Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '5da91278-1062-478f-ba11-aec4f51d7812'} Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:38:57.954696 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Returning 404 to user: Instance 5da91278-1062-478f-ba11-aec4f51d7812 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fcefd76d-2ace-4a1d-a50c-5a5b20cc1f53 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812" status: 404 len: 111 microversion: 2.1 time: 0.033220 Oct 19 07:38:57.963143 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3194/6539] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:38:57 2022] GET /compute/v2.1/servers/5da91278-1062-478f-ba11-aec4f51d7812 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:39:01.316298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:01.316806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:01.324633 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:01.325127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:01.325572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:01.326267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:01.326726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:01.327186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:01.341467 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] HTTP exception thrown: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Request method failure captured: Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 HTTP/1.1 Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6hWIjfPKFW5wwKzlFBuFSeYvSqdLsc0FWDcq-IyaWX5-LiuTR-jQiwqXiSp3l8MfWCejcGfbsz0E8DGpV3jiPaaIolRc7_0VCuGh23D5-7X9QyXZ-jVpe2Lb0tQklQLJcC9TUCXWcdDTN24yYZ692KxFeHu02DZkWDZdPj7NNmc2ns Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35f47d27c9eb471384aedcdbbe129fdf", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: fc6091612896435786aa0a2e0175ca50 Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '34cee2a4-025b-4d83-8581-a4dc2c081418'} Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:39:01.343029 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Returning 404 to user: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f833299-1562-495b-a2dc-a8d0f72d8af6 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 404 len: 111 microversion: 2.1 time: 0.032184 Oct 19 07:39:01.347079 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3346/6540] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:39:01 2022] DELETE /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:39:01.353637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:01.354269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] [instance: 34cee2a4-025b-4d83-8581-a4dc2c081418] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:01.361159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:01.361660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:01.362116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:01.362823 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:01.363297 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:01.363740 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:01.377207 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] HTTP exception thrown: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Request method failure captured: Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 HTTP/1.1 Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6hWIjfPKFW5wwKzlFBuFSeYvSqdLsc0FWDcq-IyaWX5-LiuTR-jQiwqXiSp3l8MfWCejcGfbsz0E8DGpV3jiPaaIolRc7_0VCuGh23D5-7X9QyXZ-jVpe2Lb0tQklQLJcC9TUCXWcdDTN24yYZ692KxFeHu02DZkWDZdPj7NNmc2ns Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/35f47d27c9eb471384aedcdbbe129fdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_35f47d27c9eb471384aedcdbbe129fdf", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 35f47d27c9eb471384aedcdbbe129fdf Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeTestJSON-192163850 Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: fc6091612896435786aa0a2e0175ca50 Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeTestJSON-192163850-project Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '34cee2a4-025b-4d83-8581-a4dc2c081418'} Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:01.379210 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] Returning 404 to user: Instance 34cee2a4-025b-4d83-8581-a4dc2c081418 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f38a4ba2-dd27-4afb-bc49-8278ce09d721 tempest-AttachVolumeTestJSON-192163850 tempest-AttachVolumeTestJSON-192163850-project] 10.222.0.39 "GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418" status: 404 len: 111 microversion: 2.1 time: 0.031193 Oct 19 07:39:01.383511 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3195/6541] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:01 2022] GET /compute/v2.1/servers/34cee2a4-025b-4d83-8581-a4dc2c081418 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:39:08.773268 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:08.773993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:08.774453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a441ac91-4277-4d29-b355-07a0f423b652 req-b6e7bfe6-782a-4775-98c1-291164428fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f99749-30d5-42e6-81ea-98f6ca0886fd", "tag": "9c7adcb6-4759-4b96-97d6-0aa74283cf11"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:39:08.780813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:39:08.781928 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:39:08.783518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:08.784077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:08.784584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:08.786070 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:08.786601 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:08.787046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:08.789355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a441ac91-4277-4d29-b355-07a0f423b652 req-b6e7bfe6-782a-4775-98c1-291164428fc4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:08.789976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a441ac91-4277-4d29-b355-07a0f423b652 req-b6e7bfe6-782a-4775-98c1-291164428fc4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:08.790595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a441ac91-4277-4d29-b355-07a0f423b652 req-b6e7bfe6-782a-4775-98c1-291164428fc4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:08.793805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:39:08.803891 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a441ac91-4277-4d29-b355-07a0f423b652 req-b6e7bfe6-782a-4775-98c1-291164428fc4 service nova] Creating event network-changed:9c7adcb6-4759-4b96-97d6-0aa74283cf11 for instance 16f99749-30d5-42e6-81ea-98f6ca0886fd on n-h1-861333-10 Oct 19 07:39:08.809595 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a441ac91-4277-4d29-b355-07a0f423b652 req-b6e7bfe6-782a-4775-98c1-291164428fc4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038990 Oct 19 07:39:08.810693 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3196/6542] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:39:08.842063 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:39:09.266915 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7735590a-6582-403b-abcd-8d02994e2a3b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 204 len: 0 microversion: 2.1 time: 0.501764 Oct 19 07:39:09.267739 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3347/6543] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:39:08 2022] DELETE /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:39:09.278477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:09.279500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:09.288594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:09.289403 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:09.290091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:09.291056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:09.291804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:09.292497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:09.452426 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:09.461089 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e1c7767-45e2-4e2f-a21b-175c8bc24d41 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1577 microversion: 2.1 time: 0.187219 Oct 19 07:39:09.461692 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3197/6544] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:09 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:10.486922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:10.489075 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:10.497285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:10.498119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:10.498807 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:10.499753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:10.500489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:10.501150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:10.721273 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:10.729780 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df51374e-8f3e-4c0f-83d1-f901c1f2fe26 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1577 microversion: 2.1 time: 0.248353 Oct 19 07:39:10.730360 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3348/6545] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:10 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1577 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:11.615232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0d27432c-c9d5-45c3-8734-4e049097d0a3 req-4446056c-23ee-4385-a754-41e0fc9314b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f99749-30d5-42e6-81ea-98f6ca0886fd", "name": "network-vif-deleted", "tag": "9c7adcb6-4759-4b96-97d6-0aa74283cf11"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:39:11.627269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0d27432c-c9d5-45c3-8734-4e049097d0a3 req-4446056c-23ee-4385-a754-41e0fc9314b5 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:11.627880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0d27432c-c9d5-45c3-8734-4e049097d0a3 req-4446056c-23ee-4385-a754-41e0fc9314b5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:11.628831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0d27432c-c9d5-45c3-8734-4e049097d0a3 req-4446056c-23ee-4385-a754-41e0fc9314b5 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:11.642328 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0d27432c-c9d5-45c3-8734-4e049097d0a3 req-4446056c-23ee-4385-a754-41e0fc9314b5 service nova] Creating event network-vif-deleted:9c7adcb6-4759-4b96-97d6-0aa74283cf11 for instance 16f99749-30d5-42e6-81ea-98f6ca0886fd on n-h1-861333-10 Oct 19 07:39:11.647797 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0d27432c-c9d5-45c3-8734-4e049097d0a3 req-4446056c-23ee-4385-a754-41e0fc9314b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037983 Oct 19 07:39:11.648776 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3198/6546] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:39:11.756096 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:11.756867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:11.764490 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:11.764993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:11.765438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:11.766487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:11.767163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:11.767629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:11.867458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:11.881137 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-919b5952-b1a0-4045-b5e2-a74653a37695 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1225 microversion: 2.1 time: 0.130888 Oct 19 07:39:11.882507 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3349/6547] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:11 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:12.908813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:12.910107 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:12.923447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:12.924349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:12.925717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:12.926658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:12.927336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:12.927930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:13.030398 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:13.044226 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7aacd82d-217d-4933-ae51-493ace93a1cc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1225 microversion: 2.1 time: 0.141927 Oct 19 07:39:13.044903 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3199/6548] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:12 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:13.511939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f1906f2-a06e-4680-9013-f33e3e50df11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: .version_select at 0x7f6d64fb3550>, body: {"keypair": {"name": "tempest-keypair-975608045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGJI4Cv+hdGnNdtdqHmYYtPWLXoA6gNru9uOhfZgsiLiszdvVA58m1XSI4EGXhRcYonvgbPz1KbC18PO5MKK0RmJDqsFO7NC0g3dbuus2YbNBMBQjR7mP8ye1B/3bqLcQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:39:13.527836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0f1906f2-a06e-4680-9013-f33e3e50df11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:39:13.533858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0f1906f2-a06e-4680-9013-f33e3e50df11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for user 928241230e62461bab8c543cbc938870 and project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:39:13.642820 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f1906f2-a06e-4680-9013-f33e3e50df11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.260455 Oct 19 07:39:13.643441 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3350/6549] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:39:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:39:14.068096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:14.068748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:14.075696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:14.076233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:14.076877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:14.077597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:14.078070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:14.078519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:14.174734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:14.182032 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-514ec5da-0103-45ae-8cc6-78ac4c75d520 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1225 microversion: 2.1 time: 0.118092 Oct 19 07:39:14.182973 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3200/6550] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:14 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:15.207713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:15.216381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:15.237103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:15.238220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:15.238690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:15.239428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:15.239892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:15.244948 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:15.251644 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:39:15.381772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:15.402051 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77ddaac5-692e-4731-b882-538252a8de6b tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1225 microversion: 2.1 time: 0.200461 Oct 19 07:39:15.404001 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3351/6551] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:15 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1225 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:16.089651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1574540831", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a71953-c964-433c-bc19-fc5ecbaa8dff"}], "security_groups": [{"name": "tempest-securitygroup--844513764"}], "key_name": "tempest-keypair-975608045", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:39:16.248947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] validate_networks() for [('36a71953-c964-433c-bc19-fc5ecbaa8dff', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:39:16.430503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:16.431303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:16.441168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:16.445137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:16.446697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:16.448986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:16.450760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:16.451387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:16.558151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:16.568346 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0484d6d-80c4-4bd7-ba2d-b4ba48924753 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1225 microversion: 2.1 time: 0.145928 Oct 19 07:39:16.568941 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3352/6552] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:16 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:16.795504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:39:16.795955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:39:16.796498 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:39:16.796935 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:39:16.797379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:39:16.807452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:16.807991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:16.808483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:16.809236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:16.809707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:16.810295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:16.829751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:39:16.835585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for user 928241230e62461bab8c543cbc938870 and project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:39:16.850031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:39:16.853292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:39:16.998644 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef962c2c-1201-42e3-8b5d-9f374edd6784 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.913061 Oct 19 07:39:16.999615 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3201/6553] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:39:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:39:17.011920 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5cad568-b5b0-4d79-9bd7-2ba60579db2f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:17.012837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5cad568-b5b0-4d79-9bd7-2ba60579db2f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:17.077124 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5cad568-b5b0-4d79-9bd7-2ba60579db2f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:17.085605 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5cad568-b5b0-4d79-9bd7-2ba60579db2f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1241 microversion: 2.1 time: 0.077557 Oct 19 07:39:17.094169 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3353/6554] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:17 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:17.591106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:17.591768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:17.600364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:17.600880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:17.604179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:17.604179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:17.604179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:17.604179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:17.634308 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:17.634811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:17.637674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:17.637674 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lazy-loading 'fault' on Instance uuid 16f99749-30d5-42e6-81ea-98f6ca0886fd {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:39:17.680035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:17.688141 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff8f7426-efb3-48ae-916e-d962a0e64d03 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 200 len: 1230 microversion: 2.1 time: 0.101108 Oct 19 07:39:17.689478 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3202/6555] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:17 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:18.112919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02f9dcb3-76c0-46d8-a7a3-0e955597d63f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:18.113581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02f9dcb3-76c0-46d8-a7a3-0e955597d63f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:18.170058 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02f9dcb3-76c0-46d8-a7a3-0e955597d63f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:18.177773 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02f9dcb3-76c0-46d8-a7a3-0e955597d63f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1241 microversion: 2.1 time: 0.068856 Oct 19 07:39:18.178337 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3354/6556] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:18 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:18.711888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:18.712586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 16f99749-30d5-42e6-81ea-98f6ca0886fd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:18.719509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:18.720018 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:18.720508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:18.721252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:18.722238 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:18.722717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:18.736509 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance 16f99749-30d5-42e6-81ea-98f6ca0886fd could not be found. Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd HTTP/1.1 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 16f99749-30d5-42e6-81ea-98f6ca0886fd could not be found. Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '16f99749-30d5-42e6-81ea-98f6ca0886fd'} Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f99749-30d5-42e6-81ea-98f6ca0886fd could not be found. Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f99749-30d5-42e6-81ea-98f6ca0886fd could not be found. Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:18.738787 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f99749-30d5-42e6-81ea-98f6ca0886fd could not be found. Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance 16f99749-30d5-42e6-81ea-98f6ca0886fd could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eea10a70-b77c-47bb-827d-71eaba1bf1dc tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd" status: 404 len: 111 microversion: 2.1 time: 0.032275 Oct 19 07:39:18.743418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3203/6557] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:18 2022] GET /compute/v2.1/servers/16f99749-30d5-42e6-81ea-98f6ca0886fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:39:19.210637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:19.210637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:19.210637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:19.210637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:19.210637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:19.211390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:19.211390 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:19.211627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:19.280912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:19.289190 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-adde4d1e-086e-49e3-9c5b-1c9cbe3a4e7a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1293 microversion: 2.1 time: 0.092683 Oct 19 07:39:19.289779 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3355/6558] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:19 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:20.315151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:20.316276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:20.323997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:20.324631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:20.325162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:20.326004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:20.326547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:20.327086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:20.715164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:20.725560 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ff9db69-39b4-4691-ab01-d60dbe5bdfd3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1366 microversion: 2.1 time: 0.414302 Oct 19 07:39:20.726441 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3204/6559] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:20 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:21.613980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d53cf5a2-560e-46fc-9090-3e9cdf1efadf req-2803493a-1e19-4ca0-ae6e-4cd684bd09db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "641f21cd-d9f9-494b-b220-a12313087ff0", "tag": "a117fd07-2534-402a-a919-aea6f348fbf5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:39:21.624906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d53cf5a2-560e-46fc-9090-3e9cdf1efadf req-2803493a-1e19-4ca0-ae6e-4cd684bd09db service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:21.625466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d53cf5a2-560e-46fc-9090-3e9cdf1efadf req-2803493a-1e19-4ca0-ae6e-4cd684bd09db service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:21.625880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d53cf5a2-560e-46fc-9090-3e9cdf1efadf req-2803493a-1e19-4ca0-ae6e-4cd684bd09db service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:21.638223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d53cf5a2-560e-46fc-9090-3e9cdf1efadf req-2803493a-1e19-4ca0-ae6e-4cd684bd09db service nova] Creating event network-changed:a117fd07-2534-402a-a919-aea6f348fbf5 for instance 641f21cd-d9f9-494b-b220-a12313087ff0 on n-h1-861333-10 Oct 19 07:39:21.644268 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d53cf5a2-560e-46fc-9090-3e9cdf1efadf req-2803493a-1e19-4ca0-ae6e-4cd684bd09db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033353 Oct 19 07:39:21.645007 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3356/6560] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:39:21.749414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:21.750816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:21.759244 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:21.760191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:21.760877 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:21.761738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:21.762272 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:21.762917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:21.988066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:21.995737 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0ce460c-7267-46f2-bf3e-cfa64ff7532f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1366 microversion: 2.1 time: 0.250633 Oct 19 07:39:21.996764 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3205/6561] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:21 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:23.022349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:23.024621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:23.036081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:23.036900 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:23.038260 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:23.039180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:23.039996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:23.041984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:23.191966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:23.202309 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c8cb274-d083-4183-bfed-443f0a4d6b0e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1366 microversion: 2.1 time: 0.185969 Oct 19 07:39:23.203891 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3357/6562] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:23 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:24.226838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:24.227465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:24.233609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:24.234110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:24.234563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:24.235274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:24.235743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:24.236208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:24.369681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:24.378580 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bf67281-e1e0-45ae-99ef-615843c065b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1366 microversion: 2.1 time: 0.155306 Oct 19 07:39:24.379176 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3206/6563] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:24 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:25.401652 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:25.402271 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:25.409888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:25.410382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:25.410825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:25.411725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:25.412377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:25.412815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:25.654982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:25.655944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:25.658541 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:25.664468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:25.665413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:25.665885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:25.666654 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d00aadf1-3332-4e6f-bb55-3de33941ab5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1366 microversion: 2.1 time: 0.268854 Oct 19 07:39:25.666784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:25.667259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:25.667386 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3358/6564] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:25 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:25.667981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:25.699048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:39:25.736954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-43c7f1b5-ec6b-4a58-97a7-1b43177dfc76 req-3a233bb7-26c0-4003-a3a5-cf7153b2c18e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c569e8ed-b0d2-45c2-acf2-90e6ade778f2", "tag": "f5ae13a7-1dae-4772-9d50-b07494b02bc8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:39:25.747594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-43c7f1b5-ec6b-4a58-97a7-1b43177dfc76 req-3a233bb7-26c0-4003-a3a5-cf7153b2c18e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:25.748200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-43c7f1b5-ec6b-4a58-97a7-1b43177dfc76 req-3a233bb7-26c0-4003-a3a5-cf7153b2c18e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:25.748726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-43c7f1b5-ec6b-4a58-97a7-1b43177dfc76 req-3a233bb7-26c0-4003-a3a5-cf7153b2c18e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:25.761558 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-43c7f1b5-ec6b-4a58-97a7-1b43177dfc76 req-3a233bb7-26c0-4003-a3a5-cf7153b2c18e service nova] Creating event network-changed:f5ae13a7-1dae-4772-9d50-b07494b02bc8 for instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 on n-h2-861333-10 Oct 19 07:39:25.767121 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-43c7f1b5-ec6b-4a58-97a7-1b43177dfc76 req-3a233bb7-26c0-4003-a3a5-cf7153b2c18e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098628 Oct 19 07:39:25.767847 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3359/6565] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:39:26.014306 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb553e90-994a-4a4e-ae47-31c82359f83d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 204 len: 0 microversion: 2.1 time: 0.362967 Oct 19 07:39:26.015377 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3207/6566] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:39:25 2022] DELETE /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:39:26.024757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:26.025598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:26.032195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:26.032850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:26.033285 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:26.034761 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:26.035252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:26.035686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:26.172371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:26.180847 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7def5f8-e807-47a0-bd96-939fa378eb3e tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1577 microversion: 2.1 time: 0.160342 Oct 19 07:39:26.181629 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3360/6567] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:26 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:26.690696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:26.691451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:26.698305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:26.698805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:26.699255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:26.699962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:26.700457 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:26.700899 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:26.820131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:39:26.843316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:39:26.933546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:26.943918 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abe7471e-6b96-4a87-a2a0-48856d6ae7cc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1366 microversion: 2.1 time: 0.256579 Oct 19 07:39:26.943918 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3208/6568] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:26 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:27.132537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-20e4e0d6-83e5-46a5-a2f5-bd98a1ef4dd1 req-4500f596-ca9e-4199-bea1-b691a43c97fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "641f21cd-d9f9-494b-b220-a12313087ff0", "name": "network-vif-plugged", "status": "completed", "tag": "a117fd07-2534-402a-a919-aea6f348fbf5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:39:27.142612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20e4e0d6-83e5-46a5-a2f5-bd98a1ef4dd1 req-4500f596-ca9e-4199-bea1-b691a43c97fa service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:27.143252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20e4e0d6-83e5-46a5-a2f5-bd98a1ef4dd1 req-4500f596-ca9e-4199-bea1-b691a43c97fa service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:27.144458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20e4e0d6-83e5-46a5-a2f5-bd98a1ef4dd1 req-4500f596-ca9e-4199-bea1-b691a43c97fa service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:27.156635 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-20e4e0d6-83e5-46a5-a2f5-bd98a1ef4dd1 req-4500f596-ca9e-4199-bea1-b691a43c97fa service nova] Creating event network-vif-plugged:a117fd07-2534-402a-a919-aea6f348fbf5 for instance 641f21cd-d9f9-494b-b220-a12313087ff0 on n-h1-861333-10 Oct 19 07:39:27.162993 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-20e4e0d6-83e5-46a5-a2f5-bd98a1ef4dd1 req-4500f596-ca9e-4199-bea1-b691a43c97fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104098 Oct 19 07:39:27.163917 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3361/6569] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:39:27.204918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:27.209263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:27.213215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:27.213956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:27.214409 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:27.215173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:27.215842 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:27.216312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:27.329555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:27.337940 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e89ee9a3-b330-43fe-9f79-372912ae3c72 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1391 microversion: 2.1 time: 0.136911 Oct 19 07:39:27.350088 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3209/6570] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:27 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1391 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:27.411524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-81ce1779-0fb5-4530-a677-bed98fd3e435 req-a366c411-c72f-419e-b3b4-eb0175f43dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c569e8ed-b0d2-45c2-acf2-90e6ade778f2", "name": "network-vif-deleted", "tag": "f5ae13a7-1dae-4772-9d50-b07494b02bc8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:39:27.421570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-81ce1779-0fb5-4530-a677-bed98fd3e435 req-a366c411-c72f-419e-b3b4-eb0175f43dd7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:27.424071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-81ce1779-0fb5-4530-a677-bed98fd3e435 req-a366c411-c72f-419e-b3b4-eb0175f43dd7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:27.424071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-81ce1779-0fb5-4530-a677-bed98fd3e435 req-a366c411-c72f-419e-b3b4-eb0175f43dd7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:27.434242 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-81ce1779-0fb5-4530-a677-bed98fd3e435 req-a366c411-c72f-419e-b3b4-eb0175f43dd7 service nova] Creating event network-vif-deleted:f5ae13a7-1dae-4772-9d50-b07494b02bc8 for instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 on n-h2-861333-10 Oct 19 07:39:27.439153 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-81ce1779-0fb5-4530-a677-bed98fd3e435 req-a366c411-c72f-419e-b3b4-eb0175f43dd7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 Oct 19 07:39:27.439754 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3362/6571] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:39:27.966312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:27.966835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:27.973929 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:27.974455 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:27.974912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:27.975620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:27.976086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:27.976551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:28.110745 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:28.119132 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e70ddb1b-6bfc-48b2-ae8b-d8f237c7c562 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1366 microversion: 2.1 time: 0.156889 Oct 19 07:39:28.119707 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3210/6572] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:27 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:28.360411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:39:28.365136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:28.365861 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:28.373685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:28.374186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:28.374634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:28.375698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:28.375793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:28.376234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:28.454451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:28.462644 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4ab1573-bf4c-4891-9d29-d52271e3e5a1 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1226 microversion: 2.1 time: 0.103685 Oct 19 07:39:28.463554 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3363/6573] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:28 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:29.142706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:29.143388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:29.150760 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:29.151337 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:29.151797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:29.152552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:29.153028 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:29.153474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:29.291544 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:29.299931 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-83e01dbf-7818-4cc3-bf99-b3cde55ad3b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1557 microversion: 2.1 time: 0.160614 Oct 19 07:39:29.300531 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3211/6574] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:29 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:29.322176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-219964cb-dd91-47dd-9819-e61aedbb51d0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:29.322677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-219964cb-dd91-47dd-9819-e61aedbb51d0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:29.328916 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219964cb-dd91-47dd-9819-e61aedbb51d0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:29.329354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219964cb-dd91-47dd-9819-e61aedbb51d0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:29.329799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219964cb-dd91-47dd-9819-e61aedbb51d0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:29.330536 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219964cb-dd91-47dd-9819-e61aedbb51d0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:29.331002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219964cb-dd91-47dd-9819-e61aedbb51d0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:29.331434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219964cb-dd91-47dd-9819-e61aedbb51d0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:29.410142 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-219964cb-dd91-47dd-9819-e61aedbb51d0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091834 Oct 19 07:39:29.411150 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3364/6575] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:39:29 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:39:29.487129 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:29.487949 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:29.494205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:29.494771 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:29.495225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:29.495947 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:29.496647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:29.497265 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:29.572005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:29.580888 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c2d056c-b018-4a97-83fd-b5b220f69878 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1226 microversion: 2.1 time: 0.098013 Oct 19 07:39:29.594741 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3212/6576] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:29 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:30.432858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2d94c300-165e-4e94-9f57-955fce339d77 req-1c100edf-eb82-41f1-a61a-49479dd9e76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "641f21cd-d9f9-494b-b220-a12313087ff0", "tag": "a117fd07-2534-402a-a919-aea6f348fbf5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:39:30.443924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2d94c300-165e-4e94-9f57-955fce339d77 req-1c100edf-eb82-41f1-a61a-49479dd9e76a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:30.444804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2d94c300-165e-4e94-9f57-955fce339d77 req-1c100edf-eb82-41f1-a61a-49479dd9e76a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:30.445252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2d94c300-165e-4e94-9f57-955fce339d77 req-1c100edf-eb82-41f1-a61a-49479dd9e76a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:30.458613 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2d94c300-165e-4e94-9f57-955fce339d77 req-1c100edf-eb82-41f1-a61a-49479dd9e76a service nova] Creating event network-changed:a117fd07-2534-402a-a919-aea6f348fbf5 for instance 641f21cd-d9f9-494b-b220-a12313087ff0 on n-h1-861333-10 Oct 19 07:39:30.463624 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2d94c300-165e-4e94-9f57-955fce339d77 req-1c100edf-eb82-41f1-a61a-49479dd9e76a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035361 Oct 19 07:39:30.464498 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3365/6577] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:39:30.603229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:30.603865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:30.610941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:30.612239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:30.612898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:30.614625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:30.615294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:30.615911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:30.632449 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:39:30.688281 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:30.695156 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be20fcd3-0b66-4e30-a81f-73d5325a3784 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1226 microversion: 2.1 time: 0.095386 Oct 19 07:39:30.708984 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3213/6578] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:30 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:31.720504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:31.721209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:31.727401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:31.727888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:31.728354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:31.729049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:31.729505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:31.729936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:31.796873 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221b692fdbb3495aa63a686796b02ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c707325eff4d6fb7b29c1cb2d53831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:39:31.805464 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6de227a-0418-4755-adab-bbeaaf2322e9 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 200 len: 1226 microversion: 2.1 time: 0.090218 Oct 19 07:39:31.806104 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3366/6579] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:31 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:39:32.829223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:32.829980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: c569e8ed-b0d2-45c2-acf2-90e6ade778f2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:32.838075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:32.838580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:32.839029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:32.839734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:32.840233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:32.840723 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:32.854948 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 could not be found. Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 HTTP/1.1 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 could not be found. Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'c569e8ed-b0d2-45c2-acf2-90e6ade778f2'} Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 could not be found. Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 could not be found. Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:32.856640 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 could not be found. Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance c569e8ed-b0d2-45c2-acf2-90e6ade778f2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21b0e942-b00d-47d2-afe1-fc068e315c4d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2" status: 404 len: 111 microversion: 2.1 time: 0.032844 Oct 19 07:39:32.861137 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3214/6580] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:32 2022] GET /compute/v2.1/servers/c569e8ed-b0d2-45c2-acf2-90e6ade778f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:39:33.364769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:33.365301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:33.372265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:33.372753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:33.373199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:33.373924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:33.374387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:33.374851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:33.388359 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca HTTP/1.1 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '24c62fd9-b571-436e-a5ba-2eda08e8c2ca'} Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:39:33.390020 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64f15ab2-4e83-4d22-90b8-0fbaf37bb8e0 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 404 len: 111 microversion: 2.1 time: 0.030749 Oct 19 07:39:33.395494 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3367/6581] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:39:33 2022] DELETE /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:39:33.400971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:33.401665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] [instance: 24c62fd9-b571-436e-a5ba-2eda08e8c2ca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:39:33.407840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:33.408365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:33.409419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:33.410121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:39:33.410591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:39:33.411033 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:39:33.424339 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] HTTP exception thrown: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Request method failure captured: Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca HTTP/1.1 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6YsZqGB05eHYl_vNqa3mm2HS7mmh8LhJJ9tz3AgWc3UUqpyRWx_HpCbnUDuGONJTAf7QLXTJl5VRaaocGkL2yZmJwQ3Wfk8plvU5N4PO4zUlHBgK1fvSBjKyTSWUKNkMNGihrlTSboS-kamzq60ob0ql2aD7K0yvlCMpm3xEUD22gM Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1c707325eff4d6fb7b29c1cb2d53831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1c707325eff4d6fb7b29c1cb2d53831", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: f1c707325eff4d6fb7b29c1cb2d53831 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-844697178 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 221b692fdbb3495aa63a686796b02ea8 Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-844697178-project Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '24c62fd9-b571-436e-a5ba-2eda08e8c2ca'} Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:39:33.426451 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Returning 404 to user: Instance 24c62fd9-b571-436e-a5ba-2eda08e8c2ca could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82f2c754-c489-4a59-b18e-2b2df2ed0341 tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca" status: 404 len: 111 microversion: 2.1 time: 0.030586 Oct 19 07:39:33.431097 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3215/6582] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:39:33 2022] GET /compute/v2.1/servers/24c62fd9-b571-436e-a5ba-2eda08e8c2ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:39:37.059264 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04c6af24-ac65-4050-bc8c-1cc2af22c02d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] Calling method '.version_select at 0x7f6d64e76a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:39:37.163871 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04c6af24-ac65-4050-bc8c-1cc2af22c02d tempest-TestVolumeBootPattern-844697178 tempest-TestVolumeBootPattern-844697178-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1510903324" status: 202 len: 0 microversion: 2.1 time: 0.108726 Oct 19 07:39:37.164431 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3368/6583] 10.222.0.39 () {58 vars in 1263 bytes} [Wed Oct 19 07:39:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1510903324 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:40:06.418309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02eb7bee-d459-4eda-aefd-d079afcca1d9 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:06.418847 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02eb7bee-d459-4eda-aefd-d079afcca1d9 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:06.421085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:40:06.421767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:40:06.427258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02eb7bee-d459-4eda-aefd-d079afcca1d9 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:06.427763 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02eb7bee-d459-4eda-aefd-d079afcca1d9 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:06.428263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02eb7bee-d459-4eda-aefd-d079afcca1d9 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:06.428979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02eb7bee-d459-4eda-aefd-d079afcca1d9 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:06.429473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02eb7bee-d459-4eda-aefd-d079afcca1d9 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:06.429923 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02eb7bee-d459-4eda-aefd-d079afcca1d9 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:06.453702 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02eb7bee-d459-4eda-aefd-d079afcca1d9 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/ips" status: 200 len: 151 microversion: 2.1 time: 0.040146 Oct 19 07:40:06.454310 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3216/6584] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:40:06 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:40:09.197713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=63 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:40:09.198478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:40:09.200622 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:40:09.200774 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:40:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments (ip 10.222.0.39) !!! Oct 19 07:40:09.205597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e296707b-12d7-4dea-947c-5de3a9386792 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1695835-0313-4f85-bdbf-16170e5b3180"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:40:09.207944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e296707b-12d7-4dea-947c-5de3a9386792 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:09.215636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e296707b-12d7-4dea-947c-5de3a9386792 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:09.216157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e296707b-12d7-4dea-947c-5de3a9386792 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:09.216606 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e296707b-12d7-4dea-947c-5de3a9386792 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:09.217316 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e296707b-12d7-4dea-947c-5de3a9386792 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:09.218082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e296707b-12d7-4dea-947c-5de3a9386792 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:09.218182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e296707b-12d7-4dea-947c-5de3a9386792 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:09.917238 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e296707b-12d7-4dea-947c-5de3a9386792 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721034 Oct 19 07:40:09.917851 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3369/6585] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:40:09 2022] POST /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:40:21.695325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dea84ea9-7522-4b72-9a3f-ddde4fb4f1dc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: .version_select at 0x7f6d64d46280>, body: {"keypair": {"name": "tempest-keypair-984751591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJCaRpCN1BuSmU9jlmFHxVUuOhHWSX3NBNKejgtJK7P0s2eOW3FSkaaJ5r1Jt6YZ2rVxdww68/iK/EY2i2IPDsbWhh6NYZ1AXHTTjbJ4NkKxf6Ezk41V4/SASjuNSTMVQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:40:21.713640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-dea84ea9-7522-4b72-9a3f-ddde4fb4f1dc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:40:21.719387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-dea84ea9-7522-4b72-9a3f-ddde4fb4f1dc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for user 928241230e62461bab8c543cbc938870 and project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:40:21.799429 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dea84ea9-7522-4b72-9a3f-ddde4fb4f1dc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108015 Oct 19 07:40:21.800033 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3217/6586] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:40:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:40:24.009858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:40:24.010778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:40:24.015913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1309665636", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a71953-c964-433c-bc19-fc5ecbaa8dff"}], "security_groups": [{"name": "tempest-securitygroup--445148290"}], "key_name": "tempest-keypair-984751591", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:40:24.118693 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] validate_networks() for [('36a71953-c964-433c-bc19-fc5ecbaa8dff', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:40:24.588909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:40:24.589338 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:40:24.589817 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:40:24.590234 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:40:24.590658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:40:24.599465 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:24.599949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:24.600431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:24.601170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:24.601632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:24.602061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:24.619006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:40:24.624819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for user 928241230e62461bab8c543cbc938870 and project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:40:24.637439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:40:24.639776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:40:24.757898 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-559d77ca-7889-444b-bf89-692c12fc5b6b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.750014 Oct 19 07:40:24.758554 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3370/6587] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:40:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:40:24.769914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f937ead-8f1f-474e-97dd-aafcc6d5f315 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:24.772332 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f937ead-8f1f-474e-97dd-aafcc6d5f315 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:24.829139 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f937ead-8f1f-474e-97dd-aafcc6d5f315 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:24.837760 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f937ead-8f1f-474e-97dd-aafcc6d5f315 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1241 microversion: 2.1 time: 0.071747 Oct 19 07:40:24.838800 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3218/6588] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:24 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:25.861953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:25.862498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:25.869626 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:25.870118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:25.874283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:25.874283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:25.874283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:25.874283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:25.938203 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:25.946096 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-603169bf-51a1-4a73-86ec-623b21c80a88 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1245 microversion: 2.1 time: 0.088163 Oct 19 07:40:25.946688 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3371/6589] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:25 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:26.970772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:26.971979 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:26.978985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:26.979636 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:26.980092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:26.981679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:26.982147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:26.982759 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:27.057975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:27.065889 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5b528b1c-c40f-4aa5-9aca-36ea538483a8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1301 microversion: 2.1 time: 0.099675 Oct 19 07:40:27.066449 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3219/6590] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:26 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:28.088976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:28.090289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:28.097289 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:28.097780 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:28.098220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:28.098913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:28.099370 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:28.099799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:28.232046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:28.239935 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4934054-1f09-4bf6-a77f-d50655cf167e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1366 microversion: 2.1 time: 0.154876 Oct 19 07:40:28.240533 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3372/6591] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:28 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:28.639019 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5f5f48b5-fef8-4bc1-853a-a813876edbf1 req-3a2d5782-4a72-48b5-983e-3812b513639d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6aa586-723f-45b1-a6a4-791e7a093735", "tag": "5a3e28a5-4dba-42a7-bbe0-1c01665473d1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:40:28.649504 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5f5f48b5-fef8-4bc1-853a-a813876edbf1 req-3a2d5782-4a72-48b5-983e-3812b513639d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:28.655026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5f5f48b5-fef8-4bc1-853a-a813876edbf1 req-3a2d5782-4a72-48b5-983e-3812b513639d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:28.655026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5f5f48b5-fef8-4bc1-853a-a813876edbf1 req-3a2d5782-4a72-48b5-983e-3812b513639d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:28.661491 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5f5f48b5-fef8-4bc1-853a-a813876edbf1 req-3a2d5782-4a72-48b5-983e-3812b513639d service nova] Creating event network-changed:5a3e28a5-4dba-42a7-bbe0-1c01665473d1 for instance af6aa586-723f-45b1-a6a4-791e7a093735 on n-h2-861333-10 Oct 19 07:40:28.666525 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5f5f48b5-fef8-4bc1-853a-a813876edbf1 req-3a2d5782-4a72-48b5-983e-3812b513639d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Oct 19 07:40:28.667273 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3220/6592] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:40:29.268037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:29.268703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:29.275640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:29.276164 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:29.276613 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:29.277833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:29.278300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:29.278739 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:29.412301 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:29.420921 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bdfca52-ccb4-48b0-9a0e-cea182bc62aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1366 microversion: 2.1 time: 0.157388 Oct 19 07:40:29.421501 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3373/6593] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:29 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:30.444705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:30.445410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:30.451648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:30.452170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:30.452620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:30.453316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:30.453780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:30.454218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:30.587246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:30.594919 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-05340a5d-6f99-4912-8542-9290f9b059b2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1366 microversion: 2.1 time: 0.155281 Oct 19 07:40:30.595486 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3221/6594] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:30 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:31.618357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:31.618976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:31.626480 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:31.626903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:31.627346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:31.628047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:31.628530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:31.629223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:31.761031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:31.769514 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a5fed3d-b5be-4873-bd71-1a29d68000de tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1366 microversion: 2.1 time: 0.155111 Oct 19 07:40:31.770035 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3374/6595] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:31 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:32.792383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:32.793146 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:32.799996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:32.800533 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:32.800987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:32.801710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:32.802177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:32.802620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:32.934134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:32.941896 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9be751c2-f787-4ba8-a2e4-41a077d495a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1366 microversion: 2.1 time: 0.153485 Oct 19 07:40:32.942486 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3222/6596] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:32 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:33.575005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-753308ac-e196-4a6f-8f53-06e251f9d65a req-28c4012f-11d4-4ca3-bef6-d1a7d847db60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6aa586-723f-45b1-a6a4-791e7a093735", "name": "network-vif-plugged", "status": "completed", "tag": "5a3e28a5-4dba-42a7-bbe0-1c01665473d1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:40:33.585351 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-753308ac-e196-4a6f-8f53-06e251f9d65a req-28c4012f-11d4-4ca3-bef6-d1a7d847db60 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:33.585830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-753308ac-e196-4a6f-8f53-06e251f9d65a req-28c4012f-11d4-4ca3-bef6-d1a7d847db60 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:33.586265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-753308ac-e196-4a6f-8f53-06e251f9d65a req-28c4012f-11d4-4ca3-bef6-d1a7d847db60 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:33.597138 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-753308ac-e196-4a6f-8f53-06e251f9d65a req-28c4012f-11d4-4ca3-bef6-d1a7d847db60 service nova] Creating event network-vif-plugged:5a3e28a5-4dba-42a7-bbe0-1c01665473d1 for instance af6aa586-723f-45b1-a6a4-791e7a093735 on n-h2-861333-10 Oct 19 07:40:33.602058 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-753308ac-e196-4a6f-8f53-06e251f9d65a req-28c4012f-11d4-4ca3-bef6-d1a7d847db60 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 Oct 19 07:40:33.602639 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3375/6597] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:40:33.965795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:33.966320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:33.973144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:33.973647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:33.974096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:33.974801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:33.975275 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:33.975717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:34.107728 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:34.115579 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bec20990-db52-4396-aee8-60fe37a50bc3 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1366 microversion: 2.1 time: 0.154338 Oct 19 07:40:34.116174 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3223/6598] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:33 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:35.137004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:40:35.137897 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:40:35.141980 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:35.143811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:35.149113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:35.149762 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:35.150205 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:35.151081 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:35.151543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:35.151972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:35.297665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:40:35.305552 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2d9768c-98e1-4f8b-9b32-fe4c034108cb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1556 microversion: 2.1 time: 0.170389 Oct 19 07:40:35.306129 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3376/6599] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:40:35 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:40:35.327401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f4707fb-3bfb-497b-9001-cdadeed85f87 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:40:35.327912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f4707fb-3bfb-497b-9001-cdadeed85f87 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:40:35.329880 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:40:35.335546 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4707fb-3bfb-497b-9001-cdadeed85f87 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:35.336046 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4707fb-3bfb-497b-9001-cdadeed85f87 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:35.340276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4707fb-3bfb-497b-9001-cdadeed85f87 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:35.340276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4707fb-3bfb-497b-9001-cdadeed85f87 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:35.340276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4707fb-3bfb-497b-9001-cdadeed85f87 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:35.340276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f4707fb-3bfb-497b-9001-cdadeed85f87 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:35.416558 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f4707fb-3bfb-497b-9001-cdadeed85f87 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092895 Oct 19 07:40:35.417302 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3224/6600] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:40:35 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:40:36.676217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7f071a0c-6262-44dc-8c23-5ae5f595f405 req-62dab75f-b6ed-44e0-b997-77a1c126b461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6aa586-723f-45b1-a6a4-791e7a093735", "tag": "5a3e28a5-4dba-42a7-bbe0-1c01665473d1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:40:36.687334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7f071a0c-6262-44dc-8c23-5ae5f595f405 req-62dab75f-b6ed-44e0-b997-77a1c126b461 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:40:36.687894 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7f071a0c-6262-44dc-8c23-5ae5f595f405 req-62dab75f-b6ed-44e0-b997-77a1c126b461 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:40:36.688429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7f071a0c-6262-44dc-8c23-5ae5f595f405 req-62dab75f-b6ed-44e0-b997-77a1c126b461 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:40:36.699366 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7f071a0c-6262-44dc-8c23-5ae5f595f405 req-62dab75f-b6ed-44e0-b997-77a1c126b461 service nova] Creating event network-changed:5a3e28a5-4dba-42a7-bbe0-1c01665473d1 for instance af6aa586-723f-45b1-a6a4-791e7a093735 on n-h2-861333-10 Oct 19 07:40:36.704325 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7f071a0c-6262-44dc-8c23-5ae5f595f405 req-62dab75f-b6ed-44e0-b997-77a1c126b461 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Oct 19 07:40:36.705096 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3377/6601] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:12.600513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:12.601390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=34 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:12.605439 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72acc614-154f-42f8-b5fa-03435c0f9100 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:12.605953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72acc614-154f-42f8-b5fa-03435c0f9100 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:12.611802 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72acc614-154f-42f8-b5fa-03435c0f9100 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:12.624213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72acc614-154f-42f8-b5fa-03435c0f9100 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:12.624213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72acc614-154f-42f8-b5fa-03435c0f9100 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:12.624213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72acc614-154f-42f8-b5fa-03435c0f9100 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:12.624213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72acc614-154f-42f8-b5fa-03435c0f9100 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:12.624213 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72acc614-154f-42f8-b5fa-03435c0f9100 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:12.638365 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72acc614-154f-42f8-b5fa-03435c0f9100 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735/ips" status: 200 len: 150 microversion: 2.1 time: 0.039675 Oct 19 07:41:12.639596 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3225/6602] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:41:12 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:12.649537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:12.650288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=36 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:12.654569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1695835-0313-4f85-bdbf-16170e5b3180"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:41:12.657174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:12.663174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:12.663656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:12.664090 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:12.664803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:12.665252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:12.665677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:12.925725 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Invalid volume: volume c1695835-0313-4f85-bdbf-16170e5b3180 is already attached to instances: 641f21cd-d9f9-494b-b220-a12313087ff0 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735/os-volume_attachments HTTP/1.1 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 74 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: {"volumeAttachment": {"volumeId": "c1695835-0313-4f85-bdbf-16170e5b3180"}} Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid volume: volume c1695835-0313-4f85-bdbf-16170e5b3180 is already attached to instances: 641f21cd-d9f9-494b-b220-a12313087ff0 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': 'af6aa586-723f-45b1-a6a4-791e7a093735', 'body': {'volumeAttachment': {'volumeId': 'c1695835-0313-4f85-bdbf-16170e5b3180'}}} Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c1695835-0313-4f85-bdbf-16170e5b3180 is already attached to instances: 641f21cd-d9f9-494b-b220-a12313087ff0 Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:41:12.927479 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c1695835-0313-4f85-bdbf-16170e5b3180 is already attached to instances: 641f21cd-d9f9-494b-b220-a12313087ff0 Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c1695835-0313-4f85-bdbf-16170e5b3180 is already attached to instances: 641f21cd-d9f9-494b-b220-a12313087ff0 Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 400 to user: Invalid volume: volume c1695835-0313-4f85-bdbf-16170e5b3180 is already attached to instances: 641f21cd-d9f9-494b-b220-a12313087ff0 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d79c281-3c65-4fa0-b81f-d68765686049 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.281589 Oct 19 07:41:12.931978 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3378/6603] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:41:12 2022] POST /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735/os-volume_attachments => generated 174 bytes in 283 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:41:12.938884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:12.939397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:12.945977 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:12.946477 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:12.946930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:12.947670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:12.948164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:12.954583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:12.974293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:41:13.216888 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-799f8886-c42e-4abf-8601-eee8c3925200 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 204 len: 0 microversion: 2.1 time: 0.282361 Oct 19 07:41:13.217421 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3226/6604] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:41:12 2022] DELETE /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:41:13.225770 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:13.226387 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:13.233892 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:13.234748 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:13.234868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:13.235495 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:13.235950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:13.236401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:13.366048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:13.374473 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15e5b1d5-2e15-4219-a801-cb3765b40edd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1681 microversion: 2.1 time: 0.152834 Oct 19 07:41:13.375057 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3379/6605] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:13 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:14.398664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:14.399389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:14.406742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:14.407249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:14.407705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:14.408445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:14.408921 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:14.409369 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:14.597752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:14.605518 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d15b7123-6ada-4daa-a73d-4aea76d2df05 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1681 microversion: 2.1 time: 0.211144 Oct 19 07:41:14.606090 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3227/6606] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:14 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:15.585450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8d70a28e-6b3c-4416-af0c-374530511d31 req-bb353d83-9f93-4e48-8ae9-b85982b43b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6aa586-723f-45b1-a6a4-791e7a093735", "name": "network-vif-deleted", "tag": "5a3e28a5-4dba-42a7-bbe0-1c01665473d1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:41:15.595805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8d70a28e-6b3c-4416-af0c-374530511d31 req-bb353d83-9f93-4e48-8ae9-b85982b43b0d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:15.596650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8d70a28e-6b3c-4416-af0c-374530511d31 req-bb353d83-9f93-4e48-8ae9-b85982b43b0d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:15.597097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8d70a28e-6b3c-4416-af0c-374530511d31 req-bb353d83-9f93-4e48-8ae9-b85982b43b0d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:15.609238 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8d70a28e-6b3c-4416-af0c-374530511d31 req-bb353d83-9f93-4e48-8ae9-b85982b43b0d service nova] Creating event network-vif-deleted:5a3e28a5-4dba-42a7-bbe0-1c01665473d1 for instance af6aa586-723f-45b1-a6a4-791e7a093735 on n-h2-861333-10 Oct 19 07:41:15.614371 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8d70a28e-6b3c-4416-af0c-374530511d31 req-bb353d83-9f93-4e48-8ae9-b85982b43b0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033110 Oct 19 07:41:15.614971 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3380/6607] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:15.631017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:15.631787 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:15.639173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:15.646765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:15.646765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:15.646765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:15.646765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:15.646765 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:15.711418 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:15.720648 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87e0ef72-101d-49a6-846b-10ff2cee658c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 200 len: 1614 microversion: 2.1 time: 0.093885 Oct 19 07:41:15.730493 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3228/6608] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:15 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:16.746402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:16.747043 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:16.754206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:16.754696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:16.755142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:16.755845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:16.756400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:16.756891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:16.771052 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 HTTP/1.1 Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'af6aa586-723f-45b1-a6a4-791e7a093735'} Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:41:16.772738 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af63a3fa-e215-4765-9a33-30687c0f1b4e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 404 len: 111 microversion: 2.1 time: 0.033049 Oct 19 07:41:16.777876 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3381/6609] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:16 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:41:16.783328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa18ec1c-b8b1-4681-b588-5e4bd8f526a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '.version_select at 0x7f6d5fa1c160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:16.875149 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa18ec1c-b8b1-4681-b588-5e4bd8f526a6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-984751591" status: 202 len: 0 microversion: 2.1 time: 0.095723 Oct 19 07:41:16.875763 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3229/6610] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 07:41:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-984751591 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:41:17.677960 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:17.678464 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:17.684458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:17.684949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:17.685392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:17.686110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:17.686574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:17.687002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:17.765433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lazy-loading 'services' on Instance uuid 641f21cd-d9f9-494b-b220-a12313087ff0 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:41:17.977045 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9ee8f50-64ef-4cfd-ac40-6235c0f12442 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments/c1695835-0313-4f85-bdbf-16170e5b3180" status: 202 len: 0 microversion: 2.1 time: 0.302781 Oct 19 07:41:17.977647 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3382/6611] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:41:17 2022] DELETE /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments/c1695835-0313-4f85-bdbf-16170e5b3180 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:41:17.990691 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b13e646-044d-425a-97f7-ca427bcf9808 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:17.992853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b13e646-044d-425a-97f7-ca427bcf9808 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:17.999295 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b13e646-044d-425a-97f7-ca427bcf9808 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:18.005282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b13e646-044d-425a-97f7-ca427bcf9808 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:18.005282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b13e646-044d-425a-97f7-ca427bcf9808 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:18.005282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b13e646-044d-425a-97f7-ca427bcf9808 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:18.005282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b13e646-044d-425a-97f7-ca427bcf9808 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:18.005282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b13e646-044d-425a-97f7-ca427bcf9808 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:18.031458 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b13e646-044d-425a-97f7-ca427bcf9808 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049450 Oct 19 07:41:18.032019 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3230/6612] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:41:17 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:19.043573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-749acfda-6098-4853-ba08-5ff7244450e5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:19.046501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-749acfda-6098-4853-ba08-5ff7244450e5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:19.053567 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749acfda-6098-4853-ba08-5ff7244450e5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:19.054048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749acfda-6098-4853-ba08-5ff7244450e5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:19.054487 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749acfda-6098-4853-ba08-5ff7244450e5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:19.055176 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749acfda-6098-4853-ba08-5ff7244450e5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:19.055668 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749acfda-6098-4853-ba08-5ff7244450e5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:19.056130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749acfda-6098-4853-ba08-5ff7244450e5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:19.087170 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-749acfda-6098-4853-ba08-5ff7244450e5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048000 Oct 19 07:41:19.087735 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3383/6613] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:41:19 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:20.099293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94323e3e-8fa8-4ec8-a6b2-bc72944fc1d7 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:20.101662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94323e3e-8fa8-4ec8-a6b2-bc72944fc1d7 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:20.108632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94323e3e-8fa8-4ec8-a6b2-bc72944fc1d7 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:20.109128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94323e3e-8fa8-4ec8-a6b2-bc72944fc1d7 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:20.109577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94323e3e-8fa8-4ec8-a6b2-bc72944fc1d7 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:20.110277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94323e3e-8fa8-4ec8-a6b2-bc72944fc1d7 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:20.110774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94323e3e-8fa8-4ec8-a6b2-bc72944fc1d7 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:20.111212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94323e3e-8fa8-4ec8-a6b2-bc72944fc1d7 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:20.142631 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94323e3e-8fa8-4ec8-a6b2-bc72944fc1d7 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047256 Oct 19 07:41:20.143082 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3231/6614] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:41:20 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:21.155636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00ed029d-c5f6-45bb-8c43-227a8df6dffd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:21.157979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00ed029d-c5f6-45bb-8c43-227a8df6dffd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:21.164866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00ed029d-c5f6-45bb-8c43-227a8df6dffd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:21.165341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00ed029d-c5f6-45bb-8c43-227a8df6dffd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:21.165779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00ed029d-c5f6-45bb-8c43-227a8df6dffd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:21.166471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00ed029d-c5f6-45bb-8c43-227a8df6dffd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:21.166932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00ed029d-c5f6-45bb-8c43-227a8df6dffd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:21.167359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00ed029d-c5f6-45bb-8c43-227a8df6dffd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:21.198082 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00ed029d-c5f6-45bb-8c43-227a8df6dffd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047076 Oct 19 07:41:21.198653 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3384/6615] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:41:21 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:22.210883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26376060-9af9-43a1-af0b-1b740172ca73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:22.213430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26376060-9af9-43a1-af0b-1b740172ca73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:22.220937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26376060-9af9-43a1-af0b-1b740172ca73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:22.221454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26376060-9af9-43a1-af0b-1b740172ca73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:22.221942 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26376060-9af9-43a1-af0b-1b740172ca73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:22.222686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26376060-9af9-43a1-af0b-1b740172ca73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:22.223162 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26376060-9af9-43a1-af0b-1b740172ca73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:22.223608 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26376060-9af9-43a1-af0b-1b740172ca73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:22.258210 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26376060-9af9-43a1-af0b-1b740172ca73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051474 Oct 19 07:41:22.258816 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3232/6616] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:41:22 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:23.271561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a71e6afb-f586-49a5-a51d-b4f08c61dd11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:23.274262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a71e6afb-f586-49a5-a51d-b4f08c61dd11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:23.282450 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a71e6afb-f586-49a5-a51d-b4f08c61dd11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:23.282940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a71e6afb-f586-49a5-a51d-b4f08c61dd11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:23.283462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a71e6afb-f586-49a5-a51d-b4f08c61dd11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:23.284194 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a71e6afb-f586-49a5-a51d-b4f08c61dd11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:23.284657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a71e6afb-f586-49a5-a51d-b4f08c61dd11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:23.285089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a71e6afb-f586-49a5-a51d-b4f08c61dd11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:23.316469 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a71e6afb-f586-49a5-a51d-b4f08c61dd11 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049341 Oct 19 07:41:23.316954 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3385/6617] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:41:23 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:41:23.380645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:23.382515 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:23.387841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:23.388372 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:23.389389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:23.390086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:23.390551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:23.390990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:23.415730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:41:23.738719 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-394cba89-0b56-4886-963f-7dd6ed9b1be8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 204 len: 0 microversion: 2.1 time: 0.361924 Oct 19 07:41:23.739245 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3233/6618] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:41:23 2022] DELETE /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:41:23.747605 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:23.752204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:23.754396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:23.754880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:23.755315 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:23.756003 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:23.756479 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:23.756907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:23.886722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:23.895025 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b40cb29-6dd4-430a-a037-4a6797781f2e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1682 microversion: 2.1 time: 0.151390 Oct 19 07:41:23.895593 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3386/6619] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:23 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:24.918721 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:24.919441 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:24.926212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:24.926709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:24.927160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:24.927863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:24.928368 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:24.928810 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:25.057860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:25.066427 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b0fe0cb-05a3-4cc6-8e46-0db983a713a5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1682 microversion: 2.1 time: 0.152000 Oct 19 07:41:25.067004 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3234/6620] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:24 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:26.088957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:26.089579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:26.096998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:26.097493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:26.097937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:26.098639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:26.099103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:26.099535 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:26.164813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:26.172753 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6bc196d-bec2-425c-82ff-50c20846d4ca tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1615 microversion: 2.1 time: 0.087710 Oct 19 07:41:26.173335 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3387/6621] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:26 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:26.332841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-290c8ade-420c-4fd8-8073-314597558584 req-57513a58-8d36-425e-845a-c8b49278ebc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "641f21cd-d9f9-494b-b220-a12313087ff0", "name": "network-vif-deleted", "tag": "a117fd07-2534-402a-a919-aea6f348fbf5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:41:26.342635 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-290c8ade-420c-4fd8-8073-314597558584 req-57513a58-8d36-425e-845a-c8b49278ebc6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:26.348040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-290c8ade-420c-4fd8-8073-314597558584 req-57513a58-8d36-425e-845a-c8b49278ebc6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:26.348040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-290c8ade-420c-4fd8-8073-314597558584 req-57513a58-8d36-425e-845a-c8b49278ebc6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:26.355143 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-290c8ade-420c-4fd8-8073-314597558584 req-57513a58-8d36-425e-845a-c8b49278ebc6 service nova] Creating event network-vif-deleted:a117fd07-2534-402a-a919-aea6f348fbf5 for instance 641f21cd-d9f9-494b-b220-a12313087ff0 on n-h1-861333-10 Oct 19 07:41:26.360506 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-290c8ade-420c-4fd8-8073-314597558584 req-57513a58-8d36-425e-845a-c8b49278ebc6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031520 Oct 19 07:41:26.361190 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3235/6622] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:41:27.197170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:27.198528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:27.206788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:27.207584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:27.208056 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:27.213659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:27.214151 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:27.214627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:27.251998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:27.252825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:27.253283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:27.254173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lazy-loading 'fault' on Instance uuid 641f21cd-d9f9-494b-b220-a12313087ff0 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:41:27.315661 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:27.323457 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09fc4a3b-9b18-4c04-9572-f95b6e26e6bd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 200 len: 1331 microversion: 2.1 time: 0.130163 Oct 19 07:41:27.324040 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3388/6623] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:27 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:28.348956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:28.349679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:28.356014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:28.356549 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:28.357558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:28.358255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:28.358729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:28.359173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:28.376097 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 HTTP/1.1 Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '641f21cd-d9f9-494b-b220-a12313087ff0'} Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:41:28.377754 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1de7210-3d0f-40cb-97f8-b07266463742 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 404 len: 111 microversion: 2.1 time: 0.035890 Oct 19 07:41:28.382725 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3236/6624] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:28 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:41:28.388473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86cd0a94-6956-4b04-91f0-ca7511a03273 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '.version_select at 0x7f6d64a4cca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:28.453544 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86cd0a94-6956-4b04-91f0-ca7511a03273 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-975608045" status: 202 len: 0 microversion: 2.1 time: 0.068933 Oct 19 07:41:28.454123 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3389/6625] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 07:41:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-975608045 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:41:29.203910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7dbd8467-01f7-4347-af49-93419a2de12f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: .version_select at 0x7f6d65088310>, body: {"keypair": {"name": "tempest-keypair-972649885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzswgTEbrFQUw5i5F2za1J1HY0MDwzCx2+MnK+vIzyzcz9TMeAHi2GtfrqPMNJvG8tJ5QBYmLVbzfE8M0Sg0usxiuAFNevuqlAsiymJdPprGlVjcCe1xifk/y1vtxCU7Q=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:41:29.219425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7dbd8467-01f7-4347-af49-93419a2de12f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:41:29.224973 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7dbd8467-01f7-4347-af49-93419a2de12f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for user 928241230e62461bab8c543cbc938870 and project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:41:29.317103 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7dbd8467-01f7-4347-af49-93419a2de12f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117726 Oct 19 07:41:29.317767 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3237/6626] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:41:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:41:31.541113 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1651846776", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a71953-c964-433c-bc19-fc5ecbaa8dff"}], "security_groups": [{"name": "tempest-securitygroup--1043997278"}], "key_name": "tempest-keypair-972649885", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:41:31.646820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] validate_networks() for [('36a71953-c964-433c-bc19-fc5ecbaa8dff', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:41:32.016189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:41:32.019647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:41:32.019647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:41:32.019647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:41:32.019647 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:41:32.027102 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:32.027685 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:32.028156 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:32.028882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:32.029335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:32.029789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:32.048146 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:41:32.053306 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for user 928241230e62461bab8c543cbc938870 and project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:41:32.066232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:41:32.068510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:41:32.174621 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb70b572-ee76-428d-951e-2a1581180692 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.637919 Oct 19 07:41:32.175288 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3390/6627] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:41:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:41:32.186558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0de0b0c6-1c10-4d60-b15c-fecae3d25ff0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:32.187888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0de0b0c6-1c10-4d60-b15c-fecae3d25ff0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:32.251187 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0de0b0c6-1c10-4d60-b15c-fecae3d25ff0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:32.258509 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0de0b0c6-1c10-4d60-b15c-fecae3d25ff0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1241 microversion: 2.1 time: 0.075810 Oct 19 07:41:32.259079 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3238/6628] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:32 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:33.281578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:33.282232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:33.289593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:33.290236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:33.290678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:33.291402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:33.291857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:33.292319 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:33.353105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:33.361457 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b230ee1-c559-420f-a875-92ad43b5819a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1245 microversion: 2.1 time: 0.083910 Oct 19 07:41:33.362032 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3391/6629] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:33 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:34.385091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:34.385738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:34.393413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:34.393912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:34.394362 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:34.395105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:34.395571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:34.396074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:34.473306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:34.481785 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60091a71-4f01-4580-9cdc-8970f14a2a9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1301 microversion: 2.1 time: 0.100700 Oct 19 07:41:34.482363 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3239/6630] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:34 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:35.505161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:35.506546 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:35.515092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:35.515584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:35.516050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:35.517363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:35.517823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:35.518282 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:35.654630 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:35.662979 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7173196-a6c7-4e2b-bf18-df138fab70e2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1367 microversion: 2.1 time: 0.162116 Oct 19 07:41:35.663564 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3392/6631] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:35 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:36.246317 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c198fd88-a67e-4a65-8446-469bc79beed0 req-80e0cdf3-24ec-4ce8-9061-1fb94505e69e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b32313b-9f64-494b-8d57-876c1b24ae74", "tag": "0d25864e-4502-4447-9efd-0a22ac0bf544"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:41:36.257567 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c198fd88-a67e-4a65-8446-469bc79beed0 req-80e0cdf3-24ec-4ce8-9061-1fb94505e69e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:36.262731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c198fd88-a67e-4a65-8446-469bc79beed0 req-80e0cdf3-24ec-4ce8-9061-1fb94505e69e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:36.262731 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c198fd88-a67e-4a65-8446-469bc79beed0 req-80e0cdf3-24ec-4ce8-9061-1fb94505e69e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:36.270381 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c198fd88-a67e-4a65-8446-469bc79beed0 req-80e0cdf3-24ec-4ce8-9061-1fb94505e69e service nova] Creating event network-changed:0d25864e-4502-4447-9efd-0a22ac0bf544 for instance 9b32313b-9f64-494b-8d57-876c1b24ae74 on n-h2-861333-10 Oct 19 07:41:36.275413 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c198fd88-a67e-4a65-8446-469bc79beed0 req-80e0cdf3-24ec-4ce8-9061-1fb94505e69e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032783 Oct 19 07:41:36.276229 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3240/6632] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:36.686166 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:36.686700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:36.693639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:36.694190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:36.694640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:36.695344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:36.695805 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:36.696266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:36.832790 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:36.840507 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d533d37e-7dce-4830-b12e-45550e2906fd tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1367 microversion: 2.1 time: 0.158384 Oct 19 07:41:36.841099 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3393/6633] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:36 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:37.865704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:37.866413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:37.872613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:37.873106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:37.873559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:37.874867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:37.875336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:37.875774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:38.008690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:38.016292 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c79bcb6-1625-4751-9560-99330de4aa32 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1367 microversion: 2.1 time: 0.155644 Oct 19 07:41:38.016855 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3241/6634] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:37 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:39.038910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:39.039526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:39.046429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:39.046917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:39.047367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:39.048065 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:39.048550 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:39.048982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:39.176224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:39.183986 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e720a01-b302-4d3d-ae4e-2b5a3faeafe5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1367 microversion: 2.1 time: 0.149039 Oct 19 07:41:39.184599 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3394/6635] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:39 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:40.206800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:40.207425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:40.214495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:40.215014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:40.215433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:40.216175 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:40.216651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:40.217095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:40.350217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:40.358766 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a1f8efa-d6a2-46ab-9e6c-82a063cbf9aa tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1367 microversion: 2.1 time: 0.155242 Oct 19 07:41:40.359350 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3242/6636] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:40 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:41.381086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:41.381696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:41.388521 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:41.389033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:41.390109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:41.390834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:41.391304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:41.391733 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:41.522395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:41.530113 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a63053f-372d-48ec-b46d-f23d49a1cb7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1367 microversion: 2.1 time: 0.153344 Oct 19 07:41:41.530681 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3395/6637] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:41 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:41.999249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-46a27576-71ad-4687-a62b-c670e1f44495 req-ab8b93bd-63b6-4d1b-96dc-05b02b328ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b32313b-9f64-494b-8d57-876c1b24ae74", "name": "network-vif-plugged", "status": "completed", "tag": "0d25864e-4502-4447-9efd-0a22ac0bf544"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:41:42.009945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46a27576-71ad-4687-a62b-c670e1f44495 req-ab8b93bd-63b6-4d1b-96dc-05b02b328ec3 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:42.010443 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46a27576-71ad-4687-a62b-c670e1f44495 req-ab8b93bd-63b6-4d1b-96dc-05b02b328ec3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:42.010883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46a27576-71ad-4687-a62b-c670e1f44495 req-ab8b93bd-63b6-4d1b-96dc-05b02b328ec3 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:42.022211 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-46a27576-71ad-4687-a62b-c670e1f44495 req-ab8b93bd-63b6-4d1b-96dc-05b02b328ec3 service nova] Creating event network-vif-plugged:0d25864e-4502-4447-9efd-0a22ac0bf544 for instance 9b32313b-9f64-494b-8d57-876c1b24ae74 on n-h2-861333-10 Oct 19 07:41:42.027366 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-46a27576-71ad-4687-a62b-c670e1f44495 req-ab8b93bd-63b6-4d1b-96dc-05b02b328ec3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031897 Oct 19 07:41:42.027899 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3243/6638] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:42.554522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:42.555142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:42.557180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:42.557871 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:42.567453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:42.567453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:42.567453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:42.567453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:42.567453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:42.567453 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:42.584594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:42.695411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:42.703812 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5247d59-925a-45df-ab63-000d7dc54edc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1367 microversion: 2.1 time: 0.153192 Oct 19 07:41:42.704472 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3396/6639] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:42 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:43.727428 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:43.728168 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:43.730140 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:43.731650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:43.737137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:43.737638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:43.738092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:43.738805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:43.739276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:43.739719 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:43.744371 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:43.875254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:41:43.883173 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b355898f-5459-41ac-851f-52ea14a6b527 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1557 microversion: 2.1 time: 0.159994 Oct 19 07:41:43.883749 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3244/6640] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:41:43 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:41:43.905851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-804e816f-5536-4643-8b61-292ff94f14f0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:41:43.906423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-804e816f-5536-4643-8b61-292ff94f14f0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:41:43.909100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:41:43.914086 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-804e816f-5536-4643-8b61-292ff94f14f0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:43.914573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-804e816f-5536-4643-8b61-292ff94f14f0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:43.915012 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-804e816f-5536-4643-8b61-292ff94f14f0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:43.915701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-804e816f-5536-4643-8b61-292ff94f14f0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:43.916177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-804e816f-5536-4643-8b61-292ff94f14f0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:43.916607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-804e816f-5536-4643-8b61-292ff94f14f0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:43.993660 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-804e816f-5536-4643-8b61-292ff94f14f0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092435 Oct 19 07:41:43.994268 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3397/6641] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:41:43 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:41:44.994467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8dd564a3-16b5-4b15-8c9f-9a60c3c0b035 req-decf57a4-e62f-4a7c-81cf-920e8f0fdae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b32313b-9f64-494b-8d57-876c1b24ae74", "tag": "0d25864e-4502-4447-9efd-0a22ac0bf544"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:41:45.006883 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8dd564a3-16b5-4b15-8c9f-9a60c3c0b035 req-decf57a4-e62f-4a7c-81cf-920e8f0fdae7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:41:45.007377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8dd564a3-16b5-4b15-8c9f-9a60c3c0b035 req-decf57a4-e62f-4a7c-81cf-920e8f0fdae7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:41:45.007824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8dd564a3-16b5-4b15-8c9f-9a60c3c0b035 req-decf57a4-e62f-4a7c-81cf-920e8f0fdae7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:41:45.019429 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8dd564a3-16b5-4b15-8c9f-9a60c3c0b035 req-decf57a4-e62f-4a7c-81cf-920e8f0fdae7 service nova] Creating event network-changed:0d25864e-4502-4447-9efd-0a22ac0bf544 for instance 9b32313b-9f64-494b-8d57-876c1b24ae74 on n-h2-861333-10 Oct 19 07:41:45.024473 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8dd564a3-16b5-4b15-8c9f-9a60c3c0b035 req-decf57a4-e62f-4a7c-81cf-920e8f0fdae7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033598 Oct 19 07:41:45.025342 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3245/6642] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:20.764865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:42:20.769170 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cfdc1875-8e4d-463a-8b44-8a6405f7eeaf tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:20.769669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cfdc1875-8e4d-463a-8b44-8a6405f7eeaf tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:20.776085 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfdc1875-8e4d-463a-8b44-8a6405f7eeaf tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:20.776594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfdc1875-8e4d-463a-8b44-8a6405f7eeaf tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:20.777037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfdc1875-8e4d-463a-8b44-8a6405f7eeaf tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:20.777783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfdc1875-8e4d-463a-8b44-8a6405f7eeaf tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:20.778248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfdc1875-8e4d-463a-8b44-8a6405f7eeaf tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:20.778773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfdc1875-8e4d-463a-8b44-8a6405f7eeaf tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:20.803156 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cfdc1875-8e4d-463a-8b44-8a6405f7eeaf tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/ips" status: 200 len: 150 microversion: 2.1 time: 0.041010 Oct 19 07:42:20.803730 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3398/6643] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:42:20 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:23.480602 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:42:23.481158 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:42:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments (ip 10.222.0.39) !!! Oct 19 07:42:23.486634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f674fe6-71ea-4df5-986b-5d1845cc682d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "140e4879-0bb1-4ab7-9b0c-62c2a71c5698"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:42:23.489251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f674fe6-71ea-4df5-986b-5d1845cc682d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:23.501080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f674fe6-71ea-4df5-986b-5d1845cc682d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:23.504204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f674fe6-71ea-4df5-986b-5d1845cc682d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:23.504204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f674fe6-71ea-4df5-986b-5d1845cc682d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:23.504204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f674fe6-71ea-4df5-986b-5d1845cc682d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:23.504204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f674fe6-71ea-4df5-986b-5d1845cc682d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:23.504204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f674fe6-71ea-4df5-986b-5d1845cc682d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:24.201266 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f674fe6-71ea-4df5-986b-5d1845cc682d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722691 Oct 19 07:42:24.201917 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3246/6644] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:42:23 2022] POST /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:35.974499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "140e4879-0bb1-4ab7-9b0c-62c2a71c5698"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:42:35.977038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:35.984907 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:35.985392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:35.985832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:35.986524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:35.986983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:35.987414 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:36.065393 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Invalid volume: volume 140e4879-0bb1-4ab7-9b0c-62c2a71c5698 is already attached to instances: 9b32313b-9f64-494b-8d57-876c1b24ae74 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments HTTP/1.1 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 74 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: {"volumeAttachment": {"volumeId": "140e4879-0bb1-4ab7-9b0c-62c2a71c5698"}} Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: exception: Invalid volume: volume 140e4879-0bb1-4ab7-9b0c-62c2a71c5698 is already attached to instances: 9b32313b-9f64-494b-8d57-876c1b24ae74 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'server_id': '9b32313b-9f64-494b-8d57-876c1b24ae74', 'body': {'volumeAttachment': {'volumeId': '140e4879-0bb1-4ab7-9b0c-62c2a71c5698'}}} Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 140e4879-0bb1-4ab7-9b0c-62c2a71c5698 is already attached to instances: 9b32313b-9f64-494b-8d57-876c1b24ae74 Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:42:36.067127 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 140e4879-0bb1-4ab7-9b0c-62c2a71c5698 is already attached to instances: 9b32313b-9f64-494b-8d57-876c1b24ae74 Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 140e4879-0bb1-4ab7-9b0c-62c2a71c5698 is already attached to instances: 9b32313b-9f64-494b-8d57-876c1b24ae74 Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 400 to user: Invalid volume: volume 140e4879-0bb1-4ab7-9b0c-62c2a71c5698 is already attached to instances: 9b32313b-9f64-494b-8d57-876c1b24ae74 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1171581-16f8-407c-bd76-54e15824d429 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098355 Oct 19 07:42:36.071789 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3399/6645] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:42:35 2022] POST /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 07:42:36.135438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:36.136037 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:36.139101 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:42:36.139785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:42:36.144804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:36.145312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:36.145766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:36.146488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:36.146956 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:36.147408 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:36.227448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lazy-loading 'services' on Instance uuid 9b32313b-9f64-494b-8d57-876c1b24ae74 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:42:36.374332 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4dde759d-56f0-4505-8eda-74a26db6ef6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments/140e4879-0bb1-4ab7-9b0c-62c2a71c5698" status: 202 len: 0 microversion: 2.1 time: 0.242931 Oct 19 07:42:36.374860 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3247/6646] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:42:36 2022] DELETE /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments/140e4879-0bb1-4ab7-9b0c-62c2a71c5698 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:42:36.384339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55b50faa-a90d-4a44-ae4b-657bf2a4b495 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:36.386593 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55b50faa-a90d-4a44-ae4b-657bf2a4b495 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:36.392775 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55b50faa-a90d-4a44-ae4b-657bf2a4b495 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:36.393276 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55b50faa-a90d-4a44-ae4b-657bf2a4b495 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:36.393725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55b50faa-a90d-4a44-ae4b-657bf2a4b495 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:36.394472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55b50faa-a90d-4a44-ae4b-657bf2a4b495 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:36.394939 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55b50faa-a90d-4a44-ae4b-657bf2a4b495 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:36.395374 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55b50faa-a90d-4a44-ae4b-657bf2a4b495 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:36.428488 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55b50faa-a90d-4a44-ae4b-657bf2a4b495 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048375 Oct 19 07:42:36.429064 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3400/6647] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:42:36 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:37.441710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bff444c-640b-404c-b194-d53fb2943380 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:37.444127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bff444c-640b-404c-b194-d53fb2943380 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:37.451169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bff444c-640b-404c-b194-d53fb2943380 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:37.451670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bff444c-640b-404c-b194-d53fb2943380 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:37.452150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bff444c-640b-404c-b194-d53fb2943380 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:37.452862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bff444c-640b-404c-b194-d53fb2943380 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:37.453339 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bff444c-640b-404c-b194-d53fb2943380 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:37.453811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bff444c-640b-404c-b194-d53fb2943380 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:37.484314 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bff444c-640b-404c-b194-d53fb2943380 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046894 Oct 19 07:42:37.484811 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3248/6648] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:42:37 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:38.498123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d219820-51be-4beb-a248-f42fe30b0316 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:38.500451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d219820-51be-4beb-a248-f42fe30b0316 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:38.508411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d219820-51be-4beb-a248-f42fe30b0316 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:38.508913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d219820-51be-4beb-a248-f42fe30b0316 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:38.509355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d219820-51be-4beb-a248-f42fe30b0316 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:38.510126 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d219820-51be-4beb-a248-f42fe30b0316 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:38.510583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d219820-51be-4beb-a248-f42fe30b0316 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:38.511019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d219820-51be-4beb-a248-f42fe30b0316 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:38.545384 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d219820-51be-4beb-a248-f42fe30b0316 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051706 Oct 19 07:42:38.546157 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3401/6649] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:42:38 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:39.557704 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d78eda8-fee4-447c-af20-02b9c3bbd786 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:39.559914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d78eda8-fee4-447c-af20-02b9c3bbd786 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:39.566829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d78eda8-fee4-447c-af20-02b9c3bbd786 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:39.567321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d78eda8-fee4-447c-af20-02b9c3bbd786 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:39.567769 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d78eda8-fee4-447c-af20-02b9c3bbd786 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:39.568523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d78eda8-fee4-447c-af20-02b9c3bbd786 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:39.568989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d78eda8-fee4-447c-af20-02b9c3bbd786 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:39.569429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d78eda8-fee4-447c-af20-02b9c3bbd786 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:39.599686 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d78eda8-fee4-447c-af20-02b9c3bbd786 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046259 Oct 19 07:42:39.600267 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3249/6650] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:42:39 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:40.612326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71647137-a124-4dce-a820-29d737c36f75 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:40.614504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-71647137-a124-4dce-a820-29d737c36f75 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:40.621354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71647137-a124-4dce-a820-29d737c36f75 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:40.621841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71647137-a124-4dce-a820-29d737c36f75 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:40.622281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71647137-a124-4dce-a820-29d737c36f75 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:40.622971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71647137-a124-4dce-a820-29d737c36f75 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:40.623424 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71647137-a124-4dce-a820-29d737c36f75 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:40.624141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71647137-a124-4dce-a820-29d737c36f75 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:40.654824 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-71647137-a124-4dce-a820-29d737c36f75 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047038 Oct 19 07:42:40.655599 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3402/6651] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:42:40 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:41.666991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-047ed053-c840-442d-89c0-e4aa281df1d8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:41.669263 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-047ed053-c840-442d-89c0-e4aa281df1d8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:41.676709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047ed053-c840-442d-89c0-e4aa281df1d8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:41.677237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047ed053-c840-442d-89c0-e4aa281df1d8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:41.677690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047ed053-c840-442d-89c0-e4aa281df1d8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:41.678393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047ed053-c840-442d-89c0-e4aa281df1d8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:41.678859 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047ed053-c840-442d-89c0-e4aa281df1d8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:41.679296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-047ed053-c840-442d-89c0-e4aa281df1d8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:41.708228 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-047ed053-c840-442d-89c0-e4aa281df1d8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045229 Oct 19 07:42:41.708773 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3250/6652] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:42:41 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:42:41.773380 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:41.773898 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:41.780730 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:41.781224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:41.781670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:41.782368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:41.783340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:41.783774 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:41.809147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:42:42.089420 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-346ac62d-158d-4837-a3f5-6b7b8dc7fffe tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 204 len: 0 microversion: 2.1 time: 0.319623 Oct 19 07:42:42.090015 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3403/6653] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:42:41 2022] DELETE /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 07:42:42.098269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:42.098892 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:42.104894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:42.105378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:42.105822 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:42.106513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:42.107009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:42.107444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:42.247106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:42.255817 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0752b0c9-749e-47c0-98c3-4c3b5edc6ceb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1682 microversion: 2.1 time: 0.161443 Oct 19 07:42:42.256425 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3251/6654] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:42 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:43.279426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:43.280201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:43.287562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:43.288055 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:43.288538 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:43.289236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:43.289703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:43.290137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:43.422355 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:43.430848 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6292f26-5ca7-4905-bd73-cabca3e56b30 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1682 microversion: 2.1 time: 0.155759 Oct 19 07:42:43.431425 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3404/6655] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:43 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:44.453518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:44.454141 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:44.461461 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:44.462039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:44.462706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:44.463482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:44.464049 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:44.464492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:44.572770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:44.580942 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-186867b4-5e83-4433-bb2e-9dd3363b306a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1614 microversion: 2.1 time: 0.131380 Oct 19 07:42:44.581813 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3252/6656] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:44 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1614 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:44.882627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2c9faa42-3394-4673-8548-624f5f13affd req-e9d8a14e-5292-41b8-8f04-04a232ddb23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b32313b-9f64-494b-8d57-876c1b24ae74", "name": "network-vif-deleted", "tag": "0d25864e-4502-4447-9efd-0a22ac0bf544"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:42:44.894152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c9faa42-3394-4673-8548-624f5f13affd req-e9d8a14e-5292-41b8-8f04-04a232ddb23d service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:44.894650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c9faa42-3394-4673-8548-624f5f13affd req-e9d8a14e-5292-41b8-8f04-04a232ddb23d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:44.895093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c9faa42-3394-4673-8548-624f5f13affd req-e9d8a14e-5292-41b8-8f04-04a232ddb23d service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:44.907806 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2c9faa42-3394-4673-8548-624f5f13affd req-e9d8a14e-5292-41b8-8f04-04a232ddb23d service nova] Creating event network-vif-deleted:0d25864e-4502-4447-9efd-0a22ac0bf544 for instance 9b32313b-9f64-494b-8d57-876c1b24ae74 on n-h2-861333-10 Oct 19 07:42:44.913249 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2c9faa42-3394-4673-8548-624f5f13affd req-e9d8a14e-5292-41b8-8f04-04a232ddb23d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112532 Oct 19 07:42:44.914256 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3405/6657] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:45.604056 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:45.604733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:45.611761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:45.612319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:45.612784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:45.613516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:45.614003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:45.614453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:45.648606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:45.649116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:45.649576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:45.650048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lazy-loading 'fault' on Instance uuid 9b32313b-9f64-494b-8d57-876c1b24ae74 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:42:45.699679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:45.703603 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3bac04e-70f9-4219-8c5b-be1382ce6c9c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 200 len: 1331 microversion: 2.1 time: 0.103427 Oct 19 07:42:45.704779 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3253/6658] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:45 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:46.734850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:46.735986 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:46.742227 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:46.742711 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:46.743157 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:46.743862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:46.744362 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:46.744829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:46.758832 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 HTTP/1.1 Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '9b32313b-9f64-494b-8d57-876c1b24ae74'} Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:42:46.760461 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2f265e0-9377-4794-8078-b7a9e0942cb6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 404 len: 111 microversion: 2.1 time: 0.032345 Oct 19 07:42:46.765726 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3406/6659] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:46 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:42:46.770752 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29602c87-762f-4325-a7cd-b7ceba9a5381 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '.version_select at 0x7f6d646d40d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:46.867630 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29602c87-762f-4325-a7cd-b7ceba9a5381 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-972649885" status: 202 len: 0 microversion: 2.1 time: 0.100599 Oct 19 07:42:46.868195 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3254/6660] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 07:42:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-972649885 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:42:47.910947 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-feb668b5-69ad-4a34-9543-fd1190833301 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: .version_select at 0x7f6d5fb51160>, body: {"keypair": {"name": "tempest-keypair-1467233399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/Xvh8MhA5ZpQ6hRUUFLhqHjEiEajc5O2cjcehmWUew6us+UlhQ9YVkJwUNc1JsyiHkU/Kgh2BLdld8P+qumb2OwOwY0+IsvQLDw5OZrBxzTvdvSHVgU/RRpQRoSsNtfw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:42:47.926839 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-feb668b5-69ad-4a34-9543-fd1190833301 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:42:47.935838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-feb668b5-69ad-4a34-9543-fd1190833301 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for user 928241230e62461bab8c543cbc938870 and project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:42:48.015765 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-feb668b5-69ad-4a34-9543-fd1190833301 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108749 Oct 19 07:42:48.016421 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3407/6661] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:42:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:49.998680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-245410748", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a71953-c964-433c-bc19-fc5ecbaa8dff"}], "security_groups": [{"name": "tempest-securitygroup--1343678040"}], "key_name": "tempest-keypair-1467233399", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:42:50.102341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] validate_networks() for [('36a71953-c964-433c-bc19-fc5ecbaa8dff', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:42:50.473903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:42:50.474374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:42:50.474862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:42:50.475286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:42:50.475711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:42:50.484837 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:50.485269 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:50.486232 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:50.486967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:50.487438 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:50.487876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:50.506414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:42:50.511656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Getting quotas for user 928241230e62461bab8c543cbc938870 and project b634143cbfba40e5a7e4c753d10f6a8f. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:42:50.523967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:42:50.526282 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:42:50.679242 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-014d45ea-8889-4c7e-8cc8-e4323917407a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.687176 Oct 19 07:42:50.679893 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3255/6662] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:42:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:42:50.692569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae011b8b-ce38-4014-a17f-41916afab208 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:50.693294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ae011b8b-ce38-4014-a17f-41916afab208 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:50.753640 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ae011b8b-ce38-4014-a17f-41916afab208 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:50.762010 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae011b8b-ce38-4014-a17f-41916afab208 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1241 microversion: 2.1 time: 0.074975 Oct 19 07:42:50.762563 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3408/6663] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:50 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:51.785157 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6964055-2032-46e8-81ed-cdbb1c6054bc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:51.787041 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6964055-2032-46e8-81ed-cdbb1c6054bc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:51.844836 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6964055-2032-46e8-81ed-cdbb1c6054bc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:51.852247 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6964055-2032-46e8-81ed-cdbb1c6054bc tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1241 microversion: 2.1 time: 0.071864 Oct 19 07:42:51.852817 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3256/6664] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:51 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:52.874859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-001d9629-e357-452d-97b0-51e28956ce7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:52.875473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-001d9629-e357-452d-97b0-51e28956ce7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:52.930638 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-001d9629-e357-452d-97b0-51e28956ce7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:52.937685 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-001d9629-e357-452d-97b0-51e28956ce7f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1241 microversion: 2.1 time: 0.066742 Oct 19 07:42:52.938260 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3409/6665] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:52 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:53.961442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:53.962195 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:53.968788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:53.969288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:53.969739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:53.970960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:53.971430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:53.971871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:54.033583 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:54.041187 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-496a9412-8f46-45f9-9dde-8c77c9a8d5c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1237 microversion: 2.1 time: 0.083897 Oct 19 07:42:54.041761 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3257/6666] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:53 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:55.064458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:55.065089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:55.072029 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:55.072771 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:55.073379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:55.074077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:55.074533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:55.074968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:55.137706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:55.146148 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cdd8d1f-daa4-48a0-8af7-892a341ffadb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1299 microversion: 2.1 time: 0.085813 Oct 19 07:42:55.149689 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3410/6667] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:55 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:56.169938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:56.170571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:56.178144 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:56.178647 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:56.179109 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:56.179824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:56.180329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:56.180773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:56.377503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:56.385682 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f20ae6a1-adb5-4518-b5d3-3d987215c1a0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1367 microversion: 2.1 time: 0.219692 Oct 19 07:42:56.386360 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3258/6668] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:56 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:56.774858 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5c8a19e5-0284-4770-939f-abf3d9234bed req-be9fd142-ce65-4ee2-bde9-f7dc002fa002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239c593c-412c-4200-a487-1b8d6b35964f", "tag": "e704b607-1e80-41ee-8d42-52bec7bf56bd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:42:56.785190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5c8a19e5-0284-4770-939f-abf3d9234bed req-be9fd142-ce65-4ee2-bde9-f7dc002fa002 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:56.785674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5c8a19e5-0284-4770-939f-abf3d9234bed req-be9fd142-ce65-4ee2-bde9-f7dc002fa002 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:56.786310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5c8a19e5-0284-4770-939f-abf3d9234bed req-be9fd142-ce65-4ee2-bde9-f7dc002fa002 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:56.797423 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5c8a19e5-0284-4770-939f-abf3d9234bed req-be9fd142-ce65-4ee2-bde9-f7dc002fa002 service nova] Creating event network-changed:e704b607-1e80-41ee-8d42-52bec7bf56bd for instance 239c593c-412c-4200-a487-1b8d6b35964f on n-h1-861333-10 Oct 19 07:42:56.802907 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5c8a19e5-0284-4770-939f-abf3d9234bed req-be9fd142-ce65-4ee2-bde9-f7dc002fa002 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031279 Oct 19 07:42:56.803325 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3411/6669] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:42:57.409625 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:57.410378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:57.417329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:57.417835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:57.418294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:57.419014 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:57.419492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:57.419936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:57.598454 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:57.603062 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-492e3814-fdbb-40a7-8c31-3ae40242772f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1367 microversion: 2.1 time: 0.197948 Oct 19 07:42:57.603677 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3259/6670] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:57 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:58.627905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:58.628921 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:58.635123 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:58.635609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:58.636060 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:58.636768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:58.637226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:58.637655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:58.766815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:58.774451 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46380d15-7ada-4110-87ee-213344a6fa47 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1367 microversion: 2.1 time: 0.152423 Oct 19 07:42:58.775209 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3412/6671] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:58 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:42:59.797015 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:42:59.797620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:42:59.804490 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:59.804986 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:59.805434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:59.806138 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:42:59.806603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:42:59.807043 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:42:59.943357 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:42:59.951163 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0334eec9-0c35-49f1-b7e6-a632141ee7f2 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1367 microversion: 2.1 time: 0.158098 Oct 19 07:42:59.951750 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3260/6672] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:42:59 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:43:00.975367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:00.975983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:00.982957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:00.983445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:00.983889 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:00.984610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:00.985073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:00.985533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:01.114691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:43:01.122302 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f180edfe-c406-427e-b2d4-4821e049e4b0 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1367 microversion: 2.1 time: 0.150878 Oct 19 07:43:01.122872 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3413/6673] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:43:00 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:43:02.121112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-83c98f7a-9800-411e-8475-09739e536711 req-11bb175c-9277-4bb9-af9a-7caac537637e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239c593c-412c-4200-a487-1b8d6b35964f", "name": "network-vif-plugged", "status": "completed", "tag": "e704b607-1e80-41ee-8d42-52bec7bf56bd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:43:02.126299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:43:02.127825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:43:02.133327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-83c98f7a-9800-411e-8475-09739e536711 req-11bb175c-9277-4bb9-af9a-7caac537637e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:02.133813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-83c98f7a-9800-411e-8475-09739e536711 req-11bb175c-9277-4bb9-af9a-7caac537637e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:02.134258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-83c98f7a-9800-411e-8475-09739e536711 req-11bb175c-9277-4bb9-af9a-7caac537637e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:02.145281 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:02.146004 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:02.146297 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-83c98f7a-9800-411e-8475-09739e536711 req-11bb175c-9277-4bb9-af9a-7caac537637e service nova] Creating event network-vif-plugged:e704b607-1e80-41ee-8d42-52bec7bf56bd for instance 239c593c-412c-4200-a487-1b8d6b35964f on n-h1-861333-10 Oct 19 07:43:02.152025 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-83c98f7a-9800-411e-8475-09739e536711 req-11bb175c-9277-4bb9-af9a-7caac537637e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034644 Oct 19 07:43:02.152647 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3261/6674] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:43:02.152763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:02.153303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:02.153757 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:02.154519 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:02.154976 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:02.155400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:02.302130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:43:02.310480 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f1488a6-4d69-44ed-b029-6470824c4b73 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1367 microversion: 2.1 time: 0.169226 Oct 19 07:43:02.311062 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3414/6675] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:43:02 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:43:03.334570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:03.335314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:03.342970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:03.343469 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:03.343917 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:03.344645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:03.345114 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:03.345551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:03.480148 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:43:03.488732 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19779eaa-83a0-4621-bbe5-9bee01c6f1c1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1367 microversion: 2.1 time: 0.158788 Oct 19 07:43:03.489245 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3262/6676] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:43:03 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:43:04.510713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:04.516190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:04.516190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:43:04.519806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:04.520324 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:04.520818 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:04.521526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:04.521972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:04.522404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:04.656768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:43:04.664436 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d9553f9-65c6-417f-af6e-cefd52b44f68 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1558 microversion: 2.1 time: 0.157585 Oct 19 07:43:04.665017 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3415/6677] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:43:04 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:43:04.687217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c60fad5c-17a8-4d25-a55b-99e9686ee797 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:04.687816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c60fad5c-17a8-4d25-a55b-99e9686ee797 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:04.695250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60fad5c-17a8-4d25-a55b-99e9686ee797 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:04.695748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60fad5c-17a8-4d25-a55b-99e9686ee797 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:04.696236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60fad5c-17a8-4d25-a55b-99e9686ee797 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:04.696944 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60fad5c-17a8-4d25-a55b-99e9686ee797 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:04.697414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60fad5c-17a8-4d25-a55b-99e9686ee797 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:04.697856 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60fad5c-17a8-4d25-a55b-99e9686ee797 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:04.775697 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c60fad5c-17a8-4d25-a55b-99e9686ee797 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092382 Oct 19 07:43:04.776365 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3263/6678] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 07:43:04 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:43:05.775099 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a4707c25-5574-4911-83b4-7a1007fbf637 req-97c01d44-ae3c-4110-9fd6-015f7a92c280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239c593c-412c-4200-a487-1b8d6b35964f", "tag": "e704b607-1e80-41ee-8d42-52bec7bf56bd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:43:05.786293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a4707c25-5574-4911-83b4-7a1007fbf637 req-97c01d44-ae3c-4110-9fd6-015f7a92c280 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:05.787287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a4707c25-5574-4911-83b4-7a1007fbf637 req-97c01d44-ae3c-4110-9fd6-015f7a92c280 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:05.787287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a4707c25-5574-4911-83b4-7a1007fbf637 req-97c01d44-ae3c-4110-9fd6-015f7a92c280 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:05.799035 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a4707c25-5574-4911-83b4-7a1007fbf637 req-97c01d44-ae3c-4110-9fd6-015f7a92c280 service nova] Creating event network-changed:e704b607-1e80-41ee-8d42-52bec7bf56bd for instance 239c593c-412c-4200-a487-1b8d6b35964f on n-h1-861333-10 Oct 19 07:43:05.804073 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a4707c25-5574-4911-83b4-7a1007fbf637 req-97c01d44-ae3c-4110-9fd6-015f7a92c280 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032745 Oct 19 07:43:05.804931 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3416/6679] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:43:41.611396 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:43:41.612188 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:43:41.616091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b59645c5-0a01-4c0e-8324-fc8823686615 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:41.616619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b59645c5-0a01-4c0e-8324-fc8823686615 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:41.622519 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b59645c5-0a01-4c0e-8324-fc8823686615 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:41.623012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b59645c5-0a01-4c0e-8324-fc8823686615 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:41.625620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b59645c5-0a01-4c0e-8324-fc8823686615 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:41.625620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b59645c5-0a01-4c0e-8324-fc8823686615 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:41.625620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b59645c5-0a01-4c0e-8324-fc8823686615 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:41.625620 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b59645c5-0a01-4c0e-8324-fc8823686615 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:41.649121 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b59645c5-0a01-4c0e-8324-fc8823686615 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/ips" status: 200 len: 150 microversion: 2.1 time: 0.040102 Oct 19 07:43:41.649681 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3264/6680] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 07:43:41 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:43:44.472334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:43:44.473087 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:43:44.477401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8204f459-a539-45e1-8e6a-58055282c0c6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71abadde-8bf1-46e1-af89-700cdb08b324"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:43:44.479860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8204f459-a539-45e1-8e6a-58055282c0c6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:44.486432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8204f459-a539-45e1-8e6a-58055282c0c6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:44.486868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8204f459-a539-45e1-8e6a-58055282c0c6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:44.487311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8204f459-a539-45e1-8e6a-58055282c0c6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:44.488005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8204f459-a539-45e1-8e6a-58055282c0c6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:44.488491 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8204f459-a539-45e1-8e6a-58055282c0c6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:44.488927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8204f459-a539-45e1-8e6a-58055282c0c6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:45.296997 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8204f459-a539-45e1-8e6a-58055282c0c6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "POST /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.826638 Oct 19 07:43:45.297631 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3417/6681] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:43:44 2022] POST /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:43:57.162808 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:57.164882 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:57.170214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:57.170706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:57.171155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:57.171851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:57.172347 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:57.172785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:57.260032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lazy-loading 'services' on Instance uuid 239c593c-412c-4200-a487-1b8d6b35964f {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:43:57.433591 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab8d0ca8-9ec2-4148-b0ba-ec41aa38be5e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments/71abadde-8bf1-46e1-af89-700cdb08b324" status: 202 len: 0 microversion: 2.1 time: 0.275517 Oct 19 07:43:57.434203 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3265/6682] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:43:57 2022] DELETE /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments/71abadde-8bf1-46e1-af89-700cdb08b324 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:43:57.440674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:43:57.441507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:43:57.447585 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3960f844-e50e-4b95-b552-bd1d8ae5e34b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:57.450019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3960f844-e50e-4b95-b552-bd1d8ae5e34b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:57.456329 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3960f844-e50e-4b95-b552-bd1d8ae5e34b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:57.456755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3960f844-e50e-4b95-b552-bd1d8ae5e34b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:57.457195 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3960f844-e50e-4b95-b552-bd1d8ae5e34b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:57.457893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3960f844-e50e-4b95-b552-bd1d8ae5e34b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:57.458347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3960f844-e50e-4b95-b552-bd1d8ae5e34b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:57.458772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3960f844-e50e-4b95-b552-bd1d8ae5e34b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:57.489197 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3960f844-e50e-4b95-b552-bd1d8ae5e34b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050412 Oct 19 07:43:57.489762 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3418/6683] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:43:57 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:43:58.504256 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5891c788-c8eb-4aff-8b35-94956e9f2c4f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:58.506767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5891c788-c8eb-4aff-8b35-94956e9f2c4f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:58.513669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5891c788-c8eb-4aff-8b35-94956e9f2c4f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:58.514087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5891c788-c8eb-4aff-8b35-94956e9f2c4f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:58.514658 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5891c788-c8eb-4aff-8b35-94956e9f2c4f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:58.515381 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5891c788-c8eb-4aff-8b35-94956e9f2c4f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:58.515872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5891c788-c8eb-4aff-8b35-94956e9f2c4f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:58.516304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5891c788-c8eb-4aff-8b35-94956e9f2c4f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:58.551087 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5891c788-c8eb-4aff-8b35-94956e9f2c4f tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053210 Oct 19 07:43:58.555954 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3266/6684] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:43:58 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:43:59.564434 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8e16e7c-aef7-4ca2-8286-8a2bb2a8f761 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:43:59.566820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8e16e7c-aef7-4ca2-8286-8a2bb2a8f761 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:43:59.575208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8e16e7c-aef7-4ca2-8286-8a2bb2a8f761 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:59.575707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8e16e7c-aef7-4ca2-8286-8a2bb2a8f761 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:59.576175 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8e16e7c-aef7-4ca2-8286-8a2bb2a8f761 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:59.576885 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8e16e7c-aef7-4ca2-8286-8a2bb2a8f761 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:43:59.577344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8e16e7c-aef7-4ca2-8286-8a2bb2a8f761 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:43:59.577776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8e16e7c-aef7-4ca2-8286-8a2bb2a8f761 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:43:59.613506 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8e16e7c-aef7-4ca2-8286-8a2bb2a8f761 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052699 Oct 19 07:43:59.614478 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3419/6685] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:43:59 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:00.626447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f15989e-a07f-470e-8edc-b70a550c795a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:00.628938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f15989e-a07f-470e-8edc-b70a550c795a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:00.635734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f15989e-a07f-470e-8edc-b70a550c795a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:00.636266 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f15989e-a07f-470e-8edc-b70a550c795a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:00.636715 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f15989e-a07f-470e-8edc-b70a550c795a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:00.637415 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f15989e-a07f-470e-8edc-b70a550c795a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:00.637912 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f15989e-a07f-470e-8edc-b70a550c795a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:00.638349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f15989e-a07f-470e-8edc-b70a550c795a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:00.667436 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f15989e-a07f-470e-8edc-b70a550c795a tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Oct 19 07:44:00.667918 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3267/6686] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:44:00 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:01.680441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5bc02ae5-e0c7-404e-bf4b-d142249e1b7e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:01.682689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5bc02ae5-e0c7-404e-bf4b-d142249e1b7e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:01.692365 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc02ae5-e0c7-404e-bf4b-d142249e1b7e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:01.692863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc02ae5-e0c7-404e-bf4b-d142249e1b7e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:01.693428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc02ae5-e0c7-404e-bf4b-d142249e1b7e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:01.694143 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc02ae5-e0c7-404e-bf4b-d142249e1b7e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:01.694607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc02ae5-e0c7-404e-bf4b-d142249e1b7e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:01.695045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc02ae5-e0c7-404e-bf4b-d142249e1b7e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:01.724226 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5bc02ae5-e0c7-404e-bf4b-d142249e1b7e tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048061 Oct 19 07:44:01.724832 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3420/6687] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:44:01 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:02.736830 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24cc91ba-9cd6-4c54-9fbd-36bb810e9eeb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:02.739026 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24cc91ba-9cd6-4c54-9fbd-36bb810e9eeb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:02.745863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24cc91ba-9cd6-4c54-9fbd-36bb810e9eeb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:02.746359 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24cc91ba-9cd6-4c54-9fbd-36bb810e9eeb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:02.746809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24cc91ba-9cd6-4c54-9fbd-36bb810e9eeb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:02.747505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24cc91ba-9cd6-4c54-9fbd-36bb810e9eeb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:02.747971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24cc91ba-9cd6-4c54-9fbd-36bb810e9eeb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:02.748446 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24cc91ba-9cd6-4c54-9fbd-36bb810e9eeb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:02.778057 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24cc91ba-9cd6-4c54-9fbd-36bb810e9eeb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045378 Oct 19 07:44:02.778539 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3268/6688] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 07:44:02 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 07:44:02.840512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:02.841078 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:02.847938 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:02.848458 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:02.848906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:02.849610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:02.850120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:02.850555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:02.875300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:44:03.149634 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5fbc6a4-9d7a-4787-afaa-8899e4ef4842 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 204 len: 0 microversion: 2.1 time: 0.312814 Oct 19 07:44:03.150158 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3421/6689] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:44:02 2022] DELETE /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:44:03.158451 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:03.159578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:03.165156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:03.165657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:03.166106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:03.166816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:03.167288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:03.167729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:03.305250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:44:03.312985 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf4d194a-15dd-4940-9943-7ad8d0df3897 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1682 microversion: 2.1 time: 0.158521 Oct 19 07:44:03.313551 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3269/6690] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:44:03 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:44:04.337854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:04.338562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:04.345091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:04.345582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:04.346540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:04.347265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:04.347722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:04.348182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:04.477064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:44:04.485117 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa2a4a0e-05a0-4168-a4d1-9b23e4927e95 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1682 microversion: 2.1 time: 0.151411 Oct 19 07:44:04.485637 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3422/6691] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:44:04 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:44:05.510267 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:05.511514 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:05.519494 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:05.520003 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:05.520482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:05.521201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:05.521848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:05.522293 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:05.610746 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:44:05.618916 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75654b50-a3c6-4cd0-89c3-5645a424ce66 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1614 microversion: 2.1 time: 0.113071 Oct 19 07:44:05.619525 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3270/6692] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:44:05 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1614 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:44:06.072006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2c4ba511-b039-44d3-bf75-60ca4efdb6b7 req-649ce214-2afe-4b94-850a-be264d09bfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239c593c-412c-4200-a487-1b8d6b35964f", "name": "network-vif-deleted", "tag": "e704b607-1e80-41ee-8d42-52bec7bf56bd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:44:06.083334 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c4ba511-b039-44d3-bf75-60ca4efdb6b7 req-649ce214-2afe-4b94-850a-be264d09bfa7 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:06.084036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c4ba511-b039-44d3-bf75-60ca4efdb6b7 req-649ce214-2afe-4b94-850a-be264d09bfa7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:06.084574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c4ba511-b039-44d3-bf75-60ca4efdb6b7 req-649ce214-2afe-4b94-850a-be264d09bfa7 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:06.097199 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2c4ba511-b039-44d3-bf75-60ca4efdb6b7 req-649ce214-2afe-4b94-850a-be264d09bfa7 service nova] Creating event network-vif-deleted:e704b607-1e80-41ee-8d42-52bec7bf56bd for instance 239c593c-412c-4200-a487-1b8d6b35964f on n-h1-861333-10 Oct 19 07:44:06.102591 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2c4ba511-b039-44d3-bf75-60ca4efdb6b7 req-649ce214-2afe-4b94-850a-be264d09bfa7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034442 Oct 19 07:44:06.103182 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3423/6693] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:06.644576 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:06.645288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:06.652164 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:06.652669 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:06.653116 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:06.653817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:06.654284 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:06.654727 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:06.685777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:06.686277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:06.686733 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:06.687189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lazy-loading 'fault' on Instance uuid 239c593c-412c-4200-a487-1b8d6b35964f {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:44:06.732419 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928241230e62461bab8c543cbc938870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b634143cbfba40e5a7e4c753d10f6a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:44:06.741755 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0795232-04d7-42c9-9166-63d53a96bd98 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 200 len: 1331 microversion: 2.1 time: 0.101873 Oct 19 07:44:06.742332 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3271/6694] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:44:06 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:44:07.766696 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:07.767397 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:07.775310 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:07.775843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:07.776327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:07.777032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:07.777494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:07.777926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:07.791653 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f HTTP/1.1 Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '239c593c-412c-4200-a487-1b8d6b35964f'} Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:07.793290 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-951dfdb6-a193-4c20-9099-04cd4a2a4d5c tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 404 len: 111 microversion: 2.1 time: 0.032277 Oct 19 07:44:07.798431 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3424/6695] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:44:07 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:44:07.803488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe3ec554-54ff-442a-a28a-f7d379aeb6e1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '.version_select at 0x7f6d645bc820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:07.881631 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe3ec554-54ff-442a-a28a-f7d379aeb6e1 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467233399" status: 202 len: 0 microversion: 2.1 time: 0.081883 Oct 19 07:44:07.882225 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3272/6696] 10.222.0.39 () {58 vars in 1221 bytes} [Wed Oct 19 07:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467233399 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:44:11.981233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:11.981788 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:11.989658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:11.990142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:11.990578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:11.991272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:11.991724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:11.992167 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:12.008329 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f HTTP/1.1 Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '239c593c-412c-4200-a487-1b8d6b35964f'} Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:44:12.009318 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1f2bccd-ed5b-4712-9fa4-75e91c8aaf84 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 404 len: 111 microversion: 2.1 time: 0.040138 Oct 19 07:44:12.014719 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3425/6697] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:44:11 2022] DELETE /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:44:12.019474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:12.024305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 239c593c-412c-4200-a487-1b8d6b35964f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:12.028016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:12.028542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:12.028996 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:12.029809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:12.030442 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:12.030931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:12.044509 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f HTTP/1.1 Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '239c593c-412c-4200-a487-1b8d6b35964f'} Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:12.046189 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance 239c593c-412c-4200-a487-1b8d6b35964f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b03ffee-d54d-4d3f-a91d-6e2061ac4e6d tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f" status: 404 len: 111 microversion: 2.1 time: 0.032095 Oct 19 07:44:12.052291 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3273/6698] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:44:12 2022] GET /compute/v2.1/servers/239c593c-412c-4200-a487-1b8d6b35964f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:44:15.567311 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:15.567819 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:15.574865 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:15.575364 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:15.575811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:15.576553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:15.577017 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:15.577454 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:15.590990 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 HTTP/1.1 Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '9b32313b-9f64-494b-8d57-876c1b24ae74'} Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:44:15.592594 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f8c819d-7941-4e59-93de-dabf1a8836b6 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 404 len: 111 microversion: 2.1 time: 0.030619 Oct 19 07:44:15.596753 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3426/6699] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:44:15 2022] DELETE /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:44:15.603597 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:15.604681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 9b32313b-9f64-494b-8d57-876c1b24ae74] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:15.611563 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:15.612160 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:15.613334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:15.614108 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:15.614829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:15.615349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:15.629441 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 HTTP/1.1 Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '9b32313b-9f64-494b-8d57-876c1b24ae74'} Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:15.631087 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance 9b32313b-9f64-494b-8d57-876c1b24ae74 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f669a92e-c8f3-4714-bd8d-d0c2b4206ad5 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74" status: 404 len: 111 microversion: 2.1 time: 0.034283 Oct 19 07:44:15.636261 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3274/6700] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:44:15 2022] GET /compute/v2.1/servers/9b32313b-9f64-494b-8d57-876c1b24ae74 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:44:15.643656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:15.644172 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:15.650222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:15.650703 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:15.651140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:15.651820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:15.652328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:15.652753 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:15.666553 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 HTTP/1.1 Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'af6aa586-723f-45b1-a6a4-791e7a093735'} Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:44:15.668076 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-850416ff-3a37-481d-95bb-3ee01e42afcb tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 404 len: 111 microversion: 2.1 time: 0.029650 Oct 19 07:44:15.672835 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3427/6701] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:44:15 2022] DELETE /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:44:15.679640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:15.680324 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: af6aa586-723f-45b1-a6a4-791e7a093735] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:15.686425 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:15.686925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:15.687376 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:15.688097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:15.688618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:15.689070 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:15.702526 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 HTTP/1.1 Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': 'af6aa586-723f-45b1-a6a4-791e7a093735'} Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:15.704096 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance af6aa586-723f-45b1-a6a4-791e7a093735 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70fdd08d-604a-4b37-a7b5-c4876f7d8d8b tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735" status: 404 len: 111 microversion: 2.1 time: 0.030521 Oct 19 07:44:15.709918 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3275/6702] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:44:15 2022] GET /compute/v2.1/servers/af6aa586-723f-45b1-a6a4-791e7a093735 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:44:19.111799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:19.112378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:19.119966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:19.120570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:19.121131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:19.121899 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:19.122431 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:19.123011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:19.137954 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 HTTP/1.1 Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': '641f21cd-d9f9-494b-b220-a12313087ff0'} Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:44:19.139506 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df66ada6-8ecc-4c46-a665-71ecb223ead8 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 404 len: 111 microversion: 2.1 time: 0.033101 Oct 19 07:44:19.144053 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3428/6703] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:44:19 2022] DELETE /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:44:19.150559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:19.151180 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] [instance: 641f21cd-d9f9-494b-b220-a12313087ff0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:44:19.158489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:19.158992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:19.159445 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:19.160179 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:44:19.160656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:44:19.161155 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:44:19.177698 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] HTTP exception thrown: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Request method failure captured: Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 HTTP/1.1 Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6mhnowAm4YhYDpJYH8A8a4Pi9DTtvrueG3IG8Rdkb3Fq9KIrOMSnvozxNynFO8-Hg_gL3F9y-ZL5TzFZav7BjNziGS_KlitwXQiwvb-CmsoNViDRSIP3jgXx8JWQhAWtP318fqtUSitNFaaC9KYIds1_BFAyS6N1HwIfr15aqSHOfo Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b634143cbfba40e5a7e4c753d10f6a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b634143cbfba40e5a7e4c753d10f6a8f", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: b634143cbfba40e5a7e4c753d10f6a8f Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-635330757 Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 928241230e62461bab8c543cbc938870 Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-635330757-project Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '641f21cd-d9f9-494b-b220-a12313087ff0'} Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:44:19.179254 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] Returning 404 to user: Instance 641f21cd-d9f9-494b-b220-a12313087ff0 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b18bb1e-911d-4927-94b6-f6818f53ab63 tempest-AttachVolumeNegativeTest-635330757 tempest-AttachVolumeNegativeTest-635330757-project] 10.222.0.39 "GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0" status: 404 len: 111 microversion: 2.1 time: 0.034098 Oct 19 07:44:19.188191 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3276/6704] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:44:19 2022] GET /compute/v2.1/servers/641f21cd-d9f9-494b-b220-a12313087ff0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:44:27.567354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d076acc1-d335-49a4-93c5-244dcae11e90 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d68b30c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:27.613659 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d076acc1-d335-49a4-93c5-244dcae11e90 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/14fcc0c7-2b69-40f3-9747-15cc10975893" status: 200 len: 350 microversion: 2.1 time: 0.050039 Oct 19 07:44:27.614223 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3429/6705] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:44:27 2022] GET /compute/v2.1/os-volumes/14fcc0c7-2b69-40f3-9747-15cc10975893 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:30.236692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ba53f3d-9f39-420a-9ccf-412fc3898901 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d6479ba60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:30.244612 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:44:30.245315 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:44:30.286048 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ba53f3d-9f39-420a-9ccf-412fc3898901 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/46dfbdef-cb23-41b7-8fe0-e6d084c0deab" status: 200 len: 351 microversion: 2.1 time: 0.053254 Oct 19 07:44:30.286622 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3277/6706] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:44:30 2022] GET /compute/v2.1/os-volumes/46dfbdef-cb23-41b7-8fe0-e6d084c0deab => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:32.921796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:44:32.922566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:44:32.926428 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e2f70c2-0c50-44fa-aa13-d249cbca0e11 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d64965310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:32.974055 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e2f70c2-0c50-44fa-aa13-d249cbca0e11 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/b861e223-0c2d-4ff7-90f0-16801f7369fb" status: 200 len: 351 microversion: 2.1 time: 0.053993 Oct 19 07:44:32.974657 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3430/6707] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 07:44:32 2022] GET /compute/v2.1/os-volumes/b861e223-0c2d-4ff7-90f0-16801f7369fb => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:32.989085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a4895cc-2e5d-4727-9f1e-dcac78818439 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d6483faf0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:33.071670 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a4895cc-2e5d-4727-9f1e-dcac78818439 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087629 Oct 19 07:44:33.072296 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3278/6708] 10.222.0.39 () {58 vars in 1134 bytes} [Wed Oct 19 07:44:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:44:33.087570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9e7762f-464f-49c8-9e85-ded58df5166a tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d5fb0cb80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:33.169895 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9e7762f-464f-49c8-9e85-ded58df5166a tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087226 Oct 19 07:44:33.170467 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3431/6709] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 07:44:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:33.184894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6c184e3-9411-479a-9402-7f51a408200c tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d64e3f670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:33.267469 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6c184e3-9411-479a-9402-7f51a408200c tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086371 Oct 19 07:44:33.268075 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3279/6710] 10.222.0.39 () {58 vars in 1134 bytes} [Wed Oct 19 07:44:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:44:33.281322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d9cf9cc-7242-4046-8167-30352c23ceb9 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d5f9b7a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:33.362399 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d9cf9cc-7242-4046-8167-30352c23ceb9 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084840 Oct 19 07:44:33.362972 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3432/6711] 10.222.0.39 () {58 vars in 1167 bytes} [Wed Oct 19 07:44:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:33.376530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e33e1f74-40e2-4c65-b411-304ebe55456b tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d645bc820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:33.459558 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e33e1f74-40e2-4c65-b411-304ebe55456b tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086224 Oct 19 07:44:33.460157 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3280/6712] 10.222.0.39 () {58 vars in 1170 bytes} [Wed Oct 19 07:44:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:33.473574 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34c9008f-1804-4df6-947f-fcd5b90d58c6 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d6617f310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:33.557716 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-34c9008f-1804-4df6-947f-fcd5b90d58c6 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087799 Oct 19 07:44:33.558389 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3433/6713] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 07:44:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:44:33.572891 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3874251d-b5d8-45f4-9897-fddd56e82f52 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d640258b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:33.654082 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3874251d-b5d8-45f4-9897-fddd56e82f52 tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085974 Oct 19 07:44:33.654712 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3281/6714] 10.222.0.39 () {58 vars in 1188 bytes} [Wed Oct 19 07:44:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:44:33.668868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b19b011-1182-4c53-9130-df78b8d5c10b tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] Calling method '.version_select at 0x7f6d5f56c9d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:44:33.750906 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b19b011-1182-4c53-9130-df78b8d5c10b tempest-VolumesTestJSON-555363771 tempest-VolumesTestJSON-555363771-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085604 Oct 19 07:44:33.753408 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3434/6715] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 07:44:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:49:49.487269 n-d-861333-10 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aad8ca40-72db-434c-b403-c989bcd53426] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 07:49:49.488037 n-d-861333-10 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e0029dd-ab1a-4c8a-bb57-f6ace2ff8212] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 07:49:49.488770 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:49:49.488912 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:49:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 19 07:49:49.490033 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 07:49:49.490203 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:49:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 19 07:49:49.491033 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:49:49.491153 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:49:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 19 07:49:49.496941 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1244536624", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:49:49.818276 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:49:50.090466 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:49:50.090898 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:49:50.091414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:49:50.091838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:49:50.092296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:49:50.105911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:50.106407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:50.106864 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:50.107606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:50.108077 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:50.108554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:50.131860 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Getting quotas for project 60cb9c105579499384d8c9f3b667eb5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:49:50.137841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Getting quotas for user 5b4534f5f6d3490bb90a4631f871aa05 and project 60cb9c105579499384d8c9f3b667eb5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:49:50.150184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:49:50.152534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:49:50.281721 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cfc422c-61fc-46aa-89e7-0d3532174556 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796031 Oct 19 07:49:50.282378 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3282/6716] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:49:50.291391 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4decaece-d501-4665-899d-f3f180143e7c] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 07:49:50.292177 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bca04a53-c8ea-4f59-a487-3dcf4f1196ca] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 07:49:50.292906 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:49:50.293053 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 (ip 10.222.0.39) !!! Oct 19 07:49:50.296090 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 07:49:50.296247 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 (ip 10.222.0.39) !!! Oct 19 07:49:50.298011 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 07:49:50.298136 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 (ip 10.222.0.39) !!! Oct 19 07:49:50.317508 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d70cc3c8-2efa-461c-971f-07b1f4a57eb9 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:49:50.318121 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d70cc3c8-2efa-461c-971f-07b1f4a57eb9 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:49:50.550021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d70cc3c8-2efa-461c-971f-07b1f4a57eb9 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:49:50.560682 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d70cc3c8-2efa-461c-971f-07b1f4a57eb9 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1214 microversion: 2.1 time: 0.270780 Oct 19 07:49:50.561188 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3435/6717] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:49:50 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1214 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:49:51.585474 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e33c7ba-6a76-4eda-9981-4f4bbf4d28f4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:49:51.586112 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e33c7ba-6a76-4eda-9981-4f4bbf4d28f4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:49:51.600320 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e0029dd-ab1a-4c8a-bb57-f6ace2ff8212] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 38774. Oct 19 07:49:51.604450 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [aad8ca40-72db-434c-b403-c989bcd53426] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 38772. Oct 19 07:49:51.655134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e33c7ba-6a76-4eda-9981-4f4bbf4d28f4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:49:51.662652 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e33c7ba-6a76-4eda-9981-4f4bbf4d28f4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1214 microversion: 2.1 time: 0.083706 Oct 19 07:49:51.663224 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3283/6718] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:49:51 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:49:52.686625 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-491ec7ab-5e3f-4bee-ba6c-2a801122fba8 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:49:52.687253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-491ec7ab-5e3f-4bee-ba6c-2a801122fba8 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:49:52.700878 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [bca04a53-c8ea-4f59-a487-3dcf4f1196ca] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 38786. Oct 19 07:49:52.711019 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [4decaece-d501-4665-899d-f3f180143e7c] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 38784. Oct 19 07:49:52.765357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-491ec7ab-5e3f-4bee-ba6c-2a801122fba8 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:49:52.772613 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-491ec7ab-5e3f-4bee-ba6c-2a801122fba8 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1214 microversion: 2.1 time: 0.090530 Oct 19 07:49:52.773209 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3436/6719] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:49:52 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:49:53.795340 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:49:53.795978 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:49:53.803239 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:53.803742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:53.804250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:53.804957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:53.805432 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:53.805873 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:53.871651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:49:53.880302 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a7ddc0fb-a22f-49ea-b9ec-bd1d606d7e63 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1218 microversion: 2.1 time: 0.088969 Oct 19 07:49:53.880801 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3284/6720] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:49:53 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:49:54.903581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:49:54.904893 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:49:54.912527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:54.913025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:54.918304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:54.918304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:54.918304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:54.918304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:54.984225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:49:54.992161 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f319e35-493c-4636-ad8f-05a1c1555349 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1284 microversion: 2.1 time: 0.093110 Oct 19 07:49:54.992925 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3437/6721] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:49:54 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:49:56.014906 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:49:56.015543 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:49:56.022609 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:56.023117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:56.024072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:56.024816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:56.025291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:56.025735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:56.255489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:49:56.263523 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9db710a-3884-4109-b5bc-565c01acd1aa tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1314 microversion: 2.1 time: 0.252593 Oct 19 07:49:56.264110 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3285/6722] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:49:56 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:49:56.940437 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3a0c9c00-ea7c-4353-824c-c56d72954640 req-5356cb5a-5e33-4a7a-bd9a-de8519fd4909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758a5fe7-bba8-4254-8b3e-5b3075ec2be2", "tag": "b77c7451-996f-4aaa-b296-ceedf25660fc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:49:56.950045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3a0c9c00-ea7c-4353-824c-c56d72954640 req-5356cb5a-5e33-4a7a-bd9a-de8519fd4909 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:56.950522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3a0c9c00-ea7c-4353-824c-c56d72954640 req-5356cb5a-5e33-4a7a-bd9a-de8519fd4909 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:56.952201 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3a0c9c00-ea7c-4353-824c-c56d72954640 req-5356cb5a-5e33-4a7a-bd9a-de8519fd4909 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:56.962296 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3a0c9c00-ea7c-4353-824c-c56d72954640 req-5356cb5a-5e33-4a7a-bd9a-de8519fd4909 service nova] Creating event network-changed:b77c7451-996f-4aaa-b296-ceedf25660fc for instance 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 on n-h2-861333-10 Oct 19 07:49:56.968890 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3a0c9c00-ea7c-4353-824c-c56d72954640 req-5356cb5a-5e33-4a7a-bd9a-de8519fd4909 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088214 Oct 19 07:49:56.969189 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3438/6723] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:49:57.286957 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:49:57.287701 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:49:57.295429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:57.295939 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:57.296542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:57.297397 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:57.297911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:57.298358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:57.433616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:49:57.444407 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-441550ef-66a2-441a-b368-562cc0c51e93 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1314 microversion: 2.1 time: 0.161372 Oct 19 07:49:57.444974 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3286/6724] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:49:57 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:49:58.469592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:49:58.470305 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:49:58.476677 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:58.477178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:58.477624 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:58.478335 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:58.478804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:58.479249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:58.615149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:49:58.623401 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b228ce8f-7178-4675-98a8-1a5130d8b9fb tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1314 microversion: 2.1 time: 0.159484 Oct 19 07:49:58.624000 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3439/6725] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:49:58 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:49:59.646495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:49:59.647058 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:49:59.654084 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:59.654592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:59.655048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:59.655766 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:49:59.656274 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:49:59.656726 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:49:59.791215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:49:59.803310 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b702ea2-57a5-499f-b0d9-c4478eb43d1a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1314 microversion: 2.1 time: 0.160735 Oct 19 07:49:59.803901 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3287/6726] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:49:59 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:50:00.828057 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:50:00.828690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:50:00.835610 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:00.836089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:00.836556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:00.837274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:00.837729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:00.838159 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:00.970030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:50:00.977598 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a89e3f7f-6eb4-4e26-826e-c1472412e4f7 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1314 microversion: 2.1 time: 0.154009 Oct 19 07:50:00.978165 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3440/6727] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:50:00 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:50:01.999595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:50:02.000236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:50:02.002113 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:50:02.004078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:50:02.008794 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:02.009290 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:02.009735 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:02.010486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:02.011472 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:02.011920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:02.075945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d838984b-4af1-44f1-91ad-933794eff6a5 req-1cf7bdfa-6038-4827-bd02-6d2cd4075c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758a5fe7-bba8-4254-8b3e-5b3075ec2be2", "name": "network-vif-plugged", "status": "completed", "tag": "b77c7451-996f-4aaa-b296-ceedf25660fc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:50:02.088729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d838984b-4af1-44f1-91ad-933794eff6a5 req-1cf7bdfa-6038-4827-bd02-6d2cd4075c22 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:02.089877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d838984b-4af1-44f1-91ad-933794eff6a5 req-1cf7bdfa-6038-4827-bd02-6d2cd4075c22 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:02.090945 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d838984b-4af1-44f1-91ad-933794eff6a5 req-1cf7bdfa-6038-4827-bd02-6d2cd4075c22 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:02.101973 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d838984b-4af1-44f1-91ad-933794eff6a5 req-1cf7bdfa-6038-4827-bd02-6d2cd4075c22 service nova] Creating event network-vif-plugged:b77c7451-996f-4aaa-b296-ceedf25660fc for instance 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 on n-h2-861333-10 Oct 19 07:50:02.107789 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d838984b-4af1-44f1-91ad-933794eff6a5 req-1cf7bdfa-6038-4827-bd02-6d2cd4075c22 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085445 Oct 19 07:50:02.108775 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3441/6728] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:50:02.167785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:50:02.176976 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca8ed688-0d58-4e4f-aa8e-a41bcc1249ed tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1314 microversion: 2.1 time: 0.181262 Oct 19 07:50:02.177564 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3288/6729] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:50:01 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:50:03.200940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:50:03.201646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:50:03.203603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:50:03.209354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:03.209837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:03.210275 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:03.210970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:03.211426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:03.211857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:03.345471 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:50:03.353393 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cac9f8a8-8b03-4780-966d-f3899b83d1b4 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1314 microversion: 2.1 time: 0.156697 Oct 19 07:50:03.353972 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3442/6730] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:50:03 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:50:04.376342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:50:04.376968 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:50:04.384031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:04.384627 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:04.385075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:04.385779 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:04.386747 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:04.387185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:04.514022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:50:04.521699 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b70f0924-36a8-409e-8cf7-d16952af0b75 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1463 microversion: 2.1 time: 0.149426 Oct 19 07:50:04.522267 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3289/6731] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:50:04 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1463 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:50:04.544225 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3eb4961-b4c6-4674-aa18-bacc2f749be2 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed1c79a7-96af-4430-8d2f-547b1979707c", "device": "/dev/sdb"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:50:04.546684 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3eb4961-b4c6-4674-aa18-bacc2f749be2 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:50:04.553400 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3eb4961-b4c6-4674-aa18-bacc2f749be2 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:04.553880 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3eb4961-b4c6-4674-aa18-bacc2f749be2 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:04.554314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3eb4961-b4c6-4674-aa18-bacc2f749be2 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:04.554992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3eb4961-b4c6-4674-aa18-bacc2f749be2 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:50:04.555445 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3eb4961-b4c6-4674-aa18-bacc2f749be2 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:50:04.555867 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3eb4961-b4c6-4674-aa18-bacc2f749be2 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:50:05.336223 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3eb4961-b4c6-4674-aa18-bacc2f749be2 tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "POST /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.795723 Oct 19 07:50:05.336866 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3443/6732] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 07:50:04 2022] POST /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:51:36.110431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:51:36.111219 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=38 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:51:36.116784 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:51:36.117296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:51:36.123373 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:36.123878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:36.132450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:36.132450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:36.132450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:36.132450 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:36.205751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lazy-loading 'services' on Instance uuid 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:51:36.403764 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14f2b45f-41cb-4323-8c67-696fb36925fc tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "DELETE /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2/os-volume_attachments/ed1c79a7-96af-4430-8d2f-547b1979707c" status: 202 len: 0 microversion: 2.1 time: 0.294947 Oct 19 07:51:36.404335 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3290/6733] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 07:51:36 2022] DELETE /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2/os-volume_attachments/ed1c79a7-96af-4430-8d2f-547b1979707c => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:51:41.760778 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:51:41.761654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:51:41.766731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:51:41.772150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:51:41.774207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:41.774692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:41.775129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:41.775815 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:41.776302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:41.776731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:41.802106 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:51:42.089853 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0db5aa0e-ca42-48f5-8ac0-2963d681c08a tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "DELETE /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 204 len: 0 microversion: 2.1 time: 0.331500 Oct 19 07:51:42.090450 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3444/6734] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:51:41 2022] DELETE /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:51:42.100595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:51:42.106821 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:51:42.107617 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:42.108133 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:42.108592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:42.109304 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:42.109772 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:42.110258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:42.251206 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:51:42.259802 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3929bb5-2d01-453f-912d-9f3692079c4c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1469 microversion: 2.1 time: 0.164744 Oct 19 07:51:42.260403 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3291/6735] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:51:42 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:51:43.284092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:51:43.284825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:51:43.293042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:43.293532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:43.293969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:43.294651 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:43.295103 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:43.295530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:43.435266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:51:43.443095 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9cb0190c-a672-4e31-840c-6061e69dcd7d tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1469 microversion: 2.1 time: 0.163454 Oct 19 07:51:43.443676 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3445/6736] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:51:43 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:51:44.399027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0ca85053-a03f-4107-9360-986bfe74d385 req-564b9d49-1436-4e02-a45a-2a6af8c1dbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758a5fe7-bba8-4254-8b3e-5b3075ec2be2", "name": "network-vif-deleted", "tag": "b77c7451-996f-4aaa-b296-ceedf25660fc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:51:44.409574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0ca85053-a03f-4107-9360-986bfe74d385 req-564b9d49-1436-4e02-a45a-2a6af8c1dbf9 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:44.410066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0ca85053-a03f-4107-9360-986bfe74d385 req-564b9d49-1436-4e02-a45a-2a6af8c1dbf9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:44.410511 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0ca85053-a03f-4107-9360-986bfe74d385 req-564b9d49-1436-4e02-a45a-2a6af8c1dbf9 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:44.422056 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0ca85053-a03f-4107-9360-986bfe74d385 req-564b9d49-1436-4e02-a45a-2a6af8c1dbf9 service nova] Creating event network-vif-deleted:b77c7451-996f-4aaa-b296-ceedf25660fc for instance 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 on n-h2-861333-10 Oct 19 07:51:44.427782 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0ca85053-a03f-4107-9360-986bfe74d385 req-564b9d49-1436-4e02-a45a-2a6af8c1dbf9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032038 Oct 19 07:51:44.428414 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3292/6737] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:51:44.466073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:51:44.466824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:51:44.473621 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:44.474628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:44.475071 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:44.475776 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:44.476261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:44.476724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:44.541698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4534f5f6d3490bb90a4631f871aa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cb9c105579499384d8c9f3b667eb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:51:44.549526 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43613b26-5c6c-473d-8860-51b2455eaf9c tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 200 len: 1427 microversion: 2.1 time: 0.087547 Oct 19 07:51:44.550130 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3446/6738] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:51:44 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:51:45.575225 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:51:45.575940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] [instance: 758a5fe7-bba8-4254-8b3e-5b3075ec2be2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:51:45.582413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:45.582948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:45.583434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:45.584190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:51:45.584672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:51:45.585122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:51:45.598262 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] HTTP exception thrown: Instance 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 could not be found. Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Request method failure captured: Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 HTTP/1.1 Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT6waOEKGrZJ0iCs1C2Ig3Ma6QHoG62-iHi_f61MiIvA8V8kdbOGZPDMWZAtaeIZXUZjXJRb7AH5TlxKakJQdggt2D66AC6nsmMeAdXYZWMHu6Id9b1P9OM8MyhksONK5--r1XkHwzeDctRV5hDJzSfTslGqt2eW85CjQBw-6i5Us7jE Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 60cb9c105579499384d8c9f3b667eb5c Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesBackupsTest-1628645976 Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60cb9c105579499384d8c9f3b667eb5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60cb9c105579499384d8c9f3b667eb5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60cb9c105579499384d8c9f3b667eb5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60cb9c105579499384d8c9f3b667eb5c", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesBackupsTest-1628645976 Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 60cb9c105579499384d8c9f3b667eb5c Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesBackupsTest-1628645976 Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-VolumesBackupsTest-1628645976-project Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 5b4534f5f6d3490bb90a4631f871aa05 Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesBackupsTest-1628645976-project Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 could not be found. Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '758a5fe7-bba8-4254-8b3e-5b3075ec2be2'} Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 could not be found. Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 could not be found. Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:51:45.599969 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 could not be found. Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] Returning 404 to user: Instance 758a5fe7-bba8-4254-8b3e-5b3075ec2be2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bc280ed6-9f2a-4ade-84c3-9b52ab53682b tempest-VolumesBackupsTest-1628645976 tempest-VolumesBackupsTest-1628645976-project] 10.222.0.39 "GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2" status: 404 len: 111 microversion: 2.1 time: 0.031375 Oct 19 07:51:45.608739 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3293/6739] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:51:45 2022] GET /compute/v2.1/servers/758a5fe7-bba8-4254-8b3e-5b3075ec2be2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 07:55:56.510980 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4decaece-d501-4665-899d-f3f180143e7c] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 07:55:56.511970 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bca04a53-c8ea-4f59-a487-3dcf4f1196ca] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 07:55:56.512793 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:55:56.513555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:55:56.514340 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:55:56.514481 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.39) !!! Oct 19 07:55:56.515630 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 07:55:56.515773 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.39) !!! Oct 19 07:55:56.516655 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:55:56.516784 n-d-861333-10 devstack@n-api.service[127567]: Wed Oct 19 07:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.39) !!! Oct 19 07:55:56.703998 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d27b3562-67e3-4f2d-89b6-0982a262c9a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'create', calling method: .version_select at 0x7f6d68ba3160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1966367815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//Rp37h9iZ4M1QBC4Fq0aauTJ7bJds5NgJ2bR7CUiLjj5iBkeQrRVXZ5qOWO1f+2f6j3zA5d0KXNe8zWiGO4PZrnb/UEegFs7xqYJKqYETgimfe5/YDW/YikjiiupI9A=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:55:56.721202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d27b3562-67e3-4f2d-89b6-0982a262c9a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for project 8954eb6d03f64f77812613cb33a94c35. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:55:56.726398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d27b3562-67e3-4f2d-89b6-0982a262c9a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for user 39d33dcf01aa4a0e892b4dfead2cb150 and project 8954eb6d03f64f77812613cb33a94c35. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:55:56.798340 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d27b3562-67e3-4f2d-89b6-0982a262c9a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.289341 Oct 19 07:55:56.798938 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3447/6740] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:55:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:56:05.419266 n-d-861333-10 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e0029dd-ab1a-4c8a-bb57-f6ace2ff8212] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 07:56:05.429072 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-202322938", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "3dcf83a7-22a8-4b6c-ba93-2eac8b05cdaf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1966367815", "security_groups": [{"name": "tempest-secgroup-smoke-672743806"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:56:05.444672 n-d-861333-10 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aad8ca40-72db-434c-b403-c989bcd53426] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 07:56:05.445254 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:05.446174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:05.448676 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:56:05.448808 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:56:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 19 07:56:05.451557 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 07:56:05.451689 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:56:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 19 07:56:05.453414 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 07:56:05.453519 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 07:56:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 19 07:56:05.715790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] validate_networks() for [('3dcf83a7-22a8-4b6c-ba93-2eac8b05cdaf', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:56:06.325053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:56:06.325569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:56:06.326198 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:56:06.326774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:56:06.327277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:56:06.336547 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:06.337127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:06.337655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:06.338462 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:06.339012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:06.339534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:06.358513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for project 8954eb6d03f64f77812613cb33a94c35. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:56:06.363851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for user 39d33dcf01aa4a0e892b4dfead2cb150 and project 8954eb6d03f64f77812613cb33a94c35. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:56:06.376433 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:56:06.378750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:56:06.426499 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e0029dd-ab1a-4c8a-bb57-f6ace2ff8212] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 42960. Oct 19 07:56:06.451878 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [aad8ca40-72db-434c-b403-c989bcd53426] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 42962. Oct 19 07:56:06.475599 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e877d6b-c86d-4dcf-b505-262688af2d6c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.059423 Oct 19 07:56:06.482603 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3294/6741] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:56:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:56:06.489137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb3c7837-7e20-410e-86b2-768e8ebd9076 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:06.489760 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb3c7837-7e20-410e-86b2-768e8ebd9076 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:06.515572 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [bca04a53-c8ea-4f59-a487-3dcf4f1196ca] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 42970. Oct 19 07:56:06.522359 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [4decaece-d501-4665-899d-f3f180143e7c] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 42968. Oct 19 07:56:06.632026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb3c7837-7e20-410e-86b2-768e8ebd9076 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:06.642841 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb3c7837-7e20-410e-86b2-768e8ebd9076 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1266 microversion: 2.1 time: 0.158620 Oct 19 07:56:06.658668 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3448/6742] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:06 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:07.667378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3497e617-2fd9-4558-9986-7d1f312324e7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:07.668571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3497e617-2fd9-4558-9986-7d1f312324e7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:07.731960 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3497e617-2fd9-4558-9986-7d1f312324e7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:07.749835 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3497e617-2fd9-4558-9986-7d1f312324e7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1266 microversion: 2.1 time: 0.087096 Oct 19 07:56:07.750437 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3295/6743] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:07 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:08.773174 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:08.773783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:08.782168 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:08.782656 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:08.783095 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:08.783794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:08.784299 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:08.784729 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:08.846643 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:08.854312 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d887ebb1-b2de-4e38-915e-aa111b077a1c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1318 microversion: 2.1 time: 0.085245 Oct 19 07:56:08.854891 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3449/6744] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:08 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1318 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:09.877926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:09.890643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:09.890643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:09.890643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:09.890643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:09.890643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:09.890643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:09.890643 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:10.036468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:10.044688 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b3f1aa4-1508-4201-8599-fcd36b57a8f5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1391 microversion: 2.1 time: 0.170697 Oct 19 07:56:10.045346 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3296/6745] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:09 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:10.889248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-25bdfa88-4d54-4f5a-a6d4-e2f187730015 req-4f75f590-8d3a-48f3-8c69-08161dc165c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09b7897-9128-470a-807d-1dcaaf9a5e4f", "tag": "89335681-3e9b-426e-8981-16f0a58c505a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:56:10.899534 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-25bdfa88-4d54-4f5a-a6d4-e2f187730015 req-4f75f590-8d3a-48f3-8c69-08161dc165c1 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:10.900426 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-25bdfa88-4d54-4f5a-a6d4-e2f187730015 req-4f75f590-8d3a-48f3-8c69-08161dc165c1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:10.900862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-25bdfa88-4d54-4f5a-a6d4-e2f187730015 req-4f75f590-8d3a-48f3-8c69-08161dc165c1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:10.916514 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-25bdfa88-4d54-4f5a-a6d4-e2f187730015 req-4f75f590-8d3a-48f3-8c69-08161dc165c1 service nova] Creating event network-changed:89335681-3e9b-426e-8981-16f0a58c505a for instance c09b7897-9128-470a-807d-1dcaaf9a5e4f on n-h2-861333-10 Oct 19 07:56:10.923004 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-25bdfa88-4d54-4f5a-a6d4-e2f187730015 req-4f75f590-8d3a-48f3-8c69-08161dc165c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094158 Oct 19 07:56:10.923613 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3450/6746] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:56:11.068542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:11.069872 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:11.077237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:11.077754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:11.078214 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:11.078938 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:11.079416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:11.079862 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:11.283591 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:11.291425 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23c6ea21-7115-46e4-b87a-a6043d5df0fc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1391 microversion: 2.1 time: 0.226855 Oct 19 07:56:11.292303 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3297/6747] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:11 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:12.315576 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:12.316313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:12.322475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:12.322957 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:12.323395 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:12.324082 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:12.324562 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:12.324997 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:12.460384 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:12.468831 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e990e2aa-8a9b-4695-ac5a-1c044d07a647 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1391 microversion: 2.1 time: 0.158408 Oct 19 07:56:12.469385 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3451/6748] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:12 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:13.492327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:13.493178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:13.501011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:13.501520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:13.501976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:13.502703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:13.503228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:13.503670 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:13.640835 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:13.648815 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bef55a4-7158-44e9-977e-43b1812f6d57 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1391 microversion: 2.1 time: 0.161776 Oct 19 07:56:13.649399 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3298/6749] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:13 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:14.672483 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:14.673031 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:14.679930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:14.680457 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:14.680932 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:14.681637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:14.682109 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:14.682544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:14.811953 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:14.819654 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bec99b2-9a05-43a7-9baf-32c766b3c3af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1391 microversion: 2.1 time: 0.151183 Oct 19 07:56:14.820254 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3452/6750] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:14 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:15.669492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-751ba4e2-0c52-4a09-899c-8934b0151487 req-03252b88-b862-4a26-9df3-28cfbc7ab014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09b7897-9128-470a-807d-1dcaaf9a5e4f", "name": "network-vif-plugged", "status": "completed", "tag": "89335681-3e9b-426e-8981-16f0a58c505a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:56:15.679097 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-751ba4e2-0c52-4a09-899c-8934b0151487 req-03252b88-b862-4a26-9df3-28cfbc7ab014 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:15.679586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-751ba4e2-0c52-4a09-899c-8934b0151487 req-03252b88-b862-4a26-9df3-28cfbc7ab014 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:15.680034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-751ba4e2-0c52-4a09-899c-8934b0151487 req-03252b88-b862-4a26-9df3-28cfbc7ab014 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:15.692192 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-751ba4e2-0c52-4a09-899c-8934b0151487 req-03252b88-b862-4a26-9df3-28cfbc7ab014 service nova] Creating event network-vif-plugged:89335681-3e9b-426e-8981-16f0a58c505a for instance c09b7897-9128-470a-807d-1dcaaf9a5e4f on n-h2-861333-10 Oct 19 07:56:15.698029 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-751ba4e2-0c52-4a09-899c-8934b0151487 req-03252b88-b862-4a26-9df3-28cfbc7ab014 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091827 Oct 19 07:56:15.698626 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3299/6751] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:56:15.843834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:15.844493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:15.851312 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:15.851812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:15.852291 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:15.853006 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:15.853509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:15.853949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:15.984128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:15.991736 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a98bc05-9d8a-4a45-a807-a85a5a3a3f56 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1391 microversion: 2.1 time: 0.152700 Oct 19 07:56:15.992347 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3453/6752] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:15 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:17.011584 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:17.016764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:17.017478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:17.023656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:17.024224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:17.024680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:17.025387 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:17.025858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:17.026341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:17.160764 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:17.168418 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63f5e63f-bf7f-4572-b970-2e4285c22d05 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1391 microversion: 2.1 time: 0.157770 Oct 19 07:56:17.169542 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3300/6753] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:17 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:18.191803 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:18.192442 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:18.194451 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:18.200678 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:18.201217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:18.201654 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:18.202344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:18.202801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:18.207698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:18.335949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:18.344213 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f5f609f-4587-4e65-8615-c33090a10344 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1563 microversion: 2.1 time: 0.156594 Oct 19 07:56:18.344796 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3454/6754] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:18 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:18.365959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:18.366580 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:18.368516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:18.374695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:18.379273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:18.379273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:18.379273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:18.379273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:18.379273 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:18.511867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:18.519631 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a3eca49-11f7-4adf-bf46-987565ada8cb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1563 microversion: 2.1 time: 0.157535 Oct 19 07:56:18.520212 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3301/6755] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:18 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:20.701385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:20.702000 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:20.707702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-46edaf8a-1a25-40b3-ac06-ddbd2203977a req-56d1aaba-1586-4dc5-98c4-86dba11d827a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09b7897-9128-470a-807d-1dcaaf9a5e4f", "tag": "89335681-3e9b-426e-8981-16f0a58c505a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:56:20.719050 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:20.719620 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:20.720163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:20.720924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:20.721393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46edaf8a-1a25-40b3-ac06-ddbd2203977a req-56d1aaba-1586-4dc5-98c4-86dba11d827a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:20.721530 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:20.721834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:20.722353 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46edaf8a-1a25-40b3-ac06-ddbd2203977a req-56d1aaba-1586-4dc5-98c4-86dba11d827a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:20.722804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46edaf8a-1a25-40b3-ac06-ddbd2203977a req-56d1aaba-1586-4dc5-98c4-86dba11d827a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:20.737287 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-46edaf8a-1a25-40b3-ac06-ddbd2203977a req-56d1aaba-1586-4dc5-98c4-86dba11d827a service nova] Creating event network-changed:89335681-3e9b-426e-8981-16f0a58c505a for instance c09b7897-9128-470a-807d-1dcaaf9a5e4f on n-h2-861333-10 Oct 19 07:56:20.742356 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-46edaf8a-1a25-40b3-ac06-ddbd2203977a req-56d1aaba-1586-4dc5-98c4-86dba11d827a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038146 Oct 19 07:56:20.742962 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3302/6756] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:56:20.864142 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:20.873051 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46bf0c0c-b9d2-459f-ba80-d8a74b28399b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1563 microversion: 2.1 time: 0.176150 Oct 19 07:56:20.880398 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3455/6757] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:20 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:44.130950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:44.131724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=36 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:44.136124 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43415f4b-4473-44ad-ab4e-968236434906 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:56:44.138402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43415f4b-4473-44ad-ab4e-968236434906 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:44.144363 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43415f4b-4473-44ad-ab4e-968236434906 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:44.145246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43415f4b-4473-44ad-ab4e-968236434906 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:44.145486 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43415f4b-4473-44ad-ab4e-968236434906 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:44.146193 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43415f4b-4473-44ad-ab4e-968236434906 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:44.146660 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43415f4b-4473-44ad-ab4e-968236434906 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:44.147098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43415f4b-4473-44ad-ab4e-968236434906 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:44.203237 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43415f4b-4473-44ad-ab4e-968236434906 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action" status: 200 len: 24562 microversion: 2.1 time: 0.074065 Oct 19 07:56:44.204158 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3303/6758] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:56:44 2022] POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action => generated 24562 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 07:56:54.964020 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37deca2c-5b9a-49b5-9211-74b10adf3ce0 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:54.964669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37deca2c-5b9a-49b5-9211-74b10adf3ce0 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:54.967028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:54.967702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=38 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:54.972473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37deca2c-5b9a-49b5-9211-74b10adf3ce0 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:54.972967 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37deca2c-5b9a-49b5-9211-74b10adf3ce0 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:54.973419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37deca2c-5b9a-49b5-9211-74b10adf3ce0 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:54.974710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37deca2c-5b9a-49b5-9211-74b10adf3ce0 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:54.975173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37deca2c-5b9a-49b5-9211-74b10adf3ce0 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:54.975611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37deca2c-5b9a-49b5-9211-74b10adf3ce0 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:55.261956 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37deca2c-5b9a-49b5-9211-74b10adf3ce0 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1835 microversion: 2.1 time: 0.301462 Oct 19 07:56:55.262629 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3456/6759] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:54 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1835 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:55.286555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:55.287924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:55.291191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:56:55.296632 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:55.297127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:55.297575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:55.298278 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:55.298750 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:55.299224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:55.431277 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:55.439513 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39c71c0e-5e19-4229-b363-6b14f6f3c8a6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1682 microversion: 2.1 time: 0.157286 Oct 19 07:56:55.440071 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3304/6760] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:55 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:55.536280 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-edd407ce-c2c3-48a2-8f77-3d7eb6928b78 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:56:55.538596 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-edd407ce-c2c3-48a2-8f77-3d7eb6928b78 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:55.544658 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edd407ce-c2c3-48a2-8f77-3d7eb6928b78 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:55.545161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edd407ce-c2c3-48a2-8f77-3d7eb6928b78 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:55.545582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edd407ce-c2c3-48a2-8f77-3d7eb6928b78 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:55.546277 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edd407ce-c2c3-48a2-8f77-3d7eb6928b78 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:55.546735 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edd407ce-c2c3-48a2-8f77-3d7eb6928b78 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:55.547171 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edd407ce-c2c3-48a2-8f77-3d7eb6928b78 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:55.599374 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-edd407ce-c2c3-48a2-8f77-3d7eb6928b78 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action" status: 200 len: 32637 microversion: 2.1 time: 0.066971 Oct 19 07:56:55.600040 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3457/6761] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:56:55 2022] POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action => generated 32637 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:56:55.749170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:56:55.749848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:55.757360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:55.757863 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:55.758314 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:55.759050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:55.759541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:55.759982 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:55.797600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '041c1ab23c6041b5a2c3c500a64267ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49566ac04cd64312a6bc342145b40431', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:55.798211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] flavor_id is None. Assuming migration. {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 07:56:55.798694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 07:56:56.100791 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8f34284-83fd-4309-92e8-35d227561941 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action" status: 202 len: 0 microversion: 2.1 time: 0.356023 Oct 19 07:56:56.101426 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3305/6762] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:56:55 2022] POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:56:56.110228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:56.110927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:56.119021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:56.119540 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:56.119954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:56.120686 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:56.121147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:56.121583 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:56.253518 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:56.262027 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7e44e17-50fe-42b2-a9eb-2b03ed1811ba tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1691 microversion: 2.1 time: 0.156181 Oct 19 07:56:56.262601 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3458/6763] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:56 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:57.285782 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:57.286431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:57.293431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:57.293926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:57.294375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:57.295091 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:57.295557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:57.295995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:57.430774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:57.438900 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f208871c-1221-46da-bbdc-b45ccf21733e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1691 microversion: 2.1 time: 0.157838 Oct 19 07:56:57.439476 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3306/6764] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:57 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:58.462792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:58.463320 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:58.469981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:58.470468 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:58.470995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:58.471692 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:58.472173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:58.472603 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:58.610513 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:58.619316 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1fd8b43-a364-43a2-ada0-8d1d816dc85a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1691 microversion: 2.1 time: 0.160483 Oct 19 07:56:58.619878 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3459/6765] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:58 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:56:59.643048 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:56:59.643786 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:56:59.653230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:59.653230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:59.654560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:59.655476 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:56:59.656118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:56:59.656717 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:56:59.795327 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:56:59.803819 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1adb968-6776-4918-ad2e-bc2fe93578c0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.164805 Oct 19 07:56:59.807195 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3307/6766] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:56:59 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:00.828489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:00.829262 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:00.836197 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:00.846032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:00.846032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:00.846032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:00.846032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:00.846032 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:00.969150 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:00.977481 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68003c32-930c-4731-80f5-bff1c122f79d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.153172 Oct 19 07:57:00.978063 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3460/6767] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:00 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:02.001431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:02.002085 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:02.010087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:02.010586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:02.011042 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:02.011751 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:02.012250 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:02.012694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:02.146990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:02.154718 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7f1c142-4dd2-41c5-beb9-9f71c9650753 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.157225 Oct 19 07:57:02.155294 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3308/6768] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:01 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:03.178352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:03.179002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:03.185902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:03.186392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:03.186838 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:03.187544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:03.188008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:03.188472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:03.319704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:03.327485 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7632d86-7fab-416f-808c-f9252b81114a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.153638 Oct 19 07:57:03.328057 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3461/6769] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:03 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:04.351294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:04.351959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:04.358829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:04.359333 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:04.359790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:04.360530 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:04.361004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:04.361453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:04.500812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:04.512938 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ea23317-fa16-4e68-9f73-9baf265e962f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.166044 Oct 19 07:57:04.513525 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3309/6770] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:04 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:05.537671 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:05.538287 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:05.545209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:05.545689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:05.546136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:05.546833 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:05.547297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:05.547744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:05.679850 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:05.687492 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-71ac17e7-8e18-4fdf-a97f-bb29262c30e6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.153713 Oct 19 07:57:05.688061 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3462/6771] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:05 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:06.711826 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:06.712473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:06.719004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:06.719496 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:06.719946 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:06.720685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:06.721134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:06.721574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:06.851475 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:06.859211 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b65ba9bc-bf4e-4ef3-b11a-efd774ea4b66 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.152092 Oct 19 07:57:06.859781 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3310/6772] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:06 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:07.883011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:07.883582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:07.890104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:07.890611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:07.891040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:07.891744 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:07.892235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:07.896701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:08.025937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:08.033649 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d7f1506-a729-4f2a-9a69-8549e8c33bc9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.155171 Oct 19 07:57:08.034224 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3463/6773] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:07 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:09.057869 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:09.058509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:09.065346 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:09.065838 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:09.066286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:09.066981 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:09.067448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:09.067884 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:09.197800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:09.205470 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8deb8d8d-6238-4ff1-ae99-1b8da825d06f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.151510 Oct 19 07:57:09.206042 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3311/6774] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:09 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:10.230048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:10.230570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:10.237868 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:10.238359 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:10.238796 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:10.239489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:10.240035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:10.240520 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:10.664501 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:10.672193 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ef1e155-bdb7-4f6d-831a-5fdef234b9d4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.446121 Oct 19 07:57:10.672766 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3464/6775] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:10 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:11.695123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:11.695780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:11.702695 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:11.703199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:11.703650 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:11.704394 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:11.704867 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:11.705310 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:11.840236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:11.847976 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a092c4b-3db5-4959-9dbd-ce889bf029af tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.156826 Oct 19 07:57:11.855631 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3312/6776] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:11 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:12.871972 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:12.872608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:12.879598 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:12.880084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:12.880549 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:12.881411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:12.881874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:12.882573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:13.012002 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:13.020083 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92ca2bad-4cab-48b9-817f-88ae081f36e3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.152249 Oct 19 07:57:13.020709 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3465/6777] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:12 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:14.043928 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:14.044592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:14.051335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:14.051827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:14.052336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:14.053040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:14.053506 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:14.053943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:14.184199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:14.191780 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7103ac06-76b1-4d2f-b994-cdb96abb6d7a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.151789 Oct 19 07:57:14.192377 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3313/6778] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:14 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:15.223689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:15.223689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:15.223689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:15.223689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:15.223689 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:15.224556 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:15.224629 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:15.225048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:15.358117 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:15.366260 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be8403a9-9813-422a-b5c7-3e48e716c020 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.155222 Oct 19 07:57:15.366824 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3466/6779] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:15 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:57:16.390473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:16.391103 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:16.399336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:16.399833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:16.400318 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:16.401030 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:16.401505 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:16.401948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:16.542106 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:16.549997 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c135806-b524-4581-a090-2225120ae475 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1696 microversion: 2.1 time: 0.163473 Oct 19 07:57:16.550589 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3314/6780] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:16 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:17.573812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:17.574439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:17.581323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:17.581811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:17.582246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:17.582955 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:17.583398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:17.583820 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:17.719131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:17.727320 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3ba232b-8379-46c3-aade-0ba16663bade tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1695 microversion: 2.1 time: 0.157287 Oct 19 07:57:17.727906 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3467/6781] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:17 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:17.940592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8ddc665f-3773-4db4-8f92-ec04e61c7785 req-967c4bb9-e4bd-4e16-a5ac-171f1d65f05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09b7897-9128-470a-807d-1dcaaf9a5e4f", "name": "network-vif-unplugged", "status": "completed", "tag": "89335681-3e9b-426e-8981-16f0a58c505a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:57:17.940592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8ddc665f-3773-4db4-8f92-ec04e61c7785 req-967c4bb9-e4bd-4e16-a5ac-171f1d65f05e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:17.940592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8ddc665f-3773-4db4-8f92-ec04e61c7785 req-967c4bb9-e4bd-4e16-a5ac-171f1d65f05e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:17.940592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8ddc665f-3773-4db4-8f92-ec04e61c7785 req-967c4bb9-e4bd-4e16-a5ac-171f1d65f05e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:17.949132 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8ddc665f-3773-4db4-8f92-ec04e61c7785 req-967c4bb9-e4bd-4e16-a5ac-171f1d65f05e service nova] Creating event network-vif-unplugged:89335681-3e9b-426e-8981-16f0a58c505a for instance c09b7897-9128-470a-807d-1dcaaf9a5e4f on n-h1-861333-10 Oct 19 07:57:17.954557 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-8ddc665f-3773-4db4-8f92-ec04e61c7785 req-967c4bb9-e4bd-4e16-a5ac-171f1d65f05e service nova] Instance c09b7897-9128-470a-807d-1dcaaf9a5e4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 07:57:17.965289 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8ddc665f-3773-4db4-8f92-ec04e61c7785 req-967c4bb9-e4bd-4e16-a5ac-171f1d65f05e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046434 Oct 19 07:57:17.967741 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3315/6782] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:57:18.754832 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:18.755981 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:18.763067 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:18.763557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:18.764001 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:18.764732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:18.765192 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:18.765623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:18.898243 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:18.906098 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11b93615-fb5b-47ba-b4af-3ef92f94792f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1695 microversion: 2.1 time: 0.155118 Oct 19 07:57:18.906681 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3468/6783] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:18 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:19.932205 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:19.932839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:19.938958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:19.939452 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:19.939903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:19.940631 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:19.941098 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:19.941534 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:19.981160 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-24ee2db9-8fd7-4a50-a376-43938266da3b req-8bb84e06-5ca6-427a-be81-fd2da49959dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09b7897-9128-470a-807d-1dcaaf9a5e4f", "tag": "89335681-3e9b-426e-8981-16f0a58c505a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:57:19.991284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-24ee2db9-8fd7-4a50-a376-43938266da3b req-8bb84e06-5ca6-427a-be81-fd2da49959dc service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:19.991852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-24ee2db9-8fd7-4a50-a376-43938266da3b req-8bb84e06-5ca6-427a-be81-fd2da49959dc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:19.992415 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-24ee2db9-8fd7-4a50-a376-43938266da3b req-8bb84e06-5ca6-427a-be81-fd2da49959dc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:20.004122 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-24ee2db9-8fd7-4a50-a376-43938266da3b req-8bb84e06-5ca6-427a-be81-fd2da49959dc service nova] Creating event network-changed:89335681-3e9b-426e-8981-16f0a58c505a for instance c09b7897-9128-470a-807d-1dcaaf9a5e4f on n-h1-861333-10 Oct 19 07:57:20.013901 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-24ee2db9-8fd7-4a50-a376-43938266da3b req-8bb84e06-5ca6-427a-be81-fd2da49959dc service nova] Instance c09b7897-9128-470a-807d-1dcaaf9a5e4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 07:57:20.026026 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-24ee2db9-8fd7-4a50-a376-43938266da3b req-8bb84e06-5ca6-427a-be81-fd2da49959dc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048461 Oct 19 07:57:20.026659 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3469/6784] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:57:20.114311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:20.122130 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-787bcf8e-4dd9-403f-aef0-6223f87a0300 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1693 microversion: 2.1 time: 0.195207 Oct 19 07:57:20.122704 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3316/6785] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:19 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:21.149553 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:21.150218 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:21.156544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:21.157025 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:21.157466 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:21.158158 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:21.158720 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:21.159147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:21.304906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:21.313014 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5e71433-ab04-49b2-8cc4-b0c97fba9992 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1693 microversion: 2.1 time: 0.169172 Oct 19 07:57:21.313616 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3470/6786] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:21 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:22.339555 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:22.340212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:22.347032 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:22.347536 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:22.347995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:22.348737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:22.349215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:22.349665 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:22.486100 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:22.493891 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4412b1d-e8d8-44ed-8263-78f991e886b6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1690 microversion: 2.1 time: 0.158370 Oct 19 07:57:22.494471 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3317/6787] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:22 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:22.519220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08082be8-d87e-4fd1-9f67-d6ce59e4579e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:57:22.519750 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08082be8-d87e-4fd1-9f67-d6ce59e4579e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:22.527089 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08082be8-d87e-4fd1-9f67-d6ce59e4579e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:22.527582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08082be8-d87e-4fd1-9f67-d6ce59e4579e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:22.528028 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08082be8-d87e-4fd1-9f67-d6ce59e4579e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:22.528999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08082be8-d87e-4fd1-9f67-d6ce59e4579e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:22.529462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08082be8-d87e-4fd1-9f67-d6ce59e4579e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:22.529896 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08082be8-d87e-4fd1-9f67-d6ce59e4579e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:22.709217 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08082be8-d87e-4fd1-9f67-d6ce59e4579e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action" status: 204 len: 0 microversion: 2.1 time: 0.193746 Oct 19 07:57:22.709873 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3471/6788] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:57:22 2022] POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:57:22.718328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:22.719039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:22.725571 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:22.726079 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:22.726532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:22.727249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:22.727729 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:22.728208 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:22.929702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:22.938233 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d42e05f1-d3c0-4e18-9113-b2edc93faee2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1690 microversion: 2.1 time: 0.223798 Oct 19 07:57:22.938828 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3318/6789] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:22 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1690 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:23.944636 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ab13eb2b-7e37-45cd-9b42-50e965c49e28 req-d8dc565f-f459-4b9b-85ba-653f60d1edf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09b7897-9128-470a-807d-1dcaaf9a5e4f", "name": "network-vif-plugged", "status": "completed", "tag": "89335681-3e9b-426e-8981-16f0a58c505a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:57:23.954615 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab13eb2b-7e37-45cd-9b42-50e965c49e28 req-d8dc565f-f459-4b9b-85ba-653f60d1edf4 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:23.955101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab13eb2b-7e37-45cd-9b42-50e965c49e28 req-d8dc565f-f459-4b9b-85ba-653f60d1edf4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:23.955548 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab13eb2b-7e37-45cd-9b42-50e965c49e28 req-d8dc565f-f459-4b9b-85ba-653f60d1edf4 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:23.958322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:57:23.962329 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:23.963005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:23.968182 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ab13eb2b-7e37-45cd-9b42-50e965c49e28 req-d8dc565f-f459-4b9b-85ba-653f60d1edf4 service nova] Creating event network-vif-plugged:89335681-3e9b-426e-8981-16f0a58c505a for instance c09b7897-9128-470a-807d-1dcaaf9a5e4f on n-h1-861333-10 Oct 19 07:57:23.971535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:23.971535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:23.971535 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:23.972053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:23.972619 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:23.973126 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:23.973659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-ab13eb2b-7e37-45cd-9b42-50e965c49e28 req-d8dc565f-f459-4b9b-85ba-653f60d1edf4 service nova] Instance c09b7897-9128-470a-807d-1dcaaf9a5e4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 07:57:23.977757 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:57:23.985251 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ab13eb2b-7e37-45cd-9b42-50e965c49e28 req-d8dc565f-f459-4b9b-85ba-653f60d1edf4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045512 Oct 19 07:57:23.985946 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3472/6790] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:57:24.117681 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:24.125890 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a7bc5d0-eed5-41e3-a431-f9bdda089e15 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1690 microversion: 2.1 time: 0.167784 Oct 19 07:57:24.126483 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3319/6791] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:23 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:57:25.150982 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:25.151690 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:25.154035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=35 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:57:25.159219 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:25.159743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:25.160221 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:25.160918 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:25.161379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:25.161812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:25.293623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:25.301677 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-600fb09a-a110-4792-be1d-195c58fade3a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1682 microversion: 2.1 time: 0.155731 Oct 19 07:57:25.302251 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3473/6792] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:25 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:47.508191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee3d3b2a-6c44-4328-93d9-53d30784658b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:57:47.510470 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ee3d3b2a-6c44-4328-93d9-53d30784658b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:47.513230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=36 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:57:47.518645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee3d3b2a-6c44-4328-93d9-53d30784658b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:47.519142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee3d3b2a-6c44-4328-93d9-53d30784658b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:47.519598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee3d3b2a-6c44-4328-93d9-53d30784658b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:47.520378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee3d3b2a-6c44-4328-93d9-53d30784658b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:47.523516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee3d3b2a-6c44-4328-93d9-53d30784658b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:47.523516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee3d3b2a-6c44-4328-93d9-53d30784658b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:47.586673 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ee3d3b2a-6c44-4328-93d9-53d30784658b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action" status: 200 len: 24578 microversion: 2.1 time: 0.082798 Oct 19 07:57:47.587318 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3320/6793] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:57:47 2022] POST /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f/action => generated 24578 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:57:54.011725 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63154d8a-9500-420e-a81c-66da4ea2281d tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:54.012394 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63154d8a-9500-420e-a81c-66da4ea2281d tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:54.014557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:57:54.020321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63154d8a-9500-420e-a81c-66da4ea2281d tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:54.020813 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63154d8a-9500-420e-a81c-66da4ea2281d tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:54.021255 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63154d8a-9500-420e-a81c-66da4ea2281d tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:54.021952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63154d8a-9500-420e-a81c-66da4ea2281d tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:54.022411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63154d8a-9500-420e-a81c-66da4ea2281d tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:54.022843 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63154d8a-9500-420e-a81c-66da4ea2281d tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:54.150424 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63154d8a-9500-420e-a81c-66da4ea2281d tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1835 microversion: 2.1 time: 0.143179 Oct 19 07:57:54.150999 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3474/6794] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:54 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1835 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:55.084520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:55.085279 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:55.093313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:55.093905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:55.094430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:55.095154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:55.095623 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:55.096495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:55.124513 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 07:57:55.202328 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dd178eae-655c-4c45-8220-d52397e43584 req-0bd7aaba-564b-4380-bc4e-3adfc6b706cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09b7897-9128-470a-807d-1dcaaf9a5e4f", "tag": "89335681-3e9b-426e-8981-16f0a58c505a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:57:55.213705 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dd178eae-655c-4c45-8220-d52397e43584 req-0bd7aaba-564b-4380-bc4e-3adfc6b706cc service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:55.213888 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dd178eae-655c-4c45-8220-d52397e43584 req-0bd7aaba-564b-4380-bc4e-3adfc6b706cc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:55.214283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dd178eae-655c-4c45-8220-d52397e43584 req-0bd7aaba-564b-4380-bc4e-3adfc6b706cc service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:55.228089 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dd178eae-655c-4c45-8220-d52397e43584 req-0bd7aaba-564b-4380-bc4e-3adfc6b706cc service nova] Creating event network-changed:89335681-3e9b-426e-8981-16f0a58c505a for instance c09b7897-9128-470a-807d-1dcaaf9a5e4f on n-h1-861333-10 Oct 19 07:57:55.234351 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dd178eae-655c-4c45-8220-d52397e43584 req-0bd7aaba-564b-4380-bc4e-3adfc6b706cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100277 Oct 19 07:57:55.235279 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3475/6795] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 07:57:55.455840 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d68aea53-b368-4e50-b251-8adaafd0fe13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 204 len: 0 microversion: 2.1 time: 0.372284 Oct 19 07:57:55.455840 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3321/6796] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 07:57:55 2022] DELETE /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 07:57:55.462710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:55.463423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:55.469922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:55.470543 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:55.470995 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:55.471702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:55.472198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:55.472637 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:55.614200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:55.622616 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4ae773c-01f6-443f-bec9-2a266ba5bc81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1688 microversion: 2.1 time: 0.164445 Oct 19 07:57:55.623281 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3476/6797] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:55 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:56.647437 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:56.648181 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:56.659131 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:56.659634 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:56.660092 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:56.660829 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:56.661299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:56.661742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:56.866964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:56.875097 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5565bcf-74e9-4ff7-9481-131dbde69ee9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1688 microversion: 2.1 time: 0.231910 Oct 19 07:57:56.875771 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3322/6798] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:56 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:57.352874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-99d4cefc-ecb3-4fb9-a206-8edb66b389d0 req-bdae49a2-624b-4d27-b6aa-f5bedf28009a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09b7897-9128-470a-807d-1dcaaf9a5e4f", "name": "network-vif-deleted", "tag": "89335681-3e9b-426e-8981-16f0a58c505a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:57:57.363259 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-99d4cefc-ecb3-4fb9-a206-8edb66b389d0 req-bdae49a2-624b-4d27-b6aa-f5bedf28009a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:57.363731 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-99d4cefc-ecb3-4fb9-a206-8edb66b389d0 req-bdae49a2-624b-4d27-b6aa-f5bedf28009a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:57.364181 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-99d4cefc-ecb3-4fb9-a206-8edb66b389d0 req-bdae49a2-624b-4d27-b6aa-f5bedf28009a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:57.376033 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-99d4cefc-ecb3-4fb9-a206-8edb66b389d0 req-bdae49a2-624b-4d27-b6aa-f5bedf28009a service nova] Creating event network-vif-deleted:89335681-3e9b-426e-8981-16f0a58c505a for instance c09b7897-9128-470a-807d-1dcaaf9a5e4f on n-h1-861333-10 Oct 19 07:57:57.381117 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-99d4cefc-ecb3-4fb9-a206-8edb66b389d0 req-bdae49a2-624b-4d27-b6aa-f5bedf28009a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031944 Oct 19 07:57:57.381780 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3477/6799] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:57:57.900525 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:57.901052 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:57.907953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:57.908483 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:57.908945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:57.909648 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:57.910117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:57.910559 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:57.941429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:57.941933 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:57.942388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:57.942846 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lazy-loading 'fault' on Instance uuid c09b7897-9128-470a-807d-1dcaaf9a5e4f {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 07:57:57.983754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:57:57.991404 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1404f04-00c1-4f48-bd2f-f89ca4d6a574 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 200 len: 1356 microversion: 2.1 time: 0.095481 Oct 19 07:57:57.992000 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3323/6800] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:57 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 1356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:57:59.016578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:57:59.017300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: c09b7897-9128-470a-807d-1dcaaf9a5e4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:57:59.023545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:59.024033 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:59.025140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:59.025840 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:57:59.026295 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:57:59.026721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:57:59.042984 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] HTTP exception thrown: Instance c09b7897-9128-470a-807d-1dcaaf9a5e4f could not be found. Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Request method failure captured: Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f HTTP/1.1 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: Accept: application/json Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: Accept-Encoding: identity Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: Connection: close Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: Content-Length: 0 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: Content-Type: application/json Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: Host: 10.222.0.39 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: Openstack-System-Scope: None Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjT62LwLwcrRkKctdI-lfBPeENzWZqocWGth-slKGQxEWWDws6-fjB1u1pARz2yC8bit9Qo5jMyjhZ45OfnPmtHwdFSPdIejafkAd4es23A6mVrTJ3tH8yazRu3-XGG6OW0QVSLjDbNnS7tiT-CwzGQqlq45hLm8MrZO7tpNZoHHX7BI4 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Id: None Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Domain-Name: None Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Is-Admin-Project: True Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Id: default Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Id: 8954eb6d03f64f77812613cb33a94c35 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1485450637 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Role: reader,member Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Roles: reader,member Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8954eb6d03f64f77812613cb33a94c35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8954eb6d03f64f77812613cb33a94c35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8954eb6d03f64f77812613cb33a94c35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8954eb6d03f64f77812613cb33a94c35", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1485450637 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Id: 8954eb6d03f64f77812613cb33a94c35 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1485450637 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-User: tempest-TestNetworkAdvancedServerOps-1485450637-project Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Id: default Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-User-Domain-Name: Default Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-User-Id: 39d33dcf01aa4a0e892b4dfead2cb150 Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1485450637-project Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: method: > Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: exception: Instance c09b7897-9128-470a-807d-1dcaaf9a5e4f could not be found. Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: action_args: {'id': 'c09b7897-9128-470a-807d-1dcaaf9a5e4f'} Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09b7897-9128-470a-807d-1dcaaf9a5e4f could not be found. Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09b7897-9128-470a-807d-1dcaaf9a5e4f could not be found. Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:57:59.044612 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09b7897-9128-470a-807d-1dcaaf9a5e4f could not be found. Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Returning 404 to user: Instance c09b7897-9128-470a-807d-1dcaaf9a5e4f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-56fcc849-ce88-4018-b9c7-7f003c131db1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f" status: 404 len: 111 microversion: 2.1 time: 0.034665 Oct 19 07:57:59.052376 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3478/6801] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:57:59 2022] GET /compute/v2.1/servers/c09b7897-9128-470a-807d-1dcaaf9a5e4f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 07:58:02.472083 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72df590e-0511-4b70-9dc4-95a2d6382960 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '.version_select at 0x7f6d5f841ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:02.565734 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72df590e-0511-4b70-9dc4-95a2d6382960 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1966367815" status: 202 len: 0 microversion: 2.1 time: 0.097349 Oct 19 07:58:02.566341 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3324/6802] 10.222.0.39 () {58 vars in 1284 bytes} [Wed Oct 19 07:58:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1966367815 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:58:02.606482 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f508b0a-ae7f-45e5-af6e-cc14a0aab141 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'create', calling method: .version_select at 0x7f6d5f544670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-118071474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv3EyHbEUbR1Rbju+dRtGX4kUpshfFKAgyUiwhbSpds7iHp/rnqBx2c4Ge0V+8/noNV3oNaUnpiSxNH3OZRGw4/7jQadORIKPDJTRapjBcAOFMS9KzLUemQ3+VH1jUl6Q=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:58:02.616190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4f508b0a-ae7f-45e5-af6e-cc14a0aab141 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for project 8954eb6d03f64f77812613cb33a94c35. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:58:02.622970 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4f508b0a-ae7f-45e5-af6e-cc14a0aab141 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for user 39d33dcf01aa4a0e892b4dfead2cb150 and project 8954eb6d03f64f77812613cb33a94c35. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:58:02.708361 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f508b0a-ae7f-45e5-af6e-cc14a0aab141 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.112714 Oct 19 07:58:02.708956 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3479/6803] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 07:58:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:58:10.592296 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1829681796", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "36c51858-9908-4819-92bd-e31c36e20342"}], "key_name": "tempest-TestNetworkAdvancedServerOps-118071474", "security_groups": [{"name": "tempest-secgroup-smoke-835042645"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:58:10.621173 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:10.726692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] validate_networks() for [('36c51858-9908-4819-92bd-e31c36e20342', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 07:58:11.563291 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 07:58:11.567541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 07:58:11.567541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 07:58:11.567541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 07:58:11.567541 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 07:58:11.576664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:11.577170 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:11.577841 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:11.578738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:11.579524 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:11.579980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:11.601905 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for project 8954eb6d03f64f77812613cb33a94c35. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 07:58:11.605790 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for user 39d33dcf01aa4a0e892b4dfead2cb150 and project 8954eb6d03f64f77812613cb33a94c35. Resources: {'ram', 'cores', 'instances'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 07:58:11.618893 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 07:58:11.621313 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 07:58:11.750487 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7f98f4e-96b0-4122-9a84-d91ab84f8304 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.162693 Oct 19 07:58:11.752142 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3325/6804] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 07:58:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 07:58:11.763512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bfe508e7-427a-4a94-893a-dd1d8f3780c3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:11.764152 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bfe508e7-427a-4a94-893a-dd1d8f3780c3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:11.766423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=27 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:11.826014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bfe508e7-427a-4a94-893a-dd1d8f3780c3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:11.836552 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bfe508e7-427a-4a94-893a-dd1d8f3780c3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1266 microversion: 2.1 time: 0.077637 Oct 19 07:58:11.851672 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3480/6805] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:11 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:12.859851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:12.860814 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:12.869142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:12.869672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:12.870154 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:12.870876 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:12.871348 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:12.871797 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:12.941035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:12.949666 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43d30f09-93eb-4a6e-84d1-0cf9f33351d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1270 microversion: 2.1 time: 0.093757 Oct 19 07:58:12.950247 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3326/6806] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:12 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:13.973545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:13.974107 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:13.982066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:13.982569 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:13.983019 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:13.983724 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:13.985347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:13.985347 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:14.060478 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:14.069538 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac416ed9-9948-4fbe-ac2f-da417e5e6f13 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1326 microversion: 2.1 time: 0.100027 Oct 19 07:58:14.070514 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3481/6807] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:13 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:15.093487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:15.094119 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:15.101011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:15.101925 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:15.102481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:15.103264 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:15.103813 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:15.104393 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:15.331527 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:15.339452 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e062aa49-23b0-42d0-8750-43c128761953 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1391 microversion: 2.1 time: 0.249773 Oct 19 07:58:15.339951 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3327/6808] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:15 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1391 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:15.581250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7a9acbe9-93e2-4664-a4d1-36cdcde03df6 req-797692fd-4282-4d4f-9140-1c941aae7c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:58:15.591978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a9acbe9-93e2-4664-a4d1-36cdcde03df6 req-797692fd-4282-4d4f-9140-1c941aae7c41 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:15.592441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a9acbe9-93e2-4664-a4d1-36cdcde03df6 req-797692fd-4282-4d4f-9140-1c941aae7c41 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:15.592924 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a9acbe9-93e2-4664-a4d1-36cdcde03df6 req-797692fd-4282-4d4f-9140-1c941aae7c41 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:15.604488 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7a9acbe9-93e2-4664-a4d1-36cdcde03df6 req-797692fd-4282-4d4f-9140-1c941aae7c41 service nova] Creating event network-changed:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h2-861333-10 Oct 19 07:58:15.609782 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7a9acbe9-93e2-4664-a4d1-36cdcde03df6 req-797692fd-4282-4d4f-9140-1c941aae7c41 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032280 Oct 19 07:58:15.610291 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3482/6809] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:58:16.363069 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:16.363700 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:16.370587 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:16.371087 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:16.371540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:16.372286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:16.372767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:16.373215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:16.511600 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:16.519378 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abd65943-090e-4cfa-bd28-ecaa0da0cc9a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1391 microversion: 2.1 time: 0.160498 Oct 19 07:58:16.519954 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3328/6810] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:16 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:17.544769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:17.545476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:17.551628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:17.552131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:17.552592 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:17.553283 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:17.553746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:17.554180 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:17.684177 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:17.691943 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d08497c3-ec5a-4728-97c9-7d4b7c54397f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1391 microversion: 2.1 time: 0.152847 Oct 19 07:58:17.692562 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3483/6811] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:17 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:18.715053 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:18.715680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:18.718468 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:18.723185 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:18.723685 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:18.724199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:18.724911 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:18.725382 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:18.725825 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:18.862306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:18.869947 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ea0fe49-ea72-4a7d-9942-ed3435fe25b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1391 microversion: 2.1 time: 0.158884 Oct 19 07:58:18.870532 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3329/6812] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:18 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:19.892966 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:19.893681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:19.900864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:19.901475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:19.901923 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:19.902623 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:19.903093 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:19.903524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:20.035187 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:20.043699 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a0ace67-58cc-450a-ab38-bf5cd1ef8e35 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1391 microversion: 2.1 time: 0.154578 Oct 19 07:58:20.044491 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3484/6813] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:19 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:20.079011 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-01e40afc-fd2f-4e3b-8b90-65abfd27e68d req-e8dc0510-5f1f-40a6-87de-7f25d8e9629b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "name": "network-vif-plugged", "status": "completed", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:58:20.089478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-01e40afc-fd2f-4e3b-8b90-65abfd27e68d req-e8dc0510-5f1f-40a6-87de-7f25d8e9629b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:20.089976 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-01e40afc-fd2f-4e3b-8b90-65abfd27e68d req-e8dc0510-5f1f-40a6-87de-7f25d8e9629b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:20.090422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-01e40afc-fd2f-4e3b-8b90-65abfd27e68d req-e8dc0510-5f1f-40a6-87de-7f25d8e9629b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:20.101298 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-01e40afc-fd2f-4e3b-8b90-65abfd27e68d req-e8dc0510-5f1f-40a6-87de-7f25d8e9629b service nova] Creating event network-vif-plugged:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h2-861333-10 Oct 19 07:58:20.106897 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-01e40afc-fd2f-4e3b-8b90-65abfd27e68d req-e8dc0510-5f1f-40a6-87de-7f25d8e9629b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Oct 19 07:58:20.107475 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3330/6814] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:58:21.066754 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:21.067367 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:21.074836 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:21.075326 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:21.075772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:21.076498 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:21.076962 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:21.077398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:21.209204 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:21.216993 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a640d08-df72-452a-a82e-61b8aa206df3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1391 microversion: 2.1 time: 0.154134 Oct 19 07:58:21.217562 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3485/6815] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:21 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:22.237707 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:22.238488 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:22.242785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:22.243538 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:22.249705 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:22.255395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:22.255395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:22.255395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:22.255395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:22.255395 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:22.396215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:22.404497 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c2f82d6-ef7c-4489-8c7d-1b3a05c6ab4a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1563 microversion: 2.1 time: 0.168585 Oct 19 07:58:22.405054 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3331/6816] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:22 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:22.429718 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:22.430463 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:22.432527 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:22.438163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:22.438645 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:22.439084 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:22.439768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:22.440251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:22.440679 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:22.574902 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:22.582673 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6896a6ae-b1ca-4d53-b723-71bc3adebff0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1563 microversion: 2.1 time: 0.156844 Oct 19 07:58:22.583296 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3486/6817] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:22 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:24.441404 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1753e48e-9c5f-40c0-96c7-2b7cb14b1db0 req-26d814a8-91d9-4aae-83bb-29597bde445e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:58:24.446966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:24.447598 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:24.452911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:24.460785 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1753e48e-9c5f-40c0-96c7-2b7cb14b1db0 req-26d814a8-91d9-4aae-83bb-29597bde445e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:24.461334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:24.461472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1753e48e-9c5f-40c0-96c7-2b7cb14b1db0 req-26d814a8-91d9-4aae-83bb-29597bde445e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:24.461768 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1753e48e-9c5f-40c0-96c7-2b7cb14b1db0 req-26d814a8-91d9-4aae-83bb-29597bde445e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:24.462047 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:24.462578 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:24.463429 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:24.463990 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:24.464554 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:24.473277 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1753e48e-9c5f-40c0-96c7-2b7cb14b1db0 req-26d814a8-91d9-4aae-83bb-29597bde445e service nova] Creating event network-changed:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h2-861333-10 Oct 19 07:58:24.479307 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1753e48e-9c5f-40c0-96c7-2b7cb14b1db0 req-26d814a8-91d9-4aae-83bb-29597bde445e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041795 Oct 19 07:58:24.480259 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3487/6818] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:58:24.702493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:24.706920 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72e3b1b7-b3c6-4c91-88d9-bb779bfe6f30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1563 microversion: 2.1 time: 0.271903 Oct 19 07:58:24.707696 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3332/6819] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:24 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1563 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:48.004223 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=34 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:48.009135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6bc76af-5499-4c9c-b9b8-65ef26420cde tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:58:48.013874 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6bc76af-5499-4c9c-b9b8-65ef26420cde tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:48.017717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bc76af-5499-4c9c-b9b8-65ef26420cde tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:48.018209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bc76af-5499-4c9c-b9b8-65ef26420cde tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:48.018655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bc76af-5499-4c9c-b9b8-65ef26420cde tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:48.019358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bc76af-5499-4c9c-b9b8-65ef26420cde tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:48.019903 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bc76af-5499-4c9c-b9b8-65ef26420cde tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:48.020377 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bc76af-5499-4c9c-b9b8-65ef26420cde tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:48.075431 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6bc76af-5499-4c9c-b9b8-65ef26420cde tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action" status: 200 len: 24556 microversion: 2.1 time: 0.073007 Oct 19 07:58:48.076126 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3488/6820] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:58:48 2022] POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action => generated 24556 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:58:58.975997 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-002253db-e7dd-4ddd-84cb-01be458bfa43 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:58.976774 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-002253db-e7dd-4ddd-84cb-01be458bfa43 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:58.979204 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:58.979943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=40 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:58.984710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-002253db-e7dd-4ddd-84cb-01be458bfa43 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:58.985215 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-002253db-e7dd-4ddd-84cb-01be458bfa43 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:58.985671 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-002253db-e7dd-4ddd-84cb-01be458bfa43 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:58.986388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-002253db-e7dd-4ddd-84cb-01be458bfa43 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:58.986868 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-002253db-e7dd-4ddd-84cb-01be458bfa43 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:58.987311 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-002253db-e7dd-4ddd-84cb-01be458bfa43 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:59.118265 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-002253db-e7dd-4ddd-84cb-01be458bfa43 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1834 microversion: 2.1 time: 0.146008 Oct 19 07:58:59.118845 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3333/6821] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:58 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1834 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:59.142149 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:58:59.142860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:59.145802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:59.146544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:58:59.151357 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:59.151852 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:59.152401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:59.156120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:59.156120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:59.156120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:59.291558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:59.299809 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bab0e709-5b2b-474b-9ab6-46906627879c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1681 microversion: 2.1 time: 0.162471 Oct 19 07:58:59.300421 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3489/6822] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:58:59 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:58:59.407309 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba0f0b61-b637-4711-8af7-60015298b513 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:58:59.410447 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba0f0b61-b637-4711-8af7-60015298b513 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:59.415696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba0f0b61-b637-4711-8af7-60015298b513 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:59.416243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba0f0b61-b637-4711-8af7-60015298b513 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:59.416697 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba0f0b61-b637-4711-8af7-60015298b513 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:59.417407 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba0f0b61-b637-4711-8af7-60015298b513 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:59.417881 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba0f0b61-b637-4711-8af7-60015298b513 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:59.418326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba0f0b61-b637-4711-8af7-60015298b513 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:59.470304 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba0f0b61-b637-4711-8af7-60015298b513 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action" status: 200 len: 32620 microversion: 2.1 time: 0.066856 Oct 19 07:58:59.471196 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3334/6823] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:58:59 2022] POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action => generated 32620 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 07:58:59.600707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:58:59.601274 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:58:59.607706 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:59.608777 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:59.609669 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:59.610258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:58:59.610710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:58:59.611139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:58:59.768448 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '041c1ab23c6041b5a2c3c500a64267ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49566ac04cd64312a6bc342145b40431', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:58:59.769062 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] flavor_id is None. Assuming migration. {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 07:58:59.769568 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 07:59:00.166775 n-d-861333-10 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [706c3732-afee-407f-b19f-d1cfa90fa6a9] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 07:59:01.173816 n-d-861333-10 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [706c3732-afee-407f-b19f-d1cfa90fa6a9] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43350. Oct 19 07:59:01.176946 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1526ff82-db55-4498-85c9-d6266d38df4a tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action" status: 202 len: 0 microversion: 2.1 time: 1.580121 Oct 19 07:59:01.177734 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3490/6824] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:58:59 2022] POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action => generated 0 bytes in 1581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:59:01.186218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:01.187532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:01.194903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:01.195401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:01.195858 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:01.196651 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:01.197128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:01.197575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:01.364288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:01.372388 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c2bef68-a25e-4b8a-bb72-e4d2895bfa81 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1690 microversion: 2.1 time: 0.190317 Oct 19 07:59:01.372998 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3335/6825] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:01 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:02.397763 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:02.398968 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:02.405870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:02.406369 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:02.406829 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:02.408835 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:02.410779 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:02.412475 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:02.551045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:02.558869 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15ae6518-7405-4b54-890e-ba84e544875e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1690 microversion: 2.1 time: 0.165944 Oct 19 07:59:02.559437 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3491/6826] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:02 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:03.581572 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:03.582221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:03.589961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:03.590463 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:03.590919 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:03.591630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:03.592121 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:03.592594 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:03.797672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:03.805567 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00d1d467-83a6-406b-8fef-4f8828aa3dd1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1690 microversion: 2.1 time: 0.227955 Oct 19 07:59:03.806246 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3336/6827] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:03 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:04.829178 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:04.829959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:04.838313 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:04.838801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:04.839249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:04.839954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:04.840438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:04.840869 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:04.990014 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:04.997897 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ee4be56-5aa4-4815-b0f4-b3b80955a0c6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.172640 Oct 19 07:59:04.998463 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3492/6828] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:04 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:06.022966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:06.023590 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:06.030410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:06.030900 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:06.031355 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:06.032050 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:06.032550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:06.032988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:06.171599 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:06.179469 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0fca530-87a2-48d2-9c76-ac3768d1730a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.160455 Oct 19 07:59:06.180043 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3337/6829] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:06 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:07.203927 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:07.204573 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:07.211913 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:07.212441 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:07.215239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:07.215239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:07.215239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:07.215239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:07.349122 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:07.356837 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c390b3f3-4cd2-4a8a-bfd7-59d6c1a91160 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.157448 Oct 19 07:59:07.357606 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3493/6830] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:07 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:08.380292 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:08.380924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:08.387966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:08.388497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:08.388987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:08.390013 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:08.390491 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:08.390937 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:08.521998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:08.529669 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-822ae1fc-356a-4604-b5d1-edcc65481d4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.153523 Oct 19 07:59:08.530879 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3338/6831] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:08 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:09.553339 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:09.553979 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:09.560799 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:09.561922 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:09.562368 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:09.563064 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:09.563524 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:09.563943 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:09.692758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:09.700841 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b685ed5a-763d-47fc-adce-9009941e4578 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.151357 Oct 19 07:59:09.701419 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3494/6832] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:09 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:10.724388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:10.725016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:10.731840 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:10.732367 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:10.732816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:10.734136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:10.734602 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:10.735039 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:10.865380 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:10.873161 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1cd4dd7f-68a4-406a-a311-259356115831 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.152714 Oct 19 07:59:10.873738 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3339/6833] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:10 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:11.896584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:11.897242 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:11.904248 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:11.904795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:11.905746 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:11.906443 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:11.906910 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:11.907371 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:12.036782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:12.044876 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dd06f3e-fbdb-4cca-9fbb-e167bf773a20 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.152166 Oct 19 07:59:12.045448 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3495/6834] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:11 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:13.069027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:13.069655 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:13.076510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:13.077552 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:13.078010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:13.078743 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:13.079220 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:13.079662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:13.215703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:13.224069 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-909a550e-dff2-4000-9fc8-44a0c1d3b5d5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.159013 Oct 19 07:59:13.224660 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3340/6835] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:13 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:14.246915 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:14.247523 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:14.254307 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:14.254789 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:14.255222 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:14.255911 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:14.256396 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:14.256821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:14.397040 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:14.404775 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59929dc7-9997-4e31-a22b-9ca9012c615f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.161803 Oct 19 07:59:14.405910 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3496/6836] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:14 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:15.434832 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:15.435434 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:15.442998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:15.443492 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:15.443943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:15.444683 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:15.445150 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:15.445586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:15.574068 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:15.581729 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0cfa2e00-e6ab-4c83-b686-2794aead9766 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.150873 Oct 19 07:59:15.582285 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3341/6837] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:15 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:16.605137 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:16.605764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:16.612806 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:16.613297 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:16.613743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:16.614444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:16.614906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:16.615340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:16.742983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:16.751174 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ab47c2e-170e-4a4c-9077-b936737e372d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.149891 Oct 19 07:59:16.751743 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3497/6838] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:16 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:17.775565 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:17.776218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:17.783629 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:17.784151 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:17.784615 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:17.785328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:17.785807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:17.786252 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:17.921720 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:17.929461 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d10d5517-1d36-4954-b482-cd8b8fc2284c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.157823 Oct 19 07:59:17.930035 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3342/6839] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:17 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:18.953959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:18.954551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:18.961331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:18.961821 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:18.962265 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:18.962961 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:18.963419 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:18.963854 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:19.401382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:19.409576 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33f832fc-7be9-4797-87e2-c865cae780d7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.460106 Oct 19 07:59:19.410145 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3498/6840] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:18 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:20.433686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:20.434322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:20.441177 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:20.441679 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:20.442137 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:20.442845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:20.443320 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:20.443767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:20.574770 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:20.583052 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f562eb1c-497b-42ea-a814-5c4f9d962be5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.153328 Oct 19 07:59:20.583621 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3343/6841] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:20 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:21.606528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:21.607131 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:21.614379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:21.615136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:21.615578 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:21.616340 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:21.616792 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:21.617220 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:21.746825 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:21.755934 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-135e3914-4eaa-4036-823e-2dc92f75f4d2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1695 microversion: 2.1 time: 0.153283 Oct 19 07:59:21.756598 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3499/6842] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:21 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:22.282732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0b766bb4-2a76-48e6-99d3-cbc1285927d1 req-680ea53b-9e28-4039-9611-54f87cee572a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "name": "network-vif-unplugged", "status": "completed", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:59:22.294379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0b766bb4-2a76-48e6-99d3-cbc1285927d1 req-680ea53b-9e28-4039-9611-54f87cee572a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:22.294379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0b766bb4-2a76-48e6-99d3-cbc1285927d1 req-680ea53b-9e28-4039-9611-54f87cee572a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:22.294379 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0b766bb4-2a76-48e6-99d3-cbc1285927d1 req-680ea53b-9e28-4039-9611-54f87cee572a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:22.305869 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0b766bb4-2a76-48e6-99d3-cbc1285927d1 req-680ea53b-9e28-4039-9611-54f87cee572a service nova] Creating event network-vif-unplugged:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h1-861333-10 Oct 19 07:59:22.311132 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-0b766bb4-2a76-48e6-99d3-cbc1285927d1 req-680ea53b-9e28-4039-9611-54f87cee572a service nova] Instance 71107808-1673-4a1e-bee0-a19fcf137e0e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 07:59:22.323264 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0b766bb4-2a76-48e6-99d3-cbc1285927d1 req-680ea53b-9e28-4039-9611-54f87cee572a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044849 Oct 19 07:59:22.323852 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3344/6843] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:59:22.781732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:22.782379 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:22.789279 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:22.789851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:22.790323 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:22.791026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:22.791485 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:22.791917 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:22.997542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:23.003500 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f1afe1f-ffc4-41d7-b624-b6234a6f698a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1694 microversion: 2.1 time: 0.225749 Oct 19 07:59:23.004090 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3500/6844] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:22 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:24.034391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:24.035482 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:24.043169 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:24.043662 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:24.044128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:24.044834 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:24.045301 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:24.045738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:24.189579 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:24.197527 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71e5ca9b-6b32-4c41-bdd8-15c2c6b09b41 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1692 microversion: 2.1 time: 0.167360 Oct 19 07:59:24.198131 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3345/6845] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:24 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:24.337769 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6930c6e0-baac-466f-84bb-8d7927a185e1 req-8d0a1839-e3c0-4b23-bfe7-90178733ee78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:59:24.347930 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6930c6e0-baac-466f-84bb-8d7927a185e1 req-8d0a1839-e3c0-4b23-bfe7-90178733ee78 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:24.348570 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6930c6e0-baac-466f-84bb-8d7927a185e1 req-8d0a1839-e3c0-4b23-bfe7-90178733ee78 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:24.349005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6930c6e0-baac-466f-84bb-8d7927a185e1 req-8d0a1839-e3c0-4b23-bfe7-90178733ee78 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:24.360830 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6930c6e0-baac-466f-84bb-8d7927a185e1 req-8d0a1839-e3c0-4b23-bfe7-90178733ee78 service nova] Creating event network-changed:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h1-861333-10 Oct 19 07:59:24.365996 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-6930c6e0-baac-466f-84bb-8d7927a185e1 req-8d0a1839-e3c0-4b23-bfe7-90178733ee78 service nova] Instance 71107808-1673-4a1e-bee0-a19fcf137e0e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 07:59:24.377411 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6930c6e0-baac-466f-84bb-8d7927a185e1 req-8d0a1839-e3c0-4b23-bfe7-90178733ee78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043234 Oct 19 07:59:24.377997 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3501/6846] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:59:25.224191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:25.225642 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:25.231903 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:25.235696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:25.235696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:25.235696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:25.235696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:25.235696 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:25.371966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:25.379881 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1926cee4-f876-4fad-96b8-62a533f5ab47 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1692 microversion: 2.1 time: 0.161361 Oct 19 07:59:25.380499 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3346/6847] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:25 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:26.406196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:26.407473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:26.413594 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:26.414066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:26.414512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:26.415211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:26.415666 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:26.416098 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:26.553042 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:26.561206 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-560d730d-71b1-47f0-ad7b-1cd1359d23c2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1689 microversion: 2.1 time: 0.160352 Oct 19 07:59:26.561967 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3502/6848] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:26 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:26.584364 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7cb4d402-247f-437a-88e5-dbc843d13108 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:59:26.589029 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7cb4d402-247f-437a-88e5-dbc843d13108 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:26.591800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cb4d402-247f-437a-88e5-dbc843d13108 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:26.592940 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cb4d402-247f-437a-88e5-dbc843d13108 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:26.593401 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cb4d402-247f-437a-88e5-dbc843d13108 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:26.594115 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cb4d402-247f-437a-88e5-dbc843d13108 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:26.594585 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cb4d402-247f-437a-88e5-dbc843d13108 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:26.595031 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cb4d402-247f-437a-88e5-dbc843d13108 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:26.900549 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7cb4d402-247f-437a-88e5-dbc843d13108 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.319972 Oct 19 07:59:26.901167 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3347/6849] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:59:26 2022] POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 07:59:26.910470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:26.911110 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:26.917500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:26.918023 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:26.918473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:26.919182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:26.919646 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:26.920190 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:27.137228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:27.145575 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50c4cee4-5f34-45d8-ba36-795487bb60bc tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1688 microversion: 2.1 time: 0.239366 Oct 19 07:59:27.146351 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3503/6850] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:26 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:28.169503 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:28.170218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:28.179123 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:28.179624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:28.180075 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:28.181073 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:28.181550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:28.181992 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:28.204569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:59:28.326568 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:28.334221 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2fb89fb7-781d-4668-be15-ee9d3b1bb0e0 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1688 microversion: 2.1 time: 0.169029 Oct 19 07:59:28.334799 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3348/6851] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:28 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:28.593440 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bf86d58b-9190-408f-83fe-303416ef7d0d req-3f4f63eb-6edf-4f96-8d9f-5a559df06136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "name": "network-vif-plugged", "status": "completed", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:59:28.603505 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bf86d58b-9190-408f-83fe-303416ef7d0d req-3f4f63eb-6edf-4f96-8d9f-5a559df06136 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:28.605659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bf86d58b-9190-408f-83fe-303416ef7d0d req-3f4f63eb-6edf-4f96-8d9f-5a559df06136 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:28.605659 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bf86d58b-9190-408f-83fe-303416ef7d0d req-3f4f63eb-6edf-4f96-8d9f-5a559df06136 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:28.608862 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:59:28.616801 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bf86d58b-9190-408f-83fe-303416ef7d0d req-3f4f63eb-6edf-4f96-8d9f-5a559df06136 service nova] Creating event network-vif-plugged:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h1-861333-10 Oct 19 07:59:28.621851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-bf86d58b-9190-408f-83fe-303416ef7d0d req-3f4f63eb-6edf-4f96-8d9f-5a559df06136 service nova] Instance 71107808-1673-4a1e-bee0-a19fcf137e0e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 07:59:28.632567 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bf86d58b-9190-408f-83fe-303416ef7d0d req-3f4f63eb-6edf-4f96-8d9f-5a559df06136 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043582 Oct 19 07:59:28.633375 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3504/6852] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:59:29.359127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:29.359692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:29.363004 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=37 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:59:29.367698 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:29.368233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:29.368682 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:29.369389 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:29.369855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:29.370298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:29.503210 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:29.511684 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53e175e8-a459-4b6a-910f-0bd926173be6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1688 microversion: 2.1 time: 0.157828 Oct 19 07:59:29.512265 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3349/6853] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:29 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:30.536517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:30.537217 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:30.539136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=35 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:59:30.544438 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:30.544934 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:30.545378 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:30.546079 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:30.546537 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:30.546971 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:30.682235 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:30.689958 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85b705f7-dd73-41ca-922c-ffdde7cbf094 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1688 microversion: 2.1 time: 0.158866 Oct 19 07:59:30.690516 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3505/6854] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:30 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:31.192509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e7d05088-0d06-44f5-87fd-bcc5fac26d3f req-bdbd41af-7c38-44ce-939c-7ebba9fc8ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "name": "network-vif-unplugged", "status": "completed", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:59:31.202510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e7d05088-0d06-44f5-87fd-bcc5fac26d3f req-bdbd41af-7c38-44ce-939c-7ebba9fc8ea6 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:31.203010 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e7d05088-0d06-44f5-87fd-bcc5fac26d3f req-bdbd41af-7c38-44ce-939c-7ebba9fc8ea6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:31.203465 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e7d05088-0d06-44f5-87fd-bcc5fac26d3f req-bdbd41af-7c38-44ce-939c-7ebba9fc8ea6 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:31.216418 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e7d05088-0d06-44f5-87fd-bcc5fac26d3f req-bdbd41af-7c38-44ce-939c-7ebba9fc8ea6 service nova] Creating event network-vif-unplugged:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h2-861333-10 Oct 19 07:59:31.222664 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-e7d05088-0d06-44f5-87fd-bcc5fac26d3f req-bdbd41af-7c38-44ce-939c-7ebba9fc8ea6 service nova] Instance 71107808-1673-4a1e-bee0-a19fcf137e0e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 07:59:31.233822 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e7d05088-0d06-44f5-87fd-bcc5fac26d3f req-bdbd41af-7c38-44ce-939c-7ebba9fc8ea6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044755 Oct 19 07:59:31.234155 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3350/6855] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:59:31.713741 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:31.714354 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:31.721504 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:31.723398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:31.723866 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:31.724618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:31.725083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:31.725515 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:31.864047 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:31.871838 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc70f998-d6ed-4c46-869b-5e54b19a1c4b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1688 microversion: 2.1 time: 0.161933 Oct 19 07:59:31.872560 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3506/6856] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:31 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:32.898224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:32.898994 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:32.905190 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:32.905689 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:32.906147 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:32.906855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:32.907335 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:32.907811 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:33.047217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:33.055155 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-944c2226-a4e0-4c95-a6f2-0874f8bd6d30 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1688 microversion: 2.1 time: 0.163036 Oct 19 07:59:33.055724 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3351/6857] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:32 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:33.248083 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-18485a9a-b5f9-4b67-b9a2-78b61d66e93f req-035cbfaf-0b40-4c7d-87ec-a23a7291eb04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:59:33.258936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-18485a9a-b5f9-4b67-b9a2-78b61d66e93f req-035cbfaf-0b40-4c7d-87ec-a23a7291eb04 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:33.259676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-18485a9a-b5f9-4b67-b9a2-78b61d66e93f req-035cbfaf-0b40-4c7d-87ec-a23a7291eb04 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:33.260141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-18485a9a-b5f9-4b67-b9a2-78b61d66e93f req-035cbfaf-0b40-4c7d-87ec-a23a7291eb04 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:33.271278 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-18485a9a-b5f9-4b67-b9a2-78b61d66e93f req-035cbfaf-0b40-4c7d-87ec-a23a7291eb04 service nova] Creating event network-changed:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h2-861333-10 Oct 19 07:59:33.276558 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-18485a9a-b5f9-4b67-b9a2-78b61d66e93f req-035cbfaf-0b40-4c7d-87ec-a23a7291eb04 service nova] Instance 71107808-1673-4a1e-bee0-a19fcf137e0e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-861333-10', 'n-h2-861333-10'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 07:59:33.287084 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-18485a9a-b5f9-4b67-b9a2-78b61d66e93f req-035cbfaf-0b40-4c7d-87ec-a23a7291eb04 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042691 Oct 19 07:59:33.287660 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3507/6858] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:59:34.078991 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:34.080481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:34.087761 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:34.089166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:34.089166 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:34.089548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:34.090024 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:34.090497 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:34.264734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:34.274946 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2bc8b293-6dc5-4cc7-a111-01c15b006f52 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1688 microversion: 2.1 time: 0.199732 Oct 19 07:59:34.275795 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3352/6859] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:34 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 07:59:35.302909 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 07:59:35.303607 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:35.310080 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:35.310572 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:35.311011 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:35.311698 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:35.312186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:35.312618 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:35.442382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 07:59:35.450114 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b1f0635-6add-43b5-b2e2-57f77066c0a1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1681 microversion: 2.1 time: 0.153805 Oct 19 07:59:35.450699 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3508/6860] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 07:59:35 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 07:59:36.415987 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-45968fd5-3831-40b5-8ac0-7ef18adcf818 req-ef31d8c6-f584-4c5d-aa8a-37b97f32de33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "name": "network-vif-plugged", "status": "completed", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:59:36.427012 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-45968fd5-3831-40b5-8ac0-7ef18adcf818 req-ef31d8c6-f584-4c5d-aa8a-37b97f32de33 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:36.427509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-45968fd5-3831-40b5-8ac0-7ef18adcf818 req-ef31d8c6-f584-4c5d-aa8a-37b97f32de33 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:36.427950 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-45968fd5-3831-40b5-8ac0-7ef18adcf818 req-ef31d8c6-f584-4c5d-aa8a-37b97f32de33 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:36.439949 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-45968fd5-3831-40b5-8ac0-7ef18adcf818 req-ef31d8c6-f584-4c5d-aa8a-37b97f32de33 service nova] Creating event network-vif-plugged:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h2-861333-10 Oct 19 07:59:36.445217 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-45968fd5-3831-40b5-8ac0-7ef18adcf818 req-ef31d8c6-f584-4c5d-aa8a-37b97f32de33 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032881 Oct 19 07:59:36.445835 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3353/6861] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 07:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 07:59:59.711565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c73f4bca-989c-4cf0-9f4b-7f4e852fb182 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 07:59:59.713859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c73f4bca-989c-4cf0-9f4b-7f4e852fb182 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 07:59:59.716026 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=7 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:59:59.716721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=24 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 07:59:59.721565 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c73f4bca-989c-4cf0-9f4b-7f4e852fb182 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:59.722402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c73f4bca-989c-4cf0-9f4b-7f4e852fb182 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:59.723061 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c73f4bca-989c-4cf0-9f4b-7f4e852fb182 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:59.724048 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c73f4bca-989c-4cf0-9f4b-7f4e852fb182 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 07:59:59.724555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c73f4bca-989c-4cf0-9f4b-7f4e852fb182 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 07:59:59.733423 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c73f4bca-989c-4cf0-9f4b-7f4e852fb182 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 07:59:59.792804 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c73f4bca-989c-4cf0-9f4b-7f4e852fb182 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action" status: 200 len: 63255 microversion: 2.1 time: 0.085142 Oct 19 07:59:59.793704 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3509/6862] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 07:59:59 2022] POST /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e/action => generated 63255 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:00:06.135361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4bfed2f-77cf-483f-9292-b40704e21f2e tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:06.136110 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4bfed2f-77cf-483f-9292-b40704e21f2e tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:06.139202 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=9 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:00:06.139844 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=27 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:00:06.145249 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4bfed2f-77cf-483f-9292-b40704e21f2e tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:06.145748 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4bfed2f-77cf-483f-9292-b40704e21f2e tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:06.146200 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4bfed2f-77cf-483f-9292-b40704e21f2e tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:06.146955 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4bfed2f-77cf-483f-9292-b40704e21f2e tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:06.147427 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4bfed2f-77cf-483f-9292-b40704e21f2e tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:06.147870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4bfed2f-77cf-483f-9292-b40704e21f2e tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:06.282331 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4bfed2f-77cf-483f-9292-b40704e21f2e tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1834 microversion: 2.1 time: 0.151366 Oct 19 08:00:06.282904 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3354/6863] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:06 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1834 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:07.157701 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:07.158459 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:07.159229 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ce979dc1-3ab4-45ab-b066-b340ea051c64 req-664601c3-4174-4474-a107-575cf5c02259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:00:07.166296 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:07.166856 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:07.167376 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:07.168186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:07.168805 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ce979dc1-3ab4-45ab-b066-b340ea051c64 req-664601c3-4174-4474-a107-575cf5c02259 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:07.168919 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:07.169294 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ce979dc1-3ab4-45ab-b066-b340ea051c64 req-664601c3-4174-4474-a107-575cf5c02259 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:07.169398 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:07.169736 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ce979dc1-3ab4-45ab-b066-b340ea051c64 req-664601c3-4174-4474-a107-575cf5c02259 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:07.184499 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ce979dc1-3ab4-45ab-b066-b340ea051c64 req-664601c3-4174-4474-a107-575cf5c02259 service nova] Creating event network-changed:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h2-861333-10 Oct 19 08:00:07.189932 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ce979dc1-3ab4-45ab-b066-b340ea051c64 req-664601c3-4174-4474-a107-575cf5c02259 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034358 Oct 19 08:00:07.194592 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3355/6864] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:00:07.201533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 08:00:07.521635 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac6cd3f7-f4e5-4def-b246-71968b8017a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "DELETE /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 204 len: 0 microversion: 2.1 time: 0.365114 Oct 19 08:00:07.521635 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3510/6865] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 08:00:07 2022] DELETE /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:00:07.527974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:07.528732 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:07.535624 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:07.536134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:07.536588 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:07.537289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:07.537756 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:07.538192 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:07.677616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:07.687140 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3563073a-a3e8-4ada-ba61-5b4d757947c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1687 microversion: 2.1 time: 0.163341 Oct 19 08:00:07.687741 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3356/6866] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:07 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:00:08.711989 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:08.712707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:08.720069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:08.720584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:08.721021 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:08.721834 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:08.722294 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:08.723331 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:08.854258 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:08.862002 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff98a5b7-190b-43bd-a881-88af7229104f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1687 microversion: 2.1 time: 0.154902 Oct 19 08:00:08.862578 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3511/6867] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:08 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:09.433644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2c8e1266-2647-4567-b48f-c2f452811344 req-ec24357b-375d-478e-852a-8a75fae7da89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71107808-1673-4a1e-bee0-a19fcf137e0e", "name": "network-vif-deleted", "tag": "85479a56-36c2-4316-b073-6b1bfb122f50"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:00:09.444358 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2c8e1266-2647-4567-b48f-c2f452811344 req-ec24357b-375d-478e-852a-8a75fae7da89 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:09.444853 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2c8e1266-2647-4567-b48f-c2f452811344 req-ec24357b-375d-478e-852a-8a75fae7da89 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:09.445306 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2c8e1266-2647-4567-b48f-c2f452811344 req-ec24357b-375d-478e-852a-8a75fae7da89 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:09.456456 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2c8e1266-2647-4567-b48f-c2f452811344 req-ec24357b-375d-478e-852a-8a75fae7da89 service nova] Creating event network-vif-deleted:85479a56-36c2-4316-b073-6b1bfb122f50 for instance 71107808-1673-4a1e-bee0-a19fcf137e0e on n-h2-861333-10 Oct 19 08:00:09.468527 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2c8e1266-2647-4567-b48f-c2f452811344 req-ec24357b-375d-478e-852a-8a75fae7da89 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031380 Oct 19 08:00:09.468527 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3357/6868] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:00:09.885611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:09.886346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:09.893361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:09.893891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:09.894322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:09.895532 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:09.895983 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:09.896444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:09.929356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:09.929926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:09.930427 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:09.930870 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lazy-loading 'fault' on Instance uuid 71107808-1673-4a1e-bee0-a19fcf137e0e {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 08:00:09.975130 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:09.982676 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06e78664-fa06-4828-941e-b643b43a2b2d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 200 len: 1356 microversion: 2.1 time: 0.101434 Oct 19 08:00:09.983232 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3512/6869] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:09 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:11.008542 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:11.009251 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 71107808-1673-4a1e-bee0-a19fcf137e0e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:11.015638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:11.016161 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:11.016613 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:11.017312 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:11.017780 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:11.018221 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:11.031114 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] HTTP exception thrown: Instance 71107808-1673-4a1e-bee0-a19fcf137e0e could not be found. Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Request method failure captured: Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e HTTP/1.1 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT62LwLwcrRkKctdI-lfBPeENzWZqocWGth-slKGQxEWWDws6-fjB1u1pARz2yC8bit9Qo5jMyjhZ45OfnPmtHwdFSPdIejafkAd4es23A6mVrTJ3tH8yazRu3-XGG6OW0QVSLjDbNnS7tiT-CwzGQqlq45hLm8MrZO7tpNZoHHX7BI4 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8954eb6d03f64f77812613cb33a94c35 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1485450637 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8954eb6d03f64f77812613cb33a94c35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8954eb6d03f64f77812613cb33a94c35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8954eb6d03f64f77812613cb33a94c35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8954eb6d03f64f77812613cb33a94c35", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1485450637 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8954eb6d03f64f77812613cb33a94c35 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1485450637 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestNetworkAdvancedServerOps-1485450637-project Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 39d33dcf01aa4a0e892b4dfead2cb150 Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1485450637-project Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 71107808-1673-4a1e-bee0-a19fcf137e0e could not be found. Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '71107808-1673-4a1e-bee0-a19fcf137e0e'} Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71107808-1673-4a1e-bee0-a19fcf137e0e could not be found. Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71107808-1673-4a1e-bee0-a19fcf137e0e could not be found. Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:00:11.032777 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71107808-1673-4a1e-bee0-a19fcf137e0e could not be found. Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Returning 404 to user: Instance 71107808-1673-4a1e-bee0-a19fcf137e0e could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f281e39-6774-4d8f-8279-2d724aefe7a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e" status: 404 len: 111 microversion: 2.1 time: 0.031502 Oct 19 08:00:11.037268 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3358/6870] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:11 2022] GET /compute/v2.1/servers/71107808-1673-4a1e-bee0-a19fcf137e0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:00:15.077635 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4e2f521-99b8-4999-8571-ed786744ee68 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '.version_select at 0x7f6d5f538b80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:15.182448 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4e2f521-99b8-4999-8571-ed786744ee68 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-118071474" status: 202 len: 0 microversion: 2.1 time: 0.108736 Oct 19 08:00:15.183036 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3513/6871] 10.222.0.39 () {58 vars in 1281 bytes} [Wed Oct 19 08:00:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-118071474 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:00:15.223926 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fac4ea04-36d5-44dc-a705-32659cb86c22 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'create', calling method: .version_select at 0x7f6d5f96aca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1713221960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLCiaQ0wBmXyeepnEbaxVVC36dtIZPty5T/9YKsn5qxEgKgFpmqCTBdu4Px7Gzwc0yEMgyPFyzAGGnkgQ/u4bgfUnZV9PG3UqD8/bCfe7ZnE3rwd4j84OaupAvvZGRx0w=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:00:15.247448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fac4ea04-36d5-44dc-a705-32659cb86c22 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for project 8954eb6d03f64f77812613cb33a94c35. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 08:00:15.254918 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fac4ea04-36d5-44dc-a705-32659cb86c22 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for user 39d33dcf01aa4a0e892b4dfead2cb150 and project 8954eb6d03f64f77812613cb33a94c35. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 08:00:15.268894 n-d-861333-10 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fac4ea04-36d5-44dc-a705-32659cb86c22 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [ebf27a1e-41e0-4fcc-8e96-19ae2cc7125a] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 08:00:16.277851 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-fac4ea04-36d5-44dc-a705-32659cb86c22 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [ebf27a1e-41e0-4fcc-8e96-19ae2cc7125a] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43490. Oct 19 08:00:16.370892 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fac4ea04-36d5-44dc-a705-32659cb86c22 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.151080 Oct 19 08:00:16.371508 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3359/6872] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 08:00:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:00:24.005557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:00:24.009912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-615124168", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "2312848e-fe75-45dd-85bd-25bc4529a274"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1713221960", "security_groups": [{"name": "tempest-secgroup-smoke-333009900"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:00:24.135877 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] validate_networks() for [('2312848e-fe75-45dd-85bd-25bc4529a274', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 08:00:24.554811 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:00:24.555322 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:00:24.555882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:00:24.556493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:00:24.557101 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:00:24.566226 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:24.566912 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:24.567581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:24.568360 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:24.568830 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:24.569267 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:24.589697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for project 8954eb6d03f64f77812613cb33a94c35. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 08:00:24.595108 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for user 39d33dcf01aa4a0e892b4dfead2cb150 and project 8954eb6d03f64f77812613cb33a94c35. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 08:00:24.608236 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 08:00:24.610525 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 08:00:24.732358 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-702f0e1e-7f2b-4365-b99a-39b4ba0286fe tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.729225 Oct 19 08:00:24.733242 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3514/6873] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 08:00:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:00:24.743336 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:00:24.748326 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6da13a5b-b24d-4264-bc24-56b57159e01d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:24.749448 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6da13a5b-b24d-4264-bc24-56b57159e01d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:24.834558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6da13a5b-b24d-4264-bc24-56b57159e01d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:24.843254 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6da13a5b-b24d-4264-bc24-56b57159e01d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1266 microversion: 2.1 time: 0.101641 Oct 19 08:00:24.844254 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3360/6874] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:24 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:25.866250 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:25.867503 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:25.875385 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:25.875881 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:25.876356 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:25.877072 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:25.877533 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:25.877969 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:25.945544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:25.953599 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2496733d-56c4-4d53-a2bc-b98b3f3ac014 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1262 microversion: 2.1 time: 0.091784 Oct 19 08:00:25.954186 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3515/6875] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:25 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:26.978095 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:26.978644 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:26.986606 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:26.987341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:26.987974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:26.988710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:26.989178 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:26.989618 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:27.051768 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:27.059607 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c0b28ac-f9d5-4ef1-b3ce-cfffbab1fd00 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1324 microversion: 2.1 time: 0.085863 Oct 19 08:00:27.060197 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3361/6876] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:26 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1324 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:28.083436 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:28.084037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:28.091114 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:28.091602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:28.092049 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:28.092783 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:28.093298 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:28.093738 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:28.294163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:28.301914 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afb0e40f-0987-4a8b-8c82-3f3a649907d6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1391 microversion: 2.1 time: 0.222978 Oct 19 08:00:28.302492 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3516/6877] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:28 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:28.392809 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ec1aa892-5083-4402-9959-76f90d65ef6b req-765b6f19-b50b-4f50-9e7c-851fa57af4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad5fea7-b05e-438a-aa87-7c4d84369b38", "tag": "955edab9-f3d6-4312-b99f-9411257e8daf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:00:28.404390 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec1aa892-5083-4402-9959-76f90d65ef6b req-765b6f19-b50b-4f50-9e7c-851fa57af4bf service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:28.404897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec1aa892-5083-4402-9959-76f90d65ef6b req-765b6f19-b50b-4f50-9e7c-851fa57af4bf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:28.405330 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec1aa892-5083-4402-9959-76f90d65ef6b req-765b6f19-b50b-4f50-9e7c-851fa57af4bf service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:28.416400 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ec1aa892-5083-4402-9959-76f90d65ef6b req-765b6f19-b50b-4f50-9e7c-851fa57af4bf service nova] Creating event network-changed:955edab9-f3d6-4312-b99f-9411257e8daf for instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 on n-h1-861333-10 Oct 19 08:00:28.421536 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ec1aa892-5083-4402-9959-76f90d65ef6b req-765b6f19-b50b-4f50-9e7c-851fa57af4bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032356 Oct 19 08:00:28.422212 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3362/6878] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:00:29.325198 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:29.325814 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:29.333401 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:29.333905 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:29.334345 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:29.335069 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:29.335526 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:29.335959 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:29.546670 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:29.554332 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7c7cb19-a4ea-4f00-8684-c5b14783d004 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1391 microversion: 2.1 time: 0.233240 Oct 19 08:00:29.554914 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3517/6879] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:29 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:30.578875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:30.579595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:30.586402 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:30.586897 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:30.587351 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:30.588054 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:30.588550 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:30.588988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:30.719857 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:30.727749 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d456ca6e-b735-44b5-bc02-5e11722d4682 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1391 microversion: 2.1 time: 0.154052 Oct 19 08:00:30.728359 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3363/6880] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:30 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:00:31.750544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:31.751182 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:31.754584 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:00:31.760952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:31.760952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:31.760952 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:31.761239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:31.761702 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:31.762135 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:31.894681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:31.902251 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a7898f4-3f42-42d6-b32d-c3a6d28be8c5 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1391 microversion: 2.1 time: 0.155675 Oct 19 08:00:31.902828 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3518/6881] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:31 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:32.924972 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:32.925586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:32.932375 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:32.932888 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:32.933345 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:32.934057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:32.934529 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:32.934967 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:33.073074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:33.080819 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-56fe0207-06d9-4de8-8264-1966a95a43a4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1391 microversion: 2.1 time: 0.159871 Oct 19 08:00:33.081383 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3364/6882] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:32 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:34.104052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:34.104699 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:34.111707 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:34.112232 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:34.112676 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:34.113935 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:34.114407 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:34.115522 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:34.247662 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:34.256210 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-581167f9-d7ca-4126-9480-99396c8bdcc6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1391 microversion: 2.1 time: 0.156183 Oct 19 08:00:34.256796 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3519/6883] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:34 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:34.922661 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c7e7c9b6-c2f0-486d-b9ac-4185752a1e45 req-a53a1780-1d7a-4ba7-8901-6007c38d393a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad5fea7-b05e-438a-aa87-7c4d84369b38", "name": "network-vif-plugged", "status": "completed", "tag": "955edab9-f3d6-4312-b99f-9411257e8daf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:00:34.928755 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:00:34.934616 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7e7c9b6-c2f0-486d-b9ac-4185752a1e45 req-a53a1780-1d7a-4ba7-8901-6007c38d393a service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:34.935117 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7e7c9b6-c2f0-486d-b9ac-4185752a1e45 req-a53a1780-1d7a-4ba7-8901-6007c38d393a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:34.935570 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7e7c9b6-c2f0-486d-b9ac-4185752a1e45 req-a53a1780-1d7a-4ba7-8901-6007c38d393a service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:34.947155 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c7e7c9b6-c2f0-486d-b9ac-4185752a1e45 req-a53a1780-1d7a-4ba7-8901-6007c38d393a service nova] Creating event network-vif-plugged:955edab9-f3d6-4312-b99f-9411257e8daf for instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 on n-h1-861333-10 Oct 19 08:00:34.952026 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c7e7c9b6-c2f0-486d-b9ac-4185752a1e45 req-a53a1780-1d7a-4ba7-8901-6007c38d393a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034814 Oct 19 08:00:34.952642 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3365/6884] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:00:35.280489 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:35.281134 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:35.285284 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:00:35.285940 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:00:35.290139 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:35.290627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:35.291074 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:35.291772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:35.292251 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:35.292681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:35.429358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:35.437157 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba30c2f4-0485-4bb3-a31f-ae08b9ffdd80 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1391 microversion: 2.1 time: 0.160700 Oct 19 08:00:35.437722 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3520/6885] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:35 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:36.466224 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:36.466980 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:36.468961 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:00:36.473988 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:36.474489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:36.474936 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:36.475640 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:36.476136 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:36.476575 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:36.615607 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:36.623518 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8cc0d3c-7d09-402e-9319-728d97a1353d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1563 microversion: 2.1 time: 0.162916 Oct 19 08:00:36.624149 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3366/6886] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:36 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:36.645846 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:36.646402 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:36.653132 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:36.653616 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:36.654059 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:36.654751 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:36.655209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:36.655639 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:36.789795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:36.797482 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e11114a7-1190-44ed-8cf8-a3c18f604a5d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1563 microversion: 2.1 time: 0.155526 Oct 19 08:00:36.798056 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3521/6887] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:36 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:00:39.045289 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:00:39.046561 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:00:39.047189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5b6e7780-8a90-4684-b7aa-6807eef596f8 req-b6bbf34d-5e9f-445e-bc88-b209625cf217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad5fea7-b05e-438a-aa87-7c4d84369b38", "tag": "955edab9-f3d6-4312-b99f-9411257e8daf"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:00:39.054361 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:39.054948 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:39.055478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:39.056334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:39.056983 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:39.057657 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:39.058206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5b6e7780-8a90-4684-b7aa-6807eef596f8 req-b6bbf34d-5e9f-445e-bc88-b209625cf217 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:00:39.058697 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5b6e7780-8a90-4684-b7aa-6807eef596f8 req-b6bbf34d-5e9f-445e-bc88-b209625cf217 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:00:39.059127 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5b6e7780-8a90-4684-b7aa-6807eef596f8 req-b6bbf34d-5e9f-445e-bc88-b209625cf217 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:00:39.071167 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5b6e7780-8a90-4684-b7aa-6807eef596f8 req-b6bbf34d-5e9f-445e-bc88-b209625cf217 service nova] Creating event network-changed:955edab9-f3d6-4312-b99f-9411257e8daf for instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 on n-h1-861333-10 Oct 19 08:00:39.076387 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5b6e7780-8a90-4684-b7aa-6807eef596f8 req-b6bbf34d-5e9f-445e-bc88-b209625cf217 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032776 Oct 19 08:00:39.076992 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3522/6888] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:00:39.204436 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:00:39.213449 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afd7c6b4-319a-4d27-8b71-7288f20cb132 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1681 microversion: 2.1 time: 0.172214 Oct 19 08:00:39.220369 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3367/6889] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:00:39 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:02.509758 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:02.514210 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=46 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:02.573488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1677d28b-a8b6-4b93-a6d7-c04560d5492e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:02.575863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1677d28b-a8b6-4b93-a6d7-c04560d5492e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:02.582632 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1677d28b-a8b6-4b93-a6d7-c04560d5492e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:02.583118 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1677d28b-a8b6-4b93-a6d7-c04560d5492e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:02.583561 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1677d28b-a8b6-4b93-a6d7-c04560d5492e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:02.584303 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1677d28b-a8b6-4b93-a6d7-c04560d5492e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:02.584765 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1677d28b-a8b6-4b93-a6d7-c04560d5492e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:02.585196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1677d28b-a8b6-4b93-a6d7-c04560d5492e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:02.641283 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1677d28b-a8b6-4b93-a6d7-c04560d5492e tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38/action" status: 200 len: 24565 microversion: 2.1 time: 0.133466 Oct 19 08:01:02.641877 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3523/6890] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 08:01:02 2022] POST /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38/action => generated 24565 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:01:13.588924 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:13.589551 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:13.591558 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:13.592258 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=34 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:13.593053 n-d-861333-10 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 08:01:13.593199 n-d-861333-10 devstack@n-api.service[127568]: Wed Oct 19 08:01:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 (ip 10.222.0.39) !!! Oct 19 08:01:13.599914 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:13.605680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:13.605680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:13.605680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:13.605680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:13.605680 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:13.783199 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:13.791601 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c41eb22e-4dda-4585-b28c-4976aa73aa73 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1681 microversion: 2.1 time: 0.207063 Oct 19 08:01:13.792235 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3368/6891] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:13 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:13.894429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcc56c66-caf6-42fb-bc2e-3701b4534fe6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:13.897732 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fcc56c66-caf6-42fb-bc2e-3701b4534fe6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:13.900439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:13.901104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:13.910444 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcc56c66-caf6-42fb-bc2e-3701b4534fe6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:13.912344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcc56c66-caf6-42fb-bc2e-3701b4534fe6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:13.912344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcc56c66-caf6-42fb-bc2e-3701b4534fe6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:13.912344 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcc56c66-caf6-42fb-bc2e-3701b4534fe6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:13.912766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcc56c66-caf6-42fb-bc2e-3701b4534fe6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:13.913196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcc56c66-caf6-42fb-bc2e-3701b4534fe6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:13.964590 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fcc56c66-caf6-42fb-bc2e-3701b4534fe6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38/action" status: 200 len: 32632 microversion: 2.1 time: 0.074724 Oct 19 08:01:13.965256 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3524/6892] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 08:01:13 2022] POST /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38/action => generated 32632 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:01:14.259342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eedcd5af-3ad2-41c4-a020-88de859cc972 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:14.259985 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eedcd5af-3ad2-41c4-a020-88de859cc972 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:14.266334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eedcd5af-3ad2-41c4-a020-88de859cc972 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:14.266839 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eedcd5af-3ad2-41c4-a020-88de859cc972 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:14.267298 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eedcd5af-3ad2-41c4-a020-88de859cc972 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:14.268005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eedcd5af-3ad2-41c4-a020-88de859cc972 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:14.268509 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eedcd5af-3ad2-41c4-a020-88de859cc972 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:14.269595 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eedcd5af-3ad2-41c4-a020-88de859cc972 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:14.399546 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eedcd5af-3ad2-41c4-a020-88de859cc972 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1834 microversion: 2.1 time: 0.187353 Oct 19 08:01:14.400559 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3369/6893] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:14 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1834 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:14.430602 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:14.433304 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:14.441597 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:14.442091 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:14.442544 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:14.443245 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:14.443990 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:14.444510 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:14.470300 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lazy-loading 'flavor' on Instance uuid 6ad5fea7-b05e-438a-aa87-7c4d84369b38 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 08:01:14.482773 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Going to try to live migrate instance to another host {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 08:01:18.617965 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c58c78ea-5d03-4f50-82e5-9cb64fbe21b7 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38/action" status: 202 len: 0 microversion: 2.1 time: 4.191623 Oct 19 08:01:18.619680 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3525/6894] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 08:01:14 2022] POST /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38/action => generated 0 bytes in 4194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:01:18.627638 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:18.628473 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:18.636156 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:18.636910 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:18.637360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:18.638063 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:18.638528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:18.638964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:18.776464 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:18.784679 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36cb3bd3-a782-48f9-8d12-61da2f8ae646 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1691 microversion: 2.1 time: 0.161269 Oct 19 08:01:18.785286 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3370/6895] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:18 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:19.809416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:19.809954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:19.818173 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:19.818657 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:19.819097 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:19.819794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:19.820288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:19.820721 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:20.007092 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:20.015995 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44d1f38b-a8e5-4091-a7f8-33214a2bf35b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1691 microversion: 2.1 time: 0.209927 Oct 19 08:01:20.015995 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3526/6896] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:19 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1691 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:20.043645 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2ad211df-0563-4963-acf9-5f52165122d2 req-b2648513-44bf-4ccf-a5b1-e9a97311d0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad5fea7-b05e-438a-aa87-7c4d84369b38", "name": "network-vif-unplugged", "status": "completed", "tag": "955edab9-f3d6-4312-b99f-9411257e8daf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:20.053788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2ad211df-0563-4963-acf9-5f52165122d2 req-b2648513-44bf-4ccf-a5b1-e9a97311d0c2 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:20.054283 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2ad211df-0563-4963-acf9-5f52165122d2 req-b2648513-44bf-4ccf-a5b1-e9a97311d0c2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:20.054730 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2ad211df-0563-4963-acf9-5f52165122d2 req-b2648513-44bf-4ccf-a5b1-e9a97311d0c2 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:20.066296 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2ad211df-0563-4963-acf9-5f52165122d2 req-b2648513-44bf-4ccf-a5b1-e9a97311d0c2 service nova] Creating event network-vif-unplugged:955edab9-f3d6-4312-b99f-9411257e8daf for instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 on n-h1-861333-10 Oct 19 08:01:20.072866 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2ad211df-0563-4963-acf9-5f52165122d2 req-b2648513-44bf-4ccf-a5b1-e9a97311d0c2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084942 Oct 19 08:01:20.078803 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3371/6897] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:01:21.039249 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:21.039864 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:21.046695 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:21.047184 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:21.047627 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:21.048349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:21.048812 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:21.049246 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:21.179824 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:21.187501 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-baa0673b-6229-4872-a8e5-915e062fd67a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1691 microversion: 2.1 time: 0.152146 Oct 19 08:01:21.188071 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3527/6898] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:21 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:22.103824 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d0523c15-72a9-4a21-92ab-da179e5b103a req-99d58174-3f67-4f2d-bc9d-36d216e7b7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad5fea7-b05e-438a-aa87-7c4d84369b38", "tag": "955edab9-f3d6-4312-b99f-9411257e8daf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:22.113316 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d0523c15-72a9-4a21-92ab-da179e5b103a req-99d58174-3f67-4f2d-bc9d-36d216e7b7e1 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:22.113807 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d0523c15-72a9-4a21-92ab-da179e5b103a req-99d58174-3f67-4f2d-bc9d-36d216e7b7e1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:22.114257 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d0523c15-72a9-4a21-92ab-da179e5b103a req-99d58174-3f67-4f2d-bc9d-36d216e7b7e1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:22.124851 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d0523c15-72a9-4a21-92ab-da179e5b103a req-99d58174-3f67-4f2d-bc9d-36d216e7b7e1 service nova] Creating event network-changed:955edab9-f3d6-4312-b99f-9411257e8daf for instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 on n-h1-861333-10 Oct 19 08:01:22.130190 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d0523c15-72a9-4a21-92ab-da179e5b103a req-99d58174-3f67-4f2d-bc9d-36d216e7b7e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031293 Oct 19 08:01:22.130759 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3372/6899] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:01:22.210500 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:22.211116 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:22.217949 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:22.218439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:22.218882 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:22.219581 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:22.220037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:22.220497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:22.433486 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:22.441096 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67d29d93-45b3-473b-8c66-2b1aebcaf758 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1691 microversion: 2.1 time: 0.235129 Oct 19 08:01:22.442440 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3528/6900] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:22 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:23.466545 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:23.467894 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:23.474458 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:23.474970 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:23.475431 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:23.476176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:23.476686 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:23.477130 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:23.611943 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:23.619834 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb588d0a-01ae-4e7c-8f72-54c2c9ba25c8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1691 microversion: 2.1 time: 0.158622 Oct 19 08:01:23.620442 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3373/6901] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:23 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:24.644253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:24.645346 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:24.652206 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:24.652700 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:24.653161 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:24.653845 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:24.654302 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:24.654734 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:24.787582 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:24.795306 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-571aac68-0126-4919-9e72-2ce924ce343d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1691 microversion: 2.1 time: 0.155799 Oct 19 08:01:24.795891 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3529/6902] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:24 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:25.818870 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:25.819489 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:25.826377 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:25.826875 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:25.827321 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:25.828022 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:25.828520 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:25.828958 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:25.963817 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:25.973860 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-671ca8ee-e3fd-4d99-a0f8-e858209a3557 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1691 microversion: 2.1 time: 0.158839 Oct 19 08:01:25.975557 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3374/6903] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:25 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:26.998352 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:26.998993 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:27.006381 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:27.006860 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:27.007433 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:27.008153 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:27.008609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:27.009037 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:27.142759 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:27.150482 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1e2947e-7a4f-4913-baba-f140fd428d65 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1691 microversion: 2.1 time: 0.156278 Oct 19 08:01:27.151685 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3530/6904] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:26 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:28.174230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:28.174845 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:28.182134 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:28.182628 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:28.184930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:28.184930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:28.184930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:28.184930 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:28.319586 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:28.327334 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-adb75fa7-bb2f-476c-b99d-d79efe356eaa tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1681 microversion: 2.1 time: 0.157056 Oct 19 08:01:28.327905 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3375/6905] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:28 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:28.349512 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7a1757b-29f7-4379-b4d8-1afe7fbf3708 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:28.350120 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7a1757b-29f7-4379-b4d8-1afe7fbf3708 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:28.356942 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a1757b-29f7-4379-b4d8-1afe7fbf3708 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:28.357413 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a1757b-29f7-4379-b4d8-1afe7fbf3708 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:28.357851 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a1757b-29f7-4379-b4d8-1afe7fbf3708 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:28.358554 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a1757b-29f7-4379-b4d8-1afe7fbf3708 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:28.359008 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a1757b-29f7-4379-b4d8-1afe7fbf3708 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:28.359439 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a1757b-29f7-4379-b4d8-1afe7fbf3708 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:28.494003 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7a1757b-29f7-4379-b4d8-1afe7fbf3708 tempest-TestNetworkAdvancedServerOps-1030486957 tempest-TestNetworkAdvancedServerOps-1030486957-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1834 microversion: 2.1 time: 0.147960 Oct 19 08:01:28.494651 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3531/6906] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:28 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1834 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:28.518066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:28.518775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:28.524767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:28.525261 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:28.525710 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:28.526413 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:28.526879 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:28.527383 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:28.668153 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:28.678443 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-869d37ae-f67d-481d-b402-72fbd7d97028 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1681 microversion: 2.1 time: 0.164225 Oct 19 08:01:28.683115 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3376/6907] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:28 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:28.774988 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10647c5e-ad80-4c29-a9e6-a23525e53c90 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:28.777314 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10647c5e-ad80-4c29-a9e6-a23525e53c90 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:28.783363 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10647c5e-ad80-4c29-a9e6-a23525e53c90 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:28.783848 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10647c5e-ad80-4c29-a9e6-a23525e53c90 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:28.784358 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10647c5e-ad80-4c29-a9e6-a23525e53c90 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:28.785045 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10647c5e-ad80-4c29-a9e6-a23525e53c90 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:28.786030 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10647c5e-ad80-4c29-a9e6-a23525e53c90 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:28.786462 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10647c5e-ad80-4c29-a9e6-a23525e53c90 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:28.843737 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10647c5e-ad80-4c29-a9e6-a23525e53c90 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38/action" status: 200 len: 38651 microversion: 2.1 time: 0.073216 Oct 19 08:01:28.844366 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3532/6908] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 08:01:28 2022] POST /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38/action => generated 38651 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:01:30.201228 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:30.202057 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:30.205794 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-382644de-0bc5-4815-af5f-fc91881dcbb7 req-bdb5369b-518a-41f3-ae80-03b2e6fddbde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad5fea7-b05e-438a-aa87-7c4d84369b38", "tag": "955edab9-f3d6-4312-b99f-9411257e8daf"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:30.209516 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:30.210422 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:30.212174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:30.213183 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:30.213871 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:30.214528 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:30.217140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-382644de-0bc5-4815-af5f-fc91881dcbb7 req-bdb5369b-518a-41f3-ae80-03b2e6fddbde service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:30.217628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-382644de-0bc5-4815-af5f-fc91881dcbb7 req-bdb5369b-518a-41f3-ae80-03b2e6fddbde service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:30.218163 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-382644de-0bc5-4815-af5f-fc91881dcbb7 req-bdb5369b-518a-41f3-ae80-03b2e6fddbde service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:30.230465 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-382644de-0bc5-4815-af5f-fc91881dcbb7 req-bdb5369b-518a-41f3-ae80-03b2e6fddbde service nova] Creating event network-changed:955edab9-f3d6-4312-b99f-9411257e8daf for instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 on n-h2-861333-10 Oct 19 08:01:30.235674 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-382644de-0bc5-4815-af5f-fc91881dcbb7 req-bdb5369b-518a-41f3-ae80-03b2e6fddbde service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033996 Oct 19 08:01:30.236715 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3533/6909] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:01:30.245560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 08:01:30.456041 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6805c8f-3e37-4998-a020-bfaa7532a02a tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 204 len: 0 microversion: 2.1 time: 0.259086 Oct 19 08:01:30.456948 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3377/6910] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 08:01:30 2022] DELETE /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 08:01:30.466545 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:30.467253 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:30.474477 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:30.474978 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:30.475417 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:30.476141 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:30.476604 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:30.477038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:30.618944 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:30.626802 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f77a80e-3802-4a17-94c9-3febd35be3cf tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1687 microversion: 2.1 time: 0.164994 Oct 19 08:01:30.627374 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3534/6911] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:30 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:31.651812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:31.652709 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:31.659574 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:31.660078 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:31.661074 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:31.661788 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:31.662262 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:31.662702 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:31.725964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:31.735710 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13bb3109-530d-48bb-9586-34389d45eb84 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 200 len: 1351 microversion: 2.1 time: 0.087742 Oct 19 08:01:31.735865 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3378/6912] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:31 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 1351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:32.250579 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b351d486-aa70-4e0b-8d9b-ff10bd91993d req-bcb67ac9-58b7-40a7-9398-e8a11933e13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad5fea7-b05e-438a-aa87-7c4d84369b38", "name": "network-vif-deleted", "tag": "955edab9-f3d6-4312-b99f-9411257e8daf"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:32.260722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b351d486-aa70-4e0b-8d9b-ff10bd91993d req-bcb67ac9-58b7-40a7-9398-e8a11933e13b service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:32.261202 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b351d486-aa70-4e0b-8d9b-ff10bd91993d req-bcb67ac9-58b7-40a7-9398-e8a11933e13b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:32.261906 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b351d486-aa70-4e0b-8d9b-ff10bd91993d req-bcb67ac9-58b7-40a7-9398-e8a11933e13b service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:32.273097 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b351d486-aa70-4e0b-8d9b-ff10bd91993d req-bcb67ac9-58b7-40a7-9398-e8a11933e13b service nova] Creating event network-vif-deleted:955edab9-f3d6-4312-b99f-9411257e8daf for instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 on n-h2-861333-10 Oct 19 08:01:32.277935 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b351d486-aa70-4e0b-8d9b-ff10bd91993d req-bcb67ac9-58b7-40a7-9398-e8a11933e13b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030992 Oct 19 08:01:32.278478 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3535/6913] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:01:32.759481 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:32.760122 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 6ad5fea7-b05e-438a-aa87-7c4d84369b38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:32.767201 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:32.767694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:32.768159 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:32.768855 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:32.769319 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:32.769754 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:32.782810 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] HTTP exception thrown: Instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 could not be found. Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Request method failure captured: Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 HTTP/1.1 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: Accept: application/json Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: Accept-Encoding: identity Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: Connection: close Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: Content-Length: 0 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: Content-Type: application/json Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: Host: 10.222.0.39 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: Openstack-System-Scope: None Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjT62LwLwcrRkKctdI-lfBPeENzWZqocWGth-slKGQxEWWDws6-fjB1u1pARz2yC8bit9Qo5jMyjhZ45OfnPmtHwdFSPdIejafkAd4es23A6mVrTJ3tH8yazRu3-XGG6OW0QVSLjDbNnS7tiT-CwzGQqlq45hLm8MrZO7tpNZoHHX7BI4 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Id: None Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Domain-Name: None Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Is-Admin-Project: True Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Id: default Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Id: 8954eb6d03f64f77812613cb33a94c35 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1485450637 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Role: reader,member Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Roles: reader,member Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8954eb6d03f64f77812613cb33a94c35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8954eb6d03f64f77812613cb33a94c35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8954eb6d03f64f77812613cb33a94c35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8954eb6d03f64f77812613cb33a94c35", "adminURL": "http://10.222.0.39:8080"}]}] Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1485450637 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Id: 8954eb6d03f64f77812613cb33a94c35 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1485450637 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-User: tempest-TestNetworkAdvancedServerOps-1485450637-project Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Id: default Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-User-Domain-Name: Default Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-User-Id: 39d33dcf01aa4a0e892b4dfead2cb150 Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1485450637-project Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: method: > Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: exception: Instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 could not be found. Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: action_args: {'id': '6ad5fea7-b05e-438a-aa87-7c4d84369b38'} Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 could not be found. Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 could not be found. Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:01:32.784518 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 could not be found. Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Returning 404 to user: Instance 6ad5fea7-b05e-438a-aa87-7c4d84369b38 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5cd3e54e-3c2d-4e35-93b3-7decce1bfa7c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38" status: 404 len: 111 microversion: 2.1 time: 0.031030 Oct 19 08:01:32.788934 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3379/6914] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:32 2022] GET /compute/v2.1/servers/6ad5fea7-b05e-438a-aa87-7c4d84369b38 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 08:01:36.273228 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63d05678-9bf4-4219-ade2-d6d5bbc074e8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '.version_select at 0x7f6d5f6ee700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:36.347857 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63d05678-9bf4-4219-ade2-d6d5bbc074e8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1713221960" status: 202 len: 0 microversion: 2.1 time: 0.079744 Oct 19 08:01:36.348430 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3536/6915] 10.222.0.39 () {58 vars in 1284 bytes} [Wed Oct 19 08:01:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1713221960 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 08:01:36.378724 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82b60062-fb87-4ec5-ae14-7afd2b4e2272 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'create', calling method: .version_select at 0x7f6d5f958b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2042072044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxx9ZXQ407boiU/pT/ek5/PnRl8gY3ig6xk65T30TOLiXGjuVLGZZdHllMEqT1B0HHvTRFX6hDjmw7y1JsXPbwdFfqxe2I8bOo6+URIczmgs5wBhkkqbNjey0h6Kr+AKg=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:36.399036 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-82b60062-fb87-4ec5-ae14-7afd2b4e2272 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for project 8954eb6d03f64f77812613cb33a94c35. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 08:01:36.404060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.quota [None req-82b60062-fb87-4ec5-ae14-7afd2b4e2272 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for user 39d33dcf01aa4a0e892b4dfead2cb150 and project 8954eb6d03f64f77812613cb33a94c35. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 08:01:36.473104 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82b60062-fb87-4ec5-ae14-7afd2b4e2272 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.098286 Oct 19 08:01:36.473705 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3380/6916] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 08:01:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:01:44.545005 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:44.550208 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-964721089", "imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084", "flavorRef": "452", "networks": [{"uuid": "bcbfbbbb-fcc7-4779-a1b7-a5b09928018a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2042072044", "security_groups": [{"name": "tempest-secgroup-smoke-125409911"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:44.573764 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:44.690950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] validate_networks() for [('bcbfbbbb-fcc7-4779-a1b7-a5b09928018a', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 08:01:45.120801 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:01:45.121233 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:01:45.121710 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:01:45.122128 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:01:45.122551 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:01:45.132076 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:45.132590 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:45.133046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:45.133802 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:45.134257 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:45.134681 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:45.154493 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for project 8954eb6d03f64f77812613cb33a94c35. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 08:01:45.160252 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Getting quotas for user 39d33dcf01aa4a0e892b4dfead2cb150 and project 8954eb6d03f64f77812613cb33a94c35. Resources: {'ram', 'cores', 'instances'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 08:01:45.175937 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 08:01:45.178975 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf91402f-43c2-455b-ba41-1073b9eae084',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 08:01:45.326053 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4467405f-efe4-4d40-92ea-85a3e344ae4d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.783018 Oct 19 08:01:45.327394 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3537/6917] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 08:01:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 08:01:45.336128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:45.340945 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ca9c425-5ea3-4fc9-b482-80fdcee81b99 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:45.341690 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ca9c425-5ea3-4fc9-b482-80fdcee81b99 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:45.344633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:45.435775 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ca9c425-5ea3-4fc9-b482-80fdcee81b99 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:45.442683 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ca9c425-5ea3-4fc9-b482-80fdcee81b99 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1266 microversion: 2.1 time: 0.108332 Oct 19 08:01:45.445198 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3381/6918] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:45 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:46.467528 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:46.468200 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:46.477539 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:46.478140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:46.478472 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:46.479199 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:46.479665 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:46.480147 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:46.549044 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:46.557944 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4888282b-34b7-49a6-b567-b36cc372384f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1262 microversion: 2.1 time: 0.095106 Oct 19 08:01:46.558549 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3538/6919] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:46 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:47.584411 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:47.585286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:47.594322 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:47.596184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:47.596184 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:47.596404 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:47.596767 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:47.597212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:47.660975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:47.669524 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5db7a656-2442-4f2b-83c0-d943fd8fd176 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1336 microversion: 2.1 time: 0.091228 Oct 19 08:01:47.670322 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3382/6920] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:47 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1336 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:48.694767 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:48.695499 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:48.702272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:48.702795 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:48.703241 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:48.703950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:48.704473 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:48.704936 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:48.898497 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:48.906471 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-de6a7514-f1ad-480c-84cb-dd69e05b7f14 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1391 microversion: 2.1 time: 0.216400 Oct 19 08:01:48.906992 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3539/6921] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:48 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:49.100237 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-070510f3-0758-4b62-bab9-9ff6a4ceb361 req-b1414883-e469-430d-b267-b4fdd04f5351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ff74f3-e4cc-4244-bc9e-634ba289651f", "tag": "540d87d6-9247-4736-a37f-c6a9f9f3976a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:49.113303 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-070510f3-0758-4b62-bab9-9ff6a4ceb361 req-b1414883-e469-430d-b267-b4fdd04f5351 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:49.113792 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-070510f3-0758-4b62-bab9-9ff6a4ceb361 req-b1414883-e469-430d-b267-b4fdd04f5351 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:49.114233 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-070510f3-0758-4b62-bab9-9ff6a4ceb361 req-b1414883-e469-430d-b267-b4fdd04f5351 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:49.126399 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-070510f3-0758-4b62-bab9-9ff6a4ceb361 req-b1414883-e469-430d-b267-b4fdd04f5351 service nova] Creating event network-changed:540d87d6-9247-4736-a37f-c6a9f9f3976a for instance 89ff74f3-e4cc-4244-bc9e-634ba289651f on n-h2-861333-10 Oct 19 08:01:49.131733 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-070510f3-0758-4b62-bab9-9ff6a4ceb361 req-b1414883-e469-430d-b267-b4fdd04f5351 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036257 Oct 19 08:01:49.132756 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3383/6922] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:01:49.929715 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:49.930330 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:49.937186 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:49.939066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:49.939066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:49.939066 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:49.939349 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:49.939782 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:50.070100 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:50.077873 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c451837d-a60d-4a37-952c-da4a49d0adb6 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1391 microversion: 2.1 time: 0.152134 Oct 19 08:01:50.078456 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3540/6923] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:49 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:51.109804 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:51.110637 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:51.118060 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:51.118560 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:51.119016 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:51.119734 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:51.120247 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:51.120694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:51.251904 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:51.260326 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae3b8ea4-b8ef-46b9-9170-4480f6bfa756 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1391 microversion: 2.1 time: 0.156375 Oct 19 08:01:51.260901 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3384/6924] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:51 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:52.284317 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:52.284926 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:52.291755 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:52.292288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:52.292722 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:52.293411 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:52.293863 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:52.294286 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:52.422073 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:52.430111 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dad1a228-5c51-4546-9d81-a810eafb184c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1391 microversion: 2.1 time: 0.149746 Oct 19 08:01:52.430678 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3541/6925] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:52 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:53.452328 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:53.452865 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:53.460299 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:53.460801 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:53.461253 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:53.461959 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:53.462430 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:53.462878 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:53.600086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:53.607871 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd90cf01-1092-4806-b042-d14c7c4b627c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1391 microversion: 2.1 time: 0.159647 Oct 19 08:01:53.608471 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3385/6926] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:53 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:54.631429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:54.632036 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:54.639035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:54.639517 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:54.639954 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:54.640674 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:54.641129 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:54.641557 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:54.774382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:54.781937 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c32c30f2-8939-44fd-b03a-fc09efa3e1a2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1391 microversion: 2.1 time: 0.154979 Oct 19 08:01:54.782509 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3542/6927] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:54 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:55.805833 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:55.806388 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:55.809255 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:55.814080 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:55.814581 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:55.815034 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:55.815742 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:55.816243 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:55.816711 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:55.949350 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:55.957108 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a73159e3-8c02-4c60-9d57-626d1db774bb tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1391 microversion: 2.1 time: 0.155866 Oct 19 08:01:55.957721 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3386/6928] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:55 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:56.960622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:56.961399 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:01:56.980540 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:56.981172 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:56.987962 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:56.988508 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:56.988964 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:56.990212 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:56.990334 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:56.990703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:57.011974 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d4e6453b-65b5-4e17-92b7-c45bd757a875 req-cbfe530c-75f0-4b84-8a35-9519785c2cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ff74f3-e4cc-4244-bc9e-634ba289651f", "name": "network-vif-plugged", "status": "completed", "tag": "540d87d6-9247-4736-a37f-c6a9f9f3976a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:01:57.024038 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4e6453b-65b5-4e17-92b7-c45bd757a875 req-cbfe530c-75f0-4b84-8a35-9519785c2cf1 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:57.024555 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4e6453b-65b5-4e17-92b7-c45bd757a875 req-cbfe530c-75f0-4b84-8a35-9519785c2cf1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:57.025196 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4e6453b-65b5-4e17-92b7-c45bd757a875 req-cbfe530c-75f0-4b84-8a35-9519785c2cf1 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:57.037610 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d4e6453b-65b5-4e17-92b7-c45bd757a875 req-cbfe530c-75f0-4b84-8a35-9519785c2cf1 service nova] Creating event network-vif-plugged:540d87d6-9247-4736-a37f-c6a9f9f3976a for instance 89ff74f3-e4cc-4244-bc9e-634ba289651f on n-h2-861333-10 Oct 19 08:01:57.042985 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d4e6453b-65b5-4e17-92b7-c45bd757a875 req-cbfe530c-75f0-4b84-8a35-9519785c2cf1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087367 Oct 19 08:01:57.043585 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3543/6929] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:01:57.138593 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:57.146939 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f76ab0ee-6b80-41e9-bfa3-167f9cb1415d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1391 microversion: 2.1 time: 0.169830 Oct 19 08:01:57.147521 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3387/6930] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:56 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:01:58.171617 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:58.172342 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:58.178622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:58.179105 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:58.179542 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:58.180256 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:58.180712 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:58.181136 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:58.315859 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:58.324183 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9e103e1-03cd-4108-ba43-c2c2e265c1f7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1391 microversion: 2.1 time: 0.157647 Oct 19 08:01:58.325415 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3544/6931] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:58 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:59.347005 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:59.347630 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:59.354414 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:59.354966 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:59.355378 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:59.356128 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:59.356603 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:59.359286 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:59.498223 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:59.506986 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbd6ae02-a686-4e75-8127-f7ed35853c9f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1563 microversion: 2.1 time: 0.163862 Oct 19 08:01:59.507595 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3388/6932] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:59 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:01:59.530494 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:01:59.531224 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:01:59.538823 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:59.539321 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:59.539766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:59.540509 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:01:59.541608 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:01:59.542052 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:01:59.677691 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:01:59.685669 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7dbea11-da92-4702-b378-68d39393fab7 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1563 microversion: 2.1 time: 0.159313 Oct 19 08:01:59.686267 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3545/6933] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:01:59 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:01.820610 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:01.821246 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:01.824622 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-fb7d1c21-87f2-4277-bc7b-3145476ffe34 req-31db7e13-e3a6-4b69-b456-0e1e8370b665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ff74f3-e4cc-4244-bc9e-634ba289651f", "tag": "540d87d6-9247-4736-a37f-c6a9f9f3976a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:02:01.828569 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:01.829040 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:01.829487 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:01.830416 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:01.830995 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:01.831592 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:01.835682 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fb7d1c21-87f2-4277-bc7b-3145476ffe34 req-31db7e13-e3a6-4b69-b456-0e1e8370b665 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:01.836189 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fb7d1c21-87f2-4277-bc7b-3145476ffe34 req-31db7e13-e3a6-4b69-b456-0e1e8370b665 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:01.836628 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fb7d1c21-87f2-4277-bc7b-3145476ffe34 req-31db7e13-e3a6-4b69-b456-0e1e8370b665 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:01.847949 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-fb7d1c21-87f2-4277-bc7b-3145476ffe34 req-31db7e13-e3a6-4b69-b456-0e1e8370b665 service nova] Creating event network-changed:540d87d6-9247-4736-a37f-c6a9f9f3976a for instance 89ff74f3-e4cc-4244-bc9e-634ba289651f on n-h2-861333-10 Oct 19 08:02:01.853802 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-fb7d1c21-87f2-4277-bc7b-3145476ffe34 req-31db7e13-e3a6-4b69-b456-0e1e8370b665 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033072 Oct 19 08:02:01.854758 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3546/6934] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 08:02:01.980706 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:01.988966 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62d54a1f-c5e4-4f03-b5f8-0724c1aea411 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1563 microversion: 2.1 time: 0.172765 Oct 19 08:02:01.989772 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3389/6935] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:01 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:25.244950 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:02:25.249239 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=48 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:02:25.250470 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dc3f4cb-ae51-42b4-8578-1f3d8d85a7ab tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:02:25.252743 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2dc3f4cb-ae51-42b4-8578-1f3d8d85a7ab tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:25.258719 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dc3f4cb-ae51-42b4-8578-1f3d8d85a7ab tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:25.259209 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dc3f4cb-ae51-42b4-8578-1f3d8d85a7ab tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:25.259655 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dc3f4cb-ae51-42b4-8578-1f3d8d85a7ab tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:25.260392 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dc3f4cb-ae51-42b4-8578-1f3d8d85a7ab tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:25.260857 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dc3f4cb-ae51-42b4-8578-1f3d8d85a7ab tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:25.261293 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dc3f4cb-ae51-42b4-8578-1f3d8d85a7ab tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:25.324959 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dc3f4cb-ae51-42b4-8578-1f3d8d85a7ab tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f/action" status: 200 len: 24562 microversion: 2.1 time: 0.082010 Oct 19 08:02:25.325906 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3547/6936] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 08:02:25 2022] POST /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f/action => generated 24562 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 08:02:36.410209 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bf91402f-43c2-455b-ba41-1073b9eae084"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:02:36.413066 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:36.415105 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=19 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:02:36.415800 n-d-861333-10 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=44 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:02:36.420548 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:36.421051 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:36.421510 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:36.422218 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:36.422694 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:36.423217 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:36.500035 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 08:02:36.500495 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 08:02:36.500975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 08:02:36.501391 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 08:02:36.501812 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 08:02:36.693708 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:36.699611 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:36.700785 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:36.701245 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:36.701971 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:36.702444 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:36.702920 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:36.728710 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90446f28-5527-45db-86f4-a4706edeedd4 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "POST /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f/action" status: 202 len: 1137 microversion: 2.1 time: 0.322754 Oct 19 08:02:36.729355 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3390/6937] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 08:02:36 2022] POST /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f/action => generated 1137 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 08:02:36.749207 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:36.749883 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:36.752694 n-d-861333-10 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 08:02:36.757992 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:36.766809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:36.766809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:36.766809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:36.766809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:36.766809 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:36.895416 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:36.904449 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-126b053f-0d39-49ec-8017-1b0661cb476b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.160073 Oct 19 08:02:36.905025 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3548/6938] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:36 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:37.927305 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:37.927975 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:37.935086 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:37.935577 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:37.936027 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:37.936762 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:37.937230 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:37.937672 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:38.069259 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:38.077486 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-019f267d-ebd6-4a3b-8795-f7d98c526579 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.154248 Oct 19 08:02:38.078054 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3391/6939] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:37 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 08:02:39.102650 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:39.103266 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:39.110709 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:39.117772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:39.117772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:39.117772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:39.117772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:39.117772 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:39.246687 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:39.254531 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94457caf-cd19-47c9-9fc8-5b95ec6843a9 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.155751 Oct 19 08:02:39.255101 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3549/6940] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:39 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:40.277885 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:40.278532 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:40.285714 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:40.286211 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:40.286656 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:40.287352 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:40.287816 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:40.288325 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:40.425500 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:40.433217 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1df54fbc-fac5-4f87-ab6d-1823ef52bfc8 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.159274 Oct 19 08:02:40.433794 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3392/6941] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:40 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:41.456891 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:41.457429 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:41.464119 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:41.464611 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:41.465046 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:41.466261 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:41.466717 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:41.467140 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:41.596272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:41.603978 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66781f53-8e1c-4ae4-9647-6d6f63e40013 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.151117 Oct 19 08:02:41.604582 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3550/6942] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:41 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:42.627633 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:42.628288 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:42.635240 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:42.635737 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:42.636222 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:42.636931 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:42.637453 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:42.637901 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:42.766851 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:42.774646 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cdd14c93-6d0e-43a0-b3e5-b7ad215f726d tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.150951 Oct 19 08:02:42.775214 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3393/6943] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:42 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:43.798577 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:43.799231 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:43.805963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:43.814745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:43.814745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:43.814745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:43.814745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:43.814745 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:43.947361 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:43.955734 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ccd95654-c05a-4136-8f0a-10e8aae52ec1 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.160841 Oct 19 08:02:43.956385 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3551/6944] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:43 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:44.978974 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:44.979582 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:44.986523 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:44.987017 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:44.987467 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:44.988236 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:44.988703 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:44.989142 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:45.117739 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:45.125856 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f43de57-f89c-4fcb-9a37-382dd526326c tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.150932 Oct 19 08:02:45.126418 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3394/6945] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:44 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:46.150713 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:46.151327 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:46.158727 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:46.159211 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:46.159649 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:46.160382 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:46.160841 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:46.161272 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:46.290766 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:46.298656 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc5e5afb-7e5d-40d5-8916-9c79d42315b2 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.151878 Oct 19 08:02:46.299238 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3552/6946] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:46 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:47.321827 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:47.322478 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:47.330174 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:47.330675 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:47.331127 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:47.331831 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:47.332341 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:47.332783 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:47.465342 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:47.473111 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f1b44d3-0b37-4e45-8713-e5e9b80e771f tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.155229 Oct 19 08:02:47.473679 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3395/6947] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:47 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:48.496341 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:48.497507 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:48.504488 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:48.504984 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:48.505432 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:48.506133 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:48.506600 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:48.507035 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:48.639837 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:48.647509 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c51e0b83-e566-4984-8d1e-801bdf1079fd tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1691 microversion: 2.1 time: 0.155164 Oct 19 08:02:48.648082 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3553/6948] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:48 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:49.670738 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:49.671365 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:49.678191 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:49.678692 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:49.679145 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:49.679848 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:49.680349 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:49.680795 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:49.809009 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:49.817249 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d182903-5a0c-4b26-b877-060e68c65ee3 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1697 microversion: 2.1 time: 0.150474 Oct 19 08:02:49.817820 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3396/6949] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:49 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:50.842077 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:50.842634 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:50.849476 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:50.849963 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:50.850406 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:50.851104 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:50.851566 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:50.851999 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:51.034609 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:51.042504 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e980495-2269-446d-bb3e-3a3228891f2b tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1697 microversion: 2.1 time: 0.205179 Oct 19 08:02:51.043219 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3554/6950] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:50 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1697 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:52.065953 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 08:02:52.066589 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] [instance: 89ff74f3-e4cc-4244-bc9e-634ba289651f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 08:02:52.073493 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:52.073998 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:52.074460 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:52.075176 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:52.075652 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:52.076118 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:52.206374 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d33dcf01aa4a0e892b4dfead2cb150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8954eb6d03f64f77812613cb33a94c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 08:02:52.214746 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99cd76a8-d4aa-402c-bd73-ee644ab0e247 tempest-TestNetworkAdvancedServerOps-1485450637 tempest-TestNetworkAdvancedServerOps-1485450637-project] 10.222.0.39 "GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f" status: 200 len: 1682 microversion: 2.1 time: 0.152717 Oct 19 08:02:52.215338 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3397/6951] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 08:02:52 2022] GET /compute/v2.1/servers/89ff74f3-e4cc-4244-bc9e-634ba289651f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 08:02:53.280704 n-d-861333-10 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0916178c-f146-4457-9d2f-1644fdffc7ca req-3e904461-78b5-476a-8183-f32851361989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ff74f3-e4cc-4244-bc9e-634ba289651f", "name": "network-vif-unplugged", "status": "completed", "tag": "540d87d6-9247-4736-a37f-c6a9f9f3976a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:02:53.290804 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0916178c-f146-4457-9d2f-1644fdffc7ca req-3e904461-78b5-476a-8183-f32851361989 service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:53.291288 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0916178c-f146-4457-9d2f-1644fdffc7ca req-3e904461-78b5-476a-8183-f32851361989 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:53.291723 n-d-861333-10 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0916178c-f146-4457-9d2f-1644fdffc7ca req-3e904461-78b5-476a-8183-f32851361989 service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:53.302956 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0916178c-f146-4457-9d2f-1644fdffc7ca req-3e904461-78b5-476a-8183-f32851361989 service nova] Creating event network-vif-unplugged:540d87d6-9247-4736-a37f-c6a9f9f3976a for instance 89ff74f3-e4cc-4244-bc9e-634ba289651f on n-h2-861333-10 Oct 19 08:02:53.308010 n-d-861333-10 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0916178c-f146-4457-9d2f-1644fdffc7ca req-3e904461-78b5-476a-8183-f32851361989 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031077 Oct 19 08:02:53.308829 n-d-861333-10 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3555/6952] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 08:02:55.328773 n-d-861333-10 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-bf404f59-576a-4b91-8110-f62bec0d7acc req-bb039fcc-0816-4d24-a010-ba2605ad0f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ff74f3-e4cc-4244-bc9e-634ba289651f", "name": "network-vif-plugged", "status": "completed", "tag": "540d87d6-9247-4736-a37f-c6a9f9f3976a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 08:02:55.340989 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bf404f59-576a-4b91-8110-f62bec0d7acc req-bb039fcc-0816-4d24-a010-ba2605ad0f7e service nova] Acquiring lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 08:02:55.341410 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bf404f59-576a-4b91-8110-f62bec0d7acc req-bb039fcc-0816-4d24-a010-ba2605ad0f7e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 08:02:55.342360 n-d-861333-10 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bf404f59-576a-4b91-8110-f62bec0d7acc req-bb039fcc-0816-4d24-a010-ba2605ad0f7e service nova] Lock "2095ce14-8217-4a0f-91a3-f188d1d5cb77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 08:02:55.352949 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-bf404f59-576a-4b91-8110-f62bec0d7acc req-bb039fcc-0816-4d24-a010-ba2605ad0f7e service nova] Creating event network-vif-plugged:540d87d6-9247-4736-a37f-c6a9f9f3976a for instance 89ff74f3-e4cc-4244-bc9e-634ba289651f on n-h2-861333-10 Oct 19 08:02:55.358555 n-d-861333-10 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-bf404f59-576a-4b91-8110-f62bec0d7acc req-bb039fcc-0816-4d24-a010-ba2605ad0f7e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034093 Oct 19 08:02:55.359435 n-d-861333-10 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3398/6953] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 08:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0)